[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:59:05.480202   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:33967
I20260709 12:59:05.481875   431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:59:05.482990   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:05.500795   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:05.503268   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:05.501420   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:06.792685   439 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1289 milliseconds
I20260709 12:59:06.792855   431 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 12:59:06.794318   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:06.794685   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:06.794955   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601946794928 us; error 0 us; skew 500 ppm
I20260709 12:59:06.795898   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:06.803467   431 webserver.cc:533] Webserver started at http://127.0.107.254:39867/ using document root <none> and password file <none>
I20260709 12:59:06.804431   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:06.804690   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:06.805174   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:06.811180   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/master-0-root/instance:
uuid: "2e777bebcab340a3a249f6343374cf7f"
format_stamp: "Formatted at 2026-07-09 12:59:06 on dist-test-slave-zhw8"
I20260709 12:59:06.820065   431 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.002s	sys 0.005s
I20260709 12:59:06.825757   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:06.827107   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:59:06.827600   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/master-0-root
uuid: "2e777bebcab340a3a249f6343374cf7f"
format_stamp: "Formatted at 2026-07-09 12:59:06 on dist-test-slave-zhw8"
I20260709 12:59:06.827970   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:06.888314   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:06.890019   431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:59:06.890533   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:06.977027   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:33967
I20260709 12:59:06.977556   497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:33967 every 8 connection(s)
I20260709 12:59:06.986346   498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:07.010777   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f: Bootstrap starting.
I20260709 12:59:07.017472   498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:07.019361   498 log.cc:826] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f: Log is configured to *not* fsync() on all Append() calls
I20260709 12:59:07.025059   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f: No bootstrap required, opened a new log
I20260709 12:59:07.047009   498 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e777bebcab340a3a249f6343374cf7f" member_type: VOTER }
I20260709 12:59:07.047636   498 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:07.047850   498 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e777bebcab340a3a249f6343374cf7f, State: Initialized, Role: FOLLOWER
I20260709 12:59:07.048733   498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e777bebcab340a3a249f6343374cf7f" member_type: VOTER }
I20260709 12:59:07.049211   498 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:59:07.049472   498 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:59:07.049780   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:07.054385   498 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e777bebcab340a3a249f6343374cf7f" member_type: VOTER }
I20260709 12:59:07.055122   498 leader_election.cc:304] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e777bebcab340a3a249f6343374cf7f; no voters: 
I20260709 12:59:07.057073   498 leader_election.cc:290] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:59:07.057421   501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:07.060125   501 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [term 1 LEADER]: Becoming Leader. State: Replica: 2e777bebcab340a3a249f6343374cf7f, State: Running, Role: LEADER
I20260709 12:59:07.061200   501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e777bebcab340a3a249f6343374cf7f" member_type: VOTER }
I20260709 12:59:07.062757   498 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:59:07.075563   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e777bebcab340a3a249f6343374cf7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e777bebcab340a3a249f6343374cf7f" member_type: VOTER } }
I20260709 12:59:07.075531   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e777bebcab340a3a249f6343374cf7f. Latest consensus state: current_term: 1 leader_uuid: "2e777bebcab340a3a249f6343374cf7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e777bebcab340a3a249f6343374cf7f" member_type: VOTER } }
I20260709 12:59:07.076691   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:07.076871   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:07.087487   509 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:59:07.100378   509 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:59:07.103610   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:59:07.120007   509 catalog_manager.cc:1383] Generated new cluster ID: 507e088254244a51a07433425e43bc99
I20260709 12:59:07.120352   509 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:59:07.145962   509 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:59:07.148121   509 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:59:07.166771   509 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f: Generated new TSK 0
I20260709 12:59:07.167852   509 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:59:07.235404   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:07.247943   520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:07.250649   521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:07.254729   431 server_base.cc:1061] running on GCE node
W20260709 12:59:07.254635   523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:07.255869   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:07.256145   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:07.256366   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601947256330 us; error 0 us; skew 500 ppm
I20260709 12:59:07.257037   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:07.262501   431 webserver.cc:533] Webserver started at http://127.0.107.193:41823/ using document root <none> and password file <none>
I20260709 12:59:07.263120   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:07.263417   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:07.263737   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:07.265086   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/ts-0-root/instance:
uuid: "06f0f43a9f1f40f8a91927e7c700b496"
format_stamp: "Formatted at 2026-07-09 12:59:07 on dist-test-slave-zhw8"
I20260709 12:59:07.271932   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.005s
I20260709 12:59:07.277418   528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:07.278427   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:59:07.278779   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/ts-0-root
uuid: "06f0f43a9f1f40f8a91927e7c700b496"
format_stamp: "Formatted at 2026-07-09 12:59:07 on dist-test-slave-zhw8"
I20260709 12:59:07.279105   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:07.309005   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:07.310596   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:07.314220   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:07.320060   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:07.320340   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:07.320727   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:07.320942   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:07.441620   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:32941
I20260709 12:59:07.441705   590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:32941 every 8 connection(s)
I20260709 12:59:07.449747   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:07.465059   595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:07.466850   596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:07.472935   598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:07.475540   431 server_base.cc:1061] running on GCE node
I20260709 12:59:07.476620   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:07.476817   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:07.477056   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601947477020 us; error 0 us; skew 500 ppm
I20260709 12:59:07.477669   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:07.481571   431 webserver.cc:533] Webserver started at http://127.0.107.194:39171/ using document root <none> and password file <none>
I20260709 12:59:07.482205   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:07.482440   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:07.482750   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:07.483964   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/ts-1-root/instance:
uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
format_stamp: "Formatted at 2026-07-09 12:59:07 on dist-test-slave-zhw8"
I20260709 12:59:07.489099   591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33967
I20260709 12:59:07.489741   591 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:07.490800   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:59:07.490937   591 heartbeater.cc:507] Master 127.0.107.254:33967 requested a full tablet report, sending...
I20260709 12:59:07.494979   463 ts_manager.cc:194] Registered new tserver with Master: 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941)
I20260709 12:59:07.496661   603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:07.497632   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:59:07.497927   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/ts-1-root
uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
format_stamp: "Formatted at 2026-07-09 12:59:07 on dist-test-slave-zhw8"
I20260709 12:59:07.498219   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:07.498413   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47162
I20260709 12:59:07.521559   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:07.523097   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:07.524533   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:07.527745   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:07.528002   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:07.528298   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:07.528486   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:07.636175   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:37951
I20260709 12:59:07.636488   665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:37951 every 8 connection(s)
I20260709 12:59:07.645709   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:07.662675   670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:07.662068   669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:07.668424   666 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33967
I20260709 12:59:07.669023   666 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:07.670390   666 heartbeater.cc:507] Master 127.0.107.254:33967 requested a full tablet report, sending...
I20260709 12:59:07.673579   463 ts_manager.cc:194] Registered new tserver with Master: ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951)
I20260709 12:59:07.675814   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47164
I20260709 12:59:07.677524   431 server_base.cc:1061] running on GCE node
W20260709 12:59:07.678966   672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:07.680063   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:07.680404   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:07.680616   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601947680597 us; error 0 us; skew 500 ppm
I20260709 12:59:07.681352   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:07.684860   431 webserver.cc:533] Webserver started at http://127.0.107.195:36461/ using document root <none> and password file <none>
I20260709 12:59:07.685366   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:07.685582   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:07.685853   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:07.686944   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/ts-2-root/instance:
uuid: "9f91a008cbc246e88d1edb6c6d307610"
format_stamp: "Formatted at 2026-07-09 12:59:07 on dist-test-slave-zhw8"
I20260709 12:59:07.691890   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:59:07.695349   677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:07.696183   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:59:07.696547   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/ts-2-root
uuid: "9f91a008cbc246e88d1edb6c6d307610"
format_stamp: "Formatted at 2026-07-09 12:59:07 on dist-test-slave-zhw8"
I20260709 12:59:07.696831   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601945298557-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:07.708559   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:07.709944   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:07.713227   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:07.717770   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:07.718027   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:07.718294   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:07.718492   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:07.837857   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:46077
I20260709 12:59:07.838002   739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:46077 every 8 connection(s)
I20260709 12:59:07.856078   740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33967
I20260709 12:59:07.856468   740 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:07.857357   740 heartbeater.cc:507] Master 127.0.107.254:33967 requested a full tablet report, sending...
I20260709 12:59:07.860013   463 ts_manager.cc:194] Registered new tserver with Master: 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:07.860351   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017143566s
I20260709 12:59:07.861817   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47168
I20260709 12:59:07.918996   463 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47172:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:59:07.923015   463 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:59:08.039819   555 tablet_service.cc:1511] Processing CreateTablet for tablet de9dbd2fca1a40dbab6179b6b6beb0eb (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:59:08.044145   552 tablet_service.cc:1511] Processing CreateTablet for tablet ee86a1a13e094cd493fb6dfaa37eb80a (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:59:08.039116   556 tablet_service.cc:1511] Processing CreateTablet for tablet 157f56b746944699a92d9b0129d549b1 (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:59:08.050172   553 tablet_service.cc:1511] Processing CreateTablet for tablet 2e6e90068c2d4abb927304d7450be6af (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:59:08.043123   554 tablet_service.cc:1511] Processing CreateTablet for tablet feaf0745232341efb52b14f2f233945e (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:59:08.047667   551 tablet_service.cc:1511] Processing CreateTablet for tablet 50c9eae81b654678a7eef7da4e3d64a0 (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:59:08.054072   705 tablet_service.cc:1511] Processing CreateTablet for tablet 157f56b746944699a92d9b0129d549b1 (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:59:08.057193   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de9dbd2fca1a40dbab6179b6b6beb0eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.057338   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157f56b746944699a92d9b0129d549b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.050073   704 tablet_service.cc:1511] Processing CreateTablet for tablet de9dbd2fca1a40dbab6179b6b6beb0eb (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:59:08.060765   549 tablet_service.cc:1511] Processing CreateTablet for tablet ab8dd1fd35a44593a5fb3794f823e687 (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:59:08.063724   703 tablet_service.cc:1511] Processing CreateTablet for tablet feaf0745232341efb52b14f2f233945e (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:59:08.065235   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feaf0745232341efb52b14f2f233945e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.067137   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de9dbd2fca1a40dbab6179b6b6beb0eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.067771   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157f56b746944699a92d9b0129d549b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.058096   550 tablet_service.cc:1511] Processing CreateTablet for tablet f375a6136ded461fa0194b3acba3a2b6 (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:59:08.069660   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee86a1a13e094cd493fb6dfaa37eb80a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.067817   702 tablet_service.cc:1511] Processing CreateTablet for tablet 2e6e90068c2d4abb927304d7450be6af (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:59:08.070995   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8dd1fd35a44593a5fb3794f823e687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.077152   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e6e90068c2d4abb927304d7450be6af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.083140   700 tablet_service.cc:1511] Processing CreateTablet for tablet 50c9eae81b654678a7eef7da4e3d64a0 (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
W20260709 12:59:08.087886   511 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:08.085040   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f375a6136ded461fa0194b3acba3a2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.086036   701 tablet_service.cc:1511] Processing CreateTablet for tablet ee86a1a13e094cd493fb6dfaa37eb80a (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:59:08.088513   699 tablet_service.cc:1511] Processing CreateTablet for tablet f375a6136ded461fa0194b3acba3a2b6 (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:59:08.093839   700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c9eae81b654678a7eef7da4e3d64a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.097084   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c9eae81b654678a7eef7da4e3d64a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.099431   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee86a1a13e094cd493fb6dfaa37eb80a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.104604   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f375a6136ded461fa0194b3acba3a2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.114102   698 tablet_service.cc:1511] Processing CreateTablet for tablet ab8dd1fd35a44593a5fb3794f823e687 (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:59:08.118693   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8dd1fd35a44593a5fb3794f823e687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.125710   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e6e90068c2d4abb927304d7450be6af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.134989   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feaf0745232341efb52b14f2f233945e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.152861   548 tablet_service.cc:1511] Processing CreateTablet for tablet c34ccdbff6ab484fa665454fed505bf3 (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:59:08.159312   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34ccdbff6ab484fa665454fed505bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.179634   697 tablet_service.cc:1511] Processing CreateTablet for tablet c34ccdbff6ab484fa665454fed505bf3 (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:59:08.181978   697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34ccdbff6ab484fa665454fed505bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.244436   629 tablet_service.cc:1511] Processing CreateTablet for tablet feaf0745232341efb52b14f2f233945e (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:59:08.248718   628 tablet_service.cc:1511] Processing CreateTablet for tablet 2e6e90068c2d4abb927304d7450be6af (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:59:08.247848   630 tablet_service.cc:1511] Processing CreateTablet for tablet de9dbd2fca1a40dbab6179b6b6beb0eb (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:59:08.263856   626 tablet_service.cc:1511] Processing CreateTablet for tablet 50c9eae81b654678a7eef7da4e3d64a0 (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:59:08.276239   757 tablet_bootstrap.cc:492] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496: Bootstrap starting.
I20260709 12:59:08.253341   631 tablet_service.cc:1511] Processing CreateTablet for tablet 157f56b746944699a92d9b0129d549b1 (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:59:08.279515   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feaf0745232341efb52b14f2f233945e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.285859   624 tablet_service.cc:1511] Processing CreateTablet for tablet ab8dd1fd35a44593a5fb3794f823e687 (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:59:08.290283   631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157f56b746944699a92d9b0129d549b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.297241   623 tablet_service.cc:1511] Processing CreateTablet for tablet c34ccdbff6ab484fa665454fed505bf3 (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:59:08.281028   627 tablet_service.cc:1511] Processing CreateTablet for tablet ee86a1a13e094cd493fb6dfaa37eb80a (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:59:08.288030   625 tablet_service.cc:1511] Processing CreateTablet for tablet f375a6136ded461fa0194b3acba3a2b6 (DEFAULT_TABLE table=test-workload [id=81cbbc1f4db14e6abaa22ff2304a4e6f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:59:08.303045   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de9dbd2fca1a40dbab6179b6b6beb0eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.305159   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f375a6136ded461fa0194b3acba3a2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.315546   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34ccdbff6ab484fa665454fed505bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.319072   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c9eae81b654678a7eef7da4e3d64a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.319789   758 tablet_bootstrap.cc:492] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610: Bootstrap starting.
I20260709 12:59:08.325443   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee86a1a13e094cd493fb6dfaa37eb80a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.329061   624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8dd1fd35a44593a5fb3794f823e687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.340692   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e6e90068c2d4abb927304d7450be6af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.367246   758 tablet_bootstrap.cc:654] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.388113   757 tablet_bootstrap.cc:654] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.390944   759 tablet_bootstrap.cc:492] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8: Bootstrap starting.
I20260709 12:59:08.416109   758 tablet_bootstrap.cc:492] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610: No bootstrap required, opened a new log
I20260709 12:59:08.416779   758 ts_tablet_manager.cc:1403] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610: Time spent bootstrapping tablet: real 0.135s	user 0.011s	sys 0.004s
I20260709 12:59:08.423030   758 raft_consensus.cc:359] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.423878   758 raft_consensus.cc:385] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.424220   758 raft_consensus.cc:740] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.425397   759 tablet_bootstrap.cc:654] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.425037   758 consensus_queue.cc:260] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.423556   757 tablet_bootstrap.cc:492] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496: No bootstrap required, opened a new log
I20260709 12:59:08.439639   757 ts_tablet_manager.cc:1403] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496: Time spent bootstrapping tablet: real 0.179s	user 0.017s	sys 0.007s
I20260709 12:59:08.443926   757 raft_consensus.cc:359] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.444916   757 raft_consensus.cc:385] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.445328   757 raft_consensus.cc:740] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.446532   757 consensus_queue.cc:260] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.452836   740 heartbeater.cc:499] Master 127.0.107.254:33967 was elected leader, sending a full tablet report...
I20260709 12:59:08.455143   591 heartbeater.cc:499] Master 127.0.107.254:33967 was elected leader, sending a full tablet report...
I20260709 12:59:08.456218   757 ts_tablet_manager.cc:1434] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.005s
I20260709 12:59:08.457373   757 tablet_bootstrap.cc:492] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496: Bootstrap starting.
I20260709 12:59:08.462971   757 tablet_bootstrap.cc:654] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.465865   759 tablet_bootstrap.cc:492] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8: No bootstrap required, opened a new log
I20260709 12:59:08.467770   759 ts_tablet_manager.cc:1403] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8: Time spent bootstrapping tablet: real 0.086s	user 0.015s	sys 0.025s
I20260709 12:59:08.472187   759 raft_consensus.cc:359] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.473155   759 raft_consensus.cc:385] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.473523   759 raft_consensus.cc:740] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.474486   759 consensus_queue.cc:260] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.467155   758 ts_tablet_manager.cc:1434] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610: Time spent starting tablet: real 0.050s	user 0.011s	sys 0.024s
I20260709 12:59:08.477106   758 tablet_bootstrap.cc:492] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610: Bootstrap starting.
I20260709 12:59:08.481217   759 ts_tablet_manager.cc:1434] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 12:59:08.482270   666 heartbeater.cc:499] Master 127.0.107.254:33967 was elected leader, sending a full tablet report...
I20260709 12:59:08.487586   757 tablet_bootstrap.cc:492] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496: No bootstrap required, opened a new log
I20260709 12:59:08.487923   758 tablet_bootstrap.cc:654] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.488147   757 ts_tablet_manager.cc:1403] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.009s
I20260709 12:59:08.490164   759 tablet_bootstrap.cc:492] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8: Bootstrap starting.
I20260709 12:59:08.491264   757 raft_consensus.cc:359] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.491969   757 raft_consensus.cc:385] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.492246   757 raft_consensus.cc:740] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.500103   758 tablet_bootstrap.cc:492] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610: No bootstrap required, opened a new log
I20260709 12:59:08.502079   762 raft_consensus.cc:493] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.497736   757 consensus_queue.cc:260] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.502576   762 raft_consensus.cc:515] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.505628   758 ts_tablet_manager.cc:1403] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.004s
I20260709 12:59:08.507877   762 leader_election.cc:290] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951)
I20260709 12:59:08.508184   757 ts_tablet_manager.cc:1434] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.005s
I20260709 12:59:08.512741   757 tablet_bootstrap.cc:492] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496: Bootstrap starting.
I20260709 12:59:08.519809   758 raft_consensus.cc:359] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.521287   758 raft_consensus.cc:385] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.521564   758 raft_consensus.cc:740] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.522186   758 consensus_queue.cc:260] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.523072   759 tablet_bootstrap.cc:654] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.528453   758 ts_tablet_manager.cc:1434] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.006s
I20260709 12:59:08.533175   757 tablet_bootstrap.cc:654] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.538710   759 tablet_bootstrap.cc:492] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8: No bootstrap required, opened a new log
I20260709 12:59:08.539183   759 ts_tablet_manager.cc:1403] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.002s
I20260709 12:59:08.544617   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f375a6136ded461fa0194b3acba3a2b6" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" is_pre_election: true
I20260709 12:59:08.545590   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f375a6136ded461fa0194b3acba3a2b6" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496" is_pre_election: true
I20260709 12:59:08.546590   566 raft_consensus.cc:2468] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 0.
I20260709 12:59:08.548059   757 tablet_bootstrap.cc:492] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496: No bootstrap required, opened a new log
W20260709 12:59:08.548573   680 leader_election.cc:343] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:08.547346   759 raft_consensus.cc:359] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.549187   759 raft_consensus.cc:385] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.549522   759 raft_consensus.cc:740] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.549882   758 tablet_bootstrap.cc:492] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610: Bootstrap starting.
I20260709 12:59:08.550287   759 consensus_queue.cc:260] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.552479   759 ts_tablet_manager.cc:1434] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:59:08.553319   759 tablet_bootstrap.cc:492] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8: Bootstrap starting.
I20260709 12:59:08.548650   757 ts_tablet_manager.cc:1403] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.014s
I20260709 12:59:08.558692   757 raft_consensus.cc:359] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.559894   757 raft_consensus.cc:385] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.560179   757 raft_consensus.cc:740] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.561317   759 tablet_bootstrap.cc:654] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.560869   757 consensus_queue.cc:260] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.563387   757 ts_tablet_manager.cc:1434] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:59:08.564412   757 tablet_bootstrap.cc:492] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496: Bootstrap starting.
I20260709 12:59:08.573633   757 tablet_bootstrap.cc:654] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.578532   680 leader_election.cc:304] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: ddb8d1e95c074e7c991cd1b2367495b8
I20260709 12:59:08.581463   762 raft_consensus.cc:2804] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:08.582002   762 raft_consensus.cc:493] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.582430   762 raft_consensus.cc:3060] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:08.590610   758 tablet_bootstrap.cc:654] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:08.595146   741 tablet.cc:2406] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:59:08.595773   757 tablet_bootstrap.cc:492] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496: No bootstrap required, opened a new log
I20260709 12:59:08.596182   757 ts_tablet_manager.cc:1403] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.007s
I20260709 12:59:08.596834   762 raft_consensus.cc:515] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.597507   759 tablet_bootstrap.cc:492] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8: No bootstrap required, opened a new log
I20260709 12:59:08.598012   759 ts_tablet_manager.cc:1403] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.023s
I20260709 12:59:08.599385   762 leader_election.cc:290] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951)
I20260709 12:59:08.599484   757 raft_consensus.cc:359] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:08.600343   757 raft_consensus.cc:385] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.600627   757 raft_consensus.cc:740] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.601094   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f375a6136ded461fa0194b3acba3a2b6" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:08.601290   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f375a6136ded461fa0194b3acba3a2b6" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:08.602101   566 raft_consensus.cc:3060] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:08.603015   680 leader_election.cc:343] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:08.601336   757 consensus_queue.cc:260] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:08.603809   759 raft_consensus.cc:359] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:08.604661   758 tablet_bootstrap.cc:492] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610: No bootstrap required, opened a new log
I20260709 12:59:08.604604   759 raft_consensus.cc:385] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.605214   758 ts_tablet_manager.cc:1403] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.003s
I20260709 12:59:08.605132   759 raft_consensus.cc:740] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.605662   757 ts_tablet_manager.cc:1434] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:59:08.606599   757 tablet_bootstrap.cc:492] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496: Bootstrap starting.
I20260709 12:59:08.606199   759 consensus_queue.cc:260] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:08.608728   759 ts_tablet_manager.cc:1434] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:59:08.608666   758 raft_consensus.cc:359] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.609460   758 raft_consensus.cc:385] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.609771   758 raft_consensus.cc:740] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.610001   759 tablet_bootstrap.cc:492] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8: Bootstrap starting.
I20260709 12:59:08.610451   758 consensus_queue.cc:260] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.613435   758 ts_tablet_manager.cc:1434] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:59:08.614768   757 tablet_bootstrap.cc:654] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.619962   759 tablet_bootstrap.cc:654] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.621177   758 tablet_bootstrap.cc:492] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610: Bootstrap starting.
I20260709 12:59:08.628291   566 raft_consensus.cc:2468] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 1.
I20260709 12:59:08.629432   680 leader_election.cc:304] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: ddb8d1e95c074e7c991cd1b2367495b8
I20260709 12:59:08.630470   762 raft_consensus.cc:2804] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:08.632076   758 tablet_bootstrap.cc:654] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.639325   757 tablet_bootstrap.cc:492] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496: No bootstrap required, opened a new log
I20260709 12:59:08.639786   757 ts_tablet_manager.cc:1403] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.007s
I20260709 12:59:08.642570   757 raft_consensus.cc:359] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.643306   757 raft_consensus.cc:385] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.643630   757 raft_consensus.cc:740] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.644577   757 consensus_queue.cc:260] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.648936   762 raft_consensus.cc:697] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 LEADER]: Becoming Leader. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Running, Role: LEADER
I20260709 12:59:08.649817   758 tablet_bootstrap.cc:492] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610: No bootstrap required, opened a new log
I20260709 12:59:08.650374   758 ts_tablet_manager.cc:1403] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610: Time spent bootstrapping tablet: real 0.029s	user 0.022s	sys 0.003s
I20260709 12:59:08.649887   762 consensus_queue.cc:237] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.653637   758 raft_consensus.cc:359] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:08.655339   758 raft_consensus.cc:385] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.655728   758 raft_consensus.cc:740] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.656666   757 ts_tablet_manager.cc:1434] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:59:08.646847   759 tablet_bootstrap.cc:492] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8: No bootstrap required, opened a new log
I20260709 12:59:08.656605   758 consensus_queue.cc:260] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:08.657553   759 ts_tablet_manager.cc:1403] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.016s
I20260709 12:59:08.661258   757 tablet_bootstrap.cc:492] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496: Bootstrap starting.
I20260709 12:59:08.666496   758 ts_tablet_manager.cc:1434] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610: Time spent starting tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 12:59:08.667500   758 tablet_bootstrap.cc:492] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610: Bootstrap starting.
I20260709 12:59:08.669122   759 raft_consensus.cc:359] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.669873   759 raft_consensus.cc:385] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.670161   759 raft_consensus.cc:740] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.669533   463 catalog_manager.cc:5697] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "9f91a008cbc246e88d1edb6c6d307610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:08.670992   759 consensus_queue.cc:260] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.673450   759 ts_tablet_manager.cc:1434] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:59:08.675825   758 tablet_bootstrap.cc:654] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.680817   757 tablet_bootstrap.cc:654] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.687399   759 tablet_bootstrap.cc:492] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8: Bootstrap starting.
I20260709 12:59:08.689111   758 tablet_bootstrap.cc:492] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610: No bootstrap required, opened a new log
I20260709 12:59:08.690338   758 ts_tablet_manager.cc:1403] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.002s
I20260709 12:59:08.694370   758 raft_consensus.cc:359] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.695158   758 raft_consensus.cc:385] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.695477   758 raft_consensus.cc:740] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.696226   758 consensus_queue.cc:260] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.698773   758 ts_tablet_manager.cc:1434] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:59:08.699891   758 tablet_bootstrap.cc:492] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610: Bootstrap starting.
I20260709 12:59:08.694370   759 tablet_bootstrap.cc:654] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.700548   757 tablet_bootstrap.cc:492] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496: No bootstrap required, opened a new log
I20260709 12:59:08.702041   757 ts_tablet_manager.cc:1403] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.006s
I20260709 12:59:08.705648   757 raft_consensus.cc:359] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.706605   757 raft_consensus.cc:385] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.706971   757 raft_consensus.cc:740] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.708519   757 consensus_queue.cc:260] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.710453   758 tablet_bootstrap.cc:654] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.718293   766 raft_consensus.cc:493] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.719451   766 raft_consensus.cc:515] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.725111   766 leader_election.cc:290] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:08.734402   757 ts_tablet_manager.cc:1434] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.004s
I20260709 12:59:08.736794   757 tablet_bootstrap.cc:492] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496: Bootstrap starting.
I20260709 12:59:08.738457   759 tablet_bootstrap.cc:492] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8: No bootstrap required, opened a new log
I20260709 12:59:08.739012   759 ts_tablet_manager.cc:1403] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.024s
I20260709 12:59:08.744156   757 tablet_bootstrap.cc:654] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.742298   759 raft_consensus.cc:359] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.748183   759 raft_consensus.cc:385] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.748653   759 raft_consensus.cc:740] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.749677   759 consensus_queue.cc:260] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.752815   759 ts_tablet_manager.cc:1434] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:59:08.753997   759 tablet_bootstrap.cc:492] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8: Bootstrap starting.
I20260709 12:59:08.756584   757 tablet_bootstrap.cc:492] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496: No bootstrap required, opened a new log
I20260709 12:59:08.757171   757 ts_tablet_manager.cc:1403] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 12:59:08.760447   757 raft_consensus.cc:359] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.761147   757 raft_consensus.cc:385] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.761435   757 raft_consensus.cc:740] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.761832   759 tablet_bootstrap.cc:654] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.762161   757 consensus_queue.cc:260] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.764779   757 ts_tablet_manager.cc:1434] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:59:08.765820   757 tablet_bootstrap.cc:492] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496: Bootstrap starting.
I20260709 12:59:08.769573   781 raft_consensus.cc:493] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.770108   781 raft_consensus.cc:515] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.774631   781 leader_election.cc:290] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951)
I20260709 12:59:08.775413   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496" is_pre_election: true
I20260709 12:59:08.776068   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" is_pre_election: true
W20260709 12:59:08.777822   680 leader_election.cc:343] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:08.778640   680 leader_election.cc:343] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:08.779012   680 leader_election.cc:304] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f91a008cbc246e88d1edb6c6d307610; no voters: 06f0f43a9f1f40f8a91927e7c700b496, ddb8d1e95c074e7c991cd1b2367495b8
I20260709 12:59:08.779831   781 raft_consensus.cc:2749] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:08.780452   757 tablet_bootstrap.cc:654] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.789556   759 tablet_bootstrap.cc:492] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8: No bootstrap required, opened a new log
I20260709 12:59:08.790271   759 ts_tablet_manager.cc:1403] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.009s
I20260709 12:59:08.794162   759 raft_consensus.cc:359] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.795150   759 raft_consensus.cc:385] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.795519   759 raft_consensus.cc:740] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.795614   764 raft_consensus.cc:493] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.796130   764 raft_consensus.cc:515] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:08.796335   759 consensus_queue.cc:260] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.798987   759 ts_tablet_manager.cc:1434] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.003s
I20260709 12:59:08.799401   764 leader_election.cc:290] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077), ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951)
I20260709 12:59:08.799983   759 tablet_bootstrap.cc:492] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8: Bootstrap starting.
I20260709 12:59:08.803272   757 tablet_bootstrap.cc:492] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496: No bootstrap required, opened a new log
I20260709 12:59:08.803798   757 ts_tablet_manager.cc:1403] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.011s
I20260709 12:59:08.806408   757 raft_consensus.cc:359] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.807082   757 raft_consensus.cc:385] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.807386   757 raft_consensus.cc:740] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.808068   757 consensus_queue.cc:260] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.809518   759 tablet_bootstrap.cc:654] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.810420   757 ts_tablet_manager.cc:1434] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:59:08.811363   757 tablet_bootstrap.cc:492] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496: Bootstrap starting.
I20260709 12:59:08.815186   764 raft_consensus.cc:493] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.815786   764 raft_consensus.cc:515] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.818487   764 leader_election.cc:290] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:08.824826   758 tablet_bootstrap.cc:492] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610: No bootstrap required, opened a new log
I20260709 12:59:08.825229   757 tablet_bootstrap.cc:654] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.825482   758 ts_tablet_manager.cc:1403] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610: Time spent bootstrapping tablet: real 0.126s	user 0.002s	sys 0.019s
I20260709 12:59:08.838447   757 tablet_bootstrap.cc:492] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496: No bootstrap required, opened a new log
I20260709 12:59:08.838959   757 ts_tablet_manager.cc:1403] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.003s
I20260709 12:59:08.842442   757 raft_consensus.cc:359] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.843370   757 raft_consensus.cc:385] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.843734   757 raft_consensus.cc:740] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.844622   757 consensus_queue.cc:260] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.847621   757 ts_tablet_manager.cc:1434] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:59:08.872272   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf0745232341efb52b14f2f233945e" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f91a008cbc246e88d1edb6c6d307610" is_pre_election: true
W20260709 12:59:08.874883   606 leader_election.cc:343] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:08.876158   781 raft_consensus.cc:493] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.875933   758 raft_consensus.cc:359] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.876811   758 raft_consensus.cc:385] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.876616   781 raft_consensus.cc:515] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:08.877161   758 raft_consensus.cc:740] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.878703   781 leader_election.cc:290] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951)
I20260709 12:59:08.879788   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157f56b746944699a92d9b0129d549b1" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496" is_pre_election: true
I20260709 12:59:08.880602   566 raft_consensus.cc:2468] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 0.
I20260709 12:59:08.880947   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157f56b746944699a92d9b0129d549b1" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" is_pre_election: true
I20260709 12:59:08.881925   641 raft_consensus.cc:2468] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 0.
I20260709 12:59:08.882457   680 leader_election.cc:304] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:08.883523   781 raft_consensus.cc:2804] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:08.883894   781 raft_consensus.cc:493] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.884250   781 raft_consensus.cc:3060] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:08.878109   758 consensus_queue.cc:260] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.887586   759 tablet_bootstrap.cc:492] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8: No bootstrap required, opened a new log
I20260709 12:59:08.888101   759 ts_tablet_manager.cc:1403] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8: Time spent bootstrapping tablet: real 0.088s	user 0.027s	sys 0.048s
I20260709 12:59:08.892278   759 raft_consensus.cc:359] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.893065   759 raft_consensus.cc:385] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.893391   759 raft_consensus.cc:740] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.893349   781 raft_consensus.cc:515] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:08.894344   759 consensus_queue.cc:260] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.895520   781 leader_election.cc:290] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951)
I20260709 12:59:08.896198   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157f56b746944699a92d9b0129d549b1" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:08.896741   566 raft_consensus.cc:3060] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:08.897112   759 ts_tablet_manager.cc:1434] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 12:59:08.898132   759 tablet_bootstrap.cc:492] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8: Bootstrap starting.
I20260709 12:59:08.902437   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157f56b746944699a92d9b0129d549b1" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:08.903083   641 raft_consensus.cc:3060] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:08.904032   764 raft_consensus.cc:493] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.904546   764 raft_consensus.cc:515] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.906703   764 leader_election.cc:290] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:08.906903   759 tablet_bootstrap.cc:654] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.908317   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157f56b746944699a92d9b0129d549b1" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f91a008cbc246e88d1edb6c6d307610" is_pre_election: true
I20260709 12:59:08.908376   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9dbd2fca1a40dbab6179b6b6beb0eb" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f91a008cbc246e88d1edb6c6d307610" is_pre_election: true
I20260709 12:59:08.909664   714 raft_consensus.cc:2468] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 0.
I20260709 12:59:08.912074   715 raft_consensus.cc:2393] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06f0f43a9f1f40f8a91927e7c700b496 in current term 1: Already voted for candidate 9f91a008cbc246e88d1edb6c6d307610 in this term.
I20260709 12:59:08.907917   781 raft_consensus.cc:493] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.913168   781 raft_consensus.cc:515] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.916225   758 ts_tablet_manager.cc:1434] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.002s
I20260709 12:59:08.915387   781 leader_election.cc:290] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951)
I20260709 12:59:08.923207   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c9eae81b654678a7eef7da4e3d64a0" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" is_pre_election: true
I20260709 12:59:08.919173   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c9eae81b654678a7eef7da4e3d64a0" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496" is_pre_election: true
I20260709 12:59:08.927428   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8dd1fd35a44593a5fb3794f823e687" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f91a008cbc246e88d1edb6c6d307610" is_pre_election: true
I20260709 12:59:08.928093   759 tablet_bootstrap.cc:492] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8: No bootstrap required, opened a new log
I20260709 12:59:08.920404   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157f56b746944699a92d9b0129d549b1" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" is_pre_election: true
I20260709 12:59:08.928592   565 raft_consensus.cc:2468] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 0.
I20260709 12:59:08.929374   759 ts_tablet_manager.cc:1403] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.007s
I20260709 12:59:08.927268   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9dbd2fca1a40dbab6179b6b6beb0eb" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" is_pre_election: true
I20260709 12:59:08.929056   758 tablet_bootstrap.cc:492] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610: Bootstrap starting.
I20260709 12:59:08.931149   638 raft_consensus.cc:2468] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 0.
I20260709 12:59:08.928666   715 raft_consensus.cc:2468] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 0.
I20260709 12:59:08.933269   759 raft_consensus.cc:359] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.934001   759 raft_consensus.cc:385] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.934353   759 raft_consensus.cc:740] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.935096   759 consensus_queue.cc:260] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.935653   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8dd1fd35a44593a5fb3794f823e687" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" is_pre_election: true
I20260709 12:59:08.938275   759 ts_tablet_manager.cc:1434] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:59:08.938979   641 raft_consensus.cc:2468] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 1.
I20260709 12:59:08.939538   759 tablet_bootstrap.cc:492] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8: Bootstrap starting.
W20260709 12:59:08.936180   680 leader_election.cc:343] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:08.939342   566 raft_consensus.cc:2468] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 1.
I20260709 12:59:08.941545   531 leader_election.cc:304] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:08.940456   680 leader_election.cc:304] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: ddb8d1e95c074e7c991cd1b2367495b8
I20260709 12:59:08.942369   764 raft_consensus.cc:2804] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:08.942725   764 raft_consensus.cc:493] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.943197   764 raft_consensus.cc:3060] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:08.943748   680 leader_election.cc:304] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f91a008cbc246e88d1edb6c6d307610, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 
I20260709 12:59:08.945353   762 raft_consensus.cc:2804] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:08.945740   762 raft_consensus.cc:493] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.946002   758 tablet_bootstrap.cc:654] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.946127   762 raft_consensus.cc:3060] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:08.947641   781 raft_consensus.cc:2804] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:08.948334   781 raft_consensus.cc:697] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 LEADER]: Becoming Leader. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Running, Role: LEADER
I20260709 12:59:08.949139   781 consensus_queue.cc:237] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:08.951443   766 raft_consensus.cc:493] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.952075   766 raft_consensus.cc:515] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.954939   766 leader_election.cc:290] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:08.954931   764 raft_consensus.cc:515] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.965219   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f375a6136ded461fa0194b3acba3a2b6" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f91a008cbc246e88d1edb6c6d307610" is_pre_election: true
I20260709 12:59:08.966548   531 leader_election.cc:304] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:08.965812   766 raft_consensus.cc:493] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.968284   762 raft_consensus.cc:515] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.970256   758 tablet_bootstrap.cc:492] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610: No bootstrap required, opened a new log
I20260709 12:59:08.971122   758 ts_tablet_manager.cc:1403] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.013s
I20260709 12:59:08.971452   762 leader_election.cc:290] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951)
I20260709 12:59:08.970037   766 raft_consensus.cc:515] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.973091   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c9eae81b654678a7eef7da4e3d64a0" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:08.975459   759 tablet_bootstrap.cc:654] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:08.976760   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c9eae81b654678a7eef7da4e3d64a0" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:08.977489   566 raft_consensus.cc:3060] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:08.977545   758 raft_consensus.cc:359] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.978258   766 leader_election.cc:290] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:08.978367   758 raft_consensus.cc:385] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:08.976984   641 raft_consensus.cc:3060] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:08.978677   758 raft_consensus.cc:740] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Initialized, Role: FOLLOWER
I20260709 12:59:08.983785   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf0745232341efb52b14f2f233945e" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496" is_pre_election: true
I20260709 12:59:08.985808   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f375a6136ded461fa0194b3acba3a2b6" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496" is_pre_election: true
I20260709 12:59:08.987771   564 raft_consensus.cc:2393] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddb8d1e95c074e7c991cd1b2367495b8 in current term 1: Already voted for candidate 9f91a008cbc246e88d1edb6c6d307610 in this term.
I20260709 12:59:08.990891   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34ccdbff6ab484fa665454fed505bf3" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496" is_pre_election: true
I20260709 12:59:08.989769   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34ccdbff6ab484fa665454fed505bf3" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f91a008cbc246e88d1edb6c6d307610" is_pre_election: true
I20260709 12:59:08.994874   764 leader_election.cc:290] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 election: Requested vote from peers ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:08.989887   565 raft_consensus.cc:2468] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 0.
I20260709 12:59:08.995390   606 leader_election.cc:304] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddb8d1e95c074e7c991cd1b2367495b8; no voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610
I20260709 12:59:08.992264   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9dbd2fca1a40dbab6179b6b6beb0eb" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:08.992352   766 raft_consensus.cc:493] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.993302   802 raft_consensus.cc:2804] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:08.996922   640 raft_consensus.cc:3060] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:08.997098   802 raft_consensus.cc:493] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.997551   802 raft_consensus.cc:3060] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:08.995327   563 raft_consensus.cc:2468] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 0.
I20260709 12:59:08.996953   766 raft_consensus.cc:515] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:08.991194   758 consensus_queue.cc:260] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.000842   764 raft_consensus.cc:493] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.005033   764 raft_consensus.cc:515] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.005751   766 leader_election.cc:290] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:09.006294   766 raft_consensus.cc:3060] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:09.013212   803 raft_consensus.cc:493] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.020524   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6e90068c2d4abb927304d7450be6af" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496" is_pre_election: true
I20260709 12:59:09.021565   563 raft_consensus.cc:2468] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 0.
I20260709 12:59:09.020798   758 ts_tablet_manager.cc:1434] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 12:59:09.020545   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6e90068c2d4abb927304d7450be6af" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f91a008cbc246e88d1edb6c6d307610" is_pre_election: true
W20260709 12:59:09.024032   606 leader_election.cc:343] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:09.024595   758 tablet_bootstrap.cc:492] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610: Bootstrap starting.
I20260709 12:59:09.024791   606 leader_election.cc:304] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 9f91a008cbc246e88d1edb6c6d307610
I20260709 12:59:09.025702   566 raft_consensus.cc:2468] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 1.
I20260709 12:59:09.035001   463 catalog_manager.cc:5697] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "9f91a008cbc246e88d1edb6c6d307610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.037087   805 raft_consensus.cc:2804] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:09.038638   680 leader_election.cc:304] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:09.039438   805 raft_consensus.cc:493] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.039822   781 raft_consensus.cc:2804] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:09.035734   531 leader_election.cc:304] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496; no voters: 9f91a008cbc246e88d1edb6c6d307610, ddb8d1e95c074e7c991cd1b2367495b8
I20260709 12:59:09.041124   759 tablet_bootstrap.cc:492] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8: No bootstrap required, opened a new log
I20260709 12:59:09.040709   781 raft_consensus.cc:697] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 LEADER]: Becoming Leader. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Running, Role: LEADER
I20260709 12:59:09.039822   805 raft_consensus.cc:3060] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:09.043846   759 ts_tablet_manager.cc:1403] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8: Time spent bootstrapping tablet: real 0.105s	user 0.017s	sys 0.016s
I20260709 12:59:09.043512   764 leader_election.cc:290] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:09.044906   606 leader_election.cc:304] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 9f91a008cbc246e88d1edb6c6d307610
I20260709 12:59:09.043293   781 consensus_queue.cc:237] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.030565   803 raft_consensus.cc:515] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.050264   759 raft_consensus.cc:359] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.050810   759 raft_consensus.cc:385] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:09.051055   759 raft_consensus.cc:740] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Initialized, Role: FOLLOWER
I20260709 12:59:09.053582   802 raft_consensus.cc:515] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.054719   808 raft_consensus.cc:2749] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:09.056267   758 tablet_bootstrap.cc:654] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:09.056093   641 raft_consensus.cc:2468] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 1.
I20260709 12:59:09.058104   802 leader_election.cc:290] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 election: Requested vote from peers ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:09.059659   640 raft_consensus.cc:2468] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 1.
I20260709 12:59:09.061362   759 consensus_queue.cc:260] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.061800   807 raft_consensus.cc:493] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.064039   805 raft_consensus.cc:515] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.065490   606 leader_election.cc:304] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 
W20260709 12:59:09.060245   531 leader_election.cc:343] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:09.066442   803 leader_election.cc:290] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:09.070036   759 ts_tablet_manager.cc:1434] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:59:09.069964   809 raft_consensus.cc:2804] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:09.070806   809 raft_consensus.cc:493] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.071187   809 raft_consensus.cc:3060] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:09.071105   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9dbd2fca1a40dbab6179b6b6beb0eb" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:09.071787   715 raft_consensus.cc:3060] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:09.067700   807 raft_consensus.cc:515] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.074798   811 raft_consensus.cc:2804] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:09.075338   811 raft_consensus.cc:493] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.076803   811 raft_consensus.cc:3060] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:09.078186   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34ccdbff6ab484fa665454fed505bf3" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f91a008cbc246e88d1edb6c6d307610" is_pre_election: true
I20260709 12:59:09.075358   805 leader_election.cc:290] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:09.085228   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8dd1fd35a44593a5fb3794f823e687" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
W20260709 12:59:09.086617   531 leader_election.cc:343] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:09.087572   713 raft_consensus.cc:3060] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:09.089082   766 raft_consensus.cc:2749] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:59:09.092767   511 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:09.091925   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf0745232341efb52b14f2f233945e" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f91a008cbc246e88d1edb6c6d307610" is_pre_election: true
I20260709 12:59:09.094142   712 raft_consensus.cc:2468] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 0.
I20260709 12:59:09.095882   807 leader_election.cc:290] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:09.098702   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f91a008cbc246e88d1edb6c6d307610" is_pre_election: true
I20260709 12:59:09.099689   712 raft_consensus.cc:2468] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 0.
I20260709 12:59:09.105341   713 raft_consensus.cc:2468] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 1.
I20260709 12:59:09.105954   811 raft_consensus.cc:515] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.095283   715 raft_consensus.cc:2468] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 1.
I20260709 12:59:09.106941   531 leader_election.cc:304] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:09.108712   807 raft_consensus.cc:2804] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:09.109067   807 raft_consensus.cc:493] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.110908   807 raft_consensus.cc:3060] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:09.111686   463 catalog_manager.cc:5697] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "9f91a008cbc246e88d1edb6c6d307610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:09.116187   606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:32941, user_credentials={real_user=slave}} blocked reactor thread for 50757.9us
I20260709 12:59:09.118943   811 leader_election.cc:290] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:09.115581   531 leader_election.cc:304] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:09.121368   803 raft_consensus.cc:2804] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:09.122112   803 raft_consensus.cc:493] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.122453   803 raft_consensus.cc:3060] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:09.124528   531 leader_election.cc:304] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:09.126564   802 raft_consensus.cc:2804] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:09.127053   802 raft_consensus.cc:697] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 LEADER]: Becoming Leader. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Running, Role: LEADER
I20260709 12:59:09.128583   802 consensus_queue.cc:237] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.130759   758 tablet_bootstrap.cc:492] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610: No bootstrap required, opened a new log
I20260709 12:59:09.131201   758 ts_tablet_manager.cc:1403] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610: Time spent bootstrapping tablet: real 0.108s	user 0.008s	sys 0.012s
I20260709 12:59:09.134578   758 raft_consensus.cc:359] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.135216   758 raft_consensus.cc:385] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:09.130441   803 raft_consensus.cc:515] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.135505   758 raft_consensus.cc:740] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Initialized, Role: FOLLOWER
I20260709 12:59:09.136276   758 consensus_queue.cc:260] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.139668   758 ts_tablet_manager.cc:1434] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 12:59:09.140048   803 leader_election.cc:290] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 election: Requested vote from peers ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:09.139463   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf0745232341efb52b14f2f233945e" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:09.132599   531 leader_election.cc:304] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:09.146306   758 tablet_bootstrap.cc:492] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610: Bootstrap starting.
I20260709 12:59:09.147199   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:09.139063   809 raft_consensus.cc:515] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.147797   715 raft_consensus.cc:3060] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:09.147819   803 raft_consensus.cc:2804] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:09.153151   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf0745232341efb52b14f2f233945e" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:09.153731   713 raft_consensus.cc:3060] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:09.157269   715 raft_consensus.cc:2468] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 1.
I20260709 12:59:09.158828   807 raft_consensus.cc:515] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.160259   566 raft_consensus.cc:2393] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ddb8d1e95c074e7c991cd1b2367495b8 in current term 1: Already voted for candidate 06f0f43a9f1f40f8a91927e7c700b496 in this term.
I20260709 12:59:09.160298   803 raft_consensus.cc:697] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 LEADER]: Becoming Leader. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Running, Role: LEADER
I20260709 12:59:09.161705   803 consensus_queue.cc:237] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.164213   713 raft_consensus.cc:2468] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 1.
I20260709 12:59:09.166846   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6e90068c2d4abb927304d7450be6af" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:09.167409   713 raft_consensus.cc:3060] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:09.168150   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf0745232341efb52b14f2f233945e" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" is_pre_election: true
I20260709 12:59:09.169416   638 raft_consensus.cc:2393] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06f0f43a9f1f40f8a91927e7c700b496 in current term 1: Already voted for candidate ddb8d1e95c074e7c991cd1b2367495b8 in this term.
I20260709 12:59:09.169749   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8dd1fd35a44593a5fb3794f823e687" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:09.170288   641 raft_consensus.cc:3060] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:09.170712   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" is_pre_election: true
I20260709 12:59:09.170994   809 leader_election.cc:290] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:09.171340   638 raft_consensus.cc:2468] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 0.
I20260709 12:59:09.170409   807 leader_election.cc:290] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 election: Requested vote from peers ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:09.172640   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:09.173137   638 raft_consensus.cc:3060] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:09.173084   531 leader_election.cc:304] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:09.174350   758 tablet_bootstrap.cc:654] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:09.169412   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34ccdbff6ab484fa665454fed505bf3" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" is_pre_election: true
I20260709 12:59:09.180848   640 raft_consensus.cc:2393] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06f0f43a9f1f40f8a91927e7c700b496 in current term 1: Already voted for candidate ddb8d1e95c074e7c991cd1b2367495b8 in this term.
W20260709 12:59:09.181221   606 leader_election.cc:343] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:09.184082   606 leader_election.cc:304] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f91a008cbc246e88d1edb6c6d307610, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 
I20260709 12:59:09.178169   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6e90068c2d4abb927304d7450be6af" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:09.186836   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34ccdbff6ab484fa665454fed505bf3" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:09.186877   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf0745232341efb52b14f2f233945e" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:09.187150   809 raft_consensus.cc:2804] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:09.179361   807 raft_consensus.cc:2804] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:09.178493   713 raft_consensus.cc:2468] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 1.
I20260709 12:59:09.188068   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34ccdbff6ab484fa665454fed505bf3" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:09.189569   809 raft_consensus.cc:697] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 LEADER]: Becoming Leader. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:09.189700   463 catalog_manager.cc:5697] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "06f0f43a9f1f40f8a91927e7c700b496" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.194352   563 raft_consensus.cc:3060] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:09.191126   712 raft_consensus.cc:2393] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 06f0f43a9f1f40f8a91927e7c700b496 in current term 1: Already voted for candidate ddb8d1e95c074e7c991cd1b2367495b8 in this term.
I20260709 12:59:09.190243   566 raft_consensus.cc:3060] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:09.192579   531 leader_election.cc:304] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496; no voters: 9f91a008cbc246e88d1edb6c6d307610, ddb8d1e95c074e7c991cd1b2367495b8
I20260709 12:59:09.197996   809 consensus_queue.cc:237] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.195704   807 raft_consensus.cc:697] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 LEADER]: Becoming Leader. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Running, Role: LEADER
I20260709 12:59:09.202531   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf0745232341efb52b14f2f233945e" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:09.208467   781 consensus_queue.cc:1048] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:09.213178   563 raft_consensus.cc:2468] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 1.
I20260709 12:59:09.213663   803 raft_consensus.cc:2749] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:09.203958   807 consensus_queue.cc:237] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.216867   781 consensus_queue.cc:1048] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:59:09.223173   606 leader_election.cc:343] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:09.210901   638 raft_consensus.cc:2468] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 1.
I20260709 12:59:09.223748   641 raft_consensus.cc:2468] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 1.
I20260709 12:59:09.224048   606 leader_election.cc:304] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f91a008cbc246e88d1edb6c6d307610, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 
I20260709 12:59:09.224798   811 raft_consensus.cc:2804] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:09.225258   811 raft_consensus.cc:697] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 LEADER]: Becoming Leader. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:09.225944   811 consensus_queue.cc:237] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.233777   606 leader_election.cc:304] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 9f91a008cbc246e88d1edb6c6d307610
I20260709 12:59:09.239001   758 tablet_bootstrap.cc:492] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610: No bootstrap required, opened a new log
I20260709 12:59:09.239496   758 ts_tablet_manager.cc:1403] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.005s
I20260709 12:59:09.240494   811 raft_consensus.cc:2804] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:09.240959   811 raft_consensus.cc:697] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 LEADER]: Becoming Leader. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:09.241747   811 consensus_queue.cc:237] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.242204   566 raft_consensus.cc:2468] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 1.
I20260709 12:59:09.243651   531 leader_election.cc:304] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496; no voters: 9f91a008cbc246e88d1edb6c6d307610, ddb8d1e95c074e7c991cd1b2367495b8
I20260709 12:59:09.249854   803 raft_consensus.cc:2749] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:09.253118   758 raft_consensus.cc:359] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.253804   758 raft_consensus.cc:385] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:09.254094   758 raft_consensus.cc:740] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Initialized, Role: FOLLOWER
I20260709 12:59:09.257372   758 consensus_queue.cc:260] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.265482   758 ts_tablet_manager.cc:1434] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:59:09.295805   461 catalog_manager.cc:5697] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "06f0f43a9f1f40f8a91927e7c700b496" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.265486   463 catalog_manager.cc:5697] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.317816   461 catalog_manager.cc:5697] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "06f0f43a9f1f40f8a91927e7c700b496" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.348385   460 catalog_manager.cc:5697] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.350699   460 catalog_manager.cc:5697] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.398491   778 consensus_queue.cc:1048] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:09.411437   781 consensus_queue.cc:1048] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:09.493417   778 consensus_queue.cc:1048] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:09.498725   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "157f56b746944699a92d9b0129d549b1"
dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
mode: GRACEFUL
new_leader_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
 from {username='slave'} at 127.0.0.1:45968
I20260709 12:59:09.499408   713 raft_consensus.cc:606] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 LEADER]: Received request to transfer leadership to TS 06f0f43a9f1f40f8a91927e7c700b496
I20260709 12:59:09.507423   762 consensus_queue.cc:1048] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:09.537387   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "feaf0745232341efb52b14f2f233945e"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
mode: GRACEFUL
new_leader_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
 from {username='slave'} at 127.0.0.1:33968
I20260709 12:59:09.538374   641 raft_consensus.cc:606] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 LEADER]: Received request to transfer leadership to TS 06f0f43a9f1f40f8a91927e7c700b496
I20260709 12:59:09.543814   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e6e90068c2d4abb927304d7450be6af"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
mode: GRACEFUL
new_leader_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
 from {username='slave'} at 127.0.0.1:33968
I20260709 12:59:09.544299   641 raft_consensus.cc:606] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 LEADER]: Received request to transfer leadership to TS 06f0f43a9f1f40f8a91927e7c700b496
I20260709 12:59:09.558749   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a"
dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
mode: GRACEFUL
new_leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:57182
I20260709 12:59:09.559317   565 raft_consensus.cc:606] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 LEADER]: Received request to transfer leadership to TS ddb8d1e95c074e7c991cd1b2367495b8
I20260709 12:59:09.564646   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50c9eae81b654678a7eef7da4e3d64a0"
dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
mode: GRACEFUL
new_leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:45968
I20260709 12:59:09.565142   713 raft_consensus.cc:606] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 LEADER]: Received request to transfer leadership to TS ddb8d1e95c074e7c991cd1b2367495b8
I20260709 12:59:09.570896   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f375a6136ded461fa0194b3acba3a2b6"
dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
mode: GRACEFUL
new_leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:45968
I20260709 12:59:09.571583   713 raft_consensus.cc:606] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 LEADER]: Received request to transfer leadership to TS ddb8d1e95c074e7c991cd1b2367495b8
I20260709 12:59:09.576313   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab8dd1fd35a44593a5fb3794f823e687"
dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
mode: GRACEFUL
new_leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:57182
I20260709 12:59:09.576790   565 raft_consensus.cc:606] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 LEADER]: Received request to transfer leadership to TS ddb8d1e95c074e7c991cd1b2367495b8
I20260709 12:59:09.581996   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c34ccdbff6ab484fa665454fed505bf3"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
mode: GRACEFUL
new_leader_uuid: "9f91a008cbc246e88d1edb6c6d307610"
 from {username='slave'} at 127.0.0.1:33968
I20260709 12:59:09.582165   762 raft_consensus.cc:493] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.582612   641 raft_consensus.cc:606] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 LEADER]: Received request to transfer leadership to TS 9f91a008cbc246e88d1edb6c6d307610
I20260709 12:59:09.582646   762 raft_consensus.cc:515] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.585664   762 leader_election.cc:290] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951)
I20260709 12:59:09.586294   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34ccdbff6ab484fa665454fed505bf3" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496" is_pre_election: true
I20260709 12:59:09.586621   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34ccdbff6ab484fa665454fed505bf3" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" is_pre_election: true
I20260709 12:59:09.586997   565 raft_consensus.cc:2393] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f91a008cbc246e88d1edb6c6d307610 in current term 1: Already voted for candidate ddb8d1e95c074e7c991cd1b2367495b8 in this term.
I20260709 12:59:09.588222   680 leader_election.cc:304] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f91a008cbc246e88d1edb6c6d307610; no voters: 06f0f43a9f1f40f8a91927e7c700b496, ddb8d1e95c074e7c991cd1b2367495b8
I20260709 12:59:09.588971   762 raft_consensus.cc:3060] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:09.594969   762 raft_consensus.cc:2749] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:09.631711   807 consensus_queue.cc:1048] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:09.643020   807 consensus_queue.cc:1048] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:09.682240   807 consensus_queue.cc:1048] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:09.686774   811 consensus_queue.cc:1048] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:09.705896   808 consensus_queue.cc:1048] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:09.706033   811 consensus_queue.cc:1048] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:09.728155   808 raft_consensus.cc:993] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496: : Instructing follower ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:09.728611   808 raft_consensus.cc:1081] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 LEADER]: Signalling peer ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:09.730543   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab8dd1fd35a44593a5fb3794f823e687"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:33966
I20260709 12:59:09.731217   641 raft_consensus.cc:493] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:09.731765   811 raft_consensus.cc:993] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8: : Instructing follower 06f0f43a9f1f40f8a91927e7c700b496 to start an election
I20260709 12:59:09.732216   641 raft_consensus.cc:3060] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.732375   811 raft_consensus.cc:1081] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 LEADER]: Signalling peer 06f0f43a9f1f40f8a91927e7c700b496 to start an election
I20260709 12:59:09.736719   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "feaf0745232341efb52b14f2f233945e"
dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
 from {username='slave'} at 127.0.0.1:57174
I20260709 12:59:09.737721   565 raft_consensus.cc:493] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:09.738150   565 raft_consensus.cc:3060] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.741869   641 raft_consensus.cc:515] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.746312   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8dd1fd35a44593a5fb3794f823e687" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:09.746922   566 raft_consensus.cc:3055] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:09.747138   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8dd1fd35a44593a5fb3794f823e687" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:09.747349   566 raft_consensus.cc:740] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Running, Role: LEADER
I20260709 12:59:09.747732   713 raft_consensus.cc:3060] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.748222   566 consensus_queue.cc:260] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.749452   566 raft_consensus.cc:3060] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.752418   641 leader_election.cc:290] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 2 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:09.755227   713 raft_consensus.cc:2468] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 2.
I20260709 12:59:09.755555   565 raft_consensus.cc:515] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.756395   606 leader_election.cc:304] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f91a008cbc246e88d1edb6c6d307610, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 
I20260709 12:59:09.757236   811 raft_consensus.cc:2804] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:09.757701   811 raft_consensus.cc:697] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Becoming Leader. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:09.758900   565 leader_election.cc:290] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 2 election: Requested vote from peers ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:09.759635   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf0745232341efb52b14f2f233945e" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:09.761029   641 raft_consensus.cc:3055] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:09.761590   566 raft_consensus.cc:2468] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 2.
I20260709 12:59:09.760466   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf0745232341efb52b14f2f233945e" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:09.761833   641 raft_consensus.cc:740] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:09.758497   811 consensus_queue.cc:237] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.762434   715 raft_consensus.cc:3060] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.762917   641 consensus_queue.cc:260] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.766595   641 raft_consensus.cc:3060] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.769048   811 consensus_queue.cc:1048] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:09.771152   715 raft_consensus.cc:2468] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 2.
I20260709 12:59:09.774034   641 raft_consensus.cc:2468] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 2.
I20260709 12:59:09.774863   531 leader_election.cc:304] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:09.773500   461 catalog_manager.cc:5697] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 reported cstate change: term changed from 1 to 2, leader changed from 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193) to ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.776803   808 raft_consensus.cc:2804] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:09.777551   808 raft_consensus.cc:697] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 LEADER]: Becoming Leader. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Running, Role: LEADER
I20260709 12:59:09.778455   808 consensus_queue.cc:237] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.790109   813 consensus_queue.cc:1048] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:09.802331   808 consensus_queue.cc:1048] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:09.804700   461 catalog_manager.cc:5697] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 reported cstate change: term changed from 1 to 2, leader changed from ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194) to 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "06f0f43a9f1f40f8a91927e7c700b496" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.811185   811 consensus_queue.cc:1048] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:09.811373   809 raft_consensus.cc:993] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8: : Instructing follower 9f91a008cbc246e88d1edb6c6d307610 to start an election
I20260709 12:59:09.812623   809 raft_consensus.cc:1081] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 LEADER]: Signalling peer 9f91a008cbc246e88d1edb6c6d307610 to start an election
I20260709 12:59:09.817333   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c34ccdbff6ab484fa665454fed505bf3"
dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
 from {username='slave'} at 127.0.0.1:45956
I20260709 12:59:09.817955   715 raft_consensus.cc:493] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:09.818359   715 raft_consensus.cc:3060] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.831004   715 raft_consensus.cc:515] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.833252   715 leader_election.cc:290] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 2 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951)
I20260709 12:59:09.835153   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34ccdbff6ab484fa665454fed505bf3" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:09.835745   565 raft_consensus.cc:3060] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.835973   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34ccdbff6ab484fa665454fed505bf3" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:09.836514   640 raft_consensus.cc:3055] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:09.836824   640 raft_consensus.cc:740] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:09.838037   640 consensus_queue.cc:260] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.839053   640 raft_consensus.cc:3060] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.842777   808 consensus_queue.cc:1048] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:09.843662   565 raft_consensus.cc:2468] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 2.
I20260709 12:59:09.844841   680 leader_election.cc:304] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:09.845010   813 consensus_queue.cc:1048] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:09.845806   640 raft_consensus.cc:2468] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 2.
I20260709 12:59:09.846009   762 raft_consensus.cc:2804] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:09.846575   762 raft_consensus.cc:697] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 LEADER]: Becoming Leader. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Running, Role: LEADER
I20260709 12:59:09.847483   762 consensus_queue.cc:237] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.849195   811 raft_consensus.cc:993] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8: : Instructing follower 06f0f43a9f1f40f8a91927e7c700b496 to start an election
I20260709 12:59:09.849632   811 raft_consensus.cc:1081] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 LEADER]: Signalling peer 06f0f43a9f1f40f8a91927e7c700b496 to start an election
I20260709 12:59:09.856675   803 raft_consensus.cc:993] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496: : Instructing follower ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:09.857178   803 raft_consensus.cc:1081] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 LEADER]: Signalling peer ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:09.859961   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:33966
I20260709 12:59:09.861413   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e6e90068c2d4abb927304d7450be6af"
dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
 from {username='slave'} at 127.0.0.1:57174
I20260709 12:59:09.862601   565 raft_consensus.cc:493] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:09.863076   565 raft_consensus.cc:3060] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.865262   640 raft_consensus.cc:493] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:09.865679   640 raft_consensus.cc:3060] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.870520   565 raft_consensus.cc:515] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.872748   640 raft_consensus.cc:515] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.873355   565 leader_election.cc:290] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 2 election: Requested vote from peers ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:09.875886   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6e90068c2d4abb927304d7450be6af" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:09.876556   641 raft_consensus.cc:3055] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:09.876889   641 raft_consensus.cc:740] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:09.877727   641 consensus_queue.cc:260] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.879108   641 raft_consensus.cc:3060] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.879870   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6e90068c2d4abb927304d7450be6af" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:09.880492   712 raft_consensus.cc:3060] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.885788   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:09.886368   565 raft_consensus.cc:3055] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:09.886694   565 raft_consensus.cc:740] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Running, Role: LEADER
I20260709 12:59:09.887501   565 consensus_queue.cc:260] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.888520   565 raft_consensus.cc:3060] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.896118   712 raft_consensus.cc:2468] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 2.
I20260709 12:59:09.896727   641 raft_consensus.cc:2468] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 2.
I20260709 12:59:09.892724   462 catalog_manager.cc:5697] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 reported cstate change: term changed from 1 to 2, leader changed from ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194) to 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "9f91a008cbc246e88d1edb6c6d307610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.897619   531 leader_election.cc:304] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:09.898475   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:09.898962   778 raft_consensus.cc:993] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610: : Instructing follower ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:09.899039   713 raft_consensus.cc:3060] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.899549   778 raft_consensus.cc:1081] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 LEADER]: Signalling peer ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:09.899214   807 raft_consensus.cc:2804] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:09.900246   807 raft_consensus.cc:697] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 LEADER]: Becoming Leader. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Running, Role: LEADER
I20260709 12:59:09.901554   807 consensus_queue.cc:237] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.902649   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f375a6136ded461fa0194b3acba3a2b6"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:37132
I20260709 12:59:09.903322   641 raft_consensus.cc:493] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:09.903790   641 raft_consensus.cc:3060] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.905678   713 raft_consensus.cc:2468] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 2.
I20260709 12:59:09.906853   606 leader_election.cc:304] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f91a008cbc246e88d1edb6c6d307610, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 
I20260709 12:59:09.907605   809 raft_consensus.cc:2804] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:09.908030   809 raft_consensus.cc:697] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Becoming Leader. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:09.908792   809 consensus_queue.cc:237] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.916672   640 leader_election.cc:290] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 2 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:09.896282   565 raft_consensus.cc:2468] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 2.
I20260709 12:59:09.920506   460 catalog_manager.cc:5697] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 reported cstate change: term changed from 1 to 2, leader changed from 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193) to ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.922024   461 catalog_manager.cc:5697] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 reported cstate change: term changed from 1 to 2, leader changed from ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194) to 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "06f0f43a9f1f40f8a91927e7c700b496" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.920506   641 raft_consensus.cc:515] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.925486   641 leader_election.cc:290] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 2 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:09.927378   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f375a6136ded461fa0194b3acba3a2b6" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:09.927426   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f375a6136ded461fa0194b3acba3a2b6" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:09.928253   713 raft_consensus.cc:3055] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:09.928270   565 raft_consensus.cc:3060] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.928834   713 raft_consensus.cc:740] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Running, Role: LEADER
I20260709 12:59:09.929827   713 consensus_queue.cc:260] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.931214   713 raft_consensus.cc:3060] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.935683   565 raft_consensus.cc:2468] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 2.
I20260709 12:59:09.936811   606 leader_election.cc:304] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 
I20260709 12:59:09.937680   809 raft_consensus.cc:2804] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:09.938131   809 raft_consensus.cc:697] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Becoming Leader. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:09.938465   713 raft_consensus.cc:2468] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 2.
I20260709 12:59:09.938898   809 consensus_queue.cc:237] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:09.950044   463 catalog_manager.cc:5697] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 reported cstate change: term changed from 1 to 2, leader changed from 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195) to ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.969717   778 raft_consensus.cc:993] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610: : Instructing follower 06f0f43a9f1f40f8a91927e7c700b496 to start an election
I20260709 12:59:09.970188   778 raft_consensus.cc:1081] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 LEADER]: Signalling peer 06f0f43a9f1f40f8a91927e7c700b496 to start an election
I20260709 12:59:09.971668   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "157f56b746944699a92d9b0129d549b1"
dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
 from {username='slave'} at 127.0.0.1:58578
I20260709 12:59:09.972203   565 raft_consensus.cc:493] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:09.972546   565 raft_consensus.cc:3060] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.978916   565 raft_consensus.cc:515] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:09.981539   565 leader_election.cc:290] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 2 election: Requested vote from peers 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077), ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951)
I20260709 12:59:09.981804   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157f56b746944699a92d9b0129d549b1" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:09.983184   713 raft_consensus.cc:3055] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:09.983152   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157f56b746944699a92d9b0129d549b1" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:09.983703   713 raft_consensus.cc:740] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Running, Role: LEADER
I20260709 12:59:09.983875   641 raft_consensus.cc:3060] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.984517   713 consensus_queue.cc:260] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:09.985742   713 raft_consensus.cc:3060] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.991118   641 raft_consensus.cc:2468] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 2.
I20260709 12:59:09.992345   531 leader_election.cc:304] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 
I20260709 12:59:09.993072   781 raft_consensus.cc:993] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610: : Instructing follower ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:09.993211   807 raft_consensus.cc:2804] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:09.992784   713 raft_consensus.cc:2468] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 2.
I20260709 12:59:09.993535   778 raft_consensus.cc:1081] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 LEADER]: Signalling peer ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:09.993741   807 raft_consensus.cc:697] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 LEADER]: Becoming Leader. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Running, Role: LEADER
I20260709 12:59:09.994632   807 consensus_queue.cc:237] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:09.995428   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50c9eae81b654678a7eef7da4e3d64a0"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:37132
I20260709 12:59:09.995983   641 raft_consensus.cc:493] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:09.996330   641 raft_consensus.cc:3060] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:10.001840   463 catalog_manager.cc:5697] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 reported cstate change: term changed from 1 to 2, leader changed from 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195) to 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "06f0f43a9f1f40f8a91927e7c700b496" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:10.003523   641 raft_consensus.cc:515] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:10.005446   641 leader_election.cc:290] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 2 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:10.006458   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c9eae81b654678a7eef7da4e3d64a0" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:10.006521   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c9eae81b654678a7eef7da4e3d64a0" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:10.007166   565 raft_consensus.cc:3060] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:10.007169   713 raft_consensus.cc:3055] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:10.009521   713 raft_consensus.cc:740] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Running, Role: LEADER
I20260709 12:59:10.010290   713 consensus_queue.cc:260] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:10.011655   713 raft_consensus.cc:3060] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:10.013710   565 raft_consensus.cc:2468] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 2.
I20260709 12:59:10.014717   606 leader_election.cc:304] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 
I20260709 12:59:10.015395   809 raft_consensus.cc:2804] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:10.016227   809 raft_consensus.cc:697] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Becoming Leader. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:10.016903   809 consensus_queue.cc:237] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:10.018568   713 raft_consensus.cc:2468] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 2.
I20260709 12:59:10.023947   463 catalog_manager.cc:5697] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 reported cstate change: term changed from 1 to 2, leader changed from 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195) to ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:10.236279   565 raft_consensus.cc:1275] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Refusing update from remote peer 9f91a008cbc246e88d1edb6c6d307610: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.237843   778 consensus_queue.cc:1048] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.247071   641 raft_consensus.cc:1275] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Refusing update from remote peer 9f91a008cbc246e88d1edb6c6d307610: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.249090   762 consensus_queue.cc:1048] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.319167   565 raft_consensus.cc:1275] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.320560   713 raft_consensus.cc:1275] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.321434   809 consensus_queue.cc:1048] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.322013   813 consensus_queue.cc:1048] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.330144   712 raft_consensus.cc:1275] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.332836   813 consensus_queue.cc:1048] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.337370   565 raft_consensus.cc:1275] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.340020   809 consensus_queue.cc:1048] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.376477   712 raft_consensus.cc:1275] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Refusing update from remote peer 06f0f43a9f1f40f8a91927e7c700b496: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.377642   807 consensus_queue.cc:1048] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.385003   641 raft_consensus.cc:1275] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Refusing update from remote peer 06f0f43a9f1f40f8a91927e7c700b496: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.386608   803 consensus_queue.cc:1048] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.389557   712 raft_consensus.cc:1275] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Refusing update from remote peer 06f0f43a9f1f40f8a91927e7c700b496: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.391434   802 consensus_queue.cc:1048] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.393602   641 raft_consensus.cc:1275] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Refusing update from remote peer 06f0f43a9f1f40f8a91927e7c700b496: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.395450   803 consensus_queue.cc:1048] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:10.400198   641 raft_consensus.cc:1275] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Refusing update from remote peer 06f0f43a9f1f40f8a91927e7c700b496: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.407841   807 consensus_queue.cc:1048] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.409565   712 raft_consensus.cc:1275] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.415091   849 consensus_queue.cc:1048] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.421244   712 raft_consensus.cc:1275] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Refusing update from remote peer 06f0f43a9f1f40f8a91927e7c700b496: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.425446   803 consensus_queue.cc:1048] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:10.430815   565 raft_consensus.cc:1275] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.432667   809 consensus_queue.cc:1048] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.463265   565 raft_consensus.cc:1275] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.464512   813 consensus_queue.cc:1048] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.472354   713 raft_consensus.cc:1275] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.474596   849 consensus_queue.cc:1048] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.614912   431 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 12:59:12.615820   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:12.635416   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "157f56b746944699a92d9b0129d549b1"
dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
mode: GRACEFUL
new_leader_uuid: "9f91a008cbc246e88d1edb6c6d307610"
 from {username='slave'} at 127.0.0.1:57184
I20260709 12:59:12.635991   566 raft_consensus.cc:606] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 LEADER]: Received request to transfer leadership to TS 9f91a008cbc246e88d1edb6c6d307610
I20260709 12:59:12.646849   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
mode: GRACEFUL
new_leader_uuid: "9f91a008cbc246e88d1edb6c6d307610"
 from {username='slave'} at 127.0.0.1:33984
I20260709 12:59:12.647428   641 raft_consensus.cc:606] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Received request to transfer leadership to TS 9f91a008cbc246e88d1edb6c6d307610
I20260709 12:59:12.648524   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:59:12.648996   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:13.018986   856 raft_consensus.cc:993] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8: : Instructing follower 9f91a008cbc246e88d1edb6c6d307610 to start an election
I20260709 12:59:13.019508   811 raft_consensus.cc:1081] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Signalling peer 9f91a008cbc246e88d1edb6c6d307610 to start an election
I20260709 12:59:13.021250   712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a"
dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
 from {username='slave'} at 127.0.0.1:45956
I20260709 12:59:13.021696   712 raft_consensus.cc:493] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:13.021952   712 raft_consensus.cc:3060] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:13.026343   712 raft_consensus.cc:515] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:13.027886   712 leader_election.cc:290] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 3 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951)
I20260709 12:59:13.028926   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:13.029138   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:13.029462   566 raft_consensus.cc:3060] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:13.029651   641 raft_consensus.cc:3055] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:13.030071   641 raft_consensus.cc:740] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:13.030635   641 consensus_queue.cc:260] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:13.031508   641 raft_consensus.cc:3060] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:13.034466   566 raft_consensus.cc:2468] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 3.
I20260709 12:59:13.035425   641 raft_consensus.cc:2468] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 3.
I20260709 12:59:13.035670   680 leader_election.cc:304] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:13.036538   778 raft_consensus.cc:2804] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:13.037997   778 raft_consensus.cc:697] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 3 LEADER]: Becoming Leader. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Running, Role: LEADER
I20260709 12:59:13.038846   778 consensus_queue.cc:237] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:13.045039   807 raft_consensus.cc:993] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496: : Instructing follower 9f91a008cbc246e88d1edb6c6d307610 to start an election
I20260709 12:59:13.045480   859 raft_consensus.cc:1081] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 LEADER]: Signalling peer 9f91a008cbc246e88d1edb6c6d307610 to start an election
I20260709 12:59:13.047139   712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "157f56b746944699a92d9b0129d549b1"
dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
 from {username='slave'} at 127.0.0.1:45966
I20260709 12:59:13.047825   712 raft_consensus.cc:493] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:13.048170   712 raft_consensus.cc:3060] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:13.053727   712 raft_consensus.cc:515] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:13.053793   461 catalog_manager.cc:5697] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 reported cstate change: term changed from 2 to 3, leader changed from ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194) to 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "9f91a008cbc246e88d1edb6c6d307610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:13.055698   712 leader_election.cc:290] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 3 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951)
I20260709 12:59:13.056409   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157f56b746944699a92d9b0129d549b1" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:13.056607   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157f56b746944699a92d9b0129d549b1" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:13.056988   566 raft_consensus.cc:3055] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:13.057070   641 raft_consensus.cc:3060] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:13.057374   566 raft_consensus.cc:740] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Running, Role: LEADER
I20260709 12:59:13.058139   566 consensus_queue.cc:260] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:13.059324   566 raft_consensus.cc:3060] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:13.063511   641 raft_consensus.cc:2468] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 3.
I20260709 12:59:13.064673   680 leader_election.cc:304] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f91a008cbc246e88d1edb6c6d307610, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 
I20260709 12:59:13.065505   778 raft_consensus.cc:2804] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:13.065915   566 raft_consensus.cc:2468] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 3.
I20260709 12:59:13.066175   778 raft_consensus.cc:697] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 3 LEADER]: Becoming Leader. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Running, Role: LEADER
I20260709 12:59:13.067104   778 consensus_queue.cc:237] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:13.073805   461 catalog_manager.cc:5697] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 reported cstate change: term changed from 2 to 3, leader changed from 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193) to 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "9f91a008cbc246e88d1edb6c6d307610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:13.511477   641 raft_consensus.cc:1275] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Refusing update from remote peer 9f91a008cbc246e88d1edb6c6d307610: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:13.512748   778 consensus_queue.cc:1048] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:13.522197   566 raft_consensus.cc:1275] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Refusing update from remote peer 9f91a008cbc246e88d1edb6c6d307610: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:13.523892   778 consensus_queue.cc:1048] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:13.639736   566 raft_consensus.cc:1275] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Refusing update from remote peer 9f91a008cbc246e88d1edb6c6d307610: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:13.641110   778 consensus_queue.cc:1048] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:13.650146   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:13.651013   641 raft_consensus.cc:1275] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Refusing update from remote peer 9f91a008cbc246e88d1edb6c6d307610: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:13.652475   871 consensus_queue.cc:1048] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:13.665221   712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "157f56b746944699a92d9b0129d549b1"
dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
mode: GRACEFUL
new_leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:45968
I20260709 12:59:13.665833   712 raft_consensus.cc:606] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 3 LEADER]: Received request to transfer leadership to TS ddb8d1e95c074e7c991cd1b2367495b8
I20260709 12:59:13.670868   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de9dbd2fca1a40dbab6179b6b6beb0eb"
dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
mode: GRACEFUL
new_leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:57182
I20260709 12:59:13.671392   566 raft_consensus.cc:606] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 LEADER]: Received request to transfer leadership to TS ddb8d1e95c074e7c991cd1b2367495b8
I20260709 12:59:13.676211   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "feaf0745232341efb52b14f2f233945e"
dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
mode: GRACEFUL
new_leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:57182
I20260709 12:59:13.676698   566 raft_consensus.cc:606] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 LEADER]: Received request to transfer leadership to TS ddb8d1e95c074e7c991cd1b2367495b8
I20260709 12:59:13.681694   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e6e90068c2d4abb927304d7450be6af"
dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
mode: GRACEFUL
new_leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:57182
I20260709 12:59:13.682189   566 raft_consensus.cc:606] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 LEADER]: Received request to transfer leadership to TS ddb8d1e95c074e7c991cd1b2367495b8
I20260709 12:59:13.686398   712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a"
dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
mode: GRACEFUL
new_leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:45968
I20260709 12:59:13.686872   712 raft_consensus.cc:606] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 3 LEADER]: Received request to transfer leadership to TS ddb8d1e95c074e7c991cd1b2367495b8
I20260709 12:59:13.836654   873 raft_consensus.cc:993] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496: : Instructing follower ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:13.837042   873 raft_consensus.cc:1081] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 LEADER]: Signalling peer ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:13.838598   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "feaf0745232341efb52b14f2f233945e"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:33966
I20260709 12:59:13.839007   641 raft_consensus.cc:493] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:13.839268   641 raft_consensus.cc:3060] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:13.843080   641 raft_consensus.cc:515] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:13.844592   641 leader_election.cc:290] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 3 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:13.845317   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf0745232341efb52b14f2f233945e" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:13.845615   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf0745232341efb52b14f2f233945e" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:13.845902   566 raft_consensus.cc:3055] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:13.846153   712 raft_consensus.cc:3060] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:13.846328   566 raft_consensus.cc:740] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Running, Role: LEADER
I20260709 12:59:13.847163   566 consensus_queue.cc:260] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:13.848409   566 raft_consensus.cc:3060] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:13.852959   712 raft_consensus.cc:2468] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 3.
I20260709 12:59:13.854434   606 leader_election.cc:304] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f91a008cbc246e88d1edb6c6d307610, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 
I20260709 12:59:13.855111   566 raft_consensus.cc:2468] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 3.
I20260709 12:59:13.855365   811 raft_consensus.cc:2804] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:13.856874   811 raft_consensus.cc:697] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 LEADER]: Becoming Leader. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:13.857738   811 consensus_queue.cc:237] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:13.865270   461 catalog_manager.cc:5697] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 reported cstate change: term changed from 2 to 3, leader changed from 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193) to ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:14.003710   871 raft_consensus.cc:993] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610: : Instructing follower ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:14.004156   857 raft_consensus.cc:1081] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 3 LEADER]: Signalling peer ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:14.005473   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "157f56b746944699a92d9b0129d549b1"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:37132
I20260709 12:59:14.005856   641 raft_consensus.cc:493] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:14.006085   641 raft_consensus.cc:3060] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.009895   641 raft_consensus.cc:515] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:14.011188   641 leader_election.cc:290] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 4 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:14.012213   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157f56b746944699a92d9b0129d549b1" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:14.012741   566 raft_consensus.cc:3060] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.012706   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157f56b746944699a92d9b0129d549b1" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:14.014887   712 raft_consensus.cc:3055] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:14.015285   712 raft_consensus.cc:740] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Running, Role: LEADER
I20260709 12:59:14.016070   712 consensus_queue.cc:260] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:14.017668   712 raft_consensus.cc:3060] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.018836   566 raft_consensus.cc:2468] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 4.
I20260709 12:59:14.019853   606 leader_election.cc:304] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 
I20260709 12:59:14.020553   811 raft_consensus.cc:2804] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:14.020969   811 raft_consensus.cc:697] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 LEADER]: Becoming Leader. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:14.021751   811 consensus_queue.cc:237] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:14.022742   712 raft_consensus.cc:2468] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 4.
I20260709 12:59:14.027750   461 catalog_manager.cc:5697] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 reported cstate change: term changed from 3 to 4, leader changed from 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195) to ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:14.084498   859 raft_consensus.cc:993] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496: : Instructing follower ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:14.085377   873 raft_consensus.cc:1081] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 LEADER]: Signalling peer ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:14.086707   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e6e90068c2d4abb927304d7450be6af"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:33966
I20260709 12:59:14.087177   641 raft_consensus.cc:493] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:14.087471   641 raft_consensus.cc:3060] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:14.091199   641 raft_consensus.cc:515] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:14.092619   641 leader_election.cc:290] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 3 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:14.093518   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6e90068c2d4abb927304d7450be6af" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:14.093654   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6e90068c2d4abb927304d7450be6af" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:14.094177   566 raft_consensus.cc:3055] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:14.094193   712 raft_consensus.cc:3060] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:14.094669   566 raft_consensus.cc:740] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Running, Role: LEADER
I20260709 12:59:14.095497   566 consensus_queue.cc:260] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:14.096650   566 raft_consensus.cc:3060] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:14.101490   712 raft_consensus.cc:2468] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 3.
I20260709 12:59:14.102627   606 leader_election.cc:304] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f91a008cbc246e88d1edb6c6d307610, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 
I20260709 12:59:14.103295   811 raft_consensus.cc:2804] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:14.103727   811 raft_consensus.cc:697] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 LEADER]: Becoming Leader. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:14.103703   566 raft_consensus.cc:2468] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 3.
I20260709 12:59:14.104535   811 consensus_queue.cc:237] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:14.111058   461 catalog_manager.cc:5697] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 reported cstate change: term changed from 2 to 3, leader changed from 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193) to ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:14.116293   859 raft_consensus.cc:993] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496: : Instructing follower ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:14.116729   873 raft_consensus.cc:1081] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 LEADER]: Signalling peer ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:14.118263   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de9dbd2fca1a40dbab6179b6b6beb0eb"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:33966
I20260709 12:59:14.118757   641 raft_consensus.cc:493] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:14.119047   641 raft_consensus.cc:3060] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.122803   641 raft_consensus.cc:515] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:14.124372   641 leader_election.cc:290] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 2 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:14.125841   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9dbd2fca1a40dbab6179b6b6beb0eb" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:14.126451   566 raft_consensus.cc:3055] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:14.126713   566 raft_consensus.cc:740] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Running, Role: LEADER
I20260709 12:59:14.125861   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9dbd2fca1a40dbab6179b6b6beb0eb" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:14.127349   712 raft_consensus.cc:3060] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.127540   857 raft_consensus.cc:993] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610: : Instructing follower ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:14.127424   566 consensus_queue.cc:260] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:14.127995   871 raft_consensus.cc:1081] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 3 LEADER]: Signalling peer ddb8d1e95c074e7c991cd1b2367495b8 to start an election
I20260709 12:59:14.128588   566 raft_consensus.cc:3060] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.129698   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
 from {username='slave'} at 127.0.0.1:37132
I20260709 12:59:14.130231   640 raft_consensus.cc:493] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:14.131017   640 raft_consensus.cc:3060] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.133839   566 raft_consensus.cc:2468] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 2.
I20260709 12:59:14.134572   712 raft_consensus.cc:2468] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 2.
I20260709 12:59:14.134898   606 leader_election.cc:304] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 
I20260709 12:59:14.135660   811 raft_consensus.cc:2804] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:14.136134   811 raft_consensus.cc:697] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Becoming Leader. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:14.136899   811 consensus_queue.cc:237] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:14.137445   640 raft_consensus.cc:515] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:14.140244   640 leader_election.cc:290] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 4 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:14.140846   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:14.141836   712 raft_consensus.cc:3055] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:14.142241   712 raft_consensus.cc:740] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Running, Role: LEADER
I20260709 12:59:14.142338   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a" candidate_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:14.142935   566 raft_consensus.cc:3060] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.143292   712 consensus_queue.cc:260] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:14.144951   712 raft_consensus.cc:3060] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.147202   566 raft_consensus.cc:2468] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 4.
I20260709 12:59:14.148373   606 leader_election.cc:304] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, ddb8d1e95c074e7c991cd1b2367495b8; no voters: 
I20260709 12:59:14.149104   811 raft_consensus.cc:2804] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:14.149554   811 raft_consensus.cc:697] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 LEADER]: Becoming Leader. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:14.150791   811 consensus_queue.cc:237] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:14.151928   712 raft_consensus.cc:2468] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddb8d1e95c074e7c991cd1b2367495b8 in term 4.
I20260709 12:59:14.152563   461 catalog_manager.cc:5697] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 reported cstate change: term changed from 1 to 2, leader changed from 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193) to ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:14.164769   461 catalog_manager.cc:5697] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 reported cstate change: term changed from 3 to 4, leader changed from 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195) to ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:14.335917   566 raft_consensus.cc:1275] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:14.337072   811 consensus_queue.cc:1048] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.347369   712 raft_consensus.cc:1275] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:14.348749   874 consensus_queue.cc:1048] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.520744   566 raft_consensus.cc:1275] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 4 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:14.521950   874 consensus_queue.cc:1048] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.531785   712 raft_consensus.cc:1275] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 4 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:14.533074   886 consensus_queue.cc:1048] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.564023   566 raft_consensus.cc:1275] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:14.565105   886 consensus_queue.cc:1048] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:14.574230   712 raft_consensus.cc:1275] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:14.575503   811 consensus_queue.cc:1048] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:14.633035   566 raft_consensus.cc:1275] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 4 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:14.634217   811 consensus_queue.cc:1048] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.641209   712 raft_consensus.cc:1275] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 4 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:14.642601   874 consensus_queue.cc:1048] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.657156   566 raft_consensus.cc:1275] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:14.658269   886 consensus_queue.cc:1048] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.666743   712 raft_consensus.cc:1275] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Refusing update from remote peer ddb8d1e95c074e7c991cd1b2367495b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:14.668164   811 consensus_queue.cc:1048] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.875267   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:16.882917   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "157f56b746944699a92d9b0129d549b1"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
mode: GRACEFUL
new_leader_uuid: "9f91a008cbc246e88d1edb6c6d307610"
 from {username='slave'} at 127.0.0.1:33984
I20260709 12:59:16.883658   640 raft_consensus.cc:606] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 LEADER]: Received request to transfer leadership to TS 9f91a008cbc246e88d1edb6c6d307610
I20260709 12:59:16.886245   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50c9eae81b654678a7eef7da4e3d64a0"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
mode: GRACEFUL
new_leader_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
 from {username='slave'} at 127.0.0.1:33984
I20260709 12:59:16.886720   640 raft_consensus.cc:606] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Received request to transfer leadership to TS 06f0f43a9f1f40f8a91927e7c700b496
I20260709 12:59:16.889065   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de9dbd2fca1a40dbab6179b6b6beb0eb"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
mode: GRACEFUL
new_leader_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
 from {username='slave'} at 127.0.0.1:33984
I20260709 12:59:16.889618   640 raft_consensus.cc:606] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Received request to transfer leadership to TS 06f0f43a9f1f40f8a91927e7c700b496
I20260709 12:59:16.891924   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
mode: GRACEFUL
new_leader_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
 from {username='slave'} at 127.0.0.1:33984
I20260709 12:59:16.892300   641 raft_consensus.cc:606] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 LEADER]: Received request to transfer leadership to TS 06f0f43a9f1f40f8a91927e7c700b496
I20260709 12:59:16.894325   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "feaf0745232341efb52b14f2f233945e"
dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
mode: GRACEFUL
new_leader_uuid: "9f91a008cbc246e88d1edb6c6d307610"
 from {username='slave'} at 127.0.0.1:33984
I20260709 12:59:16.894732   641 raft_consensus.cc:606] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 LEADER]: Received request to transfer leadership to TS 9f91a008cbc246e88d1edb6c6d307610
I20260709 12:59:16.895645   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:16.895998   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:16.978726   895 raft_consensus.cc:993] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8: : Instructing follower 9f91a008cbc246e88d1edb6c6d307610 to start an election
I20260709 12:59:16.979290   886 raft_consensus.cc:1081] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 LEADER]: Signalling peer 9f91a008cbc246e88d1edb6c6d307610 to start an election
I20260709 12:59:16.980805   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "157f56b746944699a92d9b0129d549b1"
dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
 from {username='slave'} at 127.0.0.1:45956
I20260709 12:59:16.981220   713 raft_consensus.cc:493] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.981556   713 raft_consensus.cc:3060] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.986407   713 raft_consensus.cc:515] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:16.987999   713 leader_election.cc:290] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 5 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951)
I20260709 12:59:16.988998   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157f56b746944699a92d9b0129d549b1" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:16.989035   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157f56b746944699a92d9b0129d549b1" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:16.989850   566 raft_consensus.cc:3060] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.989861   641 raft_consensus.cc:3055] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:16.990355   641 raft_consensus.cc:740] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:16.991189   641 consensus_queue.cc:260] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:16.992419   641 raft_consensus.cc:3060] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.996465   566 raft_consensus.cc:2468] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 5.
I20260709 12:59:16.997828   680 leader_election.cc:304] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:16.998769   641 raft_consensus.cc:2468] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 5.
I20260709 12:59:16.998788   894 raft_consensus.cc:2804] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:17.000159   894 raft_consensus.cc:697] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 5 LEADER]: Becoming Leader. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Running, Role: LEADER
I20260709 12:59:17.000964   894 consensus_queue.cc:237] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } }
I20260709 12:59:17.011600   463 catalog_manager.cc:5697] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 reported cstate change: term changed from 4 to 5, leader changed from ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194) to 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "9f91a008cbc246e88d1edb6c6d307610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.090595   895 raft_consensus.cc:993] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8: : Instructing follower 06f0f43a9f1f40f8a91927e7c700b496 to start an election
I20260709 12:59:17.091105   895 raft_consensus.cc:1081] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Signalling peer 06f0f43a9f1f40f8a91927e7c700b496 to start an election
I20260709 12:59:17.092698   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de9dbd2fca1a40dbab6179b6b6beb0eb"
dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
 from {username='slave'} at 127.0.0.1:57174
I20260709 12:59:17.093140   566 raft_consensus.cc:493] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.093421   566 raft_consensus.cc:3060] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:17.097462   566 raft_consensus.cc:515] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:17.099150   566 leader_election.cc:290] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 3 election: Requested vote from peers ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:17.100136   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9dbd2fca1a40dbab6179b6b6beb0eb" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:17.100306   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9dbd2fca1a40dbab6179b6b6beb0eb" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:17.100605   641 raft_consensus.cc:3055] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:17.100809   713 raft_consensus.cc:3060] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:17.100924   641 raft_consensus.cc:740] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:17.101615   641 consensus_queue.cc:260] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:17.102439   641 raft_consensus.cc:3060] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:17.105139   713 raft_consensus.cc:2468] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 3.
I20260709 12:59:17.106333   531 leader_election.cc:304] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:17.106510   641 raft_consensus.cc:2468] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 3.
I20260709 12:59:17.108037   902 raft_consensus.cc:2804] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:17.109043   902 raft_consensus.cc:697] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 LEADER]: Becoming Leader. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Running, Role: LEADER
I20260709 12:59:17.109805   902 consensus_queue.cc:237] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:17.115947   463 catalog_manager.cc:5697] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 reported cstate change: term changed from 2 to 3, leader changed from ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194) to 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "06f0f43a9f1f40f8a91927e7c700b496" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.178679   886 raft_consensus.cc:993] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8: : Instructing follower 9f91a008cbc246e88d1edb6c6d307610 to start an election
I20260709 12:59:17.179174   886 raft_consensus.cc:1081] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 LEADER]: Signalling peer 9f91a008cbc246e88d1edb6c6d307610 to start an election
I20260709 12:59:17.180954   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "feaf0745232341efb52b14f2f233945e"
dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
 from {username='slave'} at 127.0.0.1:45956
I20260709 12:59:17.181620   713 raft_consensus.cc:493] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.182001   713 raft_consensus.cc:3060] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:17.188400   713 raft_consensus.cc:515] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:17.189916   713 leader_election.cc:290] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 4 election: Requested vote from peers 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941), ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951)
I20260709 12:59:17.190901   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf0745232341efb52b14f2f233945e" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
I20260709 12:59:17.191166   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf0745232341efb52b14f2f233945e" candidate_uuid: "9f91a008cbc246e88d1edb6c6d307610" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:17.191529   566 raft_consensus.cc:3060] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:17.191713   641 raft_consensus.cc:3055] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:17.192046   641 raft_consensus.cc:740] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:17.192816   641 consensus_queue.cc:260] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:17.194010   641 raft_consensus.cc:3060] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:17.198511   566 raft_consensus.cc:2468] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 4.
I20260709 12:59:17.199631   680 leader_election.cc:304] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:17.200572   894 raft_consensus.cc:2804] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:17.200969   641 raft_consensus.cc:2468] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f91a008cbc246e88d1edb6c6d307610 in term 4.
I20260709 12:59:17.201014   894 raft_consensus.cc:697] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 4 LEADER]: Becoming Leader. State: Replica: 9f91a008cbc246e88d1edb6c6d307610, State: Running, Role: LEADER
I20260709 12:59:17.202139   894 consensus_queue.cc:237] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:17.209859   463 catalog_manager.cc:5697] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 reported cstate change: term changed from 3 to 4, leader changed from ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194) to 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "9f91a008cbc246e88d1edb6c6d307610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.230106   895 raft_consensus.cc:993] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8: : Instructing follower 06f0f43a9f1f40f8a91927e7c700b496 to start an election
I20260709 12:59:17.230616   895 raft_consensus.cc:1081] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 LEADER]: Signalling peer 06f0f43a9f1f40f8a91927e7c700b496 to start an election
I20260709 12:59:17.232064   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a"
dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
 from {username='slave'} at 127.0.0.1:57174
I20260709 12:59:17.232513   566 raft_consensus.cc:493] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.232769   566 raft_consensus.cc:3060] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.237619   566 raft_consensus.cc:515] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:17.239717   566 leader_election.cc:290] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 5 election: Requested vote from peers ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:17.240463   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:17.240798   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee86a1a13e094cd493fb6dfaa37eb80a" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:17.240981   641 raft_consensus.cc:3055] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:17.241339   641 raft_consensus.cc:740] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:17.241335   713 raft_consensus.cc:3060] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.242077   641 consensus_queue.cc:260] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:17.242928   641 raft_consensus.cc:3060] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.247488   713 raft_consensus.cc:2468] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 5.
I20260709 12:59:17.248833   531 leader_election.cc:304] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:17.249037   641 raft_consensus.cc:2468] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 5.
I20260709 12:59:17.249547   902 raft_consensus.cc:2804] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:17.249980   902 raft_consensus.cc:697] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 5 LEADER]: Becoming Leader. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Running, Role: LEADER
I20260709 12:59:17.250717   902 consensus_queue.cc:237] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:17.257872   463 catalog_manager.cc:5697] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 reported cstate change: term changed from 4 to 5, leader changed from ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194) to 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "06f0f43a9f1f40f8a91927e7c700b496" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.353973   886 raft_consensus.cc:993] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8: : Instructing follower 06f0f43a9f1f40f8a91927e7c700b496 to start an election
I20260709 12:59:17.354393   895 raft_consensus.cc:1081] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Signalling peer 06f0f43a9f1f40f8a91927e7c700b496 to start an election
I20260709 12:59:17.355790   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50c9eae81b654678a7eef7da4e3d64a0"
dest_uuid: "06f0f43a9f1f40f8a91927e7c700b496"
 from {username='slave'} at 127.0.0.1:57174
I20260709 12:59:17.356194   566 raft_consensus.cc:493] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.356459   566 raft_consensus.cc:3060] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:17.360309   566 raft_consensus.cc:515] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:17.361553   566 leader_election.cc:290] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 3 election: Requested vote from peers ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194:37951), 9f91a008cbc246e88d1edb6c6d307610 (127.0.107.195:46077)
I20260709 12:59:17.362380   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c9eae81b654678a7eef7da4e3d64a0" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddb8d1e95c074e7c991cd1b2367495b8"
I20260709 12:59:17.362823   641 raft_consensus.cc:3055] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:17.362625   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c9eae81b654678a7eef7da4e3d64a0" candidate_uuid: "06f0f43a9f1f40f8a91927e7c700b496" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9f91a008cbc246e88d1edb6c6d307610"
I20260709 12:59:17.363090   641 raft_consensus.cc:740] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddb8d1e95c074e7c991cd1b2367495b8, State: Running, Role: LEADER
I20260709 12:59:17.363358   713 raft_consensus.cc:3060] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:17.363853   641 consensus_queue.cc:260] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:17.364876   641 raft_consensus.cc:3060] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:17.367446   713 raft_consensus.cc:2468] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 3.
I20260709 12:59:17.368330   531 leader_election.cc:304] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0f43a9f1f40f8a91927e7c700b496, 9f91a008cbc246e88d1edb6c6d307610; no voters: 
I20260709 12:59:17.369067   902 raft_consensus.cc:2804] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:17.369113   641 raft_consensus.cc:2468] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0f43a9f1f40f8a91927e7c700b496 in term 3.
I20260709 12:59:17.369513   902 raft_consensus.cc:697] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 LEADER]: Becoming Leader. State: Replica: 06f0f43a9f1f40f8a91927e7c700b496, State: Running, Role: LEADER
I20260709 12:59:17.370376   902 consensus_queue.cc:237] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } }
I20260709 12:59:17.376401   463 catalog_manager.cc:5697] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 reported cstate change: term changed from 2 to 3, leader changed from ddb8d1e95c074e7c991cd1b2367495b8 (127.0.107.194) to 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "06f0f43a9f1f40f8a91927e7c700b496" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.405055   565 raft_consensus.cc:1275] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 5 FOLLOWER]: Refusing update from remote peer 9f91a008cbc246e88d1edb6c6d307610: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:17.406173   894 consensus_queue.cc:1048] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:17.416340   641 raft_consensus.cc:1275] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 5 FOLLOWER]: Refusing update from remote peer 9f91a008cbc246e88d1edb6c6d307610: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:17.418449   894 consensus_queue.cc:1048] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:59:17.498135   494 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 434
W20260709 12:59:17.499053   494 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 497
W20260709 12:59:17.499822   494 debug-util.cc:398] Leaking SignalData structure 0x7b08001b73a0 after lost signal to thread 590
W20260709 12:59:17.500496   494 debug-util.cc:398] Leaking SignalData structure 0x7b08001cf240 after lost signal to thread 665
W20260709 12:59:17.501125   494 debug-util.cc:398] Leaking SignalData structure 0x7b08001d94c0 after lost signal to thread 739
I20260709 12:59:17.528563   713 raft_consensus.cc:1275] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Refusing update from remote peer 06f0f43a9f1f40f8a91927e7c700b496: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:17.529739   902 consensus_queue.cc:1048] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.539793   641 raft_consensus.cc:1275] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Refusing update from remote peer 06f0f43a9f1f40f8a91927e7c700b496: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:17.541149   902 consensus_queue.cc:1048] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.630568   565 raft_consensus.cc:1275] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 4 FOLLOWER]: Refusing update from remote peer 9f91a008cbc246e88d1edb6c6d307610: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:17.632472   894 consensus_queue.cc:1048] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0f43a9f1f40f8a91927e7c700b496" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:17.645028   641 raft_consensus.cc:1275] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 FOLLOWER]: Refusing update from remote peer 9f91a008cbc246e88d1edb6c6d307610: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:17.647482   896 consensus_queue.cc:1048] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:17.682041   713 raft_consensus.cc:1275] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 5 FOLLOWER]: Refusing update from remote peer 06f0f43a9f1f40f8a91927e7c700b496: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:17.683437   903 consensus_queue.cc:1048] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:17.695384   641 raft_consensus.cc:1275] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 5 FOLLOWER]: Refusing update from remote peer 06f0f43a9f1f40f8a91927e7c700b496: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:17.697465   916 consensus_queue.cc:1048] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:17.773667   713 raft_consensus.cc:1275] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Refusing update from remote peer 06f0f43a9f1f40f8a91927e7c700b496: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:17.774951   916 consensus_queue.cc:1048] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f91a008cbc246e88d1edb6c6d307610" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.790256   641 raft_consensus.cc:1275] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Refusing update from remote peer 06f0f43a9f1f40f8a91927e7c700b496: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:17.791682   903 consensus_queue.cc:1048] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddb8d1e95c074e7c991cd1b2367495b8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.896773   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:17.902377   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 12:59:17.909518   606 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:59:17.915891   606 consensus_peers.cc:597] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 -> Peer 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941): Couldn't send request to peer 06f0f43a9f1f40f8a91927e7c700b496. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:17.951072   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:17.951987   431 tablet_replica.cc:333] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496: stopping tablet replica
I20260709 12:59:17.952718   431 raft_consensus.cc:2243] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:17.953222   431 raft_consensus.cc:2272] T 2e6e90068c2d4abb927304d7450be6af P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:17.955564   431 tablet_replica.cc:333] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496: stopping tablet replica
I20260709 12:59:17.956099   431 raft_consensus.cc:2243] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:17.956528   431 raft_consensus.cc:2272] T ab8dd1fd35a44593a5fb3794f823e687 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:17.958122   431 tablet_replica.cc:333] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496: stopping tablet replica
I20260709 12:59:17.958624   431 raft_consensus.cc:2243] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:17.959012   431 raft_consensus.cc:2272] T c34ccdbff6ab484fa665454fed505bf3 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:17.960835   431 tablet_replica.cc:333] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496: stopping tablet replica
I20260709 12:59:17.961298   431 raft_consensus.cc:2243] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:17.961704   431 raft_consensus.cc:2272] T 157f56b746944699a92d9b0129d549b1 P 06f0f43a9f1f40f8a91927e7c700b496 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:17.964251   431 tablet_replica.cc:333] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496: stopping tablet replica
I20260709 12:59:17.964823   431 raft_consensus.cc:2243] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:17.965534   431 raft_consensus.cc:2272] T de9dbd2fca1a40dbab6179b6b6beb0eb P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:17.967952   431 tablet_replica.cc:333] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496: stopping tablet replica
I20260709 12:59:17.968564   431 raft_consensus.cc:2243] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:17.969046   431 raft_consensus.cc:2272] T f375a6136ded461fa0194b3acba3a2b6 P 06f0f43a9f1f40f8a91927e7c700b496 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:17.970785   431 tablet_replica.cc:333] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496: stopping tablet replica
I20260709 12:59:17.971228   431 raft_consensus.cc:2243] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:17.971935   431 raft_consensus.cc:2272] T 50c9eae81b654678a7eef7da4e3d64a0 P 06f0f43a9f1f40f8a91927e7c700b496 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:17.973770   431 tablet_replica.cc:333] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496: stopping tablet replica
I20260709 12:59:17.974233   431 raft_consensus.cc:2243] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:59:17.974902   431 raft_consensus.cc:2272] T ee86a1a13e094cd493fb6dfaa37eb80a P 06f0f43a9f1f40f8a91927e7c700b496 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:17.976791   431 tablet_replica.cc:333] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496: stopping tablet replica
I20260709 12:59:17.977248   431 raft_consensus.cc:2243] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:17.977638   431 raft_consensus.cc:2272] T feaf0745232341efb52b14f2f233945e P 06f0f43a9f1f40f8a91927e7c700b496 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.109645   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 12:59:18.111279   680 consensus_peers.cc:597] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 -> Peer 06f0f43a9f1f40f8a91927e7c700b496 (127.0.107.193:32941): Couldn't send request to peer 06f0f43a9f1f40f8a91927e7c700b496. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:18.130039   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:59:18.160234   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:18.161115   431 tablet_replica.cc:333] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8: stopping tablet replica
I20260709 12:59:18.161912   431 raft_consensus.cc:2243] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.162454   431 raft_consensus.cc:2272] T 50c9eae81b654678a7eef7da4e3d64a0 P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.165364   431 tablet_replica.cc:333] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8: stopping tablet replica
I20260709 12:59:18.166102   431 raft_consensus.cc:2243] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.166617   431 raft_consensus.cc:2272] T de9dbd2fca1a40dbab6179b6b6beb0eb P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.169343   431 tablet_replica.cc:333] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8: stopping tablet replica
I20260709 12:59:18.170046   431 raft_consensus.cc:2243] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:18.171039   431 raft_consensus.cc:2272] T f375a6136ded461fa0194b3acba3a2b6 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.173494   431 tablet_replica.cc:333] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8: stopping tablet replica
I20260709 12:59:18.174228   431 raft_consensus.cc:2243] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:18.175194   431 raft_consensus.cc:2272] T ab8dd1fd35a44593a5fb3794f823e687 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.177624   431 tablet_replica.cc:333] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8: stopping tablet replica
I20260709 12:59:18.178339   431 raft_consensus.cc:2243] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:18.179318   431 raft_consensus.cc:2272] T 2e6e90068c2d4abb927304d7450be6af P ddb8d1e95c074e7c991cd1b2367495b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.181622   431 tablet_replica.cc:333] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8: stopping tablet replica
I20260709 12:59:18.182258   431 raft_consensus.cc:2243] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.182731   431 raft_consensus.cc:2272] T 157f56b746944699a92d9b0129d549b1 P ddb8d1e95c074e7c991cd1b2367495b8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.185387   431 tablet_replica.cc:333] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8: stopping tablet replica
I20260709 12:59:18.186105   431 raft_consensus.cc:2243] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.186710   431 raft_consensus.cc:2272] T c34ccdbff6ab484fa665454fed505bf3 P ddb8d1e95c074e7c991cd1b2367495b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.189374   431 tablet_replica.cc:333] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8: stopping tablet replica
I20260709 12:59:18.190043   431 raft_consensus.cc:2243] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.190547   431 raft_consensus.cc:2272] T ee86a1a13e094cd493fb6dfaa37eb80a P ddb8d1e95c074e7c991cd1b2367495b8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.193674   431 tablet_replica.cc:333] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8: stopping tablet replica
I20260709 12:59:18.194267   431 raft_consensus.cc:2243] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.194712   431 raft_consensus.cc:2272] T feaf0745232341efb52b14f2f233945e P ddb8d1e95c074e7c991cd1b2367495b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.216401   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:59:18.236650   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:59:18.270591   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:18.271468   431 tablet_replica.cc:333] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610: stopping tablet replica
I20260709 12:59:18.272346   431 raft_consensus.cc:2243] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:18.273417   431 raft_consensus.cc:2272] T c34ccdbff6ab484fa665454fed505bf3 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.276341   431 tablet_replica.cc:333] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610: stopping tablet replica
I20260709 12:59:18.277128   431 raft_consensus.cc:2243] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.277693   431 raft_consensus.cc:2272] T 2e6e90068c2d4abb927304d7450be6af P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.280062   431 tablet_replica.cc:333] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610: stopping tablet replica
I20260709 12:59:18.280799   431 raft_consensus.cc:2243] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.281327   431 raft_consensus.cc:2272] T ab8dd1fd35a44593a5fb3794f823e687 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.283613   431 tablet_replica.cc:333] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610: stopping tablet replica
I20260709 12:59:18.284296   431 raft_consensus.cc:2243] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:59:18.285207   431 raft_consensus.cc:2272] T feaf0745232341efb52b14f2f233945e P 9f91a008cbc246e88d1edb6c6d307610 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.287617   431 tablet_replica.cc:333] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610: stopping tablet replica
I20260709 12:59:18.288313   431 raft_consensus.cc:2243] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.288817   431 raft_consensus.cc:2272] T ee86a1a13e094cd493fb6dfaa37eb80a P 9f91a008cbc246e88d1edb6c6d307610 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.291162   431 tablet_replica.cc:333] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610: stopping tablet replica
I20260709 12:59:18.291957   431 raft_consensus.cc:2243] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:59:18.292847   431 raft_consensus.cc:2272] T 157f56b746944699a92d9b0129d549b1 P 9f91a008cbc246e88d1edb6c6d307610 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.295156   431 tablet_replica.cc:333] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610: stopping tablet replica
I20260709 12:59:18.295841   431 raft_consensus.cc:2243] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.296362   431 raft_consensus.cc:2272] T 50c9eae81b654678a7eef7da4e3d64a0 P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.298847   431 tablet_replica.cc:333] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610: stopping tablet replica
I20260709 12:59:18.299547   431 raft_consensus.cc:2243] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.300040   431 raft_consensus.cc:2272] T de9dbd2fca1a40dbab6179b6b6beb0eb P 9f91a008cbc246e88d1edb6c6d307610 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.302636   431 tablet_replica.cc:333] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610: stopping tablet replica
I20260709 12:59:18.303269   431 raft_consensus.cc:2243] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.303795   431 raft_consensus.cc:2272] T f375a6136ded461fa0194b3acba3a2b6 P 9f91a008cbc246e88d1edb6c6d307610 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.336663   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:59:18.354665   431 master.cc:562] Master@127.0.107.254:33967 shutting down...
I20260709 12:59:18.473821   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:59:18.474408   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.474761   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2e777bebcab340a3a249f6343374cf7f: stopping tablet replica
W20260709 12:59:19.491220   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 494)
I20260709 12:59:19.641126   431 master.cc:584] Master@127.0.107.254:33967 shutdown complete.
06f0f43a9f1f40f8a91927e7c700b496  4
9f91a008cbc246e88d1edb6c6d307610  1
ddb8d1e95c074e7c991cd1b2367495b8  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (14205 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:59:19.682253   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:34711
I20260709 12:59:19.683481   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:19.689670   928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:19.690192   927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:19.690914   930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:19.691221   431 server_base.cc:1061] running on GCE node
I20260709 12:59:19.692291   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:19.692484   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:19.692608   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601959692595 us; error 0 us; skew 500 ppm
I20260709 12:59:19.693087   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:19.695703   431 webserver.cc:533] Webserver started at http://127.0.107.254:40609/ using document root <none> and password file <none>
I20260709 12:59:19.696218   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:19.696388   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:19.696631   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:19.697788   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/master-0-root/instance:
uuid: "c5b55fc01c664e25ad6162ddc4e7093a"
format_stamp: "Formatted at 2026-07-09 12:59:19 on dist-test-slave-zhw8"
I20260709 12:59:19.702519   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 12:59:19.706189   935 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:19.707099   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:59:19.707453   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/master-0-root
uuid: "c5b55fc01c664e25ad6162ddc4e7093a"
format_stamp: "Formatted at 2026-07-09 12:59:19 on dist-test-slave-zhw8"
I20260709 12:59:19.707773   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:19.727736   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:19.729028   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:19.768791   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:34711
I20260709 12:59:19.768939   986 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:34711 every 8 connection(s)
I20260709 12:59:19.772778   987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:19.781752   987 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a: Bootstrap starting.
I20260709 12:59:19.786170   987 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:19.791138   987 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a: No bootstrap required, opened a new log
I20260709 12:59:19.793901   987 raft_consensus.cc:359] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5b55fc01c664e25ad6162ddc4e7093a" member_type: VOTER }
I20260709 12:59:19.794278   987 raft_consensus.cc:385] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:19.794450   987 raft_consensus.cc:740] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b55fc01c664e25ad6162ddc4e7093a, State: Initialized, Role: FOLLOWER
I20260709 12:59:19.794998   987 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5b55fc01c664e25ad6162ddc4e7093a" member_type: VOTER }
I20260709 12:59:19.795509   987 raft_consensus.cc:399] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:59:19.795704   987 raft_consensus.cc:493] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:59:19.795907   987 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:19.799832   987 raft_consensus.cc:515] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5b55fc01c664e25ad6162ddc4e7093a" member_type: VOTER }
I20260709 12:59:19.800274   987 leader_election.cc:304] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5b55fc01c664e25ad6162ddc4e7093a; no voters: 
I20260709 12:59:19.801301   987 leader_election.cc:290] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:59:19.801695   990 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:19.803638   990 raft_consensus.cc:697] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [term 1 LEADER]: Becoming Leader. State: Replica: c5b55fc01c664e25ad6162ddc4e7093a, State: Running, Role: LEADER
I20260709 12:59:19.804261   990 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5b55fc01c664e25ad6162ddc4e7093a" member_type: VOTER }
I20260709 12:59:19.804420   987 sys_catalog.cc:565] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:59:19.809348   992 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5b55fc01c664e25ad6162ddc4e7093a. Latest consensus state: current_term: 1 leader_uuid: "c5b55fc01c664e25ad6162ddc4e7093a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5b55fc01c664e25ad6162ddc4e7093a" member_type: VOTER } }
I20260709 12:59:19.809602   991 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5b55fc01c664e25ad6162ddc4e7093a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5b55fc01c664e25ad6162ddc4e7093a" member_type: VOTER } }
I20260709 12:59:19.810041   992 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:19.810303   991 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:19.813238   998 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:59:19.821452   998 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:59:19.822368   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:59:19.830646   998 catalog_manager.cc:1383] Generated new cluster ID: 14d9f55aec534bbdad8844317afe0bc9
I20260709 12:59:19.830968   998 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:59:19.848989   998 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:59:19.850178   998 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:59:19.861147   998 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a: Generated new TSK 0
I20260709 12:59:19.861761   998 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:59:19.888605   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:19.894675  1008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:19.895622  1009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:19.897601   431 server_base.cc:1061] running on GCE node
W20260709 12:59:19.897810  1011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:19.898859   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:19.899102   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:19.899325   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601959899299 us; error 0 us; skew 500 ppm
I20260709 12:59:19.899916   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:19.902196   431 webserver.cc:533] Webserver started at http://127.0.107.193:35455/ using document root <none> and password file <none>
I20260709 12:59:19.902681   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:19.902897   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:19.903162   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:19.904222   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/ts-0-root/instance:
uuid: "a0f4aa692e0a444283f0c59f4be948c6"
format_stamp: "Formatted at 2026-07-09 12:59:19 on dist-test-slave-zhw8"
I20260709 12:59:19.908514   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:59:19.911890  1016 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:19.912729   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:59:19.912977   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/ts-0-root
uuid: "a0f4aa692e0a444283f0c59f4be948c6"
format_stamp: "Formatted at 2026-07-09 12:59:19 on dist-test-slave-zhw8"
I20260709 12:59:19.913249   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:19.937988   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:19.939158   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:19.940549   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:19.942860   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:19.943029   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:19.943363   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:19.943516   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:19.982928   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:42081
I20260709 12:59:19.982981  1078 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:42081 every 8 connection(s)
I20260709 12:59:19.987944   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:19.995553  1083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:19.997557  1084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:20.001874  1086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:20.001928   431 server_base.cc:1061] running on GCE node
I20260709 12:59:20.003163  1079 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34711
I20260709 12:59:20.003655  1079 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:20.003736   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:20.004048   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:20.004252   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601960004213 us; error 0 us; skew 500 ppm
I20260709 12:59:20.004514  1079 heartbeater.cc:507] Master 127.0.107.254:34711 requested a full tablet report, sending...
I20260709 12:59:20.004931   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:20.007408   952 ts_manager.cc:194] Registered new tserver with Master: a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081)
I20260709 12:59:20.008893   431 webserver.cc:533] Webserver started at http://127.0.107.194:46737/ using document root <none> and password file <none>
I20260709 12:59:20.009598   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:20.009847   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:20.010193   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:20.010133   952 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49964
I20260709 12:59:20.012173   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/ts-1-root/instance:
uuid: "36a001d95f2d438fab687f9da249a057"
format_stamp: "Formatted at 2026-07-09 12:59:20 on dist-test-slave-zhw8"
I20260709 12:59:20.017196   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:59:20.020537  1091 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:20.021540   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:59:20.021970   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/ts-1-root
uuid: "36a001d95f2d438fab687f9da249a057"
format_stamp: "Formatted at 2026-07-09 12:59:20 on dist-test-slave-zhw8"
I20260709 12:59:20.022308   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:20.052512   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:20.053681   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:20.055114   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:20.057533   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:20.057722   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:20.058032   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:20.058189   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:20.099020   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:35893
I20260709 12:59:20.099148  1153 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:35893 every 8 connection(s)
I20260709 12:59:20.103803   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:20.111498  1157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:20.112378  1158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:20.115585   431 server_base.cc:1061] running on GCE node
W20260709 12:59:20.116489  1160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:20.117468   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:20.117725   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:20.117977   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601960117958 us; error 0 us; skew 500 ppm
I20260709 12:59:20.118543   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:20.119086  1154 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34711
I20260709 12:59:20.119515  1154 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:20.120327  1154 heartbeater.cc:507] Master 127.0.107.254:34711 requested a full tablet report, sending...
I20260709 12:59:20.121266   431 webserver.cc:533] Webserver started at http://127.0.107.195:38163/ using document root <none> and password file <none>
I20260709 12:59:20.121830   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:20.122044   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:20.122319   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:20.122727   952 ts_manager.cc:194] Registered new tserver with Master: 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:20.123606   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/ts-2-root/instance:
uuid: "9de0c5ee31ba4432976a654b0c837914"
format_stamp: "Formatted at 2026-07-09 12:59:20 on dist-test-slave-zhw8"
I20260709 12:59:20.124341   952 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49972
I20260709 12:59:20.128307   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:59:20.132149  1165 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:20.133477   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:59:20.133854   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/ts-2-root
uuid: "9de0c5ee31ba4432976a654b0c837914"
format_stamp: "Formatted at 2026-07-09 12:59:20 on dist-test-slave-zhw8"
I20260709 12:59:20.134164   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601945298557-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:20.149436   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:20.150614   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:20.152158   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:20.154349   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:20.154567   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:20.154821   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:20.154992   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:20.199167   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:44281
I20260709 12:59:20.199363  1227 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:44281 every 8 connection(s)
I20260709 12:59:20.214356  1228 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34711
I20260709 12:59:20.214792  1228 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:20.215680  1228 heartbeater.cc:507] Master 127.0.107.254:34711 requested a full tablet report, sending...
I20260709 12:59:20.217568   952 ts_manager.cc:194] Registered new tserver with Master: 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:20.218506   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015973333s
I20260709 12:59:20.218900   952 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49984
I20260709 12:59:20.247831   952 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49994:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:59:20.250720   952 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:59:20.322043  1193 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5e6b264ca0483487cf70a17124fd0d (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:20.322260  1192 tablet_service.cc:1511] Processing CreateTablet for tablet 17bbc270845440a08fc015ee0eb7641e (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:20.323621  1193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5e6b264ca0483487cf70a17124fd0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.324257  1192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17bbc270845440a08fc015ee0eb7641e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.328369  1191 tablet_service.cc:1511] Processing CreateTablet for tablet f84ad721a02348c5ac46c5a4fec2869e (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:20.329712  1191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f84ad721a02348c5ac46c5a4fec2869e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.334831  1190 tablet_service.cc:1511] Processing CreateTablet for tablet f62167d118ce404baba1bff12e001183 (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:20.336294  1190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62167d118ce404baba1bff12e001183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.340394  1119 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5e6b264ca0483487cf70a17124fd0d (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:20.340299  1116 tablet_service.cc:1511] Processing CreateTablet for tablet f62167d118ce404baba1bff12e001183 (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:20.343027  1118 tablet_service.cc:1511] Processing CreateTablet for tablet 17bbc270845440a08fc015ee0eb7641e (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:20.345188  1117 tablet_service.cc:1511] Processing CreateTablet for tablet f84ad721a02348c5ac46c5a4fec2869e (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:20.346838  1115 tablet_service.cc:1511] Processing CreateTablet for tablet bf8b6f826968464bb649cbc3ca6ce5fa (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:20.348337  1189 tablet_service.cc:1511] Processing CreateTablet for tablet bf8b6f826968464bb649cbc3ca6ce5fa (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:20.349637  1189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf8b6f826968464bb649cbc3ca6ce5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.350931  1113 tablet_service.cc:1511] Processing CreateTablet for tablet ea077c7afddc4a31a03bdba1dce16279 (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:20.352371  1188 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec50ac7ed5f4812b8c29213a0b30a34 (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:20.353642  1188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec50ac7ed5f4812b8c29213a0b30a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.356439  1114 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec50ac7ed5f4812b8c29213a0b30a34 (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:20.359666  1187 tablet_service.cc:1511] Processing CreateTablet for tablet ea077c7afddc4a31a03bdba1dce16279 (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:20.360080  1112 tablet_service.cc:1511] Processing CreateTablet for tablet ecd65356a26d418e8779c157010c56d4 (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:20.361035  1187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea077c7afddc4a31a03bdba1dce16279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.341722  1119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5e6b264ca0483487cf70a17124fd0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.364557  1186 tablet_service.cc:1511] Processing CreateTablet for tablet ecd65356a26d418e8779c157010c56d4 (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:20.372538  1111 tablet_service.cc:1511] Processing CreateTablet for tablet a7fc24e938dd48309b6db90da4e90eea (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:20.377662  1185 tablet_service.cc:1511] Processing CreateTablet for tablet a7fc24e938dd48309b6db90da4e90eea (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:20.381352  1110 tablet_service.cc:1511] Processing CreateTablet for tablet 2ce3bb32182b48dfb5c0e8c3e7c967a2 (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:20.378772  1117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f84ad721a02348c5ac46c5a4fec2869e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.393651  1113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea077c7afddc4a31a03bdba1dce16279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.394754  1186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd65356a26d418e8779c157010c56d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.392832  1184 tablet_service.cc:1511] Processing CreateTablet for tablet 2ce3bb32182b48dfb5c0e8c3e7c967a2 (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:20.398519  1185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7fc24e938dd48309b6db90da4e90eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.402324  1184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ce3bb32182b48dfb5c0e8c3e7c967a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.403390  1115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf8b6f826968464bb649cbc3ca6ce5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.405802  1118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17bbc270845440a08fc015ee0eb7641e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.406468  1044 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5e6b264ca0483487cf70a17124fd0d (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:20.408406  1043 tablet_service.cc:1511] Processing CreateTablet for tablet 17bbc270845440a08fc015ee0eb7641e (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:20.409729  1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17bbc270845440a08fc015ee0eb7641e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.412308  1110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ce3bb32182b48dfb5c0e8c3e7c967a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.415364  1114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec50ac7ed5f4812b8c29213a0b30a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.415192  1041 tablet_service.cc:1511] Processing CreateTablet for tablet f62167d118ce404baba1bff12e001183 (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:20.424090  1035 tablet_service.cc:1511] Processing CreateTablet for tablet 2ce3bb32182b48dfb5c0e8c3e7c967a2 (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:20.424805  1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5e6b264ca0483487cf70a17124fd0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.416365  1040 tablet_service.cc:1511] Processing CreateTablet for tablet bf8b6f826968464bb649cbc3ca6ce5fa (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:20.428304  1116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62167d118ce404baba1bff12e001183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.417420  1039 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec50ac7ed5f4812b8c29213a0b30a34 (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:20.418535  1038 tablet_service.cc:1511] Processing CreateTablet for tablet ea077c7afddc4a31a03bdba1dce16279 (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:20.428557  1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ce3bb32182b48dfb5c0e8c3e7c967a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.431445  1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62167d118ce404baba1bff12e001183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.419710  1037 tablet_service.cc:1511] Processing CreateTablet for tablet ecd65356a26d418e8779c157010c56d4 (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:20.433322  1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd65356a26d418e8779c157010c56d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.422094  1036 tablet_service.cc:1511] Processing CreateTablet for tablet a7fc24e938dd48309b6db90da4e90eea (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:20.435835  1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7fc24e938dd48309b6db90da4e90eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.420928  1042 tablet_service.cc:1511] Processing CreateTablet for tablet f84ad721a02348c5ac46c5a4fec2869e (DEFAULT_TABLE table=test-workload [id=6c7b51e26ea1420f8d3d5a80f42d0fb4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:20.438933  1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f84ad721a02348c5ac46c5a4fec2869e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.440579  1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec50ac7ed5f4812b8c29213a0b30a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.442170  1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea077c7afddc4a31a03bdba1dce16279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.443065  1243 tablet_bootstrap.cc:492] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914: Bootstrap starting.
I20260709 12:59:20.447561  1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf8b6f826968464bb649cbc3ca6ce5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.471547  1112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd65356a26d418e8779c157010c56d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.487555  1111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7fc24e938dd48309b6db90da4e90eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.491295  1243 tablet_bootstrap.cc:654] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.535991  1244 tablet_bootstrap.cc:492] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057: Bootstrap starting.
I20260709 12:59:20.554267  1245 tablet_bootstrap.cc:492] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6: Bootstrap starting.
I20260709 12:59:20.561331  1245 tablet_bootstrap.cc:654] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.562008  1243 tablet_bootstrap.cc:492] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914: No bootstrap required, opened a new log
I20260709 12:59:20.563340  1243 ts_tablet_manager.cc:1403] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914: Time spent bootstrapping tablet: real 0.121s	user 0.012s	sys 0.004s
I20260709 12:59:20.565358  1244 tablet_bootstrap.cc:654] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.566915  1243 raft_consensus.cc:359] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.570096  1243 raft_consensus.cc:385] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.570595  1243 raft_consensus.cc:740] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.571907  1243 consensus_queue.cc:260] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.575937  1249 raft_consensus.cc:493] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.576143  1228 heartbeater.cc:499] Master 127.0.107.254:34711 was elected leader, sending a full tablet report...
I20260709 12:59:20.576668  1249 raft_consensus.cc:515] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.600170  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17bbc270845440a08fc015ee0eb7641e" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057" is_pre_election: true
W20260709 12:59:20.602537  1167 leader_election.cc:343] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:20.604383  1249 leader_election.cc:290] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:20.580999  1243 ts_tablet_manager.cc:1434] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:59:20.607038  1243 tablet_bootstrap.cc:492] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914: Bootstrap starting.
I20260709 12:59:20.614583  1244 tablet_bootstrap.cc:492] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057: No bootstrap required, opened a new log
I20260709 12:59:20.614567  1245 tablet_bootstrap.cc:492] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6: No bootstrap required, opened a new log
I20260709 12:59:20.616000  1244 ts_tablet_manager.cc:1403] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057: Time spent bootstrapping tablet: real 0.080s	user 0.026s	sys 0.028s
I20260709 12:59:20.616137  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17bbc270845440a08fc015ee0eb7641e" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6" is_pre_election: true
I20260709 12:59:20.616513  1245 ts_tablet_manager.cc:1403] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6: Time spent bootstrapping tablet: real 0.063s	user 0.032s	sys 0.025s
W20260709 12:59:20.617775  1168 leader_election.cc:343] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:20.619078  1168 leader_election.cc:304] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9de0c5ee31ba4432976a654b0c837914; no voters: 36a001d95f2d438fab687f9da249a057, a0f4aa692e0a444283f0c59f4be948c6
I20260709 12:59:20.619737  1245 raft_consensus.cc:359] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.620213  1249 raft_consensus.cc:2749] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:20.620581  1245 raft_consensus.cc:385] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.620122  1244 raft_consensus.cc:359] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:20.621033  1245 raft_consensus.cc:740] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.621192  1244 raft_consensus.cc:385] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.621636  1244 raft_consensus.cc:740] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.621798  1243 tablet_bootstrap.cc:654] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.622145  1245 consensus_queue.cc:260] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.622476  1244 consensus_queue.cc:260] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:20.629932  1243 tablet_bootstrap.cc:492] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914: No bootstrap required, opened a new log
I20260709 12:59:20.630671  1243 ts_tablet_manager.cc:1403] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.000s
I20260709 12:59:20.635043  1243 raft_consensus.cc:359] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.636116  1243 raft_consensus.cc:385] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.636543  1243 raft_consensus.cc:740] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.636771  1079 heartbeater.cc:499] Master 127.0.107.254:34711 was elected leader, sending a full tablet report...
I20260709 12:59:20.637655  1154 heartbeater.cc:499] Master 127.0.107.254:34711 was elected leader, sending a full tablet report...
I20260709 12:59:20.638104  1244 ts_tablet_manager.cc:1434] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.012s
I20260709 12:59:20.638973  1244 tablet_bootstrap.cc:492] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057: Bootstrap starting.
I20260709 12:59:20.639416  1243 consensus_queue.cc:260] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.644146  1243 ts_tablet_manager.cc:1434] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:59:20.645035  1245 ts_tablet_manager.cc:1434] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.012s
I20260709 12:59:20.645148  1243 tablet_bootstrap.cc:492] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914: Bootstrap starting.
I20260709 12:59:20.645889  1245 tablet_bootstrap.cc:492] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6: Bootstrap starting.
I20260709 12:59:20.648428  1244 tablet_bootstrap.cc:654] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.652055  1243 tablet_bootstrap.cc:654] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.652670  1245 tablet_bootstrap.cc:654] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.660647  1244 tablet_bootstrap.cc:492] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057: No bootstrap required, opened a new log
I20260709 12:59:20.661377  1244 ts_tablet_manager.cc:1403] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.014s
I20260709 12:59:20.664667  1243 tablet_bootstrap.cc:492] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914: No bootstrap required, opened a new log
I20260709 12:59:20.664515  1244 raft_consensus.cc:359] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.665280  1243 ts_tablet_manager.cc:1403] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.006s
I20260709 12:59:20.665975  1253 raft_consensus.cc:493] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.666538  1249 raft_consensus.cc:493] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.666471  1253 raft_consensus.cc:515] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:20.667012  1249 raft_consensus.cc:515] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.669116  1249 leader_election.cc:290] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:20.665221  1244 raft_consensus.cc:385] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.670221  1253 leader_election.cc:290] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281), a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081)
I20260709 12:59:20.677330  1252 raft_consensus.cc:493] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.670323  1244 raft_consensus.cc:740] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.683199  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8b6f826968464bb649cbc3ca6ce5fa" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6" is_pre_election: true
I20260709 12:59:20.683766  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8b6f826968464bb649cbc3ca6ce5fa" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057" is_pre_election: true
I20260709 12:59:20.684528  1244 consensus_queue.cc:260] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.685320  1129 raft_consensus.cc:2468] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 0.
W20260709 12:59:20.685498  1168 leader_election.cc:343] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:20.681874  1252 raft_consensus.cc:515] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.688750  1167 leader_election.cc:304] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, 9de0c5ee31ba4432976a654b0c837914; no voters: a0f4aa692e0a444283f0c59f4be948c6
I20260709 12:59:20.689949  1249 raft_consensus.cc:2804] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:20.690315  1249 raft_consensus.cc:493] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.690653  1249 raft_consensus.cc:3060] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:20.688623  1244 ts_tablet_manager.cc:1434] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.001s
I20260709 12:59:20.699503  1252 leader_election.cc:290] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:20.707828  1249 raft_consensus.cc:515] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.710155  1244 tablet_bootstrap.cc:492] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057: Bootstrap starting.
I20260709 12:59:20.714641  1243 raft_consensus.cc:359] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.715796  1245 tablet_bootstrap.cc:492] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6: No bootstrap required, opened a new log
I20260709 12:59:20.715886  1243 raft_consensus.cc:385] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.715845  1249 leader_election.cc:290] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 election: Requested vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:20.716423  1245 ts_tablet_manager.cc:1403] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.016s
I20260709 12:59:20.716468  1243 raft_consensus.cc:740] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.719575  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6" is_pre_election: true
I20260709 12:59:20.720382  1245 raft_consensus.cc:359] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.721065  1245 raft_consensus.cc:385] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:59:20.721231  1094 leader_election.cc:343] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:20.721407  1245 raft_consensus.cc:740] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.722461  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8b6f826968464bb649cbc3ca6ce5fa" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:20.722373  1245 consensus_queue.cc:260] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.723130  1129 raft_consensus.cc:3060] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:20.723196  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8b6f826968464bb649cbc3ca6ce5fa" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
I20260709 12:59:20.723869  1244 tablet_bootstrap.cc:654] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:20.724675  1168 leader_election.cc:343] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:20.724864  1245 ts_tablet_manager.cc:1434] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:59:20.725687  1245 tablet_bootstrap.cc:492] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6: Bootstrap starting.
I20260709 12:59:20.727807  1243 consensus_queue.cc:260] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.732651  1243 ts_tablet_manager.cc:1434] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.000s
I20260709 12:59:20.733685  1243 tablet_bootstrap.cc:492] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914: Bootstrap starting.
I20260709 12:59:20.744042  1245 tablet_bootstrap.cc:654] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.745481  1243 tablet_bootstrap.cc:654] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.751606  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914" is_pre_election: true
W20260709 12:59:20.754243  1092 leader_election.cc:343] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:20.754738  1092 leader_election.cc:304] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36a001d95f2d438fab687f9da249a057; no voters: 9de0c5ee31ba4432976a654b0c837914, a0f4aa692e0a444283f0c59f4be948c6
I20260709 12:59:20.755376  1129 raft_consensus.cc:2468] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 1.
I20260709 12:59:20.756244  1253 raft_consensus.cc:2749] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:20.756553  1167 leader_election.cc:304] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, 9de0c5ee31ba4432976a654b0c837914; no voters: a0f4aa692e0a444283f0c59f4be948c6
I20260709 12:59:20.757611  1249 raft_consensus.cc:2804] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:20.758082  1249 raft_consensus.cc:697] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 1 LEADER]: Becoming Leader. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Running, Role: LEADER
I20260709 12:59:20.752553  1244 tablet_bootstrap.cc:492] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057: No bootstrap required, opened a new log
I20260709 12:59:20.759502  1249 consensus_queue.cc:237] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.763325  1244 ts_tablet_manager.cc:1403] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.018s
I20260709 12:59:20.765921  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62167d118ce404baba1bff12e001183" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057" is_pre_election: true
I20260709 12:59:20.767491  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62167d118ce404baba1bff12e001183" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914" is_pre_election: true
W20260709 12:59:20.768798  1017 leader_election.cc:343] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:20.770609  1244 raft_consensus.cc:359] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.771390  1244 raft_consensus.cc:385] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:59:20.771493  1018 leader_election.cc:343] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:20.771773  1244 raft_consensus.cc:740] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.771937  1018 leader_election.cc:304] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f4aa692e0a444283f0c59f4be948c6; no voters: 36a001d95f2d438fab687f9da249a057, 9de0c5ee31ba4432976a654b0c837914
I20260709 12:59:20.772697  1244 consensus_queue.cc:260] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.774819  1244 ts_tablet_manager.cc:1434] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.004s
I20260709 12:59:20.775840  1244 tablet_bootstrap.cc:492] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057: Bootstrap starting.
I20260709 12:59:20.775848  1252 raft_consensus.cc:2749] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:20.782728  1244 tablet_bootstrap.cc:654] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.791867  1245 tablet_bootstrap.cc:492] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6: No bootstrap required, opened a new log
I20260709 12:59:20.792445  1245 ts_tablet_manager.cc:1403] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.011s
I20260709 12:59:20.794695  1243 tablet_bootstrap.cc:492] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914: No bootstrap required, opened a new log
I20260709 12:59:20.795163  1243 ts_tablet_manager.cc:1403] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.018s
I20260709 12:59:20.794981  1245 raft_consensus.cc:359] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.795953  1245 raft_consensus.cc:385] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.796324  1245 raft_consensus.cc:740] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.797192  1245 consensus_queue.cc:260] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.798694  1243 raft_consensus.cc:359] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:20.799408  1243 raft_consensus.cc:385] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.800091  1243 raft_consensus.cc:740] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.800797  1243 consensus_queue.cc:260] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:20.803987  1243 ts_tablet_manager.cc:1434] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:59:20.804818  1244 tablet_bootstrap.cc:492] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057: No bootstrap required, opened a new log
I20260709 12:59:20.805001  1243 tablet_bootstrap.cc:492] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914: Bootstrap starting.
I20260709 12:59:20.805339  1244 ts_tablet_manager.cc:1403] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.010s
I20260709 12:59:20.801144  1245 ts_tablet_manager.cc:1434] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:59:20.806445  1245 tablet_bootstrap.cc:492] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6: Bootstrap starting.
I20260709 12:59:20.806644   952 catalog_manager.cc:5697] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "9de0c5ee31ba4432976a654b0c837914" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:20.808259  1244 raft_consensus.cc:359] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.808921  1244 raft_consensus.cc:385] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.809238  1244 raft_consensus.cc:740] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.810122  1244 consensus_queue.cc:260] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.812635  1244 ts_tablet_manager.cc:1434] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 12:59:20.813689  1244 tablet_bootstrap.cc:492] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057: Bootstrap starting.
W20260709 12:59:20.816114  1000 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:20.821139  1243 tablet_bootstrap.cc:654] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.822283  1244 tablet_bootstrap.cc:654] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.821851  1245 tablet_bootstrap.cc:654] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.828406  1244 tablet_bootstrap.cc:492] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057: No bootstrap required, opened a new log
I20260709 12:59:20.829141  1244 ts_tablet_manager.cc:1403] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057: Time spent bootstrapping tablet: real 0.016s	user 0.004s	sys 0.010s
I20260709 12:59:20.832602  1244 raft_consensus.cc:359] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.833405  1244 raft_consensus.cc:385] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.833767  1244 raft_consensus.cc:740] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.834138  1245 tablet_bootstrap.cc:492] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6: No bootstrap required, opened a new log
I20260709 12:59:20.834674  1245 ts_tablet_manager.cc:1403] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.004s
I20260709 12:59:20.834674  1244 consensus_queue.cc:260] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.836915  1243 tablet_bootstrap.cc:492] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914: No bootstrap required, opened a new log
I20260709 12:59:20.837289  1244 ts_tablet_manager.cc:1434] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:59:20.837416  1243 ts_tablet_manager.cc:1403] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.002s
I20260709 12:59:20.840015  1244 tablet_bootstrap.cc:492] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057: Bootstrap starting.
I20260709 12:59:20.840292  1243 raft_consensus.cc:359] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.841090  1243 raft_consensus.cc:385] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.838086  1245 raft_consensus.cc:359] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.841888  1245 raft_consensus.cc:385] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.841773  1243 raft_consensus.cc:740] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.842360  1245 raft_consensus.cc:740] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.843088  1243 consensus_queue.cc:260] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.843286  1245 consensus_queue.cc:260] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.846028  1243 ts_tablet_manager.cc:1434] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:59:20.847142  1243 tablet_bootstrap.cc:492] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914: Bootstrap starting.
I20260709 12:59:20.847746  1244 tablet_bootstrap.cc:654] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.848951  1249 raft_consensus.cc:493] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.849436  1249 raft_consensus.cc:515] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.851840  1249 leader_election.cc:290] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:20.852490  1245 ts_tablet_manager.cc:1434] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:59:20.855173  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc24e938dd48309b6db90da4e90eea" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057" is_pre_election: true
I20260709 12:59:20.856269  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc24e938dd48309b6db90da4e90eea" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6" is_pre_election: true
I20260709 12:59:20.856794  1245 tablet_bootstrap.cc:492] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6: Bootstrap starting.
W20260709 12:59:20.856730  1167 leader_election.cc:343] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:20.857124  1054 raft_consensus.cc:2468] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 0.
I20260709 12:59:20.858847  1168 leader_election.cc:304] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9de0c5ee31ba4432976a654b0c837914, a0f4aa692e0a444283f0c59f4be948c6; no voters: 36a001d95f2d438fab687f9da249a057
I20260709 12:59:20.863467  1249 raft_consensus.cc:2804] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:20.865978  1249 raft_consensus.cc:493] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.864521  1245 tablet_bootstrap.cc:654] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.866617  1249 raft_consensus.cc:3060] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:20.877934  1243 tablet_bootstrap.cc:654] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.878063  1245 tablet_bootstrap.cc:492] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6: No bootstrap required, opened a new log
I20260709 12:59:20.877429  1249 raft_consensus.cc:515] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.878682  1245 ts_tablet_manager.cc:1403] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 12:59:20.881714  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc24e938dd48309b6db90da4e90eea" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
I20260709 12:59:20.882308  1054 raft_consensus.cc:3060] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:20.881824  1245 raft_consensus.cc:359] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.882818  1245 raft_consensus.cc:385] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.883209  1245 raft_consensus.cc:740] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.883831  1244 tablet_bootstrap.cc:492] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057: No bootstrap required, opened a new log
I20260709 12:59:20.884348  1244 ts_tablet_manager.cc:1403] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.021s
I20260709 12:59:20.884179  1245 consensus_queue.cc:260] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.887691  1244 raft_consensus.cc:359] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.888535  1244 raft_consensus.cc:385] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.888929  1244 raft_consensus.cc:740] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.889887  1244 consensus_queue.cc:260] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.890287  1054 raft_consensus.cc:2468] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 1.
I20260709 12:59:20.892472  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc24e938dd48309b6db90da4e90eea" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:20.894402  1168 leader_election.cc:304] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9de0c5ee31ba4432976a654b0c837914, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:20.895500  1250 raft_consensus.cc:2804] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:20.895769  1244 ts_tablet_manager.cc:1434] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.006s
I20260709 12:59:20.896889  1244 tablet_bootstrap.cc:492] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057: Bootstrap starting.
W20260709 12:59:20.897045  1167 leader_election.cc:343] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:20.902637  1249 leader_election.cc:290] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 election: Requested vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:20.906845  1244 tablet_bootstrap.cc:654] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.911098  1245 ts_tablet_manager.cc:1434] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.004s
I20260709 12:59:20.912282  1245 tablet_bootstrap.cc:492] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P a0f4aa692e0a444283f0c59f4be948c6: Bootstrap starting.
I20260709 12:59:20.915946  1250 raft_consensus.cc:697] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 1 LEADER]: Becoming Leader. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Running, Role: LEADER
I20260709 12:59:20.917340  1244 tablet_bootstrap.cc:492] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057: No bootstrap required, opened a new log
I20260709 12:59:20.917024  1250 consensus_queue.cc:237] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.917999  1244 ts_tablet_manager.cc:1403] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 12:59:20.922049  1252 raft_consensus.cc:493] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.921875  1244 raft_consensus.cc:359] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.922655  1252 raft_consensus.cc:515] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.923020  1244 raft_consensus.cc:385] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.923576  1244 raft_consensus.cc:740] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.925058  1252 leader_election.cc:290] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:20.924664  1244 consensus_queue.cc:260] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.927767  1244 ts_tablet_manager.cc:1434] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:59:20.927016  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd65356a26d418e8779c157010c56d4" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057" is_pre_election: true
I20260709 12:59:20.928398  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd65356a26d418e8779c157010c56d4" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914" is_pre_election: true
I20260709 12:59:20.928855  1244 tablet_bootstrap.cc:492] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057: Bootstrap starting.
W20260709 12:59:20.929550  1018 leader_election.cc:343] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:20.930197  1017 leader_election.cc:343] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:20.930676  1017 leader_election.cc:304] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f4aa692e0a444283f0c59f4be948c6; no voters: 36a001d95f2d438fab687f9da249a057, 9de0c5ee31ba4432976a654b0c837914
I20260709 12:59:20.932135  1252 raft_consensus.cc:493] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.932719  1252 raft_consensus.cc:515] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.936129  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17bbc270845440a08fc015ee0eb7641e" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057" is_pre_election: true
I20260709 12:59:20.936878  1129 raft_consensus.cc:2468] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 0.
I20260709 12:59:20.937377  1244 tablet_bootstrap.cc:654] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.938568  1018 leader_election.cc:304] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:20.941672  1252 leader_election.cc:290] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:20.942589  1252 raft_consensus.cc:2749] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:20.942965  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17bbc270845440a08fc015ee0eb7641e" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914" is_pre_election: true
I20260709 12:59:20.943926  1203 raft_consensus.cc:2468] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 0.
I20260709 12:59:20.944254  1252 raft_consensus.cc:2804] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:20.944826  1252 raft_consensus.cc:493] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.945226  1252 raft_consensus.cc:3060] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:20.951134  1253 raft_consensus.cc:493] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.951859  1253 raft_consensus.cc:515] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.954051  1245 tablet_bootstrap.cc:654] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P a0f4aa692e0a444283f0c59f4be948c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.951897   952 catalog_manager.cc:5697] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "9de0c5ee31ba4432976a654b0c837914" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:20.955986  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ce3bb32182b48dfb5c0e8c3e7c967a2" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6" is_pre_election: true
W20260709 12:59:20.957865  1094 leader_election.cc:343] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:20.958328  1250 raft_consensus.cc:493] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.959092  1253 leader_election.cc:290] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:20.958830  1250 raft_consensus.cc:515] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:20.961104  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ce3bb32182b48dfb5c0e8c3e7c967a2" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914" is_pre_election: true
W20260709 12:59:20.962850  1092 leader_election.cc:343] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:20.963424  1092 leader_election.cc:304] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36a001d95f2d438fab687f9da249a057; no voters: 9de0c5ee31ba4432976a654b0c837914, a0f4aa692e0a444283f0c59f4be948c6
I20260709 12:59:20.964656  1253 raft_consensus.cc:2749] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:20.966610  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057" is_pre_election: true
I20260709 12:59:20.967170  1250 leader_election.cc:290] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:20.967257  1129 raft_consensus.cc:2468] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 0.
I20260709 12:59:20.968434  1167 leader_election.cc:304] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, 9de0c5ee31ba4432976a654b0c837914; no voters: 
I20260709 12:59:20.970232  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6" is_pre_election: true
I20260709 12:59:20.970624  1250 raft_consensus.cc:2804] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:20.971082  1250 raft_consensus.cc:493] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.971503  1250 raft_consensus.cc:3060] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:20.972689  1244 tablet_bootstrap.cc:492] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057: No bootstrap required, opened a new log
I20260709 12:59:20.972692  1243 tablet_bootstrap.cc:492] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914: No bootstrap required, opened a new log
W20260709 12:59:20.973026  1168 leader_election.cc:343] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:20.973265  1244 ts_tablet_manager.cc:1403] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.016s
I20260709 12:59:20.973311  1243 ts_tablet_manager.cc:1403] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914: Time spent bootstrapping tablet: real 0.126s	user 0.027s	sys 0.041s
I20260709 12:59:20.976095  1244 raft_consensus.cc:359] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.976760  1244 raft_consensus.cc:385] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.977061  1244 raft_consensus.cc:740] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.977823  1244 consensus_queue.cc:260] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.979058  1243 raft_consensus.cc:359] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.979768  1243 raft_consensus.cc:385] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.980091  1243 raft_consensus.cc:740] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.980902  1243 consensus_queue.cc:260] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:20.983074  1244 ts_tablet_manager.cc:1434] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 12:59:20.984120  1244 tablet_bootstrap.cc:492] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057: Bootstrap starting.
I20260709 12:59:20.987488  1243 ts_tablet_manager.cc:1434] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 12:59:20.988739  1243 tablet_bootstrap.cc:492] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914: Bootstrap starting.
I20260709 12:59:20.994343  1244 tablet_bootstrap.cc:654] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:21.001102  1243 tablet_bootstrap.cc:654] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:21.015750  1243 tablet_bootstrap.cc:492] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914: No bootstrap required, opened a new log
I20260709 12:59:21.016426  1243 ts_tablet_manager.cc:1403] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.003s
I20260709 12:59:21.017922  1245 tablet_bootstrap.cc:492] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P a0f4aa692e0a444283f0c59f4be948c6: No bootstrap required, opened a new log
I20260709 12:59:21.018457  1245 ts_tablet_manager.cc:1403] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P a0f4aa692e0a444283f0c59f4be948c6: Time spent bootstrapping tablet: real 0.106s	user 0.021s	sys 0.031s
I20260709 12:59:21.020167  1243 raft_consensus.cc:359] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.021148  1243 raft_consensus.cc:385] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:21.021507  1243 raft_consensus.cc:740] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Initialized, Role: FOLLOWER
I20260709 12:59:21.022006  1245 raft_consensus.cc:359] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.022751  1245 raft_consensus.cc:385] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:21.022265  1243 consensus_queue.cc:260] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.023036  1245 raft_consensus.cc:740] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:21.023774  1244 tablet_bootstrap.cc:492] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057: No bootstrap required, opened a new log
I20260709 12:59:21.024204  1244 ts_tablet_manager.cc:1403] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.013s
I20260709 12:59:21.024243  1245 consensus_queue.cc:260] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P a0f4aa692e0a444283f0c59f4be948c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.026325  1243 ts_tablet_manager.cc:1434] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:59:21.026854  1253 raft_consensus.cc:493] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.027050  1244 raft_consensus.cc:359] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.027549  1253 raft_consensus.cc:515] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.028252  1244 raft_consensus.cc:385] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:21.028573  1244 raft_consensus.cc:740] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Initialized, Role: FOLLOWER
I20260709 12:59:21.029387  1244 consensus_queue.cc:260] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.029961  1253 leader_election.cc:290] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:21.031600  1245 ts_tablet_manager.cc:1434] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P a0f4aa692e0a444283f0c59f4be948c6: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:59:21.032083  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea077c7afddc4a31a03bdba1dce16279" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6" is_pre_election: true
I20260709 12:59:21.032950  1245 tablet_bootstrap.cc:492] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6: Bootstrap starting.
I20260709 12:59:21.032780  1054 raft_consensus.cc:2468] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 0.
I20260709 12:59:21.034861  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea077c7afddc4a31a03bdba1dce16279" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914" is_pre_election: true
I20260709 12:59:21.035938  1250 raft_consensus.cc:515] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
W20260709 12:59:21.036481  1092 leader_election.cc:343] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:21.037676  1094 leader_election.cc:304] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, a0f4aa692e0a444283f0c59f4be948c6; no voters: 9de0c5ee31ba4432976a654b0c837914
I20260709 12:59:21.032644  1252 raft_consensus.cc:515] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.039366  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
I20260709 12:59:21.039778  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:21.040285  1129 raft_consensus.cc:3060] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.042682  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17bbc270845440a08fc015ee0eb7641e" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
W20260709 12:59:21.043706  1168 leader_election.cc:343] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:21.043952  1203 raft_consensus.cc:3060] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.045450  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17bbc270845440a08fc015ee0eb7641e" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:21.046142  1128 raft_consensus.cc:3060] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.047444  1252 leader_election.cc:290] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 election: Requested vote from peers 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:21.050460  1245 tablet_bootstrap.cc:654] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:21.050414  1250 leader_election.cc:290] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 election: Requested vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:21.051304  1253 raft_consensus.cc:2804] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:21.051724  1253 raft_consensus.cc:493] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.052078  1253 raft_consensus.cc:3060] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.058146  1245 tablet_bootstrap.cc:492] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6: No bootstrap required, opened a new log
I20260709 12:59:21.058455  1243 tablet_bootstrap.cc:492] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914: Bootstrap starting.
I20260709 12:59:21.058832  1245 ts_tablet_manager.cc:1403] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6: Time spent bootstrapping tablet: real 0.026s	user 0.003s	sys 0.010s
I20260709 12:59:21.063350  1245 raft_consensus.cc:359] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:21.064479  1245 raft_consensus.cc:385] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:21.065065  1243 tablet_bootstrap.cc:654] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:21.064926  1245 raft_consensus.cc:740] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:21.066278  1245 consensus_queue.cc:260] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:21.068926  1244 ts_tablet_manager.cc:1434] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.021s
I20260709 12:59:21.069046  1245 ts_tablet_manager.cc:1434] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:59:21.070602  1245 tablet_bootstrap.cc:492] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6: Bootstrap starting.
I20260709 12:59:21.077898  1244 tablet_bootstrap.cc:492] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057: Bootstrap starting.
I20260709 12:59:21.078017  1245 tablet_bootstrap.cc:654] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:21.085057  1244 tablet_bootstrap.cc:654] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:21.089138  1245 tablet_bootstrap.cc:492] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6: No bootstrap required, opened a new log
I20260709 12:59:21.089659  1243 tablet_bootstrap.cc:492] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914: No bootstrap required, opened a new log
I20260709 12:59:21.089660  1245 ts_tablet_manager.cc:1403] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:59:21.090209  1243 ts_tablet_manager.cc:1403] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.011s
I20260709 12:59:21.091346  1244 tablet_bootstrap.cc:492] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057: No bootstrap required, opened a new log
I20260709 12:59:21.091776  1244 ts_tablet_manager.cc:1403] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:59:21.092268  1245 raft_consensus.cc:359] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.092785  1245 raft_consensus.cc:385] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:21.093027  1245 raft_consensus.cc:740] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:21.093570  1243 raft_consensus.cc:359] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.093643  1245 consensus_queue.cc:260] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.094287  1243 raft_consensus.cc:385] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:21.094120  1244 raft_consensus.cc:359] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.094616  1243 raft_consensus.cc:740] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Initialized, Role: FOLLOWER
I20260709 12:59:21.094784  1244 raft_consensus.cc:385] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:21.095042  1244 raft_consensus.cc:740] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Initialized, Role: FOLLOWER
I20260709 12:59:21.095731  1245 ts_tablet_manager.cc:1434] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:59:21.095314  1243 consensus_queue.cc:260] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.095835  1244 consensus_queue.cc:260] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.097342  1243 ts_tablet_manager.cc:1434] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:59:21.098240  1243 tablet_bootstrap.cc:492] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914: Bootstrap starting.
I20260709 12:59:21.099972  1245 tablet_bootstrap.cc:492] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6: Bootstrap starting.
I20260709 12:59:21.101738  1244 ts_tablet_manager.cc:1434] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:59:21.106127  1245 tablet_bootstrap.cc:654] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:21.109805  1252 raft_consensus.cc:493] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.110466  1252 raft_consensus.cc:515] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:21.106200  1243 tablet_bootstrap.cc:654] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:21.118511  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914" is_pre_election: true
I20260709 12:59:21.124284  1202 raft_consensus.cc:2393] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f4aa692e0a444283f0c59f4be948c6 in current term 1: Already voted for candidate 9de0c5ee31ba4432976a654b0c837914 in this term.
I20260709 12:59:21.126163  1252 leader_election.cc:290] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:21.126459  1243 tablet_bootstrap.cc:492] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914: No bootstrap required, opened a new log
I20260709 12:59:21.127048  1243 ts_tablet_manager.cc:1403] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.006s
I20260709 12:59:21.127794  1129 raft_consensus.cc:2468] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 1.
I20260709 12:59:21.128680  1203 raft_consensus.cc:2468] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 1.
I20260709 12:59:21.129997  1243 raft_consensus.cc:359] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.130755  1243 raft_consensus.cc:385] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:21.123008  1286 raft_consensus.cc:493] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.131073  1243 raft_consensus.cc:740] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Initialized, Role: FOLLOWER
I20260709 12:59:21.131428  1286 raft_consensus.cc:515] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.131963  1243 consensus_queue.cc:260] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.133695  1286 leader_election.cc:290] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:21.133778  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057" is_pre_election: true
I20260709 12:59:21.134028  1243 ts_tablet_manager.cc:1434] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:59:21.134676  1127 raft_consensus.cc:2393] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f4aa692e0a444283f0c59f4be948c6 in current term 1: Already voted for candidate 9de0c5ee31ba4432976a654b0c837914 in this term.
I20260709 12:59:21.134779  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc24e938dd48309b6db90da4e90eea" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6" is_pre_election: true
I20260709 12:59:21.135133  1243 tablet_bootstrap.cc:492] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914: Bootstrap starting.
I20260709 12:59:21.135754  1054 raft_consensus.cc:2393] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36a001d95f2d438fab687f9da249a057 in current term 1: Already voted for candidate 9de0c5ee31ba4432976a654b0c837914 in this term.
I20260709 12:59:21.137036  1017 leader_election.cc:304] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9de0c5ee31ba4432976a654b0c837914, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:21.137964  1252 raft_consensus.cc:2804] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:21.138527  1252 raft_consensus.cc:697] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 1 LEADER]: Becoming Leader. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Running, Role: LEADER
I20260709 12:59:21.139632  1167 leader_election.cc:304] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, 9de0c5ee31ba4432976a654b0c837914; no voters: a0f4aa692e0a444283f0c59f4be948c6
I20260709 12:59:21.139477  1252 consensus_queue.cc:237] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.140973  1250 raft_consensus.cc:2804] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:21.141498  1250 raft_consensus.cc:697] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 1 LEADER]: Becoming Leader. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Running, Role: LEADER
I20260709 12:59:21.142163  1243 tablet_bootstrap.cc:654] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:21.142555  1018 leader_election.cc:304] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f4aa692e0a444283f0c59f4be948c6; no voters: 36a001d95f2d438fab687f9da249a057, 9de0c5ee31ba4432976a654b0c837914
I20260709 12:59:21.142393  1250 consensus_queue.cc:237] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:21.144639  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc24e938dd48309b6db90da4e90eea" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914" is_pre_election: true
I20260709 12:59:21.143522  1281 raft_consensus.cc:3060] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.148447  1092 leader_election.cc:304] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36a001d95f2d438fab687f9da249a057; no voters: 9de0c5ee31ba4432976a654b0c837914, a0f4aa692e0a444283f0c59f4be948c6
I20260709 12:59:21.149983  1286 raft_consensus.cc:3060] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.154937  1295 raft_consensus.cc:493] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.155186  1245 tablet_bootstrap.cc:492] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6: No bootstrap required, opened a new log
I20260709 12:59:21.155625  1245 ts_tablet_manager.cc:1403] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.018s
I20260709 12:59:21.155462  1295 raft_consensus.cc:515] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.158279  1245 raft_consensus.cc:359] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.158810  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914" is_pre_election: true
I20260709 12:59:21.158906  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6" is_pre_election: true
I20260709 12:59:21.159447  1203 raft_consensus.cc:2468] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 0.
I20260709 12:59:21.160774  1092 leader_election.cc:304] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, 9de0c5ee31ba4432976a654b0c837914; no voters: 
W20260709 12:59:21.161867  1094 leader_election.cc:343] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:21.165258   949 catalog_manager.cc:5697] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:21.158936  1245 raft_consensus.cc:385] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:21.169934  1245 raft_consensus.cc:740] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:21.170696  1295 leader_election.cc:290] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:21.171644  1243 tablet_bootstrap.cc:492] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914: No bootstrap required, opened a new log
I20260709 12:59:21.171916  1295 raft_consensus.cc:2804] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:21.172326  1295 raft_consensus.cc:493] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.172482  1243 ts_tablet_manager.cc:1403] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.029s
I20260709 12:59:21.172785  1295 raft_consensus.cc:3060] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.173091  1245 consensus_queue.cc:260] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.175287  1245 ts_tablet_manager.cc:1434] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:59:21.175772  1243 raft_consensus.cc:359] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.176244  1245 tablet_bootstrap.cc:492] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6: Bootstrap starting.
I20260709 12:59:21.176659  1243 raft_consensus.cc:385] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:21.177158  1243 raft_consensus.cc:740] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Initialized, Role: FOLLOWER
I20260709 12:59:21.177589  1296 raft_consensus.cc:493] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.178069  1296 raft_consensus.cc:515] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.178484  1243 consensus_queue.cc:260] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.180996  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd65356a26d418e8779c157010c56d4" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6" is_pre_election: true
I20260709 12:59:21.181664  1243 ts_tablet_manager.cc:1434] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:59:21.181682  1054 raft_consensus.cc:2468] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 0.
I20260709 12:59:21.182008  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd65356a26d418e8779c157010c56d4" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914" is_pre_election: true
I20260709 12:59:21.182675  1203 raft_consensus.cc:2468] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 0.
I20260709 12:59:21.183010  1094 leader_election.cc:304] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:21.184065  1296 leader_election.cc:290] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:21.184583  1296 raft_consensus.cc:2804] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:21.184895  1296 raft_consensus.cc:493] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.185264  1296 raft_consensus.cc:3060] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.190651  1245 tablet_bootstrap.cc:654] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:21.195576  1298 raft_consensus.cc:493] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.195895  1245 tablet_bootstrap.cc:492] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6: No bootstrap required, opened a new log
I20260709 12:59:21.196375  1245 ts_tablet_manager.cc:1403] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 12:59:21.195585   949 catalog_manager.cc:5697] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "9de0c5ee31ba4432976a654b0c837914" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:21.196269  1298 raft_consensus.cc:515] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.198505  1298 leader_election.cc:290] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:21.199061  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62167d118ce404baba1bff12e001183" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6" is_pre_election: true
I20260709 12:59:21.199576  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62167d118ce404baba1bff12e001183" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914" is_pre_election: true
I20260709 12:59:21.199755  1054 raft_consensus.cc:2468] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 0.
I20260709 12:59:21.200153  1203 raft_consensus.cc:2468] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 0.
I20260709 12:59:21.199903  1245 raft_consensus.cc:359] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.200624  1245 raft_consensus.cc:385] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:21.200903  1245 raft_consensus.cc:740] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:21.201301  1094 leader_election.cc:304] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:21.201532  1245 consensus_queue.cc:260] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.202519  1298 raft_consensus.cc:2804] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:21.202885  1298 raft_consensus.cc:493] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.203198  1298 raft_consensus.cc:3060] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.203521  1245 ts_tablet_manager.cc:1434] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:21.204782  1250 raft_consensus.cc:493] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.205186  1250 raft_consensus.cc:515] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.206777  1300 raft_consensus.cc:493] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.207326  1300 raft_consensus.cc:515] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.207887  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea077c7afddc4a31a03bdba1dce16279" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6" is_pre_election: true
I20260709 12:59:21.208202  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea077c7afddc4a31a03bdba1dce16279" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057" is_pre_election: true
I20260709 12:59:21.208523  1054 raft_consensus.cc:2468] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 0.
I20260709 12:59:21.209769  1168 leader_election.cc:304] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9de0c5ee31ba4432976a654b0c837914, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:21.210105  1300 leader_election.cc:290] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:21.210813  1277 raft_consensus.cc:2804] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:21.211172  1277 raft_consensus.cc:493] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.211555  1277 raft_consensus.cc:3060] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.212493  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec50ac7ed5f4812b8c29213a0b30a34" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914" is_pre_election: true
I20260709 12:59:21.213080  1203 raft_consensus.cc:2468] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 0.
I20260709 12:59:21.214311  1092 leader_election.cc:304] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, 9de0c5ee31ba4432976a654b0c837914; no voters: 
I20260709 12:59:21.214908  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec50ac7ed5f4812b8c29213a0b30a34" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6" is_pre_election: true
I20260709 12:59:21.215113  1250 leader_election.cc:290] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:21.215550  1054 raft_consensus.cc:2468] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 0.
I20260709 12:59:21.215837  1300 raft_consensus.cc:2804] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:21.216199  1300 raft_consensus.cc:493] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.216513  1300 raft_consensus.cc:3060] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.228843  1128 raft_consensus.cc:2468] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 1.
I20260709 12:59:21.229625  1277 raft_consensus.cc:515] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.229971  1253 raft_consensus.cc:515] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.231592  1127 raft_consensus.cc:2393] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9de0c5ee31ba4432976a654b0c837914 in current term 1: Already voted for candidate 36a001d95f2d438fab687f9da249a057 in this term.
I20260709 12:59:21.232339  1277 leader_election.cc:290] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 election: Requested vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:21.235483  1281 raft_consensus.cc:2749] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:21.235905  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea077c7afddc4a31a03bdba1dce16279" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:21.236737  1127 raft_consensus.cc:2393] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9de0c5ee31ba4432976a654b0c837914 in current term 1: Already voted for candidate 36a001d95f2d438fab687f9da249a057 in this term.
I20260709 12:59:21.238667  1253 leader_election.cc:290] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 election: Requested vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:21.239329  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea077c7afddc4a31a03bdba1dce16279" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
I20260709 12:59:21.239955  1054 raft_consensus.cc:3060] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.240285  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea077c7afddc4a31a03bdba1dce16279" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
I20260709 12:59:21.240433  1053 raft_consensus.cc:3060] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.241123  1203 raft_consensus.cc:2393] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36a001d95f2d438fab687f9da249a057 in current term 1: Already voted for candidate 9de0c5ee31ba4432976a654b0c837914 in this term.
I20260709 12:59:21.241242  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea077c7afddc4a31a03bdba1dce16279" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
I20260709 12:59:21.242944  1168 leader_election.cc:304] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9de0c5ee31ba4432976a654b0c837914; no voters: 36a001d95f2d438fab687f9da249a057, a0f4aa692e0a444283f0c59f4be948c6
I20260709 12:59:21.244048  1277 raft_consensus.cc:2749] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:21.252622  1281 raft_consensus.cc:493] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.253067  1281 raft_consensus.cc:515] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.254546  1281 leader_election.cc:290] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:21.255689  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057" is_pre_election: true
I20260709 12:59:21.255714  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914" is_pre_election: true
I20260709 12:59:21.256382  1203 raft_consensus.cc:2468] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 0.
I20260709 12:59:21.257347  1017 leader_election.cc:304] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9de0c5ee31ba4432976a654b0c837914, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:21.257998  1281 raft_consensus.cc:2804] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:21.258369  1281 raft_consensus.cc:493] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.258641  1281 raft_consensus.cc:3060] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.326531  1286 raft_consensus.cc:2749] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:21.328447  1277 consensus_queue.cc:1048] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:21.334561  1054 raft_consensus.cc:2468] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 1.
I20260709 12:59:21.335906  1094 leader_election.cc:304] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, a0f4aa692e0a444283f0c59f4be948c6; no voters: 9de0c5ee31ba4432976a654b0c837914
I20260709 12:59:21.336714  1286 raft_consensus.cc:2804] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:21.337203  1286 raft_consensus.cc:697] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Becoming Leader. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Running, Role: LEADER
I20260709 12:59:21.338047  1286 consensus_queue.cc:237] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.344702  1250 consensus_queue.cc:1048] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:21.351500   952 catalog_manager.cc:5697] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36a001d95f2d438fab687f9da249a057 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "36a001d95f2d438fab687f9da249a057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:21.365362  1250 raft_consensus.cc:493] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.365828  1250 raft_consensus.cc:515] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.368251  1250 leader_election.cc:290] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:21.368417  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ce3bb32182b48dfb5c0e8c3e7c967a2" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6" is_pre_election: true
I20260709 12:59:21.369114  1053 raft_consensus.cc:2468] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 0.
I20260709 12:59:21.369350  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ce3bb32182b48dfb5c0e8c3e7c967a2" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057" is_pre_election: true
I20260709 12:59:21.369935  1128 raft_consensus.cc:2468] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 0.
I20260709 12:59:21.370074  1168 leader_election.cc:304] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9de0c5ee31ba4432976a654b0c837914, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:21.370860  1250 raft_consensus.cc:2804] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:21.371148  1250 raft_consensus.cc:493] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.371491  1250 raft_consensus.cc:3060] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.424072  1277 consensus_queue.cc:1048] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:21.426273  1295 raft_consensus.cc:515] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.426678  1296 raft_consensus.cc:515] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.428443  1295 leader_election.cc:290] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 election: Requested vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:21.428768  1298 raft_consensus.cc:515] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.426271  1281 raft_consensus.cc:515] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.430652  1298 leader_election.cc:290] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 election: Requested vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:21.431370  1300 raft_consensus.cc:515] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.432075  1127 raft_consensus.cc:2393] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f4aa692e0a444283f0c59f4be948c6 in current term 1: Already voted for candidate 36a001d95f2d438fab687f9da249a057 in this term.
I20260709 12:59:21.433298  1300 leader_election.cc:290] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 election: Requested vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:21.428443  1296 leader_election.cc:290] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 election: Requested vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:21.433959  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd65356a26d418e8779c157010c56d4" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
I20260709 12:59:21.434535  1052 raft_consensus.cc:3060] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.434777  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
I20260709 12:59:21.435561  1054 raft_consensus.cc:2393] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36a001d95f2d438fab687f9da249a057 in current term 1: Already voted for candidate a0f4aa692e0a444283f0c59f4be948c6 in this term.
I20260709 12:59:21.435811  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62167d118ce404baba1bff12e001183" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
I20260709 12:59:21.436595  1051 raft_consensus.cc:3060] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.437790  1281 leader_election.cc:290] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 election: Requested vote from peers 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:21.438591  1250 raft_consensus.cc:515] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.441155  1250 leader_election.cc:290] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 election: Requested vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:21.442549  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec50ac7ed5f4812b8c29213a0b30a34" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
I20260709 12:59:21.443058  1054 raft_consensus.cc:3060] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.444031  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
I20260709 12:59:21.444569  1203 raft_consensus.cc:3060] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.445410  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
I20260709 12:59:21.446826  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62167d118ce404baba1bff12e001183" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
I20260709 12:59:21.447433  1200 raft_consensus.cc:3060] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.447553  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd65356a26d418e8779c157010c56d4" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
I20260709 12:59:21.448138  1202 raft_consensus.cc:3060] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.450671  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec50ac7ed5f4812b8c29213a0b30a34" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
I20260709 12:59:21.451298  1199 raft_consensus.cc:3060] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.455565  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:21.456359  1127 raft_consensus.cc:2393] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f4aa692e0a444283f0c59f4be948c6 in current term 1: Already voted for candidate 36a001d95f2d438fab687f9da249a057 in this term.
I20260709 12:59:21.456230  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ce3bb32182b48dfb5c0e8c3e7c967a2" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:21.456983  1128 raft_consensus.cc:3060] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.459204  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ce3bb32182b48dfb5c0e8c3e7c967a2" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
I20260709 12:59:21.459846  1053 raft_consensus.cc:3060] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P a0f4aa692e0a444283f0c59f4be948c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:21.461452  1092 leader_election.cc:304] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36a001d95f2d438fab687f9da249a057; no voters: 9de0c5ee31ba4432976a654b0c837914, a0f4aa692e0a444283f0c59f4be948c6
I20260709 12:59:21.462270  1296 raft_consensus.cc:2749] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:21.464030  1277 consensus_queue.cc:1048] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:21.526960  1281 consensus_queue.cc:1048] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:21.527633  1128 raft_consensus.cc:2468] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 1.
I20260709 12:59:21.527633  1200 raft_consensus.cc:2468] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 1.
I20260709 12:59:21.528594  1199 raft_consensus.cc:2468] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 1.
I20260709 12:59:21.529493  1202 raft_consensus.cc:2468] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 1.
I20260709 12:59:21.530786  1203 raft_consensus.cc:2468] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 1.
I20260709 12:59:21.531816  1051 raft_consensus.cc:2468] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 1.
I20260709 12:59:21.532366  1017 leader_election.cc:304] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9de0c5ee31ba4432976a654b0c837914, a0f4aa692e0a444283f0c59f4be948c6; no voters: 36a001d95f2d438fab687f9da249a057
I20260709 12:59:21.532641  1052 raft_consensus.cc:2468] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 1.
I20260709 12:59:21.532982  1094 leader_election.cc:304] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:21.533454  1281 raft_consensus.cc:2804] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:21.533666  1167 leader_election.cc:304] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, 9de0c5ee31ba4432976a654b0c837914; no voters: 
I20260709 12:59:21.533950  1281 raft_consensus.cc:697] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 1 LEADER]: Becoming Leader. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Running, Role: LEADER
I20260709 12:59:21.534480  1277 raft_consensus.cc:2804] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:21.534562  1296 raft_consensus.cc:2804] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:21.535113  1296 raft_consensus.cc:697] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Becoming Leader. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Running, Role: LEADER
I20260709 12:59:21.535204  1277 raft_consensus.cc:697] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [term 1 LEADER]: Becoming Leader. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Running, Role: LEADER
I20260709 12:59:21.536034  1296 consensus_queue.cc:237] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.534762  1281 consensus_queue.cc:237] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.536320  1277 consensus_queue.cc:237] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.539197  1094 leader_election.cc:304] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:21.540333  1300 raft_consensus.cc:2804] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:21.540484  1092 leader_election.cc:304] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, 9de0c5ee31ba4432976a654b0c837914; no voters: 
I20260709 12:59:21.540982  1300 raft_consensus.cc:697] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Becoming Leader. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Running, Role: LEADER
I20260709 12:59:21.541746  1295 raft_consensus.cc:2804] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:21.542322  1295 raft_consensus.cc:697] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Becoming Leader. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Running, Role: LEADER
I20260709 12:59:21.542081  1300 consensus_queue.cc:237] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.543422  1295 consensus_queue.cc:237] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:21.554601   952 catalog_manager.cc:5697] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "9de0c5ee31ba4432976a654b0c837914" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:21.561056   949 catalog_manager.cc:5697] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36a001d95f2d438fab687f9da249a057 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "36a001d95f2d438fab687f9da249a057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:21.564838   951 catalog_manager.cc:5697] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:21.569815  1281 consensus_queue.cc:1048] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:21.582804   951 catalog_manager.cc:5697] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36a001d95f2d438fab687f9da249a057 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "36a001d95f2d438fab687f9da249a057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:21.584197   951 catalog_manager.cc:5697] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36a001d95f2d438fab687f9da249a057 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "36a001d95f2d438fab687f9da249a057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:21.622148  1277 consensus_queue.cc:1048] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:21.629005  1053 raft_consensus.cc:2468] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 1.
I20260709 12:59:21.629120  1054 raft_consensus.cc:2468] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 1.
I20260709 12:59:21.636456  1250 consensus_queue.cc:1048] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:21.784353  1296 consensus_queue.cc:1048] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:21.797333  1286 consensus_queue.cc:1048] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:21.804873  1202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d"
dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
mode: GRACEFUL
new_leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
 from {username='slave'} at 127.0.0.1:58648
I20260709 12:59:21.805516  1202 raft_consensus.cc:606] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 1 LEADER]: Received request to transfer leadership to TS a0f4aa692e0a444283f0c59f4be948c6
I20260709 12:59:21.829257  1128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f62167d118ce404baba1bff12e001183"
dest_uuid: "36a001d95f2d438fab687f9da249a057"
mode: GRACEFUL
new_leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
 from {username='slave'} at 127.0.0.1:55704
I20260709 12:59:21.829913  1128 raft_consensus.cc:606] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Received request to transfer leadership to TS a0f4aa692e0a444283f0c59f4be948c6
I20260709 12:59:21.835968  1203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf8b6f826968464bb649cbc3ca6ce5fa"
dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
mode: GRACEFUL
new_leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
 from {username='slave'} at 127.0.0.1:58648
I20260709 12:59:21.836563  1203 raft_consensus.cc:606] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 1 LEADER]: Received request to transfer leadership to TS a0f4aa692e0a444283f0c59f4be948c6
I20260709 12:59:21.849086  1203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7fc24e938dd48309b6db90da4e90eea"
dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
mode: GRACEFUL
new_leader_uuid: "36a001d95f2d438fab687f9da249a057"
 from {username='slave'} at 127.0.0.1:58648
I20260709 12:59:21.849678  1203 raft_consensus.cc:606] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 1 LEADER]: Received request to transfer leadership to TS 36a001d95f2d438fab687f9da249a057
I20260709 12:59:21.962769  1281 consensus_queue.cc:1048] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:21.966760  1300 consensus_queue.cc:1048] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:21.966847  1286 consensus_queue.cc:1048] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:21.973759  1315 consensus_queue.cc:1048] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:21.991791  1286 consensus_queue.cc:1048] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:21.993026  1296 consensus_queue.cc:1048] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:22.008668  1250 raft_consensus.cc:993] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914: : Instructing follower 36a001d95f2d438fab687f9da249a057 to start an election
I20260709 12:59:22.009141  1277 raft_consensus.cc:1081] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 1 LEADER]: Signalling peer 36a001d95f2d438fab687f9da249a057 to start an election
I20260709 12:59:22.010358  1296 raft_consensus.cc:993] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057: : Instructing follower a0f4aa692e0a444283f0c59f4be948c6 to start an election
I20260709 12:59:22.010834  1298 raft_consensus.cc:1081] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Signalling peer a0f4aa692e0a444283f0c59f4be948c6 to start an election
I20260709 12:59:22.011938  1128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7fc24e938dd48309b6db90da4e90eea"
dest_uuid: "36a001d95f2d438fab687f9da249a057"
 from {username='slave'} at 127.0.0.1:55684
I20260709 12:59:22.012480  1128 raft_consensus.cc:493] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.012842  1128 raft_consensus.cc:3060] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.016737  1054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f62167d118ce404baba1bff12e001183"
dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
 from {username='slave'} at 127.0.0.1:40630
I20260709 12:59:22.017525  1054 raft_consensus.cc:493] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.017913  1054 raft_consensus.cc:3060] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.019868  1128 raft_consensus.cc:515] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:22.022732  1128 leader_election.cc:290] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 2 election: Requested vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:22.022924  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc24e938dd48309b6db90da4e90eea" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
I20260709 12:59:22.023545  1053 raft_consensus.cc:3060] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.025978  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc24e938dd48309b6db90da4e90eea" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
I20260709 12:59:22.026460  1199 raft_consensus.cc:3055] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.026716  1199 raft_consensus.cc:740] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Running, Role: LEADER
I20260709 12:59:22.027697  1199 consensus_queue.cc:260] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:22.028900  1199 raft_consensus.cc:3060] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.028878  1298 consensus_queue.cc:1048] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:22.040802  1296 consensus_queue.cc:1048] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:22.087116  1277 consensus_queue.cc:1048] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:22.097707  1249 consensus_queue.cc:1048] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:22.123461  1199 raft_consensus.cc:2468] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 2.
I20260709 12:59:22.123523  1053 raft_consensus.cc:2468] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 2.
I20260709 12:59:22.123499  1054 raft_consensus.cc:515] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:22.125512  1094 leader_election.cc:304] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:22.127293  1296 raft_consensus.cc:2804] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.127995  1296 raft_consensus.cc:697] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [term 2 LEADER]: Becoming Leader. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Running, Role: LEADER
I20260709 12:59:22.128875  1296 consensus_queue.cc:237] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:22.126291  1054 leader_election.cc:290] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 2 election: Requested vote from peers 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:22.130746  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62167d118ce404baba1bff12e001183" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
I20260709 12:59:22.131368  1199 raft_consensus.cc:3060] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.132016  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62167d118ce404baba1bff12e001183" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:22.133787  1128 raft_consensus.cc:3055] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.134168  1128 raft_consensus.cc:740] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Running, Role: LEADER
I20260709 12:59:22.135106  1128 consensus_queue.cc:260] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:22.136525  1128 raft_consensus.cc:3060] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.139375   949 catalog_manager.cc:5697] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 reported cstate change: term changed from 1 to 2, leader changed from 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195) to 36a001d95f2d438fab687f9da249a057 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "36a001d95f2d438fab687f9da249a057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:22.227033  1199 raft_consensus.cc:2468] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 2.
I20260709 12:59:22.227078  1128 raft_consensus.cc:2468] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 2.
I20260709 12:59:22.228636  1017 leader_election.cc:304] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9de0c5ee31ba4432976a654b0c837914, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:22.229525  1281 raft_consensus.cc:2804] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.230008  1281 raft_consensus.cc:697] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Becoming Leader. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Running, Role: LEADER
I20260709 12:59:22.230849  1281 consensus_queue.cc:237] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:22.238083   949 catalog_manager.cc:5697] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 reported cstate change: term changed from 1 to 2, leader changed from 36a001d95f2d438fab687f9da249a057 (127.0.107.194) to a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:22.260954  1277 raft_consensus.cc:993] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914: : Instructing follower a0f4aa692e0a444283f0c59f4be948c6 to start an election
I20260709 12:59:22.261407  1249 raft_consensus.cc:1081] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 1 LEADER]: Signalling peer a0f4aa692e0a444283f0c59f4be948c6 to start an election
I20260709 12:59:22.262967  1054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d"
dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
 from {username='slave'} at 127.0.0.1:40624
I20260709 12:59:22.263489  1054 raft_consensus.cc:493] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.263862  1054 raft_consensus.cc:3060] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.265136  1249 raft_consensus.cc:993] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914: : Instructing follower a0f4aa692e0a444283f0c59f4be948c6 to start an election
I20260709 12:59:22.265609  1277 raft_consensus.cc:1081] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 1 LEADER]: Signalling peer a0f4aa692e0a444283f0c59f4be948c6 to start an election
I20260709 12:59:22.267012  1053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf8b6f826968464bb649cbc3ca6ce5fa"
dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
 from {username='slave'} at 127.0.0.1:40624
I20260709 12:59:22.267562  1053 raft_consensus.cc:493] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.267951  1053 raft_consensus.cc:3060] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.320734  1053 raft_consensus.cc:515] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:22.320734  1054 raft_consensus.cc:515] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:22.323016  1054 leader_election.cc:290] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 2 election: Requested vote from peers 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:22.323168  1053 leader_election.cc:290] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 2 election: Requested vote from peers 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:22.324951  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
I20260709 12:59:22.325601  1199 raft_consensus.cc:3055] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.325954  1199 raft_consensus.cc:740] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Running, Role: LEADER
I20260709 12:59:22.325911  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:22.326016  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8b6f826968464bb649cbc3ca6ce5fa" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:22.326611  1127 raft_consensus.cc:3060] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.326701  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8b6f826968464bb649cbc3ca6ce5fa" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
I20260709 12:59:22.326892  1128 raft_consensus.cc:3060] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.327407  1203 raft_consensus.cc:3055] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.326972  1199 consensus_queue.cc:260] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:22.327785  1203 raft_consensus.cc:740] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Running, Role: LEADER
I20260709 12:59:22.328382  1199 raft_consensus.cc:3060] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.328751  1203 consensus_queue.cc:260] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:22.330272  1203 raft_consensus.cc:3060] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.428354  1199 raft_consensus.cc:2468] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 2.
I20260709 12:59:22.428663  1128 raft_consensus.cc:2468] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 2.
I20260709 12:59:22.428485  1203 raft_consensus.cc:2468] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 2.
I20260709 12:59:22.429816  1017 leader_election.cc:304] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9de0c5ee31ba4432976a654b0c837914, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:22.429891  1018 leader_election.cc:304] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:22.428354  1127 raft_consensus.cc:2468] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 2.
I20260709 12:59:22.430806  1281 raft_consensus.cc:2804] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.431360  1281 raft_consensus.cc:697] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Becoming Leader. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Running, Role: LEADER
I20260709 12:59:22.431486  1338 raft_consensus.cc:2804] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.431937  1338 raft_consensus.cc:697] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Becoming Leader. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Running, Role: LEADER
I20260709 12:59:22.432735  1338 consensus_queue.cc:237] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:22.432797  1281 consensus_queue.cc:237] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:22.440735   949 catalog_manager.cc:5697] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 reported cstate change: term changed from 1 to 2, leader changed from 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195) to a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:22.442071   949 catalog_manager.cc:5697] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 reported cstate change: term changed from 1 to 2, leader changed from 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195) to a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:22.577260  1054 raft_consensus.cc:1275] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Refusing update from remote peer 36a001d95f2d438fab687f9da249a057: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.578565  1298 consensus_queue.cc:1048] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:22.585953  1203 raft_consensus.cc:1275] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Refusing update from remote peer 36a001d95f2d438fab687f9da249a057: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.587347  1300 consensus_queue.cc:1048] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:22.756259  1127 raft_consensus.cc:1275] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Refusing update from remote peer a0f4aa692e0a444283f0c59f4be948c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.757589  1338 consensus_queue.cc:1048] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:22.765471  1203 raft_consensus.cc:1275] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Refusing update from remote peer a0f4aa692e0a444283f0c59f4be948c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.766985  1315 consensus_queue.cc:1048] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:22.814250  1203 raft_consensus.cc:1275] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Refusing update from remote peer a0f4aa692e0a444283f0c59f4be948c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.815670  1315 consensus_queue.cc:1048] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:22.826578  1127 raft_consensus.cc:1275] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Refusing update from remote peer a0f4aa692e0a444283f0c59f4be948c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.827854  1252 consensus_queue.cc:1048] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:22.920914  1127 raft_consensus.cc:1275] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Refusing update from remote peer a0f4aa692e0a444283f0c59f4be948c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.922075  1252 consensus_queue.cc:1048] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:22.929955  1203 raft_consensus.cc:1275] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Refusing update from remote peer a0f4aa692e0a444283f0c59f4be948c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.931375  1315 consensus_queue.cc:1048] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:24.883960   431 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 12:59:24.884668   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:24.907269  1054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d"
dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
mode: GRACEFUL
new_leader_uuid: "9de0c5ee31ba4432976a654b0c837914"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:59:24.907755  1054 raft_consensus.cc:606] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Received request to transfer leadership to TS 9de0c5ee31ba4432976a654b0c837914
I20260709 12:59:24.909910  1054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e"
dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
mode: GRACEFUL
new_leader_uuid: "9de0c5ee31ba4432976a654b0c837914"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:59:24.910399  1054 raft_consensus.cc:606] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 1 LEADER]: Received request to transfer leadership to TS 9de0c5ee31ba4432976a654b0c837914
I20260709 12:59:24.911419   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:59:24.911864   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:25.256850  1351 raft_consensus.cc:993] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6: : Instructing follower 9de0c5ee31ba4432976a654b0c837914 to start an election
I20260709 12:59:25.257386  1351 raft_consensus.cc:1081] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Signalling peer 9de0c5ee31ba4432976a654b0c837914 to start an election
I20260709 12:59:25.258922  1199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d"
dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
 from {username='slave'} at 127.0.0.1:58632
I20260709 12:59:25.259603  1199 raft_consensus.cc:493] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:25.259975  1199 raft_consensus.cc:3060] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.260183  1315 raft_consensus.cc:993] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6: : Instructing follower 9de0c5ee31ba4432976a654b0c837914 to start an election
I20260709 12:59:25.260659  1351 raft_consensus.cc:1081] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 1 LEADER]: Signalling peer 9de0c5ee31ba4432976a654b0c837914 to start an election
I20260709 12:59:25.262004  1203 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e"
dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
 from {username='slave'} at 127.0.0.1:58632
I20260709 12:59:25.262465  1203 raft_consensus.cc:493] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:25.262786  1203 raft_consensus.cc:3060] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.265596  1199 raft_consensus.cc:515] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:25.267179  1199 leader_election.cc:290] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 3 election: Requested vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:25.267989  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
I20260709 12:59:25.268278  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:25.268509  1054 raft_consensus.cc:3055] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:25.268007  1203 raft_consensus.cc:515] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:25.268862  1128 raft_consensus.cc:3060] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.268860  1054 raft_consensus.cc:740] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Running, Role: LEADER
I20260709 12:59:25.269873  1054 consensus_queue.cc:260] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:25.270901  1203 leader_election.cc:290] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 2 election: Requested vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:25.271176  1054 raft_consensus.cc:3060] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.271435  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:25.271965  1127 raft_consensus.cc:3060] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.274266  1128 raft_consensus.cc:2468] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 3.
I20260709 12:59:25.275215  1167 leader_election.cc:304] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, 9de0c5ee31ba4432976a654b0c837914; no voters: 
I20260709 12:59:25.275728  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
I20260709 12:59:25.276031  1346 raft_consensus.cc:2804] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:25.276314  1053 raft_consensus.cc:3055] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:25.276654  1053 raft_consensus.cc:740] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Running, Role: LEADER
I20260709 12:59:25.277457  1053 consensus_queue.cc:260] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:25.278302  1127 raft_consensus.cc:2468] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 2.
I20260709 12:59:25.278724  1053 raft_consensus.cc:3060] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.279431  1167 leader_election.cc:304] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, 9de0c5ee31ba4432976a654b0c837914; no voters: 
I20260709 12:59:25.279881  1346 raft_consensus.cc:697] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 3 LEADER]: Becoming Leader. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Running, Role: LEADER
I20260709 12:59:25.280375  1353 raft_consensus.cc:2804] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:25.280864  1353 raft_consensus.cc:697] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 2 LEADER]: Becoming Leader. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Running, Role: LEADER
I20260709 12:59:25.280880  1346 consensus_queue.cc:237] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:25.281561  1353 consensus_queue.cc:237] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:25.285377  1054 raft_consensus.cc:2468] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 3.
I20260709 12:59:25.292490  1053 raft_consensus.cc:2468] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 2.
I20260709 12:59:25.299345   952 catalog_manager.cc:5697] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 reported cstate change: term changed from 2 to 3, leader changed from a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193) to 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "9de0c5ee31ba4432976a654b0c837914" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:25.300446   952 catalog_manager.cc:5697] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 reported cstate change: term changed from 1 to 2, leader changed from a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193) to 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "9de0c5ee31ba4432976a654b0c837914" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:25.788836  1127 raft_consensus.cc:1275] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Refusing update from remote peer 9de0c5ee31ba4432976a654b0c837914: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:25.790421  1346 consensus_queue.cc:1048] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:25.806151  1054 raft_consensus.cc:1275] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Refusing update from remote peer 9de0c5ee31ba4432976a654b0c837914: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:25.813828  1127 raft_consensus.cc:1275] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 3 FOLLOWER]: Refusing update from remote peer 9de0c5ee31ba4432976a654b0c837914: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:25.812426  1365 consensus_queue.cc:1048] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:25.824009  1365 consensus_queue.cc:1048] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:25.837006  1053 raft_consensus.cc:1275] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 3 FOLLOWER]: Refusing update from remote peer 9de0c5ee31ba4432976a654b0c837914: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:25.839630  1365 consensus_queue.cc:1048] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:25.913028   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:25.926524  1203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d"
dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
mode: GRACEFUL
new_leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
 from {username='slave'} at 127.0.0.1:58648
I20260709 12:59:25.927305  1203 raft_consensus.cc:606] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 3 LEADER]: Received request to transfer leadership to TS a0f4aa692e0a444283f0c59f4be948c6
I20260709 12:59:25.935091  1203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e"
dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
mode: GRACEFUL
new_leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
 from {username='slave'} at 127.0.0.1:58648
I20260709 12:59:25.935537  1203 raft_consensus.cc:606] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 2 LEADER]: Received request to transfer leadership to TS a0f4aa692e0a444283f0c59f4be948c6
I20260709 12:59:25.944929  1127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ec50ac7ed5f4812b8c29213a0b30a34"
dest_uuid: "36a001d95f2d438fab687f9da249a057"
mode: GRACEFUL
new_leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
 from {username='slave'} at 127.0.0.1:55704
I20260709 12:59:25.945503  1127 raft_consensus.cc:606] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Received request to transfer leadership to TS a0f4aa692e0a444283f0c59f4be948c6
I20260709 12:59:25.950086  1127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea077c7afddc4a31a03bdba1dce16279"
dest_uuid: "36a001d95f2d438fab687f9da249a057"
mode: GRACEFUL
new_leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
 from {username='slave'} at 127.0.0.1:55704
I20260709 12:59:25.950569  1127 raft_consensus.cc:606] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Received request to transfer leadership to TS a0f4aa692e0a444283f0c59f4be948c6
I20260709 12:59:25.955699  1128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecd65356a26d418e8779c157010c56d4"
dest_uuid: "36a001d95f2d438fab687f9da249a057"
mode: GRACEFUL
new_leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
 from {username='slave'} at 127.0.0.1:55704
I20260709 12:59:25.956282  1128 raft_consensus.cc:606] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Received request to transfer leadership to TS a0f4aa692e0a444283f0c59f4be948c6
I20260709 12:59:26.317200  1365 raft_consensus.cc:993] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914: : Instructing follower a0f4aa692e0a444283f0c59f4be948c6 to start an election
I20260709 12:59:26.317723  1346 raft_consensus.cc:1081] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 3 LEADER]: Signalling peer a0f4aa692e0a444283f0c59f4be948c6 to start an election
I20260709 12:59:26.319169  1054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d"
dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
 from {username='slave'} at 127.0.0.1:40624
I20260709 12:59:26.319752  1054 raft_consensus.cc:493] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:26.320111  1054 raft_consensus.cc:3060] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:26.326632  1054 raft_consensus.cc:515] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:26.328291  1054 leader_election.cc:290] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 4 election: Requested vote from peers 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:26.329435  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:26.329591  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
I20260709 12:59:26.329989  1128 raft_consensus.cc:3060] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:26.330142  1203 raft_consensus.cc:3055] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:26.330484  1203 raft_consensus.cc:740] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Running, Role: LEADER
I20260709 12:59:26.331164  1203 consensus_queue.cc:260] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:26.332044  1203 raft_consensus.cc:3060] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:26.335229  1128 raft_consensus.cc:2468] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 4.
I20260709 12:59:26.336489  1203 raft_consensus.cc:2468] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 4.
I20260709 12:59:26.336741  1018 leader_election.cc:304] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:26.337707  1351 raft_consensus.cc:2804] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:26.338414  1351 raft_consensus.cc:697] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 4 LEADER]: Becoming Leader. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Running, Role: LEADER
I20260709 12:59:26.339114  1351 consensus_queue.cc:237] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:26.344642   951 catalog_manager.cc:5697] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 reported cstate change: term changed from 3 to 4, leader changed from 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195) to a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.350144  1374 raft_consensus.cc:993] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057: : Instructing follower a0f4aa692e0a444283f0c59f4be948c6 to start an election
I20260709 12:59:26.350687  1367 raft_consensus.cc:1081] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Signalling peer a0f4aa692e0a444283f0c59f4be948c6 to start an election
I20260709 12:59:26.352486  1054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea077c7afddc4a31a03bdba1dce16279"
dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
 from {username='slave'} at 127.0.0.1:40630
I20260709 12:59:26.352991  1054 raft_consensus.cc:493] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:26.353339  1054 raft_consensus.cc:3060] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.359073  1054 raft_consensus.cc:515] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:26.360579  1054 leader_election.cc:290] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 2 election: Requested vote from peers 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:26.361235  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea077c7afddc4a31a03bdba1dce16279" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:26.361577  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea077c7afddc4a31a03bdba1dce16279" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
I20260709 12:59:26.361793  1128 raft_consensus.cc:3055] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:26.362032  1203 raft_consensus.cc:3060] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.362118  1128 raft_consensus.cc:740] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Running, Role: LEADER
I20260709 12:59:26.362895  1128 consensus_queue.cc:260] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:26.363940  1128 raft_consensus.cc:3060] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.366287  1203 raft_consensus.cc:2468] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 2.
I20260709 12:59:26.367296  1017 leader_election.cc:304] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9de0c5ee31ba4432976a654b0c837914, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:26.367990  1351 raft_consensus.cc:2804] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:26.368468  1351 raft_consensus.cc:697] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Becoming Leader. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Running, Role: LEADER
I20260709 12:59:26.368603  1128 raft_consensus.cc:2468] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 2.
I20260709 12:59:26.369328  1351 consensus_queue.cc:237] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:26.375413   951 catalog_manager.cc:5697] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 reported cstate change: term changed from 1 to 2, leader changed from 36a001d95f2d438fab687f9da249a057 (127.0.107.194) to a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.390159  1367 raft_consensus.cc:993] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057: : Instructing follower a0f4aa692e0a444283f0c59f4be948c6 to start an election
I20260709 12:59:26.390645  1374 raft_consensus.cc:1081] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Signalling peer a0f4aa692e0a444283f0c59f4be948c6 to start an election
I20260709 12:59:26.392032  1054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecd65356a26d418e8779c157010c56d4"
dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
 from {username='slave'} at 127.0.0.1:40630
I20260709 12:59:26.392460  1054 raft_consensus.cc:493] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:26.392729  1054 raft_consensus.cc:3060] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.397585  1054 raft_consensus.cc:515] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:26.400664  1054 leader_election.cc:290] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 2 election: Requested vote from peers 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:26.401280  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd65356a26d418e8779c157010c56d4" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:26.400713  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd65356a26d418e8779c157010c56d4" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
I20260709 12:59:26.403702  1127 raft_consensus.cc:3055] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:26.403715  1203 raft_consensus.cc:3060] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.404177  1127 raft_consensus.cc:740] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Running, Role: LEADER
I20260709 12:59:26.404996  1127 consensus_queue.cc:260] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:26.405958  1127 raft_consensus.cc:3060] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.408500  1203 raft_consensus.cc:2468] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 2.
I20260709 12:59:26.409425  1017 leader_election.cc:304] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9de0c5ee31ba4432976a654b0c837914, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:26.410346  1372 raft_consensus.cc:2804] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:26.410789  1372 raft_consensus.cc:697] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Becoming Leader. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Running, Role: LEADER
I20260709 12:59:26.411880  1127 raft_consensus.cc:2468] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 2.
I20260709 12:59:26.411815  1372 consensus_queue.cc:237] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:26.418273  1363 raft_consensus.cc:993] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914: : Instructing follower a0f4aa692e0a444283f0c59f4be948c6 to start an election
I20260709 12:59:26.418715  1363 raft_consensus.cc:1081] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 2 LEADER]: Signalling peer a0f4aa692e0a444283f0c59f4be948c6 to start an election
I20260709 12:59:26.420859  1054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e"
dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
 from {username='slave'} at 127.0.0.1:40624
I20260709 12:59:26.421373  1054 raft_consensus.cc:493] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:26.420670   952 catalog_manager.cc:5697] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 reported cstate change: term changed from 1 to 2, leader changed from 36a001d95f2d438fab687f9da249a057 (127.0.107.194) to a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.421802  1054 raft_consensus.cc:3060] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.423077  1367 raft_consensus.cc:993] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057: : Instructing follower a0f4aa692e0a444283f0c59f4be948c6 to start an election
I20260709 12:59:26.423516  1367 raft_consensus.cc:1081] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Signalling peer a0f4aa692e0a444283f0c59f4be948c6 to start an election
I20260709 12:59:26.425153  1053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ec50ac7ed5f4812b8c29213a0b30a34"
dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
 from {username='slave'} at 127.0.0.1:40630
I20260709 12:59:26.425647  1053 raft_consensus.cc:493] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:26.426008  1053 raft_consensus.cc:3060] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.426720  1054 raft_consensus.cc:515] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:26.428864  1054 leader_election.cc:290] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 3 election: Requested vote from peers 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:26.429330  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:26.429884  1127 raft_consensus.cc:3060] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.431762  1053 raft_consensus.cc:515] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:26.432698  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
I20260709 12:59:26.433245  1203 raft_consensus.cc:3055] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:26.433571  1203 raft_consensus.cc:740] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Running, Role: LEADER
I20260709 12:59:26.434274  1203 consensus_queue.cc:260] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:26.435442  1203 raft_consensus.cc:3060] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.434492  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec50ac7ed5f4812b8c29213a0b30a34" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:26.436076  1128 raft_consensus.cc:3055] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:26.435990  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec50ac7ed5f4812b8c29213a0b30a34" candidate_uuid: "a0f4aa692e0a444283f0c59f4be948c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
I20260709 12:59:26.436146  1127 raft_consensus.cc:2468] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 3.
I20260709 12:59:26.436612  1128 raft_consensus.cc:740] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Running, Role: LEADER
I20260709 12:59:26.436762  1199 raft_consensus.cc:3060] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.437330  1128 consensus_queue.cc:260] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:26.438058  1128 raft_consensus.cc:3060] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.441658  1203 raft_consensus.cc:2468] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 3.
I20260709 12:59:26.442428  1128 raft_consensus.cc:2468] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 2.
I20260709 12:59:26.443037  1017 leader_election.cc:304] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9de0c5ee31ba4432976a654b0c837914, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:26.443871  1372 raft_consensus.cc:2804] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:26.444366  1199 raft_consensus.cc:2468] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f4aa692e0a444283f0c59f4be948c6 in term 2.
I20260709 12:59:26.444305  1018 leader_election.cc:304] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, a0f4aa692e0a444283f0c59f4be948c6; no voters: 
I20260709 12:59:26.444430  1053 leader_election.cc:290] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [CANDIDATE]: Term 2 election: Requested vote from peers 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:26.444340  1372 raft_consensus.cc:697] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 3 LEADER]: Becoming Leader. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Running, Role: LEADER
I20260709 12:59:26.445227  1351 raft_consensus.cc:2804] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:26.445927  1372 consensus_queue.cc:237] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:26.446570  1351 raft_consensus.cc:697] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Becoming Leader. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Running, Role: LEADER
I20260709 12:59:26.447484  1351 consensus_queue.cc:237] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:26.453131   952 catalog_manager.cc:5697] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 reported cstate change: term changed from 2 to 3, leader changed from 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195) to a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.463052   952 catalog_manager.cc:5697] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 reported cstate change: term changed from 1 to 2, leader changed from 36a001d95f2d438fab687f9da249a057 (127.0.107.194) to a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "a0f4aa692e0a444283f0c59f4be948c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.765571  1128 raft_consensus.cc:1275] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Refusing update from remote peer a0f4aa692e0a444283f0c59f4be948c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:26.767026  1351 consensus_queue.cc:1048] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.777536  1199 raft_consensus.cc:1275] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Refusing update from remote peer a0f4aa692e0a444283f0c59f4be948c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:26.781705  1351 consensus_queue.cc:1048] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.830025  1199 raft_consensus.cc:1275] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Refusing update from remote peer a0f4aa692e0a444283f0c59f4be948c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:26.831290  1372 consensus_queue.cc:1048] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.834748  1203 raft_consensus.cc:1275] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 4 FOLLOWER]: Refusing update from remote peer a0f4aa692e0a444283f0c59f4be948c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:26.836270  1372 consensus_queue.cc:1048] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:26.843825  1128 raft_consensus.cc:1275] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Refusing update from remote peer a0f4aa692e0a444283f0c59f4be948c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:26.849328  1128 raft_consensus.cc:1275] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 4 FOLLOWER]: Refusing update from remote peer a0f4aa692e0a444283f0c59f4be948c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:26.851042  1372 consensus_queue.cc:1048] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.851281  1380 consensus_queue.cc:1048] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:26.874382  1127 raft_consensus.cc:1275] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Refusing update from remote peer a0f4aa692e0a444283f0c59f4be948c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:26.875695  1380 consensus_queue.cc:1048] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.884382  1203 raft_consensus.cc:1275] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Refusing update from remote peer a0f4aa692e0a444283f0c59f4be948c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:26.885975  1380 consensus_queue.cc:1048] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:27.024187  1203 raft_consensus.cc:1275] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 3 FOLLOWER]: Refusing update from remote peer a0f4aa692e0a444283f0c59f4be948c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:27.025359  1380 consensus_queue.cc:1048] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:27.036047  1127 raft_consensus.cc:1275] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 3 FOLLOWER]: Refusing update from remote peer a0f4aa692e0a444283f0c59f4be948c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:27.037489  1372 consensus_queue.cc:1048] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:28.963284   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:28.971737  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17bbc270845440a08fc015ee0eb7641e"
dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
mode: GRACEFUL
new_leader_uuid: "36a001d95f2d438fab687f9da249a057"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:59:28.972288  1053 raft_consensus.cc:606] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 1 LEADER]: Received request to transfer leadership to TS 36a001d95f2d438fab687f9da249a057
I20260709 12:59:28.975049  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d"
dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
mode: GRACEFUL
new_leader_uuid: "9de0c5ee31ba4432976a654b0c837914"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:59:28.975569  1053 raft_consensus.cc:606] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 4 LEADER]: Received request to transfer leadership to TS 9de0c5ee31ba4432976a654b0c837914
I20260709 12:59:28.977727  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f62167d118ce404baba1bff12e001183"
dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
mode: GRACEFUL
new_leader_uuid: "36a001d95f2d438fab687f9da249a057"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:59:28.978178  1053 raft_consensus.cc:606] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Received request to transfer leadership to TS 36a001d95f2d438fab687f9da249a057
I20260709 12:59:28.980463  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e"
dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
mode: GRACEFUL
new_leader_uuid: "9de0c5ee31ba4432976a654b0c837914"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:59:28.980918  1053 raft_consensus.cc:606] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 3 LEADER]: Received request to transfer leadership to TS 9de0c5ee31ba4432976a654b0c837914
I20260709 12:59:28.981956   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:28.982438   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:29.144318  1395 raft_consensus.cc:993] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6: : Instructing follower 9de0c5ee31ba4432976a654b0c837914 to start an election
I20260709 12:59:29.144918  1372 raft_consensus.cc:1081] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 4 LEADER]: Signalling peer 9de0c5ee31ba4432976a654b0c837914 to start an election
I20260709 12:59:29.146291  1199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d"
dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
 from {username='slave'} at 127.0.0.1:58632
I20260709 12:59:29.146823  1199 raft_consensus.cc:493] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:29.147125  1199 raft_consensus.cc:3060] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:29.227145  1395 raft_consensus.cc:993] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6: : Instructing follower 9de0c5ee31ba4432976a654b0c837914 to start an election
I20260709 12:59:29.227694  1372 raft_consensus.cc:1081] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 3 LEADER]: Signalling peer 9de0c5ee31ba4432976a654b0c837914 to start an election
I20260709 12:59:29.228873  1372 raft_consensus.cc:993] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6: : Instructing follower 36a001d95f2d438fab687f9da249a057 to start an election
I20260709 12:59:29.229110  1203 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e"
dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
 from {username='slave'} at 127.0.0.1:58632
I20260709 12:59:29.229290  1395 raft_consensus.cc:1081] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 1 LEADER]: Signalling peer 36a001d95f2d438fab687f9da249a057 to start an election
I20260709 12:59:29.229612  1203 raft_consensus.cc:493] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:29.229986  1203 raft_consensus.cc:3060] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:29.230988  1127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17bbc270845440a08fc015ee0eb7641e"
dest_uuid: "36a001d95f2d438fab687f9da249a057"
 from {username='slave'} at 127.0.0.1:55700
I20260709 12:59:29.231485  1127 raft_consensus.cc:493] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:29.231788  1127 raft_consensus.cc:3060] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:29.242250  1199 raft_consensus.cc:515] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:29.242265  1127 raft_consensus.cc:515] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:29.245265  1127 leader_election.cc:290] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 2 election: Requested vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:29.246809  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17bbc270845440a08fc015ee0eb7641e" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
I20260709 12:59:29.246963  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17bbc270845440a08fc015ee0eb7641e" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
I20260709 12:59:29.245350  1199 leader_election.cc:290] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 5 election: Requested vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:29.248251  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:29.248502  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5e6b264ca0483487cf70a17124fd0d" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
I20260709 12:59:29.249343  1127 raft_consensus.cc:3060] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:29.247735  1202 raft_consensus.cc:3060] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:29.249366  1054 raft_consensus.cc:3055] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:29.249876  1054 raft_consensus.cc:740] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Running, Role: LEADER
I20260709 12:59:29.249882  1053 raft_consensus.cc:3055] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:29.251000  1053 raft_consensus.cc:740] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Running, Role: LEADER
I20260709 12:59:29.250675  1054 consensus_queue.cc:260] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:29.251976  1054 raft_consensus.cc:3060] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:29.251888  1053 consensus_queue.cc:260] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:29.253075  1053 raft_consensus.cc:3060] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:29.346832  1127 raft_consensus.cc:2468] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 5.
I20260709 12:59:29.346832  1054 raft_consensus.cc:2468] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 5.
I20260709 12:59:29.346885  1203 raft_consensus.cc:515] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:29.348217  1167 leader_election.cc:304] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, 9de0c5ee31ba4432976a654b0c837914; no voters: 
I20260709 12:59:29.349858  1346 raft_consensus.cc:2804] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:29.349958  1203 leader_election.cc:290] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 4 election: Requested vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893)
I20260709 12:59:29.354038  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "36a001d95f2d438fab687f9da249a057"
I20260709 12:59:29.354149  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84ad721a02348c5ac46c5a4fec2869e" candidate_uuid: "9de0c5ee31ba4432976a654b0c837914" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
I20260709 12:59:29.354802  1395 raft_consensus.cc:993] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6: : Instructing follower 36a001d95f2d438fab687f9da249a057 to start an election
I20260709 12:59:29.355393  1127 raft_consensus.cc:3060] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:29.355748  1346 raft_consensus.cc:697] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 5 LEADER]: Becoming Leader. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Running, Role: LEADER
I20260709 12:59:29.355611  1395 raft_consensus.cc:1081] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Signalling peer 36a001d95f2d438fab687f9da249a057 to start an election
I20260709 12:59:29.357120  1054 raft_consensus.cc:3055] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:29.357481  1054 raft_consensus.cc:740] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Running, Role: LEADER
I20260709 12:59:29.356909  1346 consensus_queue.cc:237] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } }
I20260709 12:59:29.358275  1054 consensus_queue.cc:260] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:29.359404  1054 raft_consensus.cc:3060] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:29.360746  1128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f62167d118ce404baba1bff12e001183"
dest_uuid: "36a001d95f2d438fab687f9da249a057"
 from {username='slave'} at 127.0.0.1:55700
I20260709 12:59:29.364611  1128 raft_consensus.cc:493] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:29.364964  1128 raft_consensus.cc:3060] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:29.366498   951 catalog_manager.cc:5697] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 reported cstate change: term changed from 4 to 5, leader changed from a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193) to 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "9de0c5ee31ba4432976a654b0c837914" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.451543  1053 raft_consensus.cc:2468] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 2.
I20260709 12:59:29.451543  1202 raft_consensus.cc:2468] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 2.
I20260709 12:59:29.454007  1092 leader_election.cc:304] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, 9de0c5ee31ba4432976a654b0c837914; no voters: 
I20260709 12:59:29.454805  1374 raft_consensus.cc:2804] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:29.456744  1374 raft_consensus.cc:697] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [term 2 LEADER]: Becoming Leader. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Running, Role: LEADER
I20260709 12:59:29.451596  1127 raft_consensus.cc:2468] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 4.
I20260709 12:59:29.458309  1167 leader_election.cc:304] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, 9de0c5ee31ba4432976a654b0c837914; no voters: 
I20260709 12:59:29.457556  1374 consensus_queue.cc:237] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:29.459141  1346 raft_consensus.cc:2804] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:29.459635  1346 raft_consensus.cc:697] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 4 LEADER]: Becoming Leader. State: Replica: 9de0c5ee31ba4432976a654b0c837914, State: Running, Role: LEADER
I20260709 12:59:29.460326  1346 consensus_queue.cc:237] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:29.466212   951 catalog_manager.cc:5697] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 reported cstate change: term changed from 1 to 2, leader changed from a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193) to 36a001d95f2d438fab687f9da249a057 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "36a001d95f2d438fab687f9da249a057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.468792   952 catalog_manager.cc:5697] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 reported cstate change: term changed from 3 to 4, leader changed from a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193) to 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "9de0c5ee31ba4432976a654b0c837914" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.555496  1054 raft_consensus.cc:2468] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9de0c5ee31ba4432976a654b0c837914 in term 4.
I20260709 12:59:29.555377  1128 raft_consensus.cc:515] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:29.557611  1128 leader_election.cc:290] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 3 election: Requested vote from peers a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081), 9de0c5ee31ba4432976a654b0c837914 (127.0.107.195:44281)
I20260709 12:59:29.558635  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62167d118ce404baba1bff12e001183" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9de0c5ee31ba4432976a654b0c837914"
I20260709 12:59:29.559126  1202 raft_consensus.cc:3060] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:29.558964  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62167d118ce404baba1bff12e001183" candidate_uuid: "36a001d95f2d438fab687f9da249a057" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0f4aa692e0a444283f0c59f4be948c6"
I20260709 12:59:29.559631  1054 raft_consensus.cc:3055] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:29.559942  1054 raft_consensus.cc:740] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0f4aa692e0a444283f0c59f4be948c6, State: Running, Role: LEADER
I20260709 12:59:29.560662  1054 consensus_queue.cc:260] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:29.561724  1054 raft_consensus.cc:3060] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:29.660811  1054 raft_consensus.cc:2468] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 3.
I20260709 12:59:29.660784  1202 raft_consensus.cc:2468] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36a001d95f2d438fab687f9da249a057 in term 3.
I20260709 12:59:29.662185  1092 leader_election.cc:304] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a001d95f2d438fab687f9da249a057, 9de0c5ee31ba4432976a654b0c837914; no voters: 
I20260709 12:59:29.662966  1374 raft_consensus.cc:2804] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:29.663489  1374 raft_consensus.cc:697] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 3 LEADER]: Becoming Leader. State: Replica: 36a001d95f2d438fab687f9da249a057, State: Running, Role: LEADER
I20260709 12:59:29.664256  1374 consensus_queue.cc:237] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } }
I20260709 12:59:29.671151   952 catalog_manager.cc:5697] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 reported cstate change: term changed from 2 to 3, leader changed from a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193) to 36a001d95f2d438fab687f9da249a057 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "36a001d95f2d438fab687f9da249a057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.782502  1054 raft_consensus.cc:1275] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 5 FOLLOWER]: Refusing update from remote peer 9de0c5ee31ba4432976a654b0c837914: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:29.783874  1346 consensus_queue.cc:1048] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:29.795854  1128 raft_consensus.cc:1275] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 5 FOLLOWER]: Refusing update from remote peer 9de0c5ee31ba4432976a654b0c837914: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:29.797744  1408 consensus_queue.cc:1048] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:29.973420  1054 raft_consensus.cc:1275] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 4 FOLLOWER]: Refusing update from remote peer 9de0c5ee31ba4432976a654b0c837914: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:29.974635  1408 consensus_queue.cc:1048] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f4aa692e0a444283f0c59f4be948c6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:29.983510   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:29.984032  1128 raft_consensus.cc:1275] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 4 FOLLOWER]: Refusing update from remote peer 9de0c5ee31ba4432976a654b0c837914: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:29.986209  1408 consensus_queue.cc:1048] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a001d95f2d438fab687f9da249a057" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:29.994016   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:59:30.015718  1202 raft_consensus.cc:1275] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Refusing update from remote peer 36a001d95f2d438fab687f9da249a057: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:30.018780  1374 consensus_queue.cc:1048] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de0c5ee31ba4432976a654b0c837914" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:30.023922  1094 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 12:59:30.029172  1094 consensus_peers.cc:597] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 -> Peer a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081): Couldn't send request to peer a0f4aa692e0a444283f0c59f4be948c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:30.034868   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:30.036607   431 tablet_replica.cc:333] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6: stopping tablet replica
I20260709 12:59:30.037569   431 raft_consensus.cc:2243] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.038209   431 raft_consensus.cc:2272] T f84ad721a02348c5ac46c5a4fec2869e P a0f4aa692e0a444283f0c59f4be948c6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.041502   431 tablet_replica.cc:333] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6: stopping tablet replica
I20260709 12:59:30.042307   431 raft_consensus.cc:2243] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.042819   431 raft_consensus.cc:2272] T 2f5e6b264ca0483487cf70a17124fd0d P a0f4aa692e0a444283f0c59f4be948c6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.045491   431 tablet_replica.cc:333] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6: stopping tablet replica
I20260709 12:59:30.046043   431 raft_consensus.cc:2243] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:30.046726   431 raft_consensus.cc:2272] T 2ec50ac7ed5f4812b8c29213a0b30a34 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.048498   431 tablet_replica.cc:333] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6: stopping tablet replica
I20260709 12:59:30.049007   431 raft_consensus.cc:2243] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:30.049693   431 raft_consensus.cc:2272] T bf8b6f826968464bb649cbc3ca6ce5fa P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.051517   431 tablet_replica.cc:333] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P a0f4aa692e0a444283f0c59f4be948c6: stopping tablet replica
I20260709 12:59:30.051992   431 raft_consensus.cc:2243] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.052373   431 raft_consensus.cc:2272] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P a0f4aa692e0a444283f0c59f4be948c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.054140   431 tablet_replica.cc:333] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6: stopping tablet replica
I20260709 12:59:30.054646   431 raft_consensus.cc:2243] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.055011   431 raft_consensus.cc:2272] T f62167d118ce404baba1bff12e001183 P a0f4aa692e0a444283f0c59f4be948c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.056994   431 tablet_replica.cc:333] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6: stopping tablet replica
I20260709 12:59:30.057464   431 raft_consensus.cc:2243] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.057963   431 raft_consensus.cc:2272] T a7fc24e938dd48309b6db90da4e90eea P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.060137   431 tablet_replica.cc:333] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6: stopping tablet replica
I20260709 12:59:30.060817   431 raft_consensus.cc:2243] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:30.061519   431 raft_consensus.cc:2272] T ecd65356a26d418e8779c157010c56d4 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.063623   431 tablet_replica.cc:333] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6: stopping tablet replica
I20260709 12:59:30.064141   431 raft_consensus.cc:2243] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.064524   431 raft_consensus.cc:2272] T 17bbc270845440a08fc015ee0eb7641e P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.066177   431 tablet_replica.cc:333] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6: stopping tablet replica
I20260709 12:59:30.066828   431 raft_consensus.cc:2243] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:30.067740   431 raft_consensus.cc:2272] T ea077c7afddc4a31a03bdba1dce16279 P a0f4aa692e0a444283f0c59f4be948c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.096774   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 12:59:30.117954   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:59:30.140061   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:30.140805   431 tablet_replica.cc:333] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057: stopping tablet replica
I20260709 12:59:30.141723   431 raft_consensus.cc:2243] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.142344   431 raft_consensus.cc:2272] T f84ad721a02348c5ac46c5a4fec2869e P 36a001d95f2d438fab687f9da249a057 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.144454   431 tablet_replica.cc:333] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057: stopping tablet replica
I20260709 12:59:30.144929   431 raft_consensus.cc:2243] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.145275   431 raft_consensus.cc:2272] T ea077c7afddc4a31a03bdba1dce16279 P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.146695   431 tablet_replica.cc:333] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057: stopping tablet replica
I20260709 12:59:30.147123   431 raft_consensus.cc:2243] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:30.147855   431 raft_consensus.cc:2272] T a7fc24e938dd48309b6db90da4e90eea P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.149406   431 tablet_replica.cc:333] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057: stopping tablet replica
I20260709 12:59:30.149866   431 raft_consensus.cc:2243] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:30.150367   431 pending_rounds.cc:70] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057: Trying to abort 1 pending ops.
I20260709 12:59:30.150549   431 pending_rounds.cc:77] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305633667751763968 op_type: NO_OP noop_request { }
I20260709 12:59:30.150831   431 raft_consensus.cc:2889] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:59:30.151059   431 raft_consensus.cc:2272] T f62167d118ce404baba1bff12e001183 P 36a001d95f2d438fab687f9da249a057 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.153081   431 tablet_replica.cc:333] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057: stopping tablet replica
I20260709 12:59:30.153532   431 raft_consensus.cc:2243] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.153873   431 raft_consensus.cc:2272] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.155380   431 tablet_replica.cc:333] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057: stopping tablet replica
I20260709 12:59:30.155804   431 raft_consensus.cc:2243] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.156122   431 raft_consensus.cc:2272] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 36a001d95f2d438fab687f9da249a057 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.157891   431 tablet_replica.cc:333] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057: stopping tablet replica
I20260709 12:59:30.158311   431 raft_consensus.cc:2243] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.158654   431 raft_consensus.cc:2272] T bf8b6f826968464bb649cbc3ca6ce5fa P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.160254   431 tablet_replica.cc:333] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057: stopping tablet replica
I20260709 12:59:30.160640   431 raft_consensus.cc:2243] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.160962   431 raft_consensus.cc:2272] T ecd65356a26d418e8779c157010c56d4 P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.162484   431 tablet_replica.cc:333] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057: stopping tablet replica
I20260709 12:59:30.163347   431 raft_consensus.cc:2243] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:30.164095   431 raft_consensus.cc:2272] T 17bbc270845440a08fc015ee0eb7641e P 36a001d95f2d438fab687f9da249a057 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.165933   431 tablet_replica.cc:333] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057: stopping tablet replica
I20260709 12:59:30.166355   431 raft_consensus.cc:2243] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.166675   431 raft_consensus.cc:2272] T 2f5e6b264ca0483487cf70a17124fd0d P 36a001d95f2d438fab687f9da249a057 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.193929   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:59:30.211427   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:59:30.241075   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:30.243443   431 tablet_replica.cc:333] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914: stopping tablet replica
W20260709 12:59:30.243642  1167 consensus_peers.cc:597] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 -> Peer 36a001d95f2d438fab687f9da249a057 (127.0.107.194:35893): Couldn't send request to peer 36a001d95f2d438fab687f9da249a057. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:30.244292   431 raft_consensus.cc:2243] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.244894   431 raft_consensus.cc:2272] T ea077c7afddc4a31a03bdba1dce16279 P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:30.245827  1168 consensus_peers.cc:597] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 -> Peer a0f4aa692e0a444283f0c59f4be948c6 (127.0.107.193:42081): Couldn't send request to peer a0f4aa692e0a444283f0c59f4be948c6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:30.247030   431 tablet_replica.cc:333] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914: stopping tablet replica
I20260709 12:59:30.247925   431 raft_consensus.cc:2243] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:59:30.248759   431 raft_consensus.cc:2272] T f84ad721a02348c5ac46c5a4fec2869e P 9de0c5ee31ba4432976a654b0c837914 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.251068   431 tablet_replica.cc:333] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914: stopping tablet replica
I20260709 12:59:30.251670   431 raft_consensus.cc:2243] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:59:30.252768   431 raft_consensus.cc:2272] T 2ce3bb32182b48dfb5c0e8c3e7c967a2 P 9de0c5ee31ba4432976a654b0c837914 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.254498   431 tablet_replica.cc:333] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914: stopping tablet replica
I20260709 12:59:30.255163   431 raft_consensus.cc:2243] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.255689   431 raft_consensus.cc:2272] T 2ec50ac7ed5f4812b8c29213a0b30a34 P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.257290   431 tablet_replica.cc:333] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914: stopping tablet replica
I20260709 12:59:30.257862   431 raft_consensus.cc:2243] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.258636   431 raft_consensus.cc:2272] T bf8b6f826968464bb649cbc3ca6ce5fa P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.261066   431 tablet_replica.cc:333] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914: stopping tablet replica
I20260709 12:59:30.261736   431 raft_consensus.cc:2243] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:59:30.262727   431 raft_consensus.cc:2272] T 2f5e6b264ca0483487cf70a17124fd0d P 9de0c5ee31ba4432976a654b0c837914 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.265285   431 tablet_replica.cc:333] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914: stopping tablet replica
I20260709 12:59:30.265921   431 raft_consensus.cc:2243] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.266438   431 raft_consensus.cc:2272] T f62167d118ce404baba1bff12e001183 P 9de0c5ee31ba4432976a654b0c837914 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.269068   431 tablet_replica.cc:333] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914: stopping tablet replica
I20260709 12:59:30.269662   431 raft_consensus.cc:2243] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.270144   431 raft_consensus.cc:2272] T a7fc24e938dd48309b6db90da4e90eea P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.271947   431 tablet_replica.cc:333] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914: stopping tablet replica
I20260709 12:59:30.272464   431 raft_consensus.cc:2243] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.272895   431 raft_consensus.cc:2272] T ecd65356a26d418e8779c157010c56d4 P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.274535   431 tablet_replica.cc:333] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914: stopping tablet replica
I20260709 12:59:30.275038   431 raft_consensus.cc:2243] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.275519   431 raft_consensus.cc:2272] T 17bbc270845440a08fc015ee0eb7641e P 9de0c5ee31ba4432976a654b0c837914 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.303470   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:59:30.322799   431 master.cc:562] Master@127.0.107.254:34711 shutting down...
I20260709 12:59:30.343156   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:59:30.343681   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.343950   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P c5b55fc01c664e25ad6162ddc4e7093a: stopping tablet replica
I20260709 12:59:30.363668   431 master.cc:584] Master@127.0.107.254:34711 shutdown complete.
36a001d95f2d438fab687f9da249a057  4
9de0c5ee31ba4432976a654b0c837914  1
a0f4aa692e0a444283f0c59f4be948c6  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10725 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:59:30.408542   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:43923
I20260709 12:59:30.409637   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:30.415768  1421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:30.417204  1423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:30.416219  1420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:30.423149   431 server_base.cc:1061] running on GCE node
I20260709 12:59:30.424263   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:30.424461   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:30.424590   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601970424578 us; error 0 us; skew 500 ppm
I20260709 12:59:30.425122   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:30.427851   431 webserver.cc:533] Webserver started at http://127.0.107.254:33049/ using document root <none> and password file <none>
I20260709 12:59:30.428337   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:30.428558   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:30.428809   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:30.429992   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/master-0-root/instance:
uuid: "b9f5bb9ff31f4ba4a2568147b35a35db"
format_stamp: "Formatted at 2026-07-09 12:59:30 on dist-test-slave-zhw8"
I20260709 12:59:30.435563   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.005s
I20260709 12:59:30.438917  1428 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:30.439852   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:59:30.440162   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/master-0-root
uuid: "b9f5bb9ff31f4ba4a2568147b35a35db"
format_stamp: "Formatted at 2026-07-09 12:59:30 on dist-test-slave-zhw8"
I20260709 12:59:30.440469   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:30.476433   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:30.477674   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:30.528236   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:43923
I20260709 12:59:30.528560  1479 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:43923 every 8 connection(s)
I20260709 12:59:30.533208  1480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:30.544297  1480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Bootstrap starting.
I20260709 12:59:30.548852  1480 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.553014  1480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: No bootstrap required, opened a new log
I20260709 12:59:30.555037  1480 raft_consensus.cc:359] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9f5bb9ff31f4ba4a2568147b35a35db" member_type: VOTER }
I20260709 12:59:30.555521  1480 raft_consensus.cc:385] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.555711  1480 raft_consensus.cc:740] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9f5bb9ff31f4ba4a2568147b35a35db, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.556288  1480 consensus_queue.cc:260] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9f5bb9ff31f4ba4a2568147b35a35db" member_type: VOTER }
I20260709 12:59:30.556718  1480 raft_consensus.cc:399] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:59:30.556912  1480 raft_consensus.cc:493] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:59:30.557117  1480 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.561754  1480 raft_consensus.cc:515] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9f5bb9ff31f4ba4a2568147b35a35db" member_type: VOTER }
I20260709 12:59:30.562265  1480 leader_election.cc:304] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b9f5bb9ff31f4ba4a2568147b35a35db; no voters: 
I20260709 12:59:30.563472  1480 leader_election.cc:290] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:59:30.563796  1483 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:30.565507  1483 raft_consensus.cc:697] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [term 1 LEADER]: Becoming Leader. State: Replica: b9f5bb9ff31f4ba4a2568147b35a35db, State: Running, Role: LEADER
I20260709 12:59:30.566323  1483 consensus_queue.cc:237] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9f5bb9ff31f4ba4a2568147b35a35db" member_type: VOTER }
I20260709 12:59:30.566493  1480 sys_catalog.cc:565] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:59:30.569665  1484 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b9f5bb9ff31f4ba4a2568147b35a35db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9f5bb9ff31f4ba4a2568147b35a35db" member_type: VOTER } }
I20260709 12:59:30.569725  1485 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [sys.catalog]: SysCatalogTable state changed. Reason: New leader b9f5bb9ff31f4ba4a2568147b35a35db. Latest consensus state: current_term: 1 leader_uuid: "b9f5bb9ff31f4ba4a2568147b35a35db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9f5bb9ff31f4ba4a2568147b35a35db" member_type: VOTER } }
I20260709 12:59:30.570510  1484 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:30.570531  1485 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:30.573798  1489 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:59:30.579111  1489 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:59:30.583575   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:59:30.588877  1489 catalog_manager.cc:1383] Generated new cluster ID: 17c5bfb4b16d42ffae9ef904c0871a46
I20260709 12:59:30.589174  1489 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:59:30.607039  1489 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:59:30.608397  1489 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:59:30.619349  1489 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Generated new TSK 0
I20260709 12:59:30.619949  1489 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:59:30.650804   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:30.658177  1501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:30.658792  1502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:30.660813  1504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:30.661582   431 server_base.cc:1061] running on GCE node
I20260709 12:59:30.662351   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:30.662539   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:30.662662   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601970662651 us; error 0 us; skew 500 ppm
I20260709 12:59:30.663129   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:30.665412   431 webserver.cc:533] Webserver started at http://127.0.107.193:37627/ using document root <none> and password file <none>
I20260709 12:59:30.665839   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:30.666013   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:30.666225   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:30.667317   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root/instance:
uuid: "d7158d6c3b634dc7abb69eac58eba291"
format_stamp: "Formatted at 2026-07-09 12:59:30 on dist-test-slave-zhw8"
I20260709 12:59:30.673087   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:59:30.676447  1509 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:30.677486   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:59:30.677753   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root
uuid: "d7158d6c3b634dc7abb69eac58eba291"
format_stamp: "Formatted at 2026-07-09 12:59:30 on dist-test-slave-zhw8"
I20260709 12:59:30.678086   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:30.699226   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:30.700450   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:30.701912   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:30.704648   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:30.704833   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:30.705149   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:30.705300   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:30.750155   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:41871
I20260709 12:59:30.750276  1571 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:41871 every 8 connection(s)
I20260709 12:59:30.755402   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:30.764000  1576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:30.766741  1577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:30.769860  1579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:30.770749   431 server_base.cc:1061] running on GCE node
I20260709 12:59:30.772083   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:30.772266   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:30.772509   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601970772489 us; error 0 us; skew 500 ppm
I20260709 12:59:30.773214   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:30.776172  1572 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43923
I20260709 12:59:30.776804  1572 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:30.777004   431 webserver.cc:533] Webserver started at http://127.0.107.194:44391/ using document root <none> and password file <none>
I20260709 12:59:30.777606   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:30.777845   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:30.777825  1572 heartbeater.cc:507] Master 127.0.107.254:43923 requested a full tablet report, sending...
I20260709 12:59:30.778317   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:30.779758   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root/instance:
uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
format_stamp: "Formatted at 2026-07-09 12:59:30 on dist-test-slave-zhw8"
I20260709 12:59:30.780661  1445 ts_manager.cc:194] Registered new tserver with Master: d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 12:59:30.782696  1445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42114
I20260709 12:59:30.785013   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:59:30.789206  1584 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:30.790241   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:59:30.790578   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root
uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
format_stamp: "Formatted at 2026-07-09 12:59:30 on dist-test-slave-zhw8"
I20260709 12:59:30.790915   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:30.838133   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:30.839462   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:30.840988   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:30.843384   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:30.843604   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:30.843850   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:30.844027   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:30.886888   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:39981
I20260709 12:59:30.887014  1646 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:39981 every 8 connection(s)
I20260709 12:59:30.891804   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:30.899431  1650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:30.900540  1651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:30.903921  1653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:30.904090   431 server_base.cc:1061] running on GCE node
I20260709 12:59:30.905175   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:30.905445   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:30.905614   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601970905600 us; error 0 us; skew 500 ppm
I20260709 12:59:30.906104  1647 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43923
I20260709 12:59:30.906275   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:30.906499  1647 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:30.907323  1647 heartbeater.cc:507] Master 127.0.107.254:43923 requested a full tablet report, sending...
I20260709 12:59:30.909152   431 webserver.cc:533] Webserver started at http://127.0.107.195:37267/ using document root <none> and password file <none>
I20260709 12:59:30.909552  1445 ts_manager.cc:194] Registered new tserver with Master: dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:30.909792   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:30.910046   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:30.910356   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:30.911374  1445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42122
I20260709 12:59:30.911904   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root/instance:
uuid: "822e08445eae4a33b2f2fe92060192c6"
format_stamp: "Formatted at 2026-07-09 12:59:30 on dist-test-slave-zhw8"
I20260709 12:59:30.916530   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:59:30.920006  1658 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:30.920915   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:59:30.921166   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root
uuid: "822e08445eae4a33b2f2fe92060192c6"
format_stamp: "Formatted at 2026-07-09 12:59:30 on dist-test-slave-zhw8"
I20260709 12:59:30.921399   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:30.938433   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:30.940146   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:30.941383   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:30.943832   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:30.944072   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:30.944314   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:30.944489   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:30.989713   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:34459
I20260709 12:59:30.989830  1720 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:34459 every 8 connection(s)
I20260709 12:59:31.004004  1721 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43923
I20260709 12:59:31.004433  1721 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:31.005158  1721 heartbeater.cc:507] Master 127.0.107.254:43923 requested a full tablet report, sending...
I20260709 12:59:31.007048  1445 ts_manager.cc:194] Registered new tserver with Master: 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:31.008010   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014960368s
I20260709 12:59:31.008512  1445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42132
I20260709 12:59:31.038146  1445 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42136:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:59:31.045594  1445 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:59:31.259043  1686 tablet_service.cc:1511] Processing CreateTablet for tablet 5814bf31e900408885160ea0f89d6189 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:59:31.260566  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5814bf31e900408885160ea0f89d6189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.260627  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee97fe9eef14f818a1f9178885dfc31 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:59:31.262017  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee97fe9eef14f818a1f9178885dfc31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.259043  1685 tablet_service.cc:1511] Processing CreateTablet for tablet 685ae4154c6d4c3abdaf18547da9ffe2 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:59:31.269141  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 5814bf31e900408885160ea0f89d6189 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:59:31.270577  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5814bf31e900408885160ea0f89d6189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.270399  1682 tablet_service.cc:1511] Processing CreateTablet for tablet d0a7e28ddafe4ac389f2603e93af8dba (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:59:31.271683  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a7e28ddafe4ac389f2603e93af8dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.272426  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 6c40365464684a5d86c2918b7b0160d4 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:59:31.269176  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 4f5673bb37ab4e1b9ae5af2d2091b347 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:59:31.273836  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c40365464684a5d86c2918b7b0160d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.274446  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f5673bb37ab4e1b9ae5af2d2091b347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.274266  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee97fe9eef14f818a1f9178885dfc31 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:59:31.272426  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 685ae4154c6d4c3abdaf18547da9ffe2 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:59:31.277489  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685ae4154c6d4c3abdaf18547da9ffe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.278294  1531 tablet_service.cc:1511] Processing CreateTablet for tablet bd6921d4b2d8478f99effa533f8d9f3d (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:59:31.280110  1533 tablet_service.cc:1511] Processing CreateTablet for tablet d0a7e28ddafe4ac389f2603e93af8dba (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:59:31.281834  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 4f5673bb37ab4e1b9ae5af2d2091b347 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:59:31.283802  1530 tablet_service.cc:1511] Processing CreateTablet for tablet c4270ae85dd544aeb602acb371def068 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:59:31.285235  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee97fe9eef14f818a1f9178885dfc31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.285058  1680 tablet_service.cc:1511] Processing CreateTablet for tablet bd6921d4b2d8478f99effa533f8d9f3d (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:59:31.287374  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 6c40365464684a5d86c2918b7b0160d4 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:59:31.287706  1529 tablet_service.cc:1511] Processing CreateTablet for tablet 520ee35af44d4a529e945654996352cc (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:59:31.290853  1679 tablet_service.cc:1511] Processing CreateTablet for tablet c4270ae85dd544aeb602acb371def068 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:59:31.294320  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 520ee35af44d4a529e945654996352cc (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:59:31.295416  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685ae4154c6d4c3abdaf18547da9ffe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.296555  1528 tablet_service.cc:1511] Processing CreateTablet for tablet b42f5c0b467d44b1878074fc21fa8f41 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:59:31.297922  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520ee35af44d4a529e945654996352cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.300020  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6921d4b2d8478f99effa533f8d9f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.301726  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520ee35af44d4a529e945654996352cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.303437  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6921d4b2d8478f99effa533f8d9f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.305176  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4270ae85dd544aeb602acb371def068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.307358  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c40365464684a5d86c2918b7b0160d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.337633  1677 tablet_service.cc:1511] Processing CreateTablet for tablet b42f5c0b467d44b1878074fc21fa8f41 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:59:31.342949  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42f5c0b467d44b1878074fc21fa8f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.344355  1612 tablet_service.cc:1511] Processing CreateTablet for tablet 5814bf31e900408885160ea0f89d6189 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:59:31.345723  1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5814bf31e900408885160ea0f89d6189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.348507  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 685ae4154c6d4c3abdaf18547da9ffe2 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:59:31.350059  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685ae4154c6d4c3abdaf18547da9ffe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.352532  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee97fe9eef14f818a1f9178885dfc31 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:59:31.353996  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee97fe9eef14f818a1f9178885dfc31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.356689  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 4f5673bb37ab4e1b9ae5af2d2091b347 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:59:31.358204  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f5673bb37ab4e1b9ae5af2d2091b347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.360225  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f5673bb37ab4e1b9ae5af2d2091b347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.360590  1608 tablet_service.cc:1511] Processing CreateTablet for tablet d0a7e28ddafe4ac389f2603e93af8dba (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:59:31.363065  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 6c40365464684a5d86c2918b7b0160d4 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:59:31.364010  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4270ae85dd544aeb602acb371def068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.366672  1605 tablet_service.cc:1511] Processing CreateTablet for tablet c4270ae85dd544aeb602acb371def068 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:59:31.368439  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 2d351fa3549448eda026a66b8c124d58 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:59:31.368913  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 520ee35af44d4a529e945654996352cc (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:59:31.369820  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42f5c0b467d44b1878074fc21fa8f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.371722  1603 tablet_service.cc:1511] Processing CreateTablet for tablet b42f5c0b467d44b1878074fc21fa8f41 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:59:31.368924  1606 tablet_service.cc:1511] Processing CreateTablet for tablet bd6921d4b2d8478f99effa533f8d9f3d (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:59:31.375964  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a7e28ddafe4ac389f2603e93af8dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.385885  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 7803266de9984fac88726b08bee73921 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:59:31.382103  1686 tablet_service.cc:1511] Processing CreateTablet for tablet 7803266de9984fac88726b08bee73921 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:59:31.390514  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7803266de9984fac88726b08bee73921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.393221  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a7e28ddafe4ac389f2603e93af8dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.384490  1736 tablet_bootstrap.cc:492] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:31.395583  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4270ae85dd544aeb602acb371def068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.399595  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520ee35af44d4a529e945654996352cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.402034  1736 tablet_bootstrap.cc:654] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:31.378824  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 2d351fa3549448eda026a66b8c124d58 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:59:31.403604  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42f5c0b467d44b1878074fc21fa8f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.411173  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d351fa3549448eda026a66b8c124d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.412957  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 2efa93934d6a4a8182f175ae59fc177e (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:59:31.420292  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c40365464684a5d86c2918b7b0160d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.431883  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d351fa3549448eda026a66b8c124d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.434504  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efa93934d6a4a8182f175ae59fc177e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.422465  1537 tablet_service.cc:1511] Processing CreateTablet for tablet c528a0f6bdb44c4187c750d0b1429ba1 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:59:31.441207  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7803266de9984fac88726b08bee73921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.440965  1685 tablet_service.cc:1511] Processing CreateTablet for tablet c528a0f6bdb44c4187c750d0b1429ba1 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:59:31.442231  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c528a0f6bdb44c4187c750d0b1429ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.423643  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 2efa93934d6a4a8182f175ae59fc177e (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:59:31.456499  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efa93934d6a4a8182f175ae59fc177e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.461644  1612 tablet_service.cc:1511] Processing CreateTablet for tablet 4142f46c85974609aa207df00c3d031e (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:59:31.430255  1678 tablet_service.cc:1511] Processing CreateTablet for tablet b19a10a05aa24743a6d1222179fd4af4 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:59:31.467514  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6921d4b2d8478f99effa533f8d9f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.440974  1737 tablet_bootstrap.cc:492] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:31.468225  1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4142f46c85974609aa207df00c3d031e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.474676  1737 tablet_bootstrap.cc:654] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:31.478617  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19a10a05aa24743a6d1222179fd4af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.483956  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c528a0f6bdb44c4187c750d0b1429ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.484776  1530 tablet_service.cc:1511] Processing CreateTablet for tablet b19a10a05aa24743a6d1222179fd4af4 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:59:31.486007  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19a10a05aa24743a6d1222179fd4af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.493425  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 646909798f0047ef9e8073d28a784525 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:59:31.494944  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 646909798f0047ef9e8073d28a784525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.511350  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 646909798f0047ef9e8073d28a784525 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:59:31.513026  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 646909798f0047ef9e8073d28a784525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.514137  1612 tablet_service.cc:1511] Processing CreateTablet for tablet 2d351fa3549448eda026a66b8c124d58 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:59:31.515865  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 13edebc31dfe4957b3870b909ea5330e (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:59:31.517691  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13edebc31dfe4957b3870b909ea5330e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.565728  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 05911a041e044f48bce12648b58061be (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
W20260709 12:59:31.579869  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:31.587932  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 13edebc31dfe4957b3870b909ea5330e (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:59:31.589828  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13edebc31dfe4957b3870b909ea5330e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.603889  1736 tablet_bootstrap.cc:492] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:31.604610  1736 ts_tablet_manager.cc:1403] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.220s	user 0.016s	sys 0.015s
I20260709 12:59:31.605073  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 927e42de9e944ae8a2d45f30be59d5df (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:59:31.606343  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927e42de9e944ae8a2d45f30be59d5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.562736  1533 tablet_service.cc:1511] Processing CreateTablet for tablet 05911a041e044f48bce12648b58061be (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:59:31.598234  1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d351fa3549448eda026a66b8c124d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.611186  1738 tablet_bootstrap.cc:492] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:31.619406  1529 tablet_service.cc:1511] Processing CreateTablet for tablet 4142f46c85974609aa207df00c3d031e (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:59:31.620021  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 1365c85d063446a6a6a589798b355741 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:59:31.620806  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4142f46c85974609aa207df00c3d031e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.621464  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1365c85d063446a6a6a589798b355741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.625197  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05911a041e044f48bce12648b58061be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.624974  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 2efa93934d6a4a8182f175ae59fc177e (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:59:31.626595  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 7803266de9984fac88726b08bee73921 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:59:31.631366  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05911a041e044f48bce12648b58061be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.635356  1736 raft_consensus.cc:359] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:31.636159  1736 raft_consensus.cc:385] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:31.636507  1736 raft_consensus.cc:740] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:31.637267  1736 consensus_queue.cc:260] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:31.640796  1608 tablet_service.cc:1511] Processing CreateTablet for tablet b19a10a05aa24743a6d1222179fd4af4 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:59:31.642584  1686 tablet_service.cc:1511] Processing CreateTablet for tablet 4142f46c85974609aa207df00c3d031e (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:59:31.648348  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 646909798f0047ef9e8073d28a784525 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:59:31.659225  1736 ts_tablet_manager.cc:1434] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.054s	user 0.011s	sys 0.003s
I20260709 12:59:31.662964  1572 heartbeater.cc:499] Master 127.0.107.254:43923 was elected leader, sending a full tablet report...
I20260709 12:59:31.666536  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 05911a041e044f48bce12648b58061be (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:59:31.668637  1736 tablet_bootstrap.cc:492] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:31.678869  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7803266de9984fac88726b08bee73921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.679733  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efa93934d6a4a8182f175ae59fc177e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.680550  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05911a041e044f48bce12648b58061be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.683669  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4142f46c85974609aa207df00c3d031e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.686638  1738 tablet_bootstrap.cc:654] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:31.689459  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 646909798f0047ef9e8073d28a784525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.692786  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 0f253020cc7a4b66aa6c8f66a42d44c6 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:59:31.694046  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f253020cc7a4b66aa6c8f66a42d44c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.678912  1685 tablet_service.cc:1511] Processing CreateTablet for tablet 1365c85d063446a6a6a589798b355741 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:59:31.696506  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1365c85d063446a6a6a589798b355741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.698915  1736 tablet_bootstrap.cc:654] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:31.707566  1737 tablet_bootstrap.cc:492] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:31.708032  1737 ts_tablet_manager.cc:1403] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.267s	user 0.036s	sys 0.052s
I20260709 12:59:31.710665  1741 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.689435  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 927e42de9e944ae8a2d45f30be59d5df (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:59:31.677234  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 13edebc31dfe4957b3870b909ea5330e (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:59:31.711149  1741 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:31.710909  1737 raft_consensus.cc:359] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:31.721545  1737 raft_consensus.cc:385] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:31.727622  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19a10a05aa24743a6d1222179fd4af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.744787  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 03423b07f7be422db9d20b7313be1bab (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:59:31.748482  1741 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:31.748857  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 0f253020cc7a4b66aa6c8f66a42d44c6 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:59:31.753072  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 32470c2737744478bac199459790b787 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:59:31.737093  1737 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:31.755795  1737 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:31.724047  1603 tablet_service.cc:1511] Processing CreateTablet for tablet c528a0f6bdb44c4187c750d0b1429ba1 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:59:31.764459  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 0f253020cc7a4b66aa6c8f66a42d44c6 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:59:31.766360  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f253020cc7a4b66aa6c8f66a42d44c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.747037  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03423b07f7be422db9d20b7313be1bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.769094  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 5d987fd742df4898acd2aaa15097431c (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:59:31.771019  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d987fd742df4898acd2aaa15097431c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.763105  1677 tablet_service.cc:1511] Processing CreateTablet for tablet fa1a194f4d834ee6aa037d727b8f9e2a (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:59:31.698742  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 1365c85d063446a6a6a589798b355741 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:59:31.720045  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 927e42de9e944ae8a2d45f30be59d5df (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:59:31.803210  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f253020cc7a4b66aa6c8f66a42d44c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.803822  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32470c2737744478bac199459790b787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.814494  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c528a0f6bdb44c4187c750d0b1429ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.815155  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 32470c2737744478bac199459790b787 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:59:31.816437  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32470c2737744478bac199459790b787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.818075  1721 heartbeater.cc:499] Master 127.0.107.254:43923 was elected leader, sending a full tablet report...
I20260709 12:59:31.818810  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13edebc31dfe4957b3870b909ea5330e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.821269  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927e42de9e944ae8a2d45f30be59d5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.828449  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 5d987fd742df4898acd2aaa15097431c (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:59:31.829795  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d987fd742df4898acd2aaa15097431c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.833504  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1365c85d063446a6a6a589798b355741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.836153  1529 tablet_service.cc:1511] Processing CreateTablet for tablet 03423b07f7be422db9d20b7313be1bab (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:59:31.837591  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03423b07f7be422db9d20b7313be1bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.838871  1736 tablet_bootstrap.cc:492] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:31.839401  1736 ts_tablet_manager.cc:1403] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.171s	user 0.025s	sys 0.033s
I20260709 12:59:31.847373  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1a194f4d834ee6aa037d727b8f9e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.856348  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 5d987fd742df4898acd2aaa15097431c (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:59:31.857713  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d987fd742df4898acd2aaa15097431c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.841565  1533 tablet_service.cc:1511] Processing CreateTablet for tablet fa1a194f4d834ee6aa037d727b8f9e2a (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:59:31.898231  1530 tablet_service.cc:1511] Processing CreateTablet for tablet 02b29fae0aae48f28944958f7ef007fa (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:59:31.863709  1679 tablet_service.cc:1511] Processing CreateTablet for tablet e52504b3c7614b43be2a7cf1be42ad66 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:59:31.863193  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 5a69de749cce497b83e6489ad367017a (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:59:31.867733  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 03423b07f7be422db9d20b7313be1bab (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:59:31.903164  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03423b07f7be422db9d20b7313be1bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.870208  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 12:59:31.909085  1512 leader_election.cc:343] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:31.909853  1745 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.910410  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 4ceaee3af9aa446a8796bde98fd46779 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:59:31.880257  1737 ts_tablet_manager.cc:1434] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.172s	user 0.016s	sys 0.022s
I20260709 12:59:31.874148  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 02b29fae0aae48f28944958f7ef007fa (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:59:31.881778  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 32470c2737744478bac199459790b787 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:59:31.870148  1736 raft_consensus.cc:359] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:31.913203  1736 raft_consensus.cc:385] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:31.884363  1532 tablet_service.cc:1511] Processing CreateTablet for tablet e52504b3c7614b43be2a7cf1be42ad66 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:59:31.913514  1736 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:31.913657  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32470c2737744478bac199459790b787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.913874  1647 heartbeater.cc:499] Master 127.0.107.254:43923 was elected leader, sending a full tablet report...
I20260709 12:59:31.910339  1745 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:31.884709  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927e42de9e944ae8a2d45f30be59d5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.915537  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e52504b3c7614b43be2a7cf1be42ad66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.916716  1745 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:31.924059  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 5a69de749cce497b83e6489ad367017a (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:59:31.925483  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a69de749cce497b83e6489ad367017a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.927563  1610 tablet_service.cc:1511] Processing CreateTablet for tablet fa1a194f4d834ee6aa037d727b8f9e2a (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:59:31.880182  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 6817bc4013144ede80163d16316d4860 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:59:31.879006  1685 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0db569e82e490f9de2c0a9300c24bf (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:59:31.888602  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1a194f4d834ee6aa037d727b8f9e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.931365  1605 tablet_service.cc:1511] Processing CreateTablet for tablet e52504b3c7614b43be2a7cf1be42ad66 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:59:31.933422  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 6817bc4013144ede80163d16316d4860 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:59:31.934396  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e52504b3c7614b43be2a7cf1be42ad66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.935082  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6817bc4013144ede80163d16316d4860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.881857  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 5a69de749cce497b83e6489ad367017a (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:59:31.937402  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b29fae0aae48f28944958f7ef007fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.938310  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a69de749cce497b83e6489ad367017a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.939556  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b29fae0aae48f28944958f7ef007fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.940013  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a69de749cce497b83e6489ad367017a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.940265  1737 tablet_bootstrap.cc:492] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:31.940878  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0db569e82e490f9de2c0a9300c24bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.941504  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6817bc4013144ede80163d16316d4860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.941267  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0db569e82e490f9de2c0a9300c24bf (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:59:31.942745  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0db569e82e490f9de2c0a9300c24bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.945076  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1a194f4d834ee6aa037d727b8f9e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.946889  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e52504b3c7614b43be2a7cf1be42ad66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.956588  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ceaee3af9aa446a8796bde98fd46779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.961735  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7d1afbc98a49f3a48b32b8d2b9b646 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:59:31.977968  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7d1afbc98a49f3a48b32b8d2b9b646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.991494  1736 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:31.995729  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0db569e82e490f9de2c0a9300c24bf (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:59:31.997094  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0db569e82e490f9de2c0a9300c24bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.999905  1738 tablet_bootstrap.cc:492] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:32.000411  1738 ts_tablet_manager.cc:1403] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.389s	user 0.037s	sys 0.005s
I20260709 12:59:32.013139  1736 ts_tablet_manager.cc:1434] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.173s	user 0.007s	sys 0.004s
I20260709 12:59:32.016929  1736 tablet_bootstrap.cc:492] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:32.022331  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 02b29fae0aae48f28944958f7ef007fa (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:59:32.023761  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b29fae0aae48f28944958f7ef007fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.037842  1686 tablet_service.cc:1511] Processing CreateTablet for tablet 89f88fe569c2476cb298d5e6b745bb5c (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:59:32.048076  1681 tablet_service.cc:1511] Processing CreateTablet for tablet cdca03ab6655412d9f1d4fea1f1acf78 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:59:32.053135  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdca03ab6655412d9f1d4fea1f1acf78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.105649  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f88fe569c2476cb298d5e6b745bb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.055461  1738 raft_consensus.cc:359] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.082476  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:32.107316  1511 leader_election.cc:343] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.107767  1511 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:32.108872  1741 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:32.109683  1738 raft_consensus.cc:385] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.110064  1738 raft_consensus.cc:740] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.111002  1738 consensus_queue.cc:260] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.111672  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 6817bc4013144ede80163d16316d4860 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:59:32.113050  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6817bc4013144ede80163d16316d4860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.115809  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:32.116542  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 4ceaee3af9aa446a8796bde98fd46779 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 12:59:32.117671  1660 leader_election.cc:343] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.121975  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 4ceaee3af9aa446a8796bde98fd46779 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:59:32.123399  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ceaee3af9aa446a8796bde98fd46779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.124297  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:32.125023  1547 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:32.125989  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7d1afbc98a49f3a48b32b8d2b9b646 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:59:32.126526  1659 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:32.127534  1745 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:32.127889  1745 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.128235  1745 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.135030  1745 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.136281  1737 tablet_bootstrap.cc:654] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.137104  1745 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:32.137943  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:32.138520  1547 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.138564  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 12:59:32.140878  1660 leader_election.cc:343] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.142376  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7d1afbc98a49f3a48b32b8d2b9b646 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:59:32.143714  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7d1afbc98a49f3a48b32b8d2b9b646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.145038  1529 tablet_service.cc:1511] Processing CreateTablet for tablet 89f88fe569c2476cb298d5e6b745bb5c (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:59:32.145325  1531 tablet_service.cc:1511] Processing CreateTablet for tablet cdca03ab6655412d9f1d4fea1f1acf78 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:59:32.137928  1612 tablet_service.cc:1511] Processing CreateTablet for tablet 89f88fe569c2476cb298d5e6b745bb5c (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:59:32.147354  1736 tablet_bootstrap.cc:654] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.157308  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdca03ab6655412d9f1d4fea1f1acf78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.159068  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2222d3d1694f2d93fb2f0702805e3e (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:59:32.152392  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7d1afbc98a49f3a48b32b8d2b9b646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.160392  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2222d3d1694f2d93fb2f0702805e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.115895  1678 tablet_service.cc:1511] Processing CreateTablet for tablet ad3e3b7b46ab493c8eda918df77def64 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:59:32.168292  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad3e3b7b46ab493c8eda918df77def64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.168414  1533 tablet_service.cc:1511] Processing CreateTablet for tablet ad3e3b7b46ab493c8eda918df77def64 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:59:32.169657  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad3e3b7b46ab493c8eda918df77def64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.170899  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 710dba62795546819d9b3fd89ad4e8fe (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:59:32.172183  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710dba62795546819d9b3fd89ad4e8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.184926  1610 tablet_service.cc:1511] Processing CreateTablet for tablet ad3e3b7b46ab493c8eda918df77def64 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:59:32.191812  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca86ee366e14bdd8686ea8e5b48be10 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:59:32.193130  1738 ts_tablet_manager.cc:1434] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.192s	user 0.010s	sys 0.000s
I20260709 12:59:32.193279  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca86ee366e14bdd8686ea8e5b48be10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.194226  1738 tablet_bootstrap.cc:492] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:32.197067  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 6e3bc16a73cd42baba8ebfcbf2a0e93b (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:59:32.198288  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e3bc16a73cd42baba8ebfcbf2a0e93b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.203516  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 7b5efbd7e50442858cc9d27a08f50b3e (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:59:32.204871  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b5efbd7e50442858cc9d27a08f50b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.210292  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2222d3d1694f2d93fb2f0702805e3e (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:59:32.212110  1603 tablet_service.cc:1511] Processing CreateTablet for tablet cdca03ab6655412d9f1d4fea1f1acf78 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:59:32.212733  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2222d3d1694f2d93fb2f0702805e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.191910  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ceaee3af9aa446a8796bde98fd46779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.210794  1685 tablet_service.cc:1511] Processing CreateTablet for tablet e4b724996f86487f991c761b011e8aaf (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:59:32.217949  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 7b5efbd7e50442858cc9d27a08f50b3e (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:59:32.202980  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2222d3d1694f2d93fb2f0702805e3e (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:59:32.219682  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b724996f86487f991c761b011e8aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.221457  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 9831a5f16aac472b8ce4f707c039e298 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:59:32.222779  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9831a5f16aac472b8ce4f707c039e298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.224479  1530 tablet_service.cc:1511] Processing CreateTablet for tablet e4b724996f86487f991c761b011e8aaf (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:59:32.225625  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b5efbd7e50442858cc9d27a08f50b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.226231  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 710dba62795546819d9b3fd89ad4e8fe (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:59:32.227924  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b724996f86487f991c761b011e8aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.215060  1547 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:32.219498  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdca03ab6655412d9f1d4fea1f1acf78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.206928  1608 tablet_service.cc:1511] Processing CreateTablet for tablet 7b5efbd7e50442858cc9d27a08f50b3e (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:59:32.239401  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 6e3bc16a73cd42baba8ebfcbf2a0e93b (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:59:32.240756  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e3bc16a73cd42baba8ebfcbf2a0e93b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.241396  1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f88fe569c2476cb298d5e6b745bb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.242316  1659 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:32.243187  1745 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:32.245981  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2222d3d1694f2d93fb2f0702805e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.241385  1686 tablet_service.cc:1511] Processing CreateTablet for tablet c97fa1eb9d6548d3852cfed83b346e69 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:59:32.248307  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b5efbd7e50442858cc9d27a08f50b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.248523  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97fa1eb9d6548d3852cfed83b346e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.253964  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca86ee366e14bdd8686ea8e5b48be10 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:59:32.279034  1751 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.279642  1751 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.282368  1751 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:32.265514  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 6e3bc16a73cd42baba8ebfcbf2a0e93b (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:59:32.296809  1607 tablet_service.cc:1511] Processing CreateTablet for tablet e4b724996f86487f991c761b011e8aaf (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:59:32.289312  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710dba62795546819d9b3fd89ad4e8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.233655  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 710dba62795546819d9b3fd89ad4e8fe (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:59:32.306047  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca86ee366e14bdd8686ea8e5b48be10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.319518  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e3bc16a73cd42baba8ebfcbf2a0e93b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.319101  1683 tablet_service.cc:1511] Processing CreateTablet for tablet b11a3619de25451bbe5a091f271cfa6b (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:59:32.320995  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b11a3619de25451bbe5a091f271cfa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.324086  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 9831a5f16aac472b8ce4f707c039e298 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:59:32.305531  1745 raft_consensus.cc:697] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:32.343775  1736 tablet_bootstrap.cc:492] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:32.344326  1736 ts_tablet_manager.cc:1403] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.328s	user 0.021s	sys 0.007s
I20260709 12:59:32.344659  1738 tablet_bootstrap.cc:654] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.347169  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 00924ae4c66740e59de627a44de33c38 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:59:32.350400  1681 tablet_service.cc:1511] Processing CreateTablet for tablet ded1641387fd4fd4be29caddb22781fb (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:59:32.351594  1535 tablet_service.cc:1511] Processing CreateTablet for tablet c97fa1eb9d6548d3852cfed83b346e69 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:59:32.360987  1736 raft_consensus.cc:359] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.361843  1736 raft_consensus.cc:385] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.362164  1736 raft_consensus.cc:740] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.363055  1736 consensus_queue.cc:260] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.368619  1736 ts_tablet_manager.cc:1434] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.024s	user 0.014s	sys 0.000s
I20260709 12:59:32.369745  1736 tablet_bootstrap.cc:492] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:32.354452  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad3e3b7b46ab493c8eda918df77def64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.354833  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f88fe569c2476cb298d5e6b745bb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.381649  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b724996f86487f991c761b011e8aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.382113  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 9831a5f16aac472b8ce4f707c039e298 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:59:32.383610  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9831a5f16aac472b8ce4f707c039e298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.397835  1737 tablet_bootstrap.cc:492] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:32.398504  1737 ts_tablet_manager.cc:1403] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.458s	user 0.017s	sys 0.038s
I20260709 12:59:32.404812  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 9355ac91422346bb9f5dfa3c1424df25 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:59:32.409901  1533 tablet_service.cc:1511] Processing CreateTablet for tablet b11a3619de25451bbe5a091f271cfa6b (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:59:32.412087  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97fa1eb9d6548d3852cfed83b346e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.419605  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710dba62795546819d9b3fd89ad4e8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.420195  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9355ac91422346bb9f5dfa3c1424df25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.420528  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9831a5f16aac472b8ce4f707c039e298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.420990  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca86ee366e14bdd8686ea8e5b48be10 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:59:32.407616  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 17d7fbb63fde4df88c4345a9532b4738 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:59:32.421717  1603 tablet_service.cc:1511] Processing CreateTablet for tablet c97fa1eb9d6548d3852cfed83b346e69 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:59:32.422345  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca86ee366e14bdd8686ea8e5b48be10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.426172  1737 raft_consensus.cc:359] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.427302  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d7fbb63fde4df88c4345a9532b4738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.431461  1745 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.423125  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97fa1eb9d6548d3852cfed83b346e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.441977  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b11a3619de25451bbe5a091f271cfa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.442019  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00924ae4c66740e59de627a44de33c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.443434  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:32.448716  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 4b6f3b457deb4725b437c627cc3a5cd7 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 12:59:32.462215  1585 leader_election.cc:343] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.468195  1736 tablet_bootstrap.cc:654] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.468921  1738 tablet_bootstrap.cc:492] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:32.469622  1738 ts_tablet_manager.cc:1403] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.276s	user 0.016s	sys 0.000s
I20260709 12:59:32.472204  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 00924ae4c66740e59de627a44de33c38 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:59:32.472844  1738 raft_consensus.cc:359] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } }
I20260709 12:59:32.473667  1738 raft_consensus.cc:385] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.474009  1738 raft_consensus.cc:740] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.475314  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded1641387fd4fd4be29caddb22781fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.477838  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b6f3b457deb4725b437c627cc3a5cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.480436  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 00924ae4c66740e59de627a44de33c38 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:59:32.481909  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00924ae4c66740e59de627a44de33c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.482331  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 1becd217447147aeb09608ec3f5c123b (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:59:32.483139  1608 tablet_service.cc:1511] Processing CreateTablet for tablet b11a3619de25451bbe5a091f271cfa6b (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:59:32.484539  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b11a3619de25451bbe5a091f271cfa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.489567  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00924ae4c66740e59de627a44de33c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.432677  1737 raft_consensus.cc:385] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.491438  1737 raft_consensus.cc:740] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.492370  1737 consensus_queue.cc:260] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.494704  1737 ts_tablet_manager.cc:1434] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.096s	user 0.002s	sys 0.007s
I20260709 12:59:32.495505  1530 tablet_service.cc:1511] Processing CreateTablet for tablet 9355ac91422346bb9f5dfa3c1424df25 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:59:32.496467  1686 tablet_service.cc:1511] Processing CreateTablet for tablet 158ebfb5c6324189947e23e5386968e4 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:59:32.497391  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9355ac91422346bb9f5dfa3c1424df25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.483624  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1becd217447147aeb09608ec3f5c123b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.503062  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 17d7fbb63fde4df88c4345a9532b4738 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:59:32.506024  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 4b6f3b457deb4725b437c627cc3a5cd7 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:59:32.515511  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158ebfb5c6324189947e23e5386968e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.474813  1738 consensus_queue.cc:260] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } }
I20260709 12:59:32.517946  1736 tablet_bootstrap.cc:492] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:32.518420  1736 ts_tablet_manager.cc:1403] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.149s	user 0.009s	sys 0.006s
I20260709 12:59:32.492553  1531 tablet_service.cc:1511] Processing CreateTablet for tablet ded1641387fd4fd4be29caddb22781fb (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:59:32.515549  1737 tablet_bootstrap.cc:492] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:32.521377  1736 raft_consensus.cc:359] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } }
I20260709 12:59:32.522073  1736 raft_consensus.cc:385] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.522349  1736 raft_consensus.cc:740] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.525588  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 9355ac91422346bb9f5dfa3c1424df25 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:59:32.525950  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:32.526849  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9355ac91422346bb9f5dfa3c1424df25. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:32.527912  1587 leader_election.cc:343] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.528422  1587 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:32.529587  1751 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:32.531795  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d7fbb63fde4df88c4345a9532b4738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.532362  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 1becd217447147aeb09608ec3f5c123b (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:59:32.535858  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b6f3b457deb4725b437c627cc3a5cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.536305  1612 tablet_service.cc:1511] Processing CreateTablet for tablet ded1641387fd4fd4be29caddb22781fb (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:59:32.516251  1685 tablet_service.cc:1511] Processing CreateTablet for tablet 479456ab418d44c4983d2bb37eb0e700 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:59:32.541819  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 4b6f3b457deb4725b437c627cc3a5cd7 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:59:32.534646  1738 ts_tablet_manager.cc:1434] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.065s	user 0.001s	sys 0.005s
I20260709 12:59:32.543934  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479456ab418d44c4983d2bb37eb0e700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.552074  1738 tablet_bootstrap.cc:492] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:32.552610  1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded1641387fd4fd4be29caddb22781fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.558146  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 1becd217447147aeb09608ec3f5c123b (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:59:32.559947  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 17d7fbb63fde4df88c4345a9532b4738 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:59:32.563077  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d7fbb63fde4df88c4345a9532b4738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.565076  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 158ebfb5c6324189947e23e5386968e4 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:59:32.566294  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158ebfb5c6324189947e23e5386968e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.566674  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 479456ab418d44c4983d2bb37eb0e700 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:59:32.562000  1737 tablet_bootstrap.cc:654] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.568368  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b6f3b457deb4725b437c627cc3a5cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.581418  1736 consensus_queue.cc:260] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } }
W20260709 12:59:32.582777  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:32.568730  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 9c6a5febc6e54b13a4ed0d342e7b7f8f (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:59:32.571503  1753 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.592795  1753 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.594964  1753 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:32.597457  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 9c6a5febc6e54b13a4ed0d342e7b7f8f (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:59:32.598737  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c6a5febc6e54b13a4ed0d342e7b7f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.596089  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:32.600495  1533 tablet_service.cc:1511] Processing CreateTablet for tablet 158ebfb5c6324189947e23e5386968e4 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:59:32.597743  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1becd217447147aeb09608ec3f5c123b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:32.600997  1660 leader_election.cc:343] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.596347  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:32.611343  1547 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:32.611939  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded1641387fd4fd4be29caddb22781fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.613155  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 479456ab418d44c4983d2bb37eb0e700 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:59:32.613649  1659 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:32.614377  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479456ab418d44c4983d2bb37eb0e700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.614847  1753 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:32.615257  1753 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.615621  1753 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.617424  1529 tablet_service.cc:1511] Processing CreateTablet for tablet 9c6a5febc6e54b13a4ed0d342e7b7f8f (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:59:32.618759  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c6a5febc6e54b13a4ed0d342e7b7f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.619314  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1becd217447147aeb09608ec3f5c123b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.619910  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479456ab418d44c4983d2bb37eb0e700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.620401  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 63e2429c350c4d36a523ed1c4955ef23 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:59:32.597443  1736 ts_tablet_manager.cc:1434] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.000s
I20260709 12:59:32.626309  1608 tablet_service.cc:1511] Processing CreateTablet for tablet 63e2429c350c4d36a523ed1c4955ef23 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:59:32.632138  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c6a5febc6e54b13a4ed0d342e7b7f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.634946  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 67f0dcf1e89644688ea3e2603f9a37d0 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:59:32.636319  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 63e2429c350c4d36a523ed1c4955ef23 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:59:32.639300  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 67f0dcf1e89644688ea3e2603f9a37d0 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:59:32.645728  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63e2429c350c4d36a523ed1c4955ef23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.655426  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f0dcf1e89644688ea3e2603f9a37d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.658247  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 7aca6dcf002947d6841150860825871b (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:59:32.660928  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 67f0dcf1e89644688ea3e2603f9a37d0 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:59:32.662189  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f0dcf1e89644688ea3e2603f9a37d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.662858  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 7aca6dcf002947d6841150860825871b (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:59:32.664327  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aca6dcf002947d6841150860825871b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.668547  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63e2429c350c4d36a523ed1c4955ef23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.670953  1736 tablet_bootstrap.cc:492] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:32.681013  1443 catalog_manager.cc:5697] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.659725  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aca6dcf002947d6841150860825871b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.684914  1686 tablet_service.cc:1511] Processing CreateTablet for tablet b5871ff5fd9c4673b5650490648edf26 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:59:32.688192  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f0dcf1e89644688ea3e2603f9a37d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.695359  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5daaba0e764f4ca8876bda9d220973 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:59:32.696766  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5daaba0e764f4ca8876bda9d220973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.695479  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 7aca6dcf002947d6841150860825871b (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:59:32.700699  1736 tablet_bootstrap.cc:654] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.703732  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63e2429c350c4d36a523ed1c4955ef23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.705513  1738 tablet_bootstrap.cc:654] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.685089  1753 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.708614  1753 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:32.709816  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:32.710073  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:32.710412  1547 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:32.711365  1660 leader_election.cc:343] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.712857  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5871ff5fd9c4673b5650490648edf26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.718384  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158ebfb5c6324189947e23e5386968e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.734438  1547 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:32.736059  1659 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:32.737185  1753 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:32.737864  1753 raft_consensus.cc:697] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:32.739048  1753 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.751338  1611 tablet_service.cc:1511] Processing CreateTablet for tablet b5871ff5fd9c4673b5650490648edf26 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:59:32.753002  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5871ff5fd9c4673b5650490648edf26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.762153  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aca6dcf002947d6841150860825871b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.777094  1741 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.777637  1741 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.780697  1738 tablet_bootstrap.cc:492] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:32.781167  1738 ts_tablet_manager.cc:1403] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.229s	user 0.006s	sys 0.012s
I20260709 12:59:32.781490  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:32.783070  1511 leader_election.cc:343] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.784551  1738 raft_consensus.cc:359] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.785250  1738 raft_consensus.cc:385] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.785568  1738 raft_consensus.cc:740] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.785418  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 12:59:32.786953  1512 leader_election.cc:343] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.787470  1512 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:32.791517  1738 consensus_queue.cc:260] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.796975  1737 tablet_bootstrap.cc:492] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:32.797524  1737 ts_tablet_manager.cc:1403] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.282s	user 0.004s	sys 0.014s
I20260709 12:59:32.798884  1738 ts_tablet_manager.cc:1434] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.017s	user 0.000s	sys 0.008s
I20260709 12:59:32.799903  1738 tablet_bootstrap.cc:492] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:32.803921  1531 tablet_service.cc:1511] Processing CreateTablet for tablet b5871ff5fd9c4673b5650490648edf26 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:59:32.805310  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5871ff5fd9c4673b5650490648edf26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.806648  1738 tablet_bootstrap.cc:654] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.816885  1736 tablet_bootstrap.cc:492] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:32.817404  1736 ts_tablet_manager.cc:1403] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.147s	user 0.014s	sys 0.007s
I20260709 12:59:32.790218  1741 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:32.819674  1741 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:32.821599  1736 raft_consensus.cc:359] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.822314  1736 raft_consensus.cc:385] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.822669  1736 raft_consensus.cc:740] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.825309  1736 consensus_queue.cc:260] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.836269  1737 raft_consensus.cc:359] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } }
I20260709 12:59:32.836551  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5daaba0e764f4ca8876bda9d220973 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:59:32.837013  1737 raft_consensus.cc:385] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.837342  1737 raft_consensus.cc:740] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.837940  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5daaba0e764f4ca8876bda9d220973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.838268  1737 consensus_queue.cc:260] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } }
W20260709 12:59:32.835130  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 48216.7us
I20260709 12:59:32.840548  1737 ts_tablet_manager.cc:1434] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.004s
I20260709 12:59:32.851770  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5daaba0e764f4ca8876bda9d220973 (DEFAULT_TABLE table=test-workload [id=b4707bb388214cfa862131e3f63f3467]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:59:32.853000  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5daaba0e764f4ca8876bda9d220973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.857743  1737 tablet_bootstrap.cc:492] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:32.867580  1736 ts_tablet_manager.cc:1434] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.050s	user 0.003s	sys 0.007s
I20260709 12:59:32.868067  1737 tablet_bootstrap.cc:654] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.868372  1764 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.869052  1764 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } }
I20260709 12:59:32.873385  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:32.874064  1622 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:32.875448  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:32.876044  1696 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:32.877322  1512 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:32.879766  1741 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:32.880678  1741 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.881357  1741 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.879499  1764 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:32.886118  1736 tablet_bootstrap.cc:492] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:32.891295  1741 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } }
I20260709 12:59:32.897040  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:32.897264  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:32.897610  1696 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.898200  1622 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.901069  1737 tablet_bootstrap.cc:492] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:32.901566  1737 ts_tablet_manager.cc:1403] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.012s
I20260709 12:59:32.893720  1738 tablet_bootstrap.cc:492] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:32.903586  1738 ts_tablet_manager.cc:1403] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.104s	user 0.020s	sys 0.001s
I20260709 12:59:32.904699  1737 raft_consensus.cc:359] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.905421  1737 raft_consensus.cc:385] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.894560  1736 tablet_bootstrap.cc:654] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.905704  1737 raft_consensus.cc:740] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.906131  1696 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:32.908711  1741 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:32.909456  1512 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:32.905714  1622 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:32.910456  1741 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:32.906319  1738 raft_consensus.cc:359] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.913071  1738 raft_consensus.cc:385] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.913116  1741 raft_consensus.cc:697] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:32.913894  1738 raft_consensus.cc:740] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.907521  1737 consensus_queue.cc:260] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.915216  1738 consensus_queue.cc:260] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.917426  1737 ts_tablet_manager.cc:1434] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:59:32.917892  1736 tablet_bootstrap.cc:492] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:32.918342  1736 ts_tablet_manager.cc:1403] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.038s	user 0.003s	sys 0.013s
I20260709 12:59:32.918705  1737 tablet_bootstrap.cc:492] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:32.914557  1741 consensus_queue.cc:237] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } }
I20260709 12:59:32.921537  1738 ts_tablet_manager.cc:1434] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:59:32.921599  1736 raft_consensus.cc:359] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.922340  1736 raft_consensus.cc:385] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.922762  1738 tablet_bootstrap.cc:492] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:32.922641  1736 raft_consensus.cc:740] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.924209  1736 consensus_queue.cc:260] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.927194  1736 ts_tablet_manager.cc:1434] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 12:59:32.928484  1736 tablet_bootstrap.cc:492] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:32.937145  1736 tablet_bootstrap.cc:654] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.938691  1737 tablet_bootstrap.cc:654] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.942248  1751 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.942876  1751 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.945945  1738 tablet_bootstrap.cc:654] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.946075  1443 catalog_manager.cc:5697] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.947445  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:32.948220  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:32.948954  1547 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 12:59:32.950209  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:32.951473  1751 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:32.951942  1751 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.955605  1737 tablet_bootstrap.cc:492] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:32.956074  1737 ts_tablet_manager.cc:1403] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.001s
I20260709 12:59:32.959448  1737 raft_consensus.cc:359] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.960173  1737 raft_consensus.cc:385] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.960446  1737 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.961351  1751 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:32.961361  1737 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.964608  1737 ts_tablet_manager.cc:1434] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:59:32.963688  1444 catalog_manager.cc:5697] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:32.966336  1736 tablet_bootstrap.cc:492] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:32.966794  1736 ts_tablet_manager.cc:1403] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.008s
I20260709 12:59:32.967193  1738 tablet_bootstrap.cc:492] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:32.967761  1738 ts_tablet_manager.cc:1403] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.000s
I20260709 12:59:32.969627  1736 raft_consensus.cc:359] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.970373  1736 raft_consensus.cc:385] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.970693  1736 raft_consensus.cc:740] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.970532  1738 raft_consensus.cc:359] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.971386  1738 raft_consensus.cc:385] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.971729  1738 raft_consensus.cc:740] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.971585  1736 consensus_queue.cc:260] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.972493  1738 consensus_queue.cc:260] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.973868  1736 ts_tablet_manager.cc:1434] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:59:32.975108  1736 tablet_bootstrap.cc:492] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:32.975543  1738 ts_tablet_manager.cc:1434] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:59:32.973886  1737 tablet_bootstrap.cc:492] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:32.976780  1738 tablet_bootstrap.cc:492] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:32.979306  1751 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.979779  1751 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:32.981822  1751 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:32.981915  1736 tablet_bootstrap.cc:654] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.983866  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 12:59:32.985191  1587 leader_election.cc:343] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.987208  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:32.988885  1738 tablet_bootstrap.cc:654] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:32.988943  1585 leader_election.cc:343] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.989466  1585 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:32.990551  1751 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:32.993992  1737 tablet_bootstrap.cc:654] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.997450  1753 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:33.000118  1736 tablet_bootstrap.cc:492] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:33.000708  1736 ts_tablet_manager.cc:1403] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.003s
I20260709 12:59:33.004860  1736 raft_consensus.cc:359] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.005782  1736 raft_consensus.cc:385] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.006134  1736 raft_consensus.cc:740] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.015689  1738 tablet_bootstrap.cc:492] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:33.016197  1738 ts_tablet_manager.cc:1403] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.018s
I20260709 12:59:33.016297  1736 consensus_queue.cc:260] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.010464  1753 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.018225  1753 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.019505  1738 raft_consensus.cc:359] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.020277  1738 raft_consensus.cc:385] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.020586  1738 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.021364  1738 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.021811  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 12:59:33.023283  1659 leader_election.cc:343] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.023428  1736 ts_tablet_manager.cc:1434] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:59:33.023783  1738 ts_tablet_manager.cc:1434] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:59:33.024488  1736 tablet_bootstrap.cc:492] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:33.024721  1738 tablet_bootstrap.cc:492] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:33.027998  1741 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.028473  1741 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.030951  1736 tablet_bootstrap.cc:654] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.031392  1738 tablet_bootstrap.cc:654] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.031713  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:33.033131  1737 tablet_bootstrap.cc:492] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
W20260709 12:59:33.033306  1511 leader_election.cc:343] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.033631  1737 ts_tablet_manager.cc:1403] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.060s	user 0.024s	sys 0.003s
I20260709 12:59:33.033934  1751 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.034421  1751 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.037583  1737 raft_consensus.cc:359] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.038662  1737 raft_consensus.cc:385] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.039047  1737 raft_consensus.cc:740] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.040103  1737 consensus_queue.cc:260] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.040772  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:33.041407  1546 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:33.042445  1585 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:33.043589  1776 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:33.044035  1776 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.044363  1776 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.045372  1737 ts_tablet_manager.cc:1434] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:59:33.045789  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:33.046434  1696 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:33.046813  1737 tablet_bootstrap.cc:492] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
W20260709 12:59:33.051012  1660 consensus_peers.cc:597] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:33.055033  1751 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.055049  1776 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.058264  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:33.058912  1546 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.059672  1741 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.061156  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:33.061776  1696 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:33.062908  1736 tablet_bootstrap.cc:492] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:33.063095  1512 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:33.063546  1736 ts_tablet_manager.cc:1403] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.003s
I20260709 12:59:33.065963  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:33.066607  1622 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:33.067592  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:33.068131  1776 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.068670  1745 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:33.069056  1546 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 12:59:33.069371  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:33.069967  1696 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.070294  1737 tablet_bootstrap.cc:654] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.069058  1745 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.071744  1745 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.072171  1764 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.072746  1738 tablet_bootstrap.cc:492] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:33.072649  1764 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.073278  1738 ts_tablet_manager.cc:1403] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.037s
I20260709 12:59:33.074679  1764 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.076483  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:33.077766  1511 leader_election.cc:343] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.067648  1736 raft_consensus.cc:359] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.078259  1736 raft_consensus.cc:385] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.078685  1736 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.077999  1738 raft_consensus.cc:359] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.079464  1738 raft_consensus.cc:385] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.079716  1585 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:33.080399  1741 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:33.080677  1736 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.080781  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:33.081208  1753 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:33.080797  1741 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.082671  1776 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:33.083128  1776 raft_consensus.cc:697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 12:59:33.083904  1776 consensus_queue.cc:237] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:33.084740  1512 leader_election.cc:343] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.085464  1512 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:33.086462  1764 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:33.078681  1745 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.089020  1745 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:33.080054  1738 raft_consensus.cc:740] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.089706  1737 tablet_bootstrap.cc:492] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:33.090273  1737 ts_tablet_manager.cc:1403] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.019s
I20260709 12:59:33.090179  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:33.090358  1736 ts_tablet_manager.cc:1434] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:59:33.090991  1622 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.091605  1736 tablet_bootstrap.cc:492] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:33.094125  1737 raft_consensus.cc:359] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.094873  1737 raft_consensus.cc:385] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.095212  1737 raft_consensus.cc:740] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.095947  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:33.096486  1546 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.096567  1737 consensus_queue.cc:260] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.098338  1736 tablet_bootstrap.cc:654] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.098922  1737 ts_tablet_manager.cc:1434] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 12:59:33.099891  1737 tablet_bootstrap.cc:492] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:33.094400  1696 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 12:59:33.082286  1741 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.104110  1546 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:33.106120  1659 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:33.107139  1745 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:33.090181  1738 consensus_queue.cc:260] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.110955  1736 tablet_bootstrap.cc:492] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:33.111433  1736 ts_tablet_manager.cc:1403] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.003s
I20260709 12:59:33.111907  1738 ts_tablet_manager.cc:1434] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.004s
I20260709 12:59:33.113061  1737 tablet_bootstrap.cc:654] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.113933  1736 raft_consensus.cc:359] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.114969  1736 raft_consensus.cc:385] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.115280  1736 raft_consensus.cc:740] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.115989  1736 consensus_queue.cc:260] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.122319  1738 tablet_bootstrap.cc:492] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:33.125349  1741 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.130103  1736 ts_tablet_manager.cc:1434] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:59:33.131824  1736 tablet_bootstrap.cc:492] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:33.145776  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:33.146788  1737 tablet_bootstrap.cc:492] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:33.147480  1737 ts_tablet_manager.cc:1403] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.005s
I20260709 12:59:33.148969  1622 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
W20260709 12:59:33.150712  1511 leader_election.cc:343] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.152218  1737 raft_consensus.cc:359] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.153450  1737 raft_consensus.cc:385] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.153963  1737 raft_consensus.cc:740] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.144210  1745 raft_consensus.cc:697] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:33.156066  1745 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.157915  1736 tablet_bootstrap.cc:654] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.159137  1737 consensus_queue.cc:260] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.163189  1737 ts_tablet_manager.cc:1434] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 12:59:33.162889  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:33.163877  1696 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.164050  1737 tablet_bootstrap.cc:492] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:33.168435  1445 catalog_manager.cc:5697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.169504  1737 tablet_bootstrap.cc:654] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.161454  1741 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.172192  1696 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:33.173950  1512 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:33.175016  1741 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:33.175544  1741 raft_consensus.cc:697] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:33.176374  1741 consensus_queue.cc:237] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.177145  1738 tablet_bootstrap.cc:654] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.198251  1736 tablet_bootstrap.cc:492] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:33.199946  1736 ts_tablet_manager.cc:1403] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.007s
I20260709 12:59:33.202663  1737 tablet_bootstrap.cc:492] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:33.204183  1737 ts_tablet_manager.cc:1403] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.008s
I20260709 12:59:33.205972  1736 raft_consensus.cc:359] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.206509  1736 raft_consensus.cc:385] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.206745  1736 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.207137  1745 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.207656  1745 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.209108  1736 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.210700  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:33.210896  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:33.211151  1736 ts_tablet_manager.cc:1434] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 12:59:33.211445  1547 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:33.211498  1622 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:33.212391  1736 tablet_bootstrap.cc:492] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:33.212970  1659 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:33.212311  1442 catalog_manager.cc:5697] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:33.213812  1745 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:33.214579  1745 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:33.214957  1745 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.215380  1745 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.216969  1445 catalog_manager.cc:5697] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.219300  1736 tablet_bootstrap.cc:654] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.222098  1738 tablet_bootstrap.cc:492] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:33.222550  1738 ts_tablet_manager.cc:1403] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.101s	user 0.025s	sys 0.004s
I20260709 12:59:33.223948  1745 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.225265  1738 raft_consensus.cc:359] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.225972  1738 raft_consensus.cc:385] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.226263  1738 raft_consensus.cc:740] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.227059  1738 consensus_queue.cc:260] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.227946  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:33.228685  1547 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.238714  1547 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:33.240636  1659 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:33.241849  1792 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:33.242610  1792 raft_consensus.cc:697] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:33.243619  1738 ts_tablet_manager.cc:1434] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.004s
I20260709 12:59:33.243860  1792 consensus_queue.cc:237] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.244589  1738 tablet_bootstrap.cc:492] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:33.241326  1737 raft_consensus.cc:359] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.247767  1737 raft_consensus.cc:385] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.248062  1737 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.249460  1737 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.250638  1738 tablet_bootstrap.cc:654] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.251394  1737 ts_tablet_manager.cc:1434] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.003s
I20260709 12:59:33.251758  1745 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:33.252306  1737 tablet_bootstrap.cc:492] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:33.253170  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:33.253768  1622 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.258701  1736 tablet_bootstrap.cc:492] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:33.259147  1736 ts_tablet_manager.cc:1403] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.018s
I20260709 12:59:33.262346  1736 raft_consensus.cc:359] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.262975  1736 raft_consensus.cc:385] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.263283  1736 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.264093  1736 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.264637  1622 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:33.267999  1737 tablet_bootstrap.cc:654] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.270223  1736 ts_tablet_manager.cc:1434] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:59:33.270581  1738 tablet_bootstrap.cc:492] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:33.271026  1738 ts_tablet_manager.cc:1403] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.011s
I20260709 12:59:33.271098  1736 tablet_bootstrap.cc:492] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:33.274474  1738 raft_consensus.cc:359] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.275367  1738 raft_consensus.cc:385] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.275745  1738 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.276505  1738 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.278245  1736 tablet_bootstrap.cc:654] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.279084  1738 ts_tablet_manager.cc:1434] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:59:33.280227  1738 tablet_bootstrap.cc:492] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:33.288153  1738 tablet_bootstrap.cc:654] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.290138  1736 tablet_bootstrap.cc:492] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:33.290195  1745 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:33.290755  1736 ts_tablet_manager.cc:1403] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:59:33.294971  1442 catalog_manager.cc:5697] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:33.297672  1745 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.294330  1736 raft_consensus.cc:359] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.298666  1736 raft_consensus.cc:385] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.298972  1736 raft_consensus.cc:740] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.299795  1736 consensus_queue.cc:260] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.305301  1792 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.305765  1792 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.307128  1736 ts_tablet_manager.cc:1434] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:59:33.308125  1736 tablet_bootstrap.cc:492] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:33.308143  1792 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:33.310019  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:33.310730  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 12:59:33.311673  1660 leader_election.cc:343] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.312196  1546 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:33.316848  1737 tablet_bootstrap.cc:492] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:33.317500  1737 ts_tablet_manager.cc:1403] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.004s
I20260709 12:59:33.318939  1659 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:33.320168  1792 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:33.320643  1792 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.321069  1792 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.332631  1737 raft_consensus.cc:359] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.333416  1737 raft_consensus.cc:385] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.333757  1737 raft_consensus.cc:740] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.335352  1737 consensus_queue.cc:260] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.338024  1737 ts_tablet_manager.cc:1434] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:59:33.338900  1737 tablet_bootstrap.cc:492] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:33.339366  1736 tablet_bootstrap.cc:654] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.341769  1792 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.342581  1738 tablet_bootstrap.cc:492] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:33.343005  1738 ts_tablet_manager.cc:1403] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.063s	user 0.030s	sys 0.003s
I20260709 12:59:33.344892  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:33.345525  1546 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.346625  1738 raft_consensus.cc:359] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.347271  1738 raft_consensus.cc:385] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.347537  1738 raft_consensus.cc:740] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.348161  1738 consensus_queue.cc:260] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.350095  1738 ts_tablet_manager.cc:1434] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.003s
I20260709 12:59:33.350905  1738 tablet_bootstrap.cc:492] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:33.359226  1737 tablet_bootstrap.cc:654] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.360823  1741 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:33.364324  1738 tablet_bootstrap.cc:654] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.361500  1546 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:33.367548  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 12:59:33.369241  1660 leader_election.cc:343] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.370035  1736 tablet_bootstrap.cc:492] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:33.370534  1736 ts_tablet_manager.cc:1403] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.020s
I20260709 12:59:33.370707  1659 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:33.371905  1787 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:33.371896  1792 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:33.372383  1737 tablet_bootstrap.cc:492] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:33.372975  1737 ts_tablet_manager.cc:1403] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.001s
I20260709 12:59:33.373733  1787 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:33.373876  1736 raft_consensus.cc:359] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.374590  1736 raft_consensus.cc:385] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.374935  1736 raft_consensus.cc:740] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.374679  1787 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.375654  1736 consensus_queue.cc:260] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.375996  1737 raft_consensus.cc:359] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.376629  1737 raft_consensus.cc:385] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.376924  1737 raft_consensus.cc:740] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.377658  1737 consensus_queue.cc:260] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.380954  1736 ts_tablet_manager.cc:1434] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:59:33.381119  1737 ts_tablet_manager.cc:1434] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:59:33.382076  1737 tablet_bootstrap.cc:492] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:33.385720  1736 tablet_bootstrap.cc:492] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:33.386090  1764 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.400362  1737 tablet_bootstrap.cc:654] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.402271  1736 tablet_bootstrap.cc:654] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.405179  1776 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.405655  1776 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.409268  1776 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.410290  1764 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.410356  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:33.413040  1738 tablet_bootstrap.cc:492] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:33.413486  1738 ts_tablet_manager.cc:1403] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.063s	user 0.005s	sys 0.019s
I20260709 12:59:33.410884  1764 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.415814  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:33.416774  1737 tablet_bootstrap.cc:492] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:33.417104  1764 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.417207  1737 ts_tablet_manager.cc:1403] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.002s
I20260709 12:59:33.417156  1587 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:33.418231  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:33.418406  1776 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:33.418812  1695 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:33.419921  1737 raft_consensus.cc:359] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.420524  1737 raft_consensus.cc:385] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.420828  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:33.421003  1737 raft_consensus.cc:740] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.421491  1622 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:33.422068  1737 consensus_queue.cc:260] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.422461  1512 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:33.422408  1738 raft_consensus.cc:359] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.423117  1738 raft_consensus.cc:385] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.423470  1738 raft_consensus.cc:740] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.424103  1738 consensus_queue.cc:260] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.424829  1737 ts_tablet_manager.cc:1434] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:59:33.425976  1738 ts_tablet_manager.cc:1434] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:59:33.426379  1764 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:33.426730  1737 tablet_bootstrap.cc:492] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:33.427472  1764 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.427876  1764 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.433578  1737 tablet_bootstrap.cc:654] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.426730  1738 tablet_bootstrap.cc:492] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:33.444213  1764 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.445945  1737 tablet_bootstrap.cc:492] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:33.446389  1737 ts_tablet_manager.cc:1403] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 12:59:33.447191  1764 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.447088  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:33.448493  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:33.448906  1738 tablet_bootstrap.cc:654] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.449128  1737 raft_consensus.cc:359] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.448982  1695 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.448858  1622 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.450320  1737 raft_consensus.cc:385] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.450693  1737 raft_consensus.cc:740] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.451455  1737 consensus_queue.cc:260] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.454151  1737 ts_tablet_manager.cc:1434] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:59:33.455202  1737 tablet_bootstrap.cc:492] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:33.457243  1622 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:33.458325  1511 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:33.458593  1736 tablet_bootstrap.cc:492] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:33.459131  1736 ts_tablet_manager.cc:1403] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.074s	user 0.025s	sys 0.013s
I20260709 12:59:33.446632  1445 catalog_manager.cc:5697] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:33.459651  1764 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:33.457243  1695 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:33.460219  1764 raft_consensus.cc:697] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:33.461063  1764 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.462203  1737 tablet_bootstrap.cc:654] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.465471  1736 raft_consensus.cc:359] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.466127  1736 raft_consensus.cc:385] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.466830  1736 raft_consensus.cc:740] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.467556  1736 consensus_queue.cc:260] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.469728  1736 ts_tablet_manager.cc:1434] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 12:59:33.470630  1736 tablet_bootstrap.cc:492] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:33.476344  1736 tablet_bootstrap.cc:654] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.477475  1737 tablet_bootstrap.cc:492] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:33.477840  1738 tablet_bootstrap.cc:492] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:33.478001  1737 ts_tablet_manager.cc:1403] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.009s
I20260709 12:59:33.478232  1738 ts_tablet_manager.cc:1403] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.052s	user 0.004s	sys 0.012s
I20260709 12:59:33.480634  1737 raft_consensus.cc:359] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.481299  1737 raft_consensus.cc:385] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.481566  1737 raft_consensus.cc:740] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.482306  1737 consensus_queue.cc:260] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.484591  1737 ts_tablet_manager.cc:1434] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:59:33.485409  1737 tablet_bootstrap.cc:492] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:33.485450  1738 raft_consensus.cc:359] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.486131  1738 raft_consensus.cc:385] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.486378  1738 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.486546  1444 catalog_manager.cc:5697] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.487069  1738 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.489804  1738 ts_tablet_manager.cc:1434] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:59:33.490615  1738 tablet_bootstrap.cc:492] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:33.492103  1737 tablet_bootstrap.cc:654] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.497274  1738 tablet_bootstrap.cc:654] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.497956  1736 tablet_bootstrap.cc:492] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:33.498435  1736 ts_tablet_manager.cc:1403] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.003s
I20260709 12:59:33.498325  1776 consensus_queue.cc:1048] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.501835  1736 raft_consensus.cc:359] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.502759  1736 raft_consensus.cc:385] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.503098  1736 raft_consensus.cc:740] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.503916  1736 consensus_queue.cc:260] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.506599  1736 ts_tablet_manager.cc:1434] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:59:33.507681  1736 tablet_bootstrap.cc:492] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:33.511579  1787 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.512091  1787 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.515303  1787 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:33.516444  1736 tablet_bootstrap.cc:654] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.516999  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:33.519012  1737 tablet_bootstrap.cc:492] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
W20260709 12:59:33.519213  1660 leader_election.cc:343] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.519533  1737 ts_tablet_manager.cc:1403] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.004s
I20260709 12:59:33.521092  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 12:59:33.522598  1659 leader_election.cc:343] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.523079  1659 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:33.522817  1737 raft_consensus.cc:359] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.523904  1737 raft_consensus.cc:385] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.524204  1737 raft_consensus.cc:740] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.524911  1737 consensus_queue.cc:260] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.526021  1787 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:33.526523  1737 ts_tablet_manager.cc:1434] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:59:33.527460  1737 tablet_bootstrap.cc:492] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:33.532160  1736 tablet_bootstrap.cc:492] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:33.532747  1736 ts_tablet_manager.cc:1403] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.025s	user 0.023s	sys 0.000s
I20260709 12:59:33.536216  1736 raft_consensus.cc:359] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.537119  1736 raft_consensus.cc:385] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.537457  1736 raft_consensus.cc:740] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.538295  1736 consensus_queue.cc:260] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.539566  1787 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.540530  1736 ts_tablet_manager.cc:1434] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:59:33.540211  1787 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.541687  1736 tablet_bootstrap.cc:492] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:33.544131  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:33.548080  1737 tablet_bootstrap.cc:654] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.549973  1736 tablet_bootstrap.cc:654] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:33.553188  1660 leader_election.cc:343] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.555624  1738 tablet_bootstrap.cc:492] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:33.555358  1751 consensus_queue.cc:1048] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:33.556196  1738 ts_tablet_manager.cc:1403] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.066s	user 0.030s	sys 0.025s
I20260709 12:59:33.557428  1787 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:33.563668  1737 tablet_bootstrap.cc:492] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:33.564143  1737 ts_tablet_manager.cc:1403] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.010s
I20260709 12:59:33.559592  1738 raft_consensus.cc:359] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.565730  1738 raft_consensus.cc:385] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.566015  1738 raft_consensus.cc:740] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.566692  1738 consensus_queue.cc:260] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.569274  1751 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.569712  1751 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.571700  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:33.562423  1736 tablet_bootstrap.cc:492] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:33.572605  1547 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:33.573203  1736 ts_tablet_manager.cc:1403] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.012s
I20260709 12:59:33.573659  1737 raft_consensus.cc:359] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.574376  1737 raft_consensus.cc:385] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.574548  1751 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.574674  1737 raft_consensus.cc:740] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.570827  1622 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.575675  1737 consensus_queue.cc:260] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.576995  1736 raft_consensus.cc:359] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.577804  1736 raft_consensus.cc:385] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.578055  1737 ts_tablet_manager.cc:1434] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:59:33.578158  1736 raft_consensus.cc:740] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.579063  1737 tablet_bootstrap.cc:492] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:33.579125  1736 consensus_queue.cc:260] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.580282  1787 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.580761  1787 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.582343  1736 ts_tablet_manager.cc:1434] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:59:33.583395  1736 tablet_bootstrap.cc:492] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:33.583973  1659 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:33.587726  1787 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:33.588038  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:33.590272  1695 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:33.591207  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:33.592890  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 12:59:33.593127  1659 leader_election.cc:343] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.593575  1547 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:33.589308  1786 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:33.595674  1585 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:33.598146  1751 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:33.598574  1751 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.599344  1786 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.599838  1786 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:33.600484  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:33.599013  1751 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.606690  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:33.608155  1776 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.608656  1764 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.608614  1776 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.609127  1764 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.609702  1787 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.610306  1787 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.611088  1776 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.616276  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:33.620599  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:33.623121  1511 leader_election.cc:343] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:33.623343  1660 leader_election.cc:343] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.624050  1660 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:33.624810  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:33.625845  1695 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 12:59:33.626029  1764 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.626705  1792 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:33.628484  1745 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.629096  1745 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.637158  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:33.637904  1787 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 12:59:33.638964  1512 leader_election.cc:343] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.639745  1512 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:33.640247  1587 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:33.640700  1741 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.641162  1741 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.641914  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:33.642822  1621 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:33.643110  1741 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.643659  1741 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:33.644542  1737 tablet_bootstrap.cc:654] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.646795  1745 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:33.648315  1660 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:33.648891  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:33.649551  1547 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:33.649725  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:33.650570  1546 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:33.654979  1751 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.646842  1776 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.657162  1751 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.655378  1659 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:33.660797  1792 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:33.658697  1745 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:33.661167  1792 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.661306  1745 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.661553  1792 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.661662  1745 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.661765  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:33.663790  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:33.663944  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:33.660643  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:33.664433  1620 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:33.664610  1696 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.665001  1695 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
W20260709 12:59:33.663993  1511 leader_election.cc:343] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.661665  1738 ts_tablet_manager.cc:1434] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.105s	user 0.027s	sys 0.059s
I20260709 12:59:33.667598  1738 tablet_bootstrap.cc:492] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:33.675678  1736 tablet_bootstrap.cc:654] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.677062  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:33.677841  1546 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.677031  1512 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:33.683064  1764 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:33.684111  1792 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.685722  1764 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.690635  1787 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.691156  1764 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.692034  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:33.692109  1787 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:33.692662  1621 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.691902  1786 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.694097  1792 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:33.694828  1741 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.695319  1741 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.699533  1546 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 12:59:33.699525  1741 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.707116  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:33.707640  1741 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:33.708648  1511 leader_election.cc:343] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.714578  1776 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:33.718907  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:33.708258  1741 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.725180  1737 tablet_bootstrap.cc:492] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:33.725564  1737 ts_tablet_manager.cc:1403] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.147s	user 0.015s	sys 0.010s
I20260709 12:59:33.728410  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:33.728909  1696 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 12:59:33.730795  1587 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 12:59:33.730909  1660 leader_election.cc:343] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.721721  1786 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:33.729303  1622 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:33.734740  1511 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:33.731369  1745 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.732558  1621 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:33.732272  1829 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:33.738067  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:33.738448  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:33.738652  1546 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.738997  1547 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.741163  1832 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:33.741612  1832 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.742087  1832 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.743105  1737 raft_consensus.cc:359] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.743789  1737 raft_consensus.cc:385] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.744041  1737 raft_consensus.cc:740] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.735464  1776 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:33.745751  1776 raft_consensus.cc:697] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 12:59:33.746516  1776 consensus_queue.cc:237] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.747462  1741 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.749246  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:33.750762  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:33.753229  1547 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:33.755177  1745 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:33.753255  1738 tablet_bootstrap.cc:654] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.759004  1660 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:33.761173  1764 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.762683  1787 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:33.778158  1787 raft_consensus.cc:697] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:33.779062  1787 consensus_queue.cc:237] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.782001  1764 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.785989  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:33.764896  1659 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:33.767316  1737 consensus_queue.cc:260] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.787268  1832 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.769155  1736 tablet_bootstrap.cc:492] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:33.768910  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:33.788305  1736 ts_tablet_manager.cc:1403] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.205s	user 0.013s	sys 0.000s
I20260709 12:59:33.788439  1621 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.790798  1736 raft_consensus.cc:359] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:33.788582  1511 leader_election.cc:343] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.770193  1741 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:33.770192  1512 leader_election.cc:343] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.787714  1792 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:33.792212  1792 raft_consensus.cc:697] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:33.792127  1741 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.793087  1792 consensus_queue.cc:237] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.765024  1546 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:33.795130  1741 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.795409  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:33.796269  1737 ts_tablet_manager.cc:1434] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.070s	user 0.011s	sys 0.000s
I20260709 12:59:33.797578  1737 tablet_bootstrap.cc:492] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
W20260709 12:59:33.797741  1511 leader_election.cc:343] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.798331  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:33.798863  1832 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.798938  1622 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.771636  1738 tablet_bootstrap.cc:492] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:33.803642  1738 ts_tablet_manager.cc:1403] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.136s	user 0.009s	sys 0.007s
I20260709 12:59:33.791472  1736 raft_consensus.cc:385] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.804059  1736 raft_consensus.cc:740] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.804699  1736 consensus_queue.cc:260] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.806778  1736 ts_tablet_manager.cc:1434] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:59:33.807132  1512 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:33.808554  1832 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:33.810477  1736 tablet_bootstrap.cc:492] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:33.814860  1622 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:33.817090  1511 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:33.818342  1832 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:33.819283  1832 raft_consensus.cc:697] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:33.820574  1832 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.809188  1738 raft_consensus.cc:359] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.822175  1738 raft_consensus.cc:385] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:59:33.823423  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 53258.5us
W20260709 12:59:33.824465  1512 leader_election.cc:343] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.825071  1737 tablet_bootstrap.cc:654] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.826130  1751 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.822460  1738 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.826795  1751 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.827939  1738 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.829882  1738 ts_tablet_manager.cc:1434] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.001s
I20260709 12:59:33.830726  1738 tablet_bootstrap.cc:492] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:33.832206  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:33.835058  1751 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.836145  1741 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:33.838831  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:33.836185  1621 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:33.839488  1546 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.840262  1660 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:33.842833  1792 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:33.835880  1443 catalog_manager.cc:5697] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:33.844425  1792 raft_consensus.cc:697] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:33.845852  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:33.845373  1443 catalog_manager.cc:5697] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:33.847155  1695 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.846022  1792 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.854338  1737 tablet_bootstrap.cc:492] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:33.854796  1737 ts_tablet_manager.cc:1403] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.003s
I20260709 12:59:33.854626  1546 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:33.857297  1737 raft_consensus.cc:359] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.857491  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:33.854557  1695 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:33.858366  1696 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:33.858539  1445 catalog_manager.cc:5697] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.859594  1738 tablet_bootstrap.cc:654] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.857980  1737 raft_consensus.cc:385] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.860800  1737 raft_consensus.cc:740] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.861580  1737 consensus_queue.cc:260] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.864068  1737 ts_tablet_manager.cc:1434] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:59:33.864970  1737 tablet_bootstrap.cc:492] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:33.868803  1736 tablet_bootstrap.cc:654] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.876937  1621 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.886629  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:33.894232  1831 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:59:33.899822  1737 tablet_bootstrap.cc:654] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.902565  1831 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.902822  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:33.903069  1512 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:33.903688  1546 raft_consensus.cc:2393] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 12:59:33.904409  1741 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:33.904347  1512 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:33.905038  1741 raft_consensus.cc:697] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:33.905735  1764 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:33.906282  1764 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.906713  1764 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.913358  1736 tablet_bootstrap.cc:492] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:33.913791  1736 ts_tablet_manager.cc:1403] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.104s	user 0.016s	sys 0.002s
I20260709 12:59:33.923000  1445 catalog_manager.cc:5697] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.915596  1741 consensus_queue.cc:237] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.932868  1776 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.935228  1776 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.937462  1776 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.939105  1832 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:33.955278  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 12:59:33.960577  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 56296.1us
W20260709 12:59:33.961666  1512 leader_election.cc:343] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:33.964025  1587 leader_election.cc:343] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.969542  1832 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:33.972476  1764 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.975463  1764 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:33.969799  1444 catalog_manager.cc:5697] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:33.976579  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:33.978603  1738 tablet_bootstrap.cc:492] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:33.978964  1738 ts_tablet_manager.cc:1403] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.148s	user 0.026s	sys 0.009s
W20260709 12:59:33.979962  1511 leader_election.cc:343] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.984030  1738 raft_consensus.cc:359] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.985409  1738 raft_consensus.cc:385] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.985754  1738 raft_consensus.cc:740] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.987185  1738 consensus_queue.cc:260] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.988796  1831 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.994516  1831 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:33.997779  1831 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:33.991859  1585 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:33.999408  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:34.001070  1738 ts_tablet_manager.cc:1434] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
W20260709 12:59:34.001487  1660 leader_election.cc:343] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:34.002235  1738 tablet_bootstrap.cc:492] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:34.007838  1736 raft_consensus.cc:359] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.008656  1736 raft_consensus.cc:385] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:34.008958  1736 raft_consensus.cc:740] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:34.009660  1736 consensus_queue.cc:260] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.012635  1445 catalog_manager.cc:5697] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:34.044798  1736 ts_tablet_manager.cc:1434] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.131s	user 0.006s	sys 0.001s
I20260709 12:59:34.013878  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:34.045759  1736 tablet_bootstrap.cc:492] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:34.045823  1696 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:34.014361  1831 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:34.015331  1737 tablet_bootstrap.cc:492] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:34.020578  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:34.024863  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:34.053805  1545 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:34.030588  1738 tablet_bootstrap.cc:654] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:34.040518  1776 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:34.059732  1585 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 12:59:34.061523  1751 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:34.065950  1845 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:34.062758  1751 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.068367  1751 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:34.054077  1696 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:34.086540  1512 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:34.087684  1845 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:34.088578  1845 raft_consensus.cc:697] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:34.090073  1845 consensus_queue.cc:237] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.105685  1751 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.116967  1829 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.117146  1737 ts_tablet_manager.cc:1403] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.252s	user 0.008s	sys 0.039s
W20260709 12:59:34.117053  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 57426.3us
I20260709 12:59:34.120675  1738 tablet_bootstrap.cc:492] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:34.118777  1829 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.121109  1738 ts_tablet_manager.cc:1403] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.119s	user 0.011s	sys 0.008s
I20260709 12:59:34.126631  1738 raft_consensus.cc:359] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.127537  1738 raft_consensus.cc:385] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:34.127923  1738 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:34.128767  1738 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.116461  1547 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:34.131388  1659 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:34.132253  1738 ts_tablet_manager.cc:1434] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:59:34.133198  1738 tablet_bootstrap.cc:492] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:34.133783  1787 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:34.134219  1787 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.134617  1787 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:34.137414  1829 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:34.140276  1776 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.140823  1776 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.143616  1776 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:34.144444  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:34.144812  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:34.145146  1620 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:34.145452  1696 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:34.146157  1787 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.146562  1660 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:34.147445  1829 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:34.147799  1829 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.148134  1829 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:34.148617  1787 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:34.149194  1587 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:34.151412  1776 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:34.151762  1776 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.152076  1776 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:34.153373  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 12:59:34.155715  1660 leader_election.cc:343] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:34.159325  1737 raft_consensus.cc:359] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.160063  1737 raft_consensus.cc:385] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:34.160369  1737 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:34.161810  1737 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.163957  1737 ts_tablet_manager.cc:1434] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 12:59:34.164362  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:34.161170  1829 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.165009  1547 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:34.165323  1737 tablet_bootstrap.cc:492] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:34.166281  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:34.167109  1546 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:34.168040  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:34.168715  1544 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:34.165285  1776 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.171052  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:34.169381  1751 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 12:59:34.174830  1587 leader_election.cc:343] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:34.175849  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:34.179589  1544 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:34.177681  1443 catalog_manager.cc:5697] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:34.182400  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:34.183154  1696 raft_consensus.cc:2393] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 12:59:34.186805  1736 tablet_bootstrap.cc:654] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:34.184422  1776 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:34.189576  1738 tablet_bootstrap.cc:654] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:34.189870  1546 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:34.198499  1659 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:34.204582  1829 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:34.205191  1829 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:34.205591  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:34.206466  1620 raft_consensus.cc:2393] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 1: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 12:59:34.205660  1829 raft_consensus.cc:697] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:34.209632  1829 consensus_queue.cc:237] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.213079  1544 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 12:59:34.213155  1738 tablet_bootstrap.cc:492] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:34.213160  1736 tablet_bootstrap.cc:492] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:34.213860  1738 ts_tablet_manager.cc:1403] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.007s
I20260709 12:59:34.213860  1736 ts_tablet_manager.cc:1403] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.168s	user 0.009s	sys 0.004s
I20260709 12:59:34.217772  1776 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.218264  1776 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.219364  1737 tablet_bootstrap.cc:654] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:34.221547  1776 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:34.221896  1585 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 12:59:34.223459  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:34.225503  1736 raft_consensus.cc:359] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.226130  1736 raft_consensus.cc:385] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:34.224057  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:34.226433  1736 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:34.226677  1695 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:34.227092  1736 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.227984  1546 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:34.225111  1738 raft_consensus.cc:359] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.228479  1738 raft_consensus.cc:385] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:34.228770  1738 raft_consensus.cc:740] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:34.229488  1738 consensus_queue.cc:260] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.227370  1776 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:34.231112  1585 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:34.225370  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:34.231537  1776 raft_consensus.cc:697] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 12:59:34.231809  1545 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:34.232503  1738 ts_tablet_manager.cc:1434] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:59:34.233261  1738 tablet_bootstrap.cc:492] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:34.233923  1854 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:34.234303  1854 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.235508  1854 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:34.237207  1776 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.240747  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:34.245774  1585 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:34.246961  1751 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:34.250686  1736 ts_tablet_manager.cc:1434] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 12:59:34.250907  1545 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:34.252394  1736 tablet_bootstrap.cc:492] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:34.254632  1659 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:34.255754  1787 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:34.256263  1787 raft_consensus.cc:697] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:34.257033  1787 consensus_queue.cc:237] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.257939  1854 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.262814  1845 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.265439  1845 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.267108  1854 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:34.268020  1845 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:34.270058  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:34.270304  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:34.270756  1695 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:34.270912  1696 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:34.272863  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:34.273281  1512 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:34.274942  1443 catalog_manager.cc:5697] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:34.276175  1845 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:34.276602  1845 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:34.276638  1511 leader_election.cc:343] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:34.278074  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:34.278695  1545 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:34.277086  1845 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:34.286747  1445 catalog_manager.cc:5697] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:34.283543  1776 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:59:34.292487  1738 tablet_bootstrap.cc:654] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:34.295935  1787 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:34.313606  1854 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:34.317818  1832 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:59:34.327649  1445 catalog_manager.cc:5697] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:34.330180  1545 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 12:59:34.332306  1585 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:34.336601  1695 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 12:59:34.336941  1854 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:34.340776  1854 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 12:59:34.341948  1854 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.321635  1845 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:34.343456  1660 consensus_peers.cc:597] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:34.337488  1787 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:59:34.354139  1737 tablet_bootstrap.cc:492] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:34.354624  1737 ts_tablet_manager.cc:1403] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.190s	user 0.031s	sys 0.009s
I20260709 12:59:34.358196  1736 tablet_bootstrap.cc:654] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:34.364163  1831 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:59:34.379962  1511 consensus_peers.cc:597] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:34.382637  1787 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:34.384364  1845 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:34.414017  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:34.429317  1737 raft_consensus.cc:359] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.430294  1737 raft_consensus.cc:385] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:34.430644  1737 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:34.410590  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:34.432462  1737 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:34.456753  1511 leader_election.cc:343] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:34.458313  1512 consensus_peers.cc:597] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:34.459731  1741 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:34.463348  1737 ts_tablet_manager.cc:1434] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.108s	user 0.009s	sys 0.001s
I20260709 12:59:34.463303  1831 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:34.464354  1737 tablet_bootstrap.cc:492] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:34.442272  1695 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:34.538267  1736 tablet_bootstrap.cc:492] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:34.554250  1736 ts_tablet_manager.cc:1403] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.303s	user 0.028s	sys 0.052s
I20260709 12:59:34.490490  1445 catalog_manager.cc:5697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:34.545702  1511 consensus_peers.cc:597] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:34.533998  1776 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.555063  1776 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.557520  1776 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:34.557372  1736 raft_consensus.cc:359] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.557669  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:34.558081  1736 raft_consensus.cc:385] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:34.558369  1736 raft_consensus.cc:740] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:34.558701  1544 raft_consensus.cc:2393] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 12:59:34.558974  1738 tablet_bootstrap.cc:492] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:34.559466  1738 ts_tablet_manager.cc:1403] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.326s	user 0.015s	sys 0.002s
I20260709 12:59:34.561892  1738 raft_consensus.cc:359] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.562536  1738 raft_consensus.cc:385] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:34.559001  1736 consensus_queue.cc:260] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.570123  1695 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:34.571650  1736 ts_tablet_manager.cc:1434] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:59:34.572739  1512 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:34.573873  1845 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:34.574337  1845 raft_consensus.cc:697] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:34.575119  1845 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.578588  1736 tablet_bootstrap.cc:492] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:34.591557  1736 tablet_bootstrap.cc:654] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:34.604347  1736 tablet_bootstrap.cc:492] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:34.604815  1736 ts_tablet_manager.cc:1403] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.003s
I20260709 12:59:34.606876  1736 raft_consensus.cc:359] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.607554  1736 raft_consensus.cc:385] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:34.607831  1736 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:34.608544  1736 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.562886  1738 raft_consensus.cc:740] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:34.610567  1736 ts_tablet_manager.cc:1434] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:59:34.610249  1738 consensus_queue.cc:260] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.611495  1736 tablet_bootstrap.cc:492] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:34.611752  1737 tablet_bootstrap.cc:654] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:34.618376  1736 tablet_bootstrap.cc:654] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:34.620623  1751 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.622205  1738 ts_tablet_manager.cc:1434] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.000s
I20260709 12:59:34.622611  1832 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.624238  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:34.623574  1751 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.624279  1832 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.627605  1738 tablet_bootstrap.cc:492] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:34.630363  1751 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:34.631477  1764 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:34.631996  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:34.649685  1738 tablet_bootstrap.cc:654] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:34.651669  1587 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:34.652693  1736 tablet_bootstrap.cc:492] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:34.653112  1736 ts_tablet_manager.cc:1403] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.010s
I20260709 12:59:34.653231  1776 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:34.655718  1736 raft_consensus.cc:359] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.656358  1736 raft_consensus.cc:385] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:34.656606  1736 raft_consensus.cc:740] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:34.658898  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:34.659162  1736 consensus_queue.cc:260] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.662878  1736 ts_tablet_manager.cc:1434] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:59:34.662755  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:34.663784  1736 tablet_bootstrap.cc:492] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:34.664234  1737 tablet_bootstrap.cc:492] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:34.664631  1737 ts_tablet_manager.cc:1403] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.200s	user 0.014s	sys 0.000s
W20260709 12:59:34.668468  1511 leader_election.cc:343] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:34.670329  1832 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:34.682615  1737 raft_consensus.cc:359] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.685114  1737 raft_consensus.cc:385] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:34.686870  1737 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
W20260709 12:59:34.689646  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:34.691051  1696 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:34.672341  1585 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:34.696623  1751 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:34.697958  1736 tablet_bootstrap.cc:654] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:34.701963  1776 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:34.700822  1737 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.703567  1737 ts_tablet_manager.cc:1434] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.039s	user 0.012s	sys 0.000s
I20260709 12:59:34.703154  1445 catalog_manager.cc:5697] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:34.704130  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:34.704432  1737 tablet_bootstrap.cc:492] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:34.704861  1694 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:34.723531  1776 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:34.724447  1745 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.725108  1745 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.729782  1831 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:34.716357  1512 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:34.731204  1879 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:34.731650  1879 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.731997  1879 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:34.733779  1738 tablet_bootstrap.cc:492] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:34.735302  1738 ts_tablet_manager.cc:1403] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.112s	user 0.010s	sys 0.010s
I20260709 12:59:34.738535  1879 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.749099  1745 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:34.750447  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:34.755105  1831 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:34.756747  1879 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:34.757071  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:34.759086  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:34.759434  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:34.759752  1544 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:34.759981  1694 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:34.764328  1511 leader_election.cc:343] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:34.765839  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:34.765897  1751 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:34.767830  1738 raft_consensus.cc:359] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.768695  1738 raft_consensus.cc:385] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:34.769048  1738 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:34.770593  1736 tablet_bootstrap.cc:492] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:34.771040  1736 ts_tablet_manager.cc:1403] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.107s	user 0.021s	sys 0.015s
I20260709 12:59:34.776829  1737 tablet_bootstrap.cc:654] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:34.779022  1736 raft_consensus.cc:359] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.779924  1736 raft_consensus.cc:385] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:34.780274  1736 raft_consensus.cc:740] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:34.781208  1736 consensus_queue.cc:260] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.784940  1738 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.790066  1738 ts_tablet_manager.cc:1434] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:59:34.790984  1738 tablet_bootstrap.cc:492] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:34.791530  1831 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:34.792865  1831 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 12:59:34.793269  1831 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:34.797847  1736 ts_tablet_manager.cc:1434] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:59:34.807966  1736 tablet_bootstrap.cc:492] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:34.805671  1792 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:59:34.816110  1776 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:34.819139  1694 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:34.820552  1622 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:34.831750  1831 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.837466  1738 tablet_bootstrap.cc:654] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:34.840256  1787 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:59:34.860720  1736 tablet_bootstrap.cc:654] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:34.855492  1512 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:34.878094  1879 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.887531  1879 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.890790  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:34.891577  1831 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:34.892351  1879 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:34.881506  1845 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:34.892952  1845 raft_consensus.cc:697] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:34.893887  1845 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.901333  1854 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:34.901500  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:34.897944  1695 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:34.911417  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:34.921037  1751 consensus_queue.cc:1059] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:34.921378  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:34.921581  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:34.922456  1854 raft_consensus.cc:3055] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:34.922791  1854 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 12:59:34.925995  1831 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:59:34.927522  1511 leader_election.cc:343] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:34.934185  1736 tablet_bootstrap.cc:492] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:34.935420  1736 ts_tablet_manager.cc:1403] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.136s	user 0.021s	sys 0.001s
W20260709 12:59:34.939116  1512 leader_election.cc:343] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:34.941510  1512 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:34.943471  1832 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:34.955683  1736 raft_consensus.cc:359] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.956636  1736 raft_consensus.cc:385] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:34.957332  1736 raft_consensus.cc:740] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:34.956282  1764 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.960457  1764 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.962385  1764 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:34.935900  1854 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.964048  1854 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:34.966003  1738 tablet_bootstrap.cc:492] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:34.966317  1738 ts_tablet_manager.cc:1403] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.176s	user 0.012s	sys 0.004s
I20260709 12:59:34.957937  1736 consensus_queue.cc:260] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.966167  1443 catalog_manager.cc:5697] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:34.970652  1736 ts_tablet_manager.cc:1434] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:59:34.971542  1736 tablet_bootstrap.cc:492] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:34.973142  1738 raft_consensus.cc:359] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.973783  1738 raft_consensus.cc:385] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:34.974045  1738 raft_consensus.cc:740] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:34.974675  1738 consensus_queue.cc:260] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:34.974314  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:34.976415  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 12:59:34.977731  1511 leader_election.cc:343] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:34.988080  1891 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:59:35.002744  1845 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.003422  1845 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.018965  1738 ts_tablet_manager.cc:1434] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
W20260709 12:59:35.019166  1512 leader_election.cc:343] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:35.026183  1512 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:35.027402  1764 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:35.027985  1737 tablet_bootstrap.cc:492] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
W20260709 12:59:35.019500  1892 log.cc:927] Time spent T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:59:35.029714  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 12:59:35.031062  1512 leader_election.cc:343] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:35.032873  1738 tablet_bootstrap.cc:492] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:35.028486  1737 ts_tablet_manager.cc:1403] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.324s	user 0.012s	sys 0.017s
I20260709 12:59:35.037493  1737 raft_consensus.cc:359] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.041862  1737 raft_consensus.cc:385] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.024315  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:35.042168  1737 raft_consensus.cc:740] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.042994  1737 consensus_queue.cc:260] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:35.044176  1511 leader_election.cc:343] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:35.044697  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:35.045342  1737 ts_tablet_manager.cc:1434] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:59:35.046237  1737 tablet_bootstrap.cc:492] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:35.047317  1832 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:35.047923  1832 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:35.040355  1738 tablet_bootstrap.cc:654] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.052418  1737 tablet_bootstrap.cc:654] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.041244  1736 tablet_bootstrap.cc:654] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.062989  1737 tablet_bootstrap.cc:492] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:35.063292  1738 tablet_bootstrap.cc:492] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:35.063470  1737 ts_tablet_manager.cc:1403] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:59:35.063776  1738 ts_tablet_manager.cc:1403] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.003s
I20260709 12:59:35.066085  1737 raft_consensus.cc:359] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.066772  1737 raft_consensus.cc:385] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.067044  1737 raft_consensus.cc:740] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.067725  1737 consensus_queue.cc:260] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:35.069079  1511 consensus_peers.cc:597] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:35.069713  1737 ts_tablet_manager.cc:1434] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:59:35.070575  1737 tablet_bootstrap.cc:492] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:35.022190  1845 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.077819  1737 tablet_bootstrap.cc:654] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.079973  1736 tablet_bootstrap.cc:492] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:35.080880  1736 ts_tablet_manager.cc:1403] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.109s	user 0.012s	sys 0.000s
I20260709 12:59:35.092270  1738 raft_consensus.cc:359] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.093066  1738 raft_consensus.cc:385] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.093367  1738 raft_consensus.cc:740] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.094085  1738 consensus_queue.cc:260] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.096319  1738 ts_tablet_manager.cc:1434] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:59:35.097087  1738 tablet_bootstrap.cc:492] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:35.103518  1736 raft_consensus.cc:359] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.104494  1736 raft_consensus.cc:385] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.105247  1736 raft_consensus.cc:740] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.106077  1736 consensus_queue.cc:260] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.109588  1845 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.110280  1738 tablet_bootstrap.cc:654] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.110205  1845 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.114337  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:35.115978  1511 leader_election.cc:343] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:35.117057  1736 ts_tablet_manager.cc:1434] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:59:35.117879  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:35.119639  1696 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:35.120283  1736 tablet_bootstrap.cc:492] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:35.121302  1845 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.120846  1512 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:35.122444  1845 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:35.122886  1845 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:35.123219  1845 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.128796  1736 tablet_bootstrap.cc:654] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.121356  1737 tablet_bootstrap.cc:492] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:35.129510  1737 ts_tablet_manager.cc:1403] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.023s
I20260709 12:59:35.132475  1737 raft_consensus.cc:359] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.133340  1737 raft_consensus.cc:385] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.133672  1737 raft_consensus.cc:740] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.137499  1845 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.139902  1845 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.140412  1736 tablet_bootstrap.cc:492] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:35.140942  1736 ts_tablet_manager.cc:1403] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 12:59:35.140599  1737 consensus_queue.cc:260] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.141695  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:35.142356  1696 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.143069  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:35.144116  1736 raft_consensus.cc:359] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:35.144538  1511 leader_election.cc:343] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:35.144892  1736 raft_consensus.cc:385] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.145323  1736 raft_consensus.cc:740] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.146070  1736 consensus_queue.cc:260] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.146817  1737 ts_tablet_manager.cc:1434] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:59:35.148304  1737 tablet_bootstrap.cc:492] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:35.153437  1736 ts_tablet_manager.cc:1434] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:59:35.154371  1736 tablet_bootstrap.cc:492] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:35.155954  1745 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.156673  1745 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.161224  1736 tablet_bootstrap.cc:654] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.163723  1737 tablet_bootstrap.cc:654] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.164379  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:35.166378  1745 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 12:59:35.167625  1660 leader_election.cc:343] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:35.172641  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:35.173496  1736 tablet_bootstrap.cc:492] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:35.173583  1545 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:35.174029  1736 ts_tablet_manager.cc:1403] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:59:35.174505  1737 tablet_bootstrap.cc:492] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:35.175031  1737 ts_tablet_manager.cc:1403] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.000s
I20260709 12:59:35.176343  1845 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.176419  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:35.176945  1845 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.177627  1831 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:35.177407  1736 raft_consensus.cc:359] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.178074  1831 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:35.178262  1736 raft_consensus.cc:385] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.178505  1831 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.178634  1736 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.178731  1737 raft_consensus.cc:359] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.179857  1737 raft_consensus.cc:385] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.180315  1737 raft_consensus.cc:740] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.179804  1736 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.181106  1737 consensus_queue.cc:260] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.183586  1737 ts_tablet_manager.cc:1434] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:59:35.185395  1737 tablet_bootstrap.cc:492] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:35.186183  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:35.186896  1736 ts_tablet_manager.cc:1434] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
W20260709 12:59:35.187592  1511 leader_election.cc:343] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:35.188171  1736 tablet_bootstrap.cc:492] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:35.191615  1845 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.195461  1737 tablet_bootstrap.cc:654] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.196058  1831 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.197322  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 12:59:35.199653  1512 leader_election.cc:343] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:35.202077  1512 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:35.204078  1845 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:35.195147  1696 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:35.205466  1736 tablet_bootstrap.cc:654] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.208425  1831 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:35.215641  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 12:59:35.222855  1660 leader_election.cc:343] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:35.211526  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:35.224465  1545 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.207003  1512 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:35.231940  1845 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:35.232568  1845 raft_consensus.cc:697] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:35.234807  1845 consensus_queue.cc:237] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.239984  1545 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:35.241019  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:35.242637  1745 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:35.242772  1738 tablet_bootstrap.cc:492] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:35.243403  1738 ts_tablet_manager.cc:1403] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.146s	user 0.052s	sys 0.043s
I20260709 12:59:35.244663  1745 raft_consensus.cc:697] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:35.245986  1745 consensus_queue.cc:237] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.247728  1736 tablet_bootstrap.cc:492] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:35.247642  1738 raft_consensus.cc:359] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.248502  1736 ts_tablet_manager.cc:1403] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.009s
I20260709 12:59:35.248574  1738 raft_consensus.cc:385] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.249176  1738 raft_consensus.cc:740] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.249989  1738 consensus_queue.cc:260] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.252285  1738 ts_tablet_manager.cc:1434] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:59:35.252367  1737 tablet_bootstrap.cc:492] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:35.253185  1764 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.253304  1738 tablet_bootstrap.cc:492] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:35.253638  1737 ts_tablet_manager.cc:1403] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.068s	user 0.019s	sys 0.013s
I20260709 12:59:35.253750  1764 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.256490  1764 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.257149  1737 raft_consensus.cc:359] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.257912  1737 raft_consensus.cc:385] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.258175  1737 raft_consensus.cc:740] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.258407  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:35.260053  1511 leader_election.cc:343] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:35.261117  1737 consensus_queue.cc:260] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.262022  1738 tablet_bootstrap.cc:654] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.262053  1736 raft_consensus.cc:359] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.263067  1736 raft_consensus.cc:385] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.263383  1736 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.264320  1736 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.262053  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:35.265756  1737 ts_tablet_manager.cc:1434] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.006s
I20260709 12:59:35.266820  1736 ts_tablet_manager.cc:1434] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:59:35.266914  1737 tablet_bootstrap.cc:492] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:35.267920  1736 tablet_bootstrap.cc:492] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:35.268339  1854 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.268826  1854 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.271072  1854 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.274024  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:35.274358  1738 tablet_bootstrap.cc:492] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:35.274922  1738 ts_tablet_manager.cc:1403] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
W20260709 12:59:35.266610  1512 leader_election.cc:343] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:35.275544  1736 tablet_bootstrap.cc:654] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.275622  1512 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:35.274904  1696 raft_consensus.cc:2393] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 12:59:35.278255  1738 raft_consensus.cc:359] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.278996  1738 raft_consensus.cc:385] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.279325  1738 raft_consensus.cc:740] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.279605  1764 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:35.280059  1738 consensus_queue.cc:260] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.282673  1738 ts_tablet_manager.cc:1434] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:59:35.283646  1738 tablet_bootstrap.cc:492] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:35.288825  1736 tablet_bootstrap.cc:492] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:35.289356  1736 ts_tablet_manager.cc:1403] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.012s
I20260709 12:59:35.290874  1738 tablet_bootstrap.cc:654] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.291491  1445 catalog_manager.cc:5697] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:35.292109  1736 raft_consensus.cc:359] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.292793  1736 raft_consensus.cc:385] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.293102  1736 raft_consensus.cc:740] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.293246  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:35.294061  1736 consensus_queue.cc:260] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.296337  1736 ts_tablet_manager.cc:1434] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:59:35.297714  1736 tablet_bootstrap.cc:492] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:35.298612  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:35.299731  1854 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.304186  1736 tablet_bootstrap.cc:654] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.307075  1737 tablet_bootstrap.cc:654] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.309674  1854 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:35.316422  1845 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:59:35.329752  1738 tablet_bootstrap.cc:492] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:35.330302  1738 ts_tablet_manager.cc:1403] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.016s
I20260709 12:59:35.332085  1845 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.332636  1845 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.334896  1845 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.337399  1738 raft_consensus.cc:359] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.338195  1738 raft_consensus.cc:385] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.338507  1738 raft_consensus.cc:740] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.338939  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:35.339191  1738 consensus_queue.cc:260] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.341480  1738 ts_tablet_manager.cc:1434] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
W20260709 12:59:35.341418  1511 leader_election.cc:343] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:35.342103  1736 tablet_bootstrap.cc:492] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:35.342774  1736 ts_tablet_manager.cc:1403] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.008s
I20260709 12:59:35.345353  1736 raft_consensus.cc:359] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.346993  1845 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:35.347472  1736 raft_consensus.cc:385] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.347906  1736 raft_consensus.cc:740] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.345687  1737 tablet_bootstrap.cc:492] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:35.345697  1826 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.348670  1826 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.349160  1738 tablet_bootstrap.cc:492] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:35.350821  1826 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.352447  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:35.350792  1736 consensus_queue.cc:260] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.355809  1737 ts_tablet_manager.cc:1403] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.089s	user 0.019s	sys 0.015s
I20260709 12:59:35.356040  1736 ts_tablet_manager.cc:1434] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:59:35.357203  1736 tablet_bootstrap.cc:492] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:35.358174  1738 tablet_bootstrap.cc:654] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.361745  1826 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.362419  1826 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.363561  1737 raft_consensus.cc:359] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.364527  1737 raft_consensus.cc:385] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.366026  1826 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.370024  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:35.374989  1736 tablet_bootstrap.cc:654] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.365091  1737 raft_consensus.cc:740] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.380124  1737 consensus_queue.cc:260] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.361687  1445 catalog_manager.cc:5697] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:35.384433  1737 ts_tablet_manager.cc:1434] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:59:35.385432  1737 tablet_bootstrap.cc:492] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:35.386480  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:35.391408  1737 tablet_bootstrap.cc:654] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.397109  1736 tablet_bootstrap.cc:492] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:35.397809  1736 ts_tablet_manager.cc:1403] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.003s
I20260709 12:59:35.399094  1745 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.399578  1745 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.400733  1736 raft_consensus.cc:359] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.401408  1736 raft_consensus.cc:385] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.401584  1745 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:35.401777  1736 raft_consensus.cc:740] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.401520  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:35.402977  1546 raft_consensus.cc:2393] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 12:59:35.403635  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:35.402689  1736 consensus_queue.cc:260] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.406491  1736 ts_tablet_manager.cc:1434] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:59:35.412887  1737 tablet_bootstrap.cc:492] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:35.414175  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:35.414434  1737 ts_tablet_manager.cc:1403] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.008s
W20260709 12:59:35.417874  1512 leader_election.cc:343] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:35.418377  1737 raft_consensus.cc:359] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.419090  1737 raft_consensus.cc:385] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.419404  1737 raft_consensus.cc:740] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.420117  1737 consensus_queue.cc:260] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.425895  1737 ts_tablet_manager.cc:1434] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:59:35.418393  1512 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:35.430234  1621 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.431548  1737 tablet_bootstrap.cc:492] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:35.436728  1738 tablet_bootstrap.cc:492] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:35.430439  1736 tablet_bootstrap.cc:492] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:35.437114  1738 ts_tablet_manager.cc:1403] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.088s	user 0.018s	sys 0.043s
I20260709 12:59:35.439155  1738 raft_consensus.cc:359] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.440315  1738 raft_consensus.cc:385] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.440591  1738 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.441241  1738 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.443507  1738 ts_tablet_manager.cc:1434] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:59:35.444015  1879 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:35.444897  1585 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:35.445583  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:35.446115  1585 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:35.447219  1736 tablet_bootstrap.cc:654] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.447412  1826 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.455965  1826 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:35.447974  1737 tablet_bootstrap.cc:654] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.458899  1738 tablet_bootstrap.cc:492] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:35.460429  1736 tablet_bootstrap.cc:492] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:35.460903  1736 ts_tablet_manager.cc:1403] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.003s
I20260709 12:59:35.472973  1659 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:35.474466  1831 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:35.500051  1831 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.500727  1831 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.509080  1751 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.509855  1751 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.555991  1736 raft_consensus.cc:359] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.558593  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:35.559569  1831 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:35.562234  1751 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.562647  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:35.563257  1620 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:35.564471  1854 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:35.565171  1745 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.565938  1737 tablet_bootstrap.cc:492] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:35.565763  1745 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.566437  1737 ts_tablet_manager.cc:1403] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.135s	user 0.028s	sys 0.035s
I20260709 12:59:35.568351  1660 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:35.569424  1737 raft_consensus.cc:359] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.570149  1737 raft_consensus.cc:385] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.570443  1737 raft_consensus.cc:740] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.570592  1787 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:35.571039  1787 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:35.571424  1787 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.571146  1737 consensus_queue.cc:260] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.572849  1737 ts_tablet_manager.cc:1434] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:59:35.580902  1745 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:35.583454  1832 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.584035  1832 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.585258  1737 tablet_bootstrap.cc:492] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:35.587262  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:35.587863  1622 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:35.589087  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:35.590029  1879 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:35.590416  1879 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:35.590859  1879 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.594820  1737 tablet_bootstrap.cc:654] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.596093  1832 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.608021  1751 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.608572  1751 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.610757  1751 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.617599  1845 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.618100  1845 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.588510  1787 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.558703  1736 raft_consensus.cc:385] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.620620  1736 raft_consensus.cc:740] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.624919  1736 consensus_queue.cc:260] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.620023  1845 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.629729  1736 ts_tablet_manager.cc:1434] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.169s	user 0.003s	sys 0.006s
I20260709 12:59:35.629640  1879 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.630163  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:35.630805  1696 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:35.631034  1736 tablet_bootstrap.cc:492] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:35.631914  1879 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.635854  1738 tablet_bootstrap.cc:654] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.640412  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:35.641325  1546 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:35.643615  1737 tablet_bootstrap.cc:492] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:35.644066  1737 ts_tablet_manager.cc:1403] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.011s
I20260709 12:59:35.645632  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:35.646179  1787 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:35.648226  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:35.648764  1622 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.654680  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 12:59:35.655982  1511 leader_election.cc:343] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:35.654783  1587 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 12:59:35.645128  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 75595.8us
I20260709 12:59:35.657306  1751 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:35.658501  1751 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:35.659263  1751 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.661028  1622 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:35.661443  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:35.662398  1547 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.662878  1736 tablet_bootstrap.cc:654] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.664070  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:35.662434  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:35.665307  1879 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:35.665670  1545 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:35.666074  1879 raft_consensus.cc:697] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:35.666893  1879 consensus_queue.cc:237] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.667646  1737 raft_consensus.cc:359] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.668370  1737 raft_consensus.cc:385] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.668635  1737 raft_consensus.cc:740] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.669384  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:35.669344  1737 consensus_queue.cc:260] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.670902  1547 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:35.671818  1737 ts_tablet_manager.cc:1434] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.002s
I20260709 12:59:35.671582  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:35.672338  1545 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:35.672640  1737 tablet_bootstrap.cc:492] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:35.675490  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:35.676663  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:35.677201  1620 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.677254  1694 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:35.676707  1693 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.678911  1737 tablet_bootstrap.cc:654] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.684486  1751 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.684937  1620 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:35.685544  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:35.686110  1660 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:35.687896  1924 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:35.688208  1751 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.688548  1924 raft_consensus.cc:697] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:35.689766  1924 consensus_queue.cc:237] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:35.694646  1660 leader_election.cc:343] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:35.694866  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:35.695448  1696 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.704780  1738 tablet_bootstrap.cc:492] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:35.705236  1738 ts_tablet_manager.cc:1403] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.247s	user 0.019s	sys 0.003s
I20260709 12:59:35.706095  1737 tablet_bootstrap.cc:492] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:35.706409  1737 ts_tablet_manager.cc:1403] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.002s
I20260709 12:59:35.707167  1738 raft_consensus.cc:359] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.707741  1738 raft_consensus.cc:385] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.707962  1738 raft_consensus.cc:740] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.708282  1737 raft_consensus.cc:359] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.708779  1737 raft_consensus.cc:385] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.708523  1738 consensus_queue.cc:260] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.709009  1737 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.709549  1737 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.710179  1738 ts_tablet_manager.cc:1434] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:59:35.710865  1738 tablet_bootstrap.cc:492] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:35.711078  1737 ts_tablet_manager.cc:1434] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 12:59:35.711791  1737 tablet_bootstrap.cc:492] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:35.714686  1738 tablet_bootstrap.cc:654] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.751751  1737 tablet_bootstrap.cc:654] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.760041  1845 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.761204  1845 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.763754  1925 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.772993  1585 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:35.775141  1737 tablet_bootstrap.cc:492] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:35.776021  1737 ts_tablet_manager.cc:1403] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.013s
I20260709 12:59:35.776726  1751 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:35.782308  1845 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.789371  1736 tablet_bootstrap.cc:492] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:35.790025  1736 ts_tablet_manager.cc:1403] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.159s	user 0.009s	sys 0.004s
I20260709 12:59:35.793253  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:35.797355  1620 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.798774  1696 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 12:59:35.786994  1925 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.808104  1923 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.808550  1587 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:35.808879  1923 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.810084  1751 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:35.810828  1751 raft_consensus.cc:697] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 12:59:35.811152  1923 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:35.811633  1925 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:35.815865  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:35.815745  1737 raft_consensus.cc:359] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.817167  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:35.818267  1737 raft_consensus.cc:385] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.818624  1737 raft_consensus.cc:740] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.816057  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:35.819751  1736 raft_consensus.cc:359] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.812381  1751 consensus_queue.cc:237] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:35.820885  1660 leader_election.cc:343] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:35.821357  1512 leader_election.cc:343] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:35.821969  1660 leader_election.cc:343] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:35.821385  1736 raft_consensus.cc:385] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.822903  1736 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.823756  1736 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.822723  1512 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:35.828584  1737 consensus_queue.cc:260] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.826771  1659 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:35.839495  1787 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:35.839933  1787 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:35.840401  1787 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:35.839846  1512 leader_election.cc:343] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:35.841529  1737 ts_tablet_manager.cc:1434] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.004s
I20260709 12:59:35.843324  1845 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:35.843801  1845 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:35.844973  1845 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.850368  1738 tablet_bootstrap.cc:492] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:35.851157  1738 ts_tablet_manager.cc:1403] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.140s	user 0.005s	sys 0.012s
I20260709 12:59:35.854557  1738 raft_consensus.cc:359] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.855397  1738 raft_consensus.cc:385] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:35.855811  1738 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:35.856222  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:35.857117  1545 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.856663  1738 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.860803  1738 ts_tablet_manager.cc:1434] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:59:35.862454  1738 tablet_bootstrap.cc:492] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:35.845515  1923 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:59:35.869731  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:35.870512  1694 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:35.872393  1936 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:59:35.875639  1511 leader_election.cc:343] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:35.878489  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 52131.3us
I20260709 12:59:35.883711  1736 ts_tablet_manager.cc:1434] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.093s	user 0.004s	sys 0.008s
I20260709 12:59:35.890453  1737 tablet_bootstrap.cc:492] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:35.890333  1444 catalog_manager.cc:5697] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:35.888628  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:35.899521  1620 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:35.919309  1764 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.919970  1764 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.921239  1736 tablet_bootstrap.cc:492] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:35.922245  1764 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.912750  1879 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.926103  1879 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.929080  1879 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.917495  1845 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:35.931906  1845 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:35.932541  1445 catalog_manager.cc:5697] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:35.939461  1738 tablet_bootstrap.cc:654] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:35.946712  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:35.946884  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:35.918550  1512 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 12:59:36.010890  1938 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 12:59:36.011116  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 96617.7us
W20260709 12:59:36.011761  1511 leader_election.cc:343] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:36.013401  1511 leader_election.cc:343] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.010967  1845 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:36.014519  1845 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.014483  1832 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:59:36.016333  1845 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.016266  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 12:59:36.019032  1511 leader_election.cc:343] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.020731  1736 tablet_bootstrap.cc:654] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.023216  1737 tablet_bootstrap.cc:654] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.024669  1854 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.025147  1854 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:36.028329  1939 log.cc:927] Time spent T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:59:36.029409  1854 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:36.038869  1787 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.043090  1925 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.043664  1925 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.044765  1787 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:36.046664  1925 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:36.038319  1443 catalog_manager.cc:5697] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:36.049311  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:36.050010  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:36.050212  1696 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:36.044958  1845 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.050695  1694 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:36.052901  1845 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:36.054828  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:36.053455  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:36.056986  1694 raft_consensus.cc:2393] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 1: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 12:59:36.060012  1511 leader_election.cc:343] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.042608  1545 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 12:59:36.069216  1854 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.069602  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:36.069952  1854 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.070715  1615 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:36.064043  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:36.076697  1738 tablet_bootstrap.cc:492] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:36.077324  1738 ts_tablet_manager.cc:1403] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.215s	user 0.012s	sys 0.008s
I20260709 12:59:36.079747  1854 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:36.079075  1737 tablet_bootstrap.cc:492] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:36.081629  1737 ts_tablet_manager.cc:1403] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.192s	user 0.024s	sys 0.023s
I20260709 12:59:36.081976  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:36.084457  1696 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:36.085053  1660 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:36.088716  1738 raft_consensus.cc:359] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.089248  1738 raft_consensus.cc:385] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.089486  1738 raft_consensus.cc:740] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.090082  1738 consensus_queue.cc:260] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.086297  1923 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:36.099661  1923 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.100035  1923 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.113281  1738 ts_tablet_manager.cc:1434] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.036s	user 0.011s	sys 0.005s
W20260709 12:59:36.116571  1660 leader_election.cc:343] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.120150  1924 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:36.124975  1738 tablet_bootstrap.cc:492] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:36.125412  1923 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.126242  1736 tablet_bootstrap.cc:492] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:36.126750  1736 ts_tablet_manager.cc:1403] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.206s	user 0.011s	sys 0.030s
I20260709 12:59:36.128962  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:36.129876  1923 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:36.136170  1845 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:36.139573  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:36.146365  1736 raft_consensus.cc:359] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.147374  1736 raft_consensus.cc:385] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.147729  1736 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.148567  1736 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.158104  1736 ts_tablet_manager.cc:1434] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260709 12:59:36.158561  1545 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:36.159153  1736 tablet_bootstrap.cc:492] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:36.158851  1737 raft_consensus.cc:359] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.160454  1737 raft_consensus.cc:385] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.160776  1737 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.171267  1737 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.180136  1737 ts_tablet_manager.cc:1434] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.000s
I20260709 12:59:36.161586  1587 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:36.183190  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:36.186007  1940 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.186514  1940 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.187467  1751 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:36.187855  1751 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.188199  1751 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.193311  1737 tablet_bootstrap.cc:492] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:36.196208  1940 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:36.202869  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:36.309792  1511 leader_election.cc:343] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.313251  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:36.313953  1693 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:36.319340  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 173065us
I20260709 12:59:36.323189  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:36.326810  1695 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.327020  1585 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:36.328954  1854 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:36.333292  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:36.327226  1751 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.335425  1512 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.336385  1620 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.339448  1737 tablet_bootstrap.cc:654] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.339536  1936 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:36.339936  1936 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.340278  1936 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.340368  1751 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:36.336443  1618 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 1: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 12:59:36.343418  1693 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:36.345957  1738 tablet_bootstrap.cc:654] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.346208  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:36.349578  1693 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 12:59:36.356747  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:36.357144  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:36.357679  1538 raft_consensus.cc:2393] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 1: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 12:59:36.357962  1547 raft_consensus.cc:2393] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 1: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 12:59:36.358701  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:36.359369  1547 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:36.358641  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:36.367450  1538 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.372612  1936 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.374776  1936 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:36.375607  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:36.376492  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:36.377300  1544 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
W20260709 12:59:36.377605  1511 leader_election.cc:343] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.378157  1736 tablet_bootstrap.cc:654] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.381517  1538 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:36.382503  1512 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.383594  1512 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.384083  1832 raft_consensus.cc:2804] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:36.384498  1832 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.384809  1832 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.387310  1751 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 12:59:36.387703  1845 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:36.387821  1751 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:36.390358  1512 leader_election.cc:343] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.390751  1512 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.390826  1924 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.391366  1924 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.391957  1738 tablet_bootstrap.cc:492] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:36.392376  1738 ts_tablet_manager.cc:1403] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.268s	user 0.006s	sys 0.027s
I20260709 12:59:36.393491  1924 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:36.394306  1751 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:36.394598  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:36.396922  1936 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:36.397475  1512 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.398862  1936 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:36.399322  1936 raft_consensus.cc:697] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:36.400344  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:36.400120  1936 consensus_queue.cc:237] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.401072  1544 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 12:59:36.402066  1764 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:36.402742  1659 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.403715  1736 tablet_bootstrap.cc:492] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:36.404145  1736 ts_tablet_manager.cc:1403] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.245s	user 0.014s	sys 0.047s
I20260709 12:59:36.403992  1659 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.405701  1923 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:36.405860  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:36.406354  1923 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:36.406421  1693 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.408926  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:36.418447  1924 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:36.419112  1745 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:36.421804  1659 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.422613  1925 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:36.422964  1925 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.423318  1925 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.429019  1693 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:36.422986  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.402736  1737 tablet_bootstrap.cc:492] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:36.430310  1923 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:36.430837  1737 ts_tablet_manager.cc:1403] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.242s	user 0.007s	sys 0.005s
I20260709 12:59:36.430994  1923 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:36.432950  1512 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.433907  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:36.436094  1879 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:36.394903  1738 raft_consensus.cc:359] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.436594  1879 raft_consensus.cc:697] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:36.436846  1738 raft_consensus.cc:385] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.437204  1738 raft_consensus.cc:740] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.437489  1879 consensus_queue.cc:237] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.439024  1738 consensus_queue.cc:260] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.440169  1923 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.441048  1738 ts_tablet_manager.cc:1434] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:59:36.441833  1738 tablet_bootstrap.cc:492] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:36.443061  1832 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.443576  1831 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.443513  1737 raft_consensus.cc:359] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.444254  1737 raft_consensus.cc:385] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.444571  1737 raft_consensus.cc:740] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.444132  1831 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.445767  1737 consensus_queue.cc:260] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.447022  1831 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:36.447383  1736 raft_consensus.cc:359] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.448041  1736 raft_consensus.cc:385] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.448169  1737 ts_tablet_manager.cc:1434] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:59:36.430310  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:36.448334  1736 raft_consensus.cc:740] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.453493  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:36.459622  1693 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.454296  1659 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.450112  1832 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:36.462682  1745 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:36.453261  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:36.464047  1545 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:36.448860  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:36.467458  1621 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 12:59:36.468847  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:36.470203  1831 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:36.470561  1737 tablet_bootstrap.cc:492] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:36.470831  1831 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.471421  1831 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:36.470474  1925 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.471638  1693 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:36.475224  1736 consensus_queue.cc:260] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.482622  1736 ts_tablet_manager.cc:1434] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.078s	user 0.003s	sys 0.004s
I20260709 12:59:36.483719  1736 tablet_bootstrap.cc:492] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:36.493643  1512 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:36.496196  1751 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:36.496639  1832 raft_consensus.cc:2804] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:36.497828  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:36.499760  1925 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:36.500488  1832 raft_consensus.cc:697] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:36.502202  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:36.501915  1832 consensus_queue.cc:237] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:36.505654  1660 leader_election.cc:343] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.505990  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:36.507603  1545 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.512458  1738 tablet_bootstrap.cc:654] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.497901  1585 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:36.518898  1444 catalog_manager.cc:5697] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:36.528900  1845 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.529127  1954 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.529439  1845 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.529580  1954 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.531278  1737 tablet_bootstrap.cc:654] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.531656  1954 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:36.531780  1845 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:36.534096  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:36.535249  1696 raft_consensus.cc:2393] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 12:59:36.537256  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 12:59:36.542068  1512 leader_election.cc:343] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.528662  1751 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:59:36.545789  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 48032.1us
I20260709 12:59:36.555940  1585 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:36.556955  1545 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:36.558624  1854 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:36.559345  1854 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:36.561275  1736 tablet_bootstrap.cc:654] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.561416  1737 tablet_bootstrap.cc:492] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:36.561812  1737 ts_tablet_manager.cc:1403] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.092s	user 0.018s	sys 0.007s
I20260709 12:59:36.548894  1831 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.564189  1659 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.569402  1925 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:36.570165  1925 raft_consensus.cc:697] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:36.571465  1925 consensus_queue.cc:237] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.573963  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:36.579393  1831 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:36.585992  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:36.586565  1621 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:36.588445  1738 tablet_bootstrap.cc:492] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:36.588989  1738 ts_tablet_manager.cc:1403] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.147s	user 0.007s	sys 0.011s
I20260709 12:59:36.591755  1738 raft_consensus.cc:359] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.593372  1738 raft_consensus.cc:385] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.593722  1738 raft_consensus.cc:740] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.585052  1444 catalog_manager.cc:5697] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:36.576413  1545 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:36.595762  1738 consensus_queue.cc:260] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.595256  1444 catalog_manager.cc:5697] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:36.607952  1737 raft_consensus.cc:359] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.608956  1737 raft_consensus.cc:385] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.609005  1621 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 12:59:36.609421  1737 raft_consensus.cc:740] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.610399  1660 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:36.611496  1831 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:36.612224  1831 raft_consensus.cc:697] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:36.612337  1444 catalog_manager.cc:5697] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:36.613107  1831 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.617636  1738 ts_tablet_manager.cc:1434] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 12:59:36.618932  1738 tablet_bootstrap.cc:492] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:36.610404  1737 consensus_queue.cc:260] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.622484  1737 ts_tablet_manager.cc:1434] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.001s
I20260709 12:59:36.623781  1737 tablet_bootstrap.cc:492] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:36.628733  1545 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 12:59:36.631711  1737 tablet_bootstrap.cc:654] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:36.635131  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 77758.5us
I20260709 12:59:36.637797  1845 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.638489  1845 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.641023  1738 tablet_bootstrap.cc:654] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.642416  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:36.642937  1845 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 12:59:36.654352  1512 leader_election.cc:343] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.645586  1736 tablet_bootstrap.cc:492] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
W20260709 12:59:36.646502  1511 leader_election.cc:343] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.655617  1736 ts_tablet_manager.cc:1403] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.172s	user 0.010s	sys 0.010s
I20260709 12:59:36.649142  1737 tablet_bootstrap.cc:492] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:36.649540  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:36.650079  1443 catalog_manager.cc:5697] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:36.658317  1736 raft_consensus.cc:359] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.658954  1736 raft_consensus.cc:385] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.650744  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:36.659205  1736 raft_consensus.cc:740] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.660420  1736 consensus_queue.cc:260] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.662038  1737 ts_tablet_manager.cc:1403] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.008s
I20260709 12:59:36.662853  1736 ts_tablet_manager.cc:1434] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:36.663815  1736 tablet_bootstrap.cc:492] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:36.665853  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 12:59:36.667781  1511 leader_election.cc:343] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.668231  1511 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.667215  1585 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 12:59:36.669371  1511 leader_election.cc:343] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.669863  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.669409  1854 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.664633  1737 raft_consensus.cc:359] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.675706  1737 raft_consensus.cc:385] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.676002  1737 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.677287  1737 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.677722  1854 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:36.679448  1737 ts_tablet_manager.cc:1434] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.005s
I20260709 12:59:36.680430  1737 tablet_bootstrap.cc:492] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:36.680991  1845 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:36.681690  1845 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:36.683917  1443 catalog_manager.cc:5697] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 1 to 3, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:36.686164  1831 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.686620  1831 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.689081  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 12:59:36.690362  1659 leader_election.cc:343] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.691403  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:36.693806  1660 leader_election.cc:343] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.694237  1660 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.694798  1736 tablet_bootstrap.cc:654] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.691910  1831 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:36.697324  1738 tablet_bootstrap.cc:492] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:36.694458  1737 tablet_bootstrap.cc:654] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.698535  1738 ts_tablet_manager.cc:1403] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.005s
I20260709 12:59:36.702334  1738 raft_consensus.cc:359] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.703191  1738 raft_consensus.cc:385] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.703485  1738 raft_consensus.cc:740] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.704299  1738 consensus_queue.cc:260] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.706570  1738 ts_tablet_manager.cc:1434] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:36.708086  1738 tablet_bootstrap.cc:492] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:36.712960  1738 tablet_bootstrap.cc:654] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.717029  1736 tablet_bootstrap.cc:492] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:36.695007  1925 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:36.717638  1736 ts_tablet_manager.cc:1403] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.000s
I20260709 12:59:36.722221  1737 tablet_bootstrap.cc:492] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:36.722869  1737 ts_tablet_manager.cc:1403] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.009s
I20260709 12:59:36.722251  1738 tablet_bootstrap.cc:492] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:36.724171  1738 ts_tablet_manager.cc:1403] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.006s
I20260709 12:59:36.725689  1736 raft_consensus.cc:359] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.726394  1736 raft_consensus.cc:385] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.726670  1736 raft_consensus.cc:740] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.727288  1736 consensus_queue.cc:260] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.729105  1736 ts_tablet_manager.cc:1434] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:59:36.729238  1738 raft_consensus.cc:359] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.729892  1738 raft_consensus.cc:385] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.730180  1738 raft_consensus.cc:740] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.730706  1738 consensus_queue.cc:260] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.731127  1737 raft_consensus.cc:359] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.731877  1737 raft_consensus.cc:385] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.732115  1737 raft_consensus.cc:740] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.732520  1738 ts_tablet_manager.cc:1434] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:59:36.732725  1737 consensus_queue.cc:260] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.733713  1738 tablet_bootstrap.cc:492] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:36.735176  1736 tablet_bootstrap.cc:492] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:36.741039  1738 tablet_bootstrap.cc:654] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.743546  1832 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.744107  1736 tablet_bootstrap.cc:654] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.744076  1832 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.747059  1971 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.747193  1737 ts_tablet_manager.cc:1434] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 12:59:36.747606  1971 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.748296  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:36.749681  1971 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 12:59:36.750402  1511 leader_election.cc:343] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.748303  1737 tablet_bootstrap.cc:492] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:36.751792  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:36.752701  1544 raft_consensus.cc:2393] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 12:59:36.752470  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:36.755815  1832 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:36.757337  1587 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:36.758620  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:36.759284  1693 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:36.760612  1512 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.761598  1832 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:36.762007  1832 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.762342  1832 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.772704  1854 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.776754  1737 tablet_bootstrap.cc:654] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.787643  1738 tablet_bootstrap.cc:492] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:36.787710  1736 tablet_bootstrap.cc:492] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:36.788270  1738 ts_tablet_manager.cc:1403] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.007s
I20260709 12:59:36.788286  1736 ts_tablet_manager.cc:1403] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.028s
I20260709 12:59:36.789434  1737 tablet_bootstrap.cc:492] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:36.789855  1737 ts_tablet_manager.cc:1403] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.009s
I20260709 12:59:36.791252  1738 raft_consensus.cc:359] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.791445  1736 raft_consensus.cc:359] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.792012  1738 raft_consensus.cc:385] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.792126  1736 raft_consensus.cc:385] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.792429  1738 raft_consensus.cc:740] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.792704  1736 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.793367  1738 consensus_queue.cc:260] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.793560  1736 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.792364  1737 raft_consensus.cc:359] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.795405  1737 raft_consensus.cc:385] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.795687  1736 ts_tablet_manager.cc:1434] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:36.795655  1737 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.796380  1737 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.796983  1736 tablet_bootstrap.cc:492] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:36.795140  1832 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.800522  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 12:59:36.802047  1511 leader_election.cc:343] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.802670  1736 tablet_bootstrap.cc:654] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.803455  1738 ts_tablet_manager.cc:1434] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:59:36.804044  1737 ts_tablet_manager.cc:1434] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:59:36.804960  1737 tablet_bootstrap.cc:492] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:36.807984  1738 tablet_bootstrap.cc:492] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:36.812908  1832 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:36.815914  1736 tablet_bootstrap.cc:492] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:36.816370  1736 ts_tablet_manager.cc:1403] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.008s
I20260709 12:59:36.816725  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:36.818979  1736 raft_consensus.cc:359] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.819789  1736 raft_consensus.cc:385] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.820103  1736 raft_consensus.cc:740] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.817319  1693 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.820850  1832 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.820994  1736 consensus_queue.cc:260] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.821309  1832 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.822995  1736 ts_tablet_manager.cc:1434] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:59:36.823968  1736 tablet_bootstrap.cc:492] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:36.825070  1738 tablet_bootstrap.cc:654] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.824873  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:36.826511  1511 leader_election.cc:343] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.828559  1832 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:36.829576  1736 tablet_bootstrap.cc:654] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.812953  1737 tablet_bootstrap.cc:654] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.830981  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:36.837149  1845 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:36.837872  1738 tablet_bootstrap.cc:492] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:36.838354  1738 ts_tablet_manager.cc:1403] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.008s
I20260709 12:59:36.841140  1738 raft_consensus.cc:359] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.842206  1738 raft_consensus.cc:385] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.842522  1738 raft_consensus.cc:740] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.843298  1738 consensus_queue.cc:260] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.846122  1738 ts_tablet_manager.cc:1434] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:36.847059  1738 tablet_bootstrap.cc:492] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:36.850431  1854 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:36.850620  1831 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.851297  1831 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.853678  1738 tablet_bootstrap.cc:654] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.854683  1737 tablet_bootstrap.cc:492] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:36.857087  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:36.860162  1660 leader_election.cc:343] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.866194  1925 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:36.867703  1616 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.868394  1738 tablet_bootstrap.cc:492] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
W20260709 12:59:36.868280  1512 leader_election.cc:343] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.869199  1512 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.869792  1831 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:36.869948  1845 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:36.876217  1693 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:36.878453  1738 ts_tablet_manager.cc:1403] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.006s
I20260709 12:59:36.881837  1738 raft_consensus.cc:359] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.883570  1738 raft_consensus.cc:385] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.883939  1738 raft_consensus.cc:740] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.884708  1738 consensus_queue.cc:260] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.886060  1736 tablet_bootstrap.cc:492] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:36.886524  1736 ts_tablet_manager.cc:1403] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.016s
I20260709 12:59:36.886958  1738 ts_tablet_manager.cc:1434] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 12:59:36.887949  1738 tablet_bootstrap.cc:492] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:36.889109  1736 raft_consensus.cc:359] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.889547  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:36.889869  1736 raft_consensus.cc:385] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:36.890163  1736 raft_consensus.cc:740] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.890201  1544 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:36.889428  1512 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.894114  1879 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:36.894582  1879 raft_consensus.cc:697] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:36.895455  1879 consensus_queue.cc:237] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.899952  1879 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:36.902031  1831 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:36.903064  1659 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:36.904332  1925 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:36.904767  1925 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.905125  1925 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.906594  1738 tablet_bootstrap.cc:654] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:36.890970  1736 consensus_queue.cc:260] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.892850  1620 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:36.916956  1879 consensus_queue.cc:1048] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:36.855115  1737 ts_tablet_manager.cc:1403] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.001s
I20260709 12:59:36.924793  1736 ts_tablet_manager.cc:1434] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.004s
I20260709 12:59:36.925819  1736 tablet_bootstrap.cc:492] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:36.917482  1925 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.943073  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 12:59:36.944340  1660 leader_election.cc:343] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:36.945950  1879 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:36.948670  1925 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:36.950237  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:36.950415  1854 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:36.951668  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:36.926829  1737 raft_consensus.cc:359] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:36.955801  1736 tablet_bootstrap.cc:654] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:37.010773  1737 raft_consensus.cc:385] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:37.011423  1737 raft_consensus.cc:740] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:36.973592  1546 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.012322  1854 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.013947  1737 consensus_queue.cc:260] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:37.014761  1994 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:59:36.979853  1443 catalog_manager.cc:5697] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.020243  1832 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.023631  1737 ts_tablet_manager.cc:1434] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.099s	user 0.016s	sys 0.002s
I20260709 12:59:37.031970  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:37.032819  1694 raft_consensus.cc:2393] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 12:59:37.032949  1737 tablet_bootstrap.cc:492] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:37.035336  1832 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.038344  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:37.041257  1831 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.046125  1831 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.047731  1832 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:36.995664  1954 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.049193  1831 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:37.049429  1954 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.038842  1925 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.023352  1854 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:37.056638  1585 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:37.058249  1832 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.060103  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:37.060236  1832 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.060717  1538 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:37.062158  1832 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:37.063201  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:37.064121  1616 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:37.065661  1854 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.067198  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:37.068856  1692 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:37.052034  1925 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.073629  1511 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:37.074945  1845 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:37.076326  1659 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:37.085923  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:37.086844  1692 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:37.088210  1940 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:37.088802  1940 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.089280  1940 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.093449  1736 tablet_bootstrap.cc:492] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:37.093852  1736 ts_tablet_manager.cc:1403] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.168s	user 0.016s	sys 0.010s
I20260709 12:59:37.095041  1879 consensus_queue.cc:1048] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:37.095341  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:37.090170  1923 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:37.097855  1545 raft_consensus.cc:2393] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 12:59:37.099658  1923 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.117599  1738 tablet_bootstrap.cc:492] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:37.118019  1738 ts_tablet_manager.cc:1403] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.230s	user 0.027s	sys 0.081s
I20260709 12:59:37.090596  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:37.118458  1954 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:37.120165  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:37.120995  1695 raft_consensus.cc:2393] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 12:59:37.115338  1923 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.124399  1617 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:37.125166  1736 raft_consensus.cc:359] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.126376  1736 raft_consensus.cc:385] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:37.126735  1736 raft_consensus.cc:740] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
W20260709 12:59:37.142808  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 43646.4us
I20260709 12:59:37.148528  1512 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:37.123142  1616 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:37.149271  1736 consensus_queue.cc:260] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.152906  1940 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.154280  1925 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:37.152211  1745 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:59:37.159873  1940 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:37.218721  1999 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:37.156922  1587 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:37.164645  1854 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:37.229957  1737 tablet_bootstrap.cc:654] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:37.230396  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:37.196292  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:37.219347  1999 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.249445  1736 ts_tablet_manager.cc:1434] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.155s	user 0.008s	sys 0.007s
I20260709 12:59:37.244151  1854 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:37.231803  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 116153us
I20260709 12:59:37.248979  1999 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.260598  1736 tablet_bootstrap.cc:492] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
W20260709 12:59:37.250367  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 98534.3us
I20260709 12:59:37.248934  1545 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:37.266062  1738 raft_consensus.cc:359] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.266681  1738 raft_consensus.cc:385] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:37.266897  1738 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:37.271783  1659 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:37.276751  1831 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:37.277143  1831 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.277489  1831 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.277946  1854 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:37.270180  1546 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:37.281440  1659 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:37.282501  2003 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:37.282948  2003 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:37.275386  1925 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:59:37.283751  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:37.285085  1738 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.296738  1738 ts_tablet_manager.cc:1434] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.178s	user 0.005s	sys 0.003s
I20260709 12:59:37.284078  2003 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.305866  1738 tablet_bootstrap.cc:492] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:37.304062  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:37.317137  1616 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.318643  1999 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:37.314859  1660 leader_election.cc:343] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:37.296885  1925 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:59:37.326148  1616 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:37.311302  1831 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.347142  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:37.313405  1923 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.358047  1693 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 1: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 12:59:37.341250  1545 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:37.347863  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 12:59:37.361616  1511 leader_election.cc:343] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:37.364032  1923 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:37.365842  1831 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:37.366158  1924 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:37.368108  1511 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 12:59:37.368841  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:37.369539  1545 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.371660  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:37.372905  1539 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 1: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 12:59:37.373400  1998 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:37.374054  1998 raft_consensus.cc:697] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:37.374846  1998 consensus_queue.cc:237] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.351044  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:37.350558  1736 tablet_bootstrap.cc:654] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:37.387097  1738 tablet_bootstrap.cc:654] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:37.360746  1694 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.346130  1999 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 12:59:37.396553  1511 leader_election.cc:343] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:37.410372  1737 tablet_bootstrap.cc:492] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:37.411021  1737 ts_tablet_manager.cc:1403] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.378s	user 0.013s	sys 0.036s
I20260709 12:59:37.412715  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:37.414873  1617 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 1: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 12:59:37.422873  1999 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.423339  1999 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.423560  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:37.425292  1999 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:37.426193  1999 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:37.427520  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:37.429003  1660 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:37.430207  2003 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:37.430614  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 12:59:37.437413  1511 leader_election.cc:343] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:37.440737  1545 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
W20260709 12:59:37.442291  1660 leader_election.cc:343] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:37.446152  1737 raft_consensus.cc:359] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:37.450062  1512 leader_election.cc:343] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:37.450479  1737 raft_consensus.cc:385] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:37.450767  1737 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:37.446383  1736 tablet_bootstrap.cc:492] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:37.451454  1736 ts_tablet_manager.cc:1403] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.193s	user 0.008s	sys 0.010s
I20260709 12:59:37.458029  1737 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.460246  1737 ts_tablet_manager.cc:1434] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.001s
I20260709 12:59:37.461220  1737 tablet_bootstrap.cc:492] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:37.461488  1512 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:37.462296  1999 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:37.464219  1736 raft_consensus.cc:359] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.464953  1736 raft_consensus.cc:385] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:37.465307  1736 raft_consensus.cc:740] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:37.465971  1736 consensus_queue.cc:260] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.469555  1659 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:37.472052  1736 ts_tablet_manager.cc:1434] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:59:37.476100  1736 tablet_bootstrap.cc:492] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:37.478447  2003 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:37.480826  2003 raft_consensus.cc:697] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:37.481683  2003 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.466481  1694 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:37.490145  1512 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:37.495744  1845 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:37.494211  1924 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.498898  1924 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.499775  1738 tablet_bootstrap.cc:492] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:37.500188  1738 ts_tablet_manager.cc:1403] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.195s	user 0.020s	sys 0.001s
I20260709 12:59:37.500681  1736 tablet_bootstrap.cc:654] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:37.502377  1845 raft_consensus.cc:697] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:37.503463  1845 consensus_queue.cc:237] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.505650  1738 raft_consensus.cc:359] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.506312  1738 raft_consensus.cc:385] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:37.506629  1738 raft_consensus.cc:740] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:37.506683  1924 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:37.507275  1738 consensus_queue.cc:260] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.497313  1443 catalog_manager.cc:5697] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.538424  2000 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.540187  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:37.540912  1545 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:37.542936  1659 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:37.539047  2000 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.545814  1831 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:37.546248  1831 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.546612  1831 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.547657  2000 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:37.550453  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:37.551677  1737 tablet_bootstrap.cc:654] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:37.552273  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:37.552973  1693 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:37.557112  1512 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:37.565137  1738 ts_tablet_manager.cc:1434] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.065s	user 0.014s	sys 0.006s
I20260709 12:59:37.562422  1621 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:37.566190  1998 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:37.576849  1998 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.577284  1998 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.577414  1999 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:37.587291  1831 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.589665  1831 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:37.591118  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 12:59:37.593560  2014 log.cc:927] Time spent T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:59:37.594636  1660 leader_election.cc:343] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:37.575019  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:37.600081  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:37.602186  1738 tablet_bootstrap.cc:492] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:37.601011  1544 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.610329  1738 tablet_bootstrap.cc:654] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:37.622877  1544 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
W20260709 12:59:37.624519  1660 leader_election.cc:343] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:37.627921  1659 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:37.631126  1831 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:37.631722  1831 raft_consensus.cc:697] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:37.638890  2000 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.642742  2000 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.646195  2000 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:37.647370  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:37.648912  1511 leader_election.cc:343] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:37.649818  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 12:59:37.651634  1512 leader_election.cc:343] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:37.632846  1831 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.652129  1512 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:37.654449  1999 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:37.661463  1998 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.666476  1737 tablet_bootstrap.cc:492] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:37.666955  1737 ts_tablet_manager.cc:1403] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.206s	user 0.015s	sys 0.011s
I20260709 12:59:37.670888  1737 raft_consensus.cc:359] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.672034  1737 raft_consensus.cc:385] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:37.672271  1737 raft_consensus.cc:740] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:37.672801  1737 consensus_queue.cc:260] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.673954  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:37.674537  1617 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.674603  1998 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:37.687660  1444 catalog_manager.cc:5697] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:37.674495  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:37.690238  1693 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.689918  1444 catalog_manager.cc:5697] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:37.692989  1737 ts_tablet_manager.cc:1434] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 12:59:37.694021  1737 tablet_bootstrap.cc:492] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:37.694759  1736 tablet_bootstrap.cc:492] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:37.695210  1736 ts_tablet_manager.cc:1403] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.219s	user 0.014s	sys 0.007s
I20260709 12:59:37.697177  1617 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:37.700260  1737 tablet_bootstrap.cc:654] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:37.701992  1738 tablet_bootstrap.cc:492] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:37.702430  1738 ts_tablet_manager.cc:1403] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.101s	user 0.013s	sys 0.002s
I20260709 12:59:37.703163  1736 raft_consensus.cc:359] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.703852  1736 raft_consensus.cc:385] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:37.704106  1736 raft_consensus.cc:740] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:37.704710  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:37.705124  1693 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:37.705700  1998 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:37.706167  1998 raft_consensus.cc:697] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:37.704905  1738 raft_consensus.cc:359] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.707132  1738 raft_consensus.cc:385] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:37.706779  1998 consensus_queue.cc:237] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.707422  1738 raft_consensus.cc:740] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:37.708163  1738 consensus_queue.cc:260] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.710358  1738 ts_tablet_manager.cc:1434] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:59:37.704747  1736 consensus_queue.cc:260] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.711401  1738 tablet_bootstrap.cc:492] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:37.713196  1736 ts_tablet_manager.cc:1434] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:59:37.714222  1736 tablet_bootstrap.cc:492] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:37.717458  1738 tablet_bootstrap.cc:654] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:37.720121  1445 catalog_manager.cc:5697] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.735473  1737 tablet_bootstrap.cc:492] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:37.735953  1737 ts_tablet_manager.cc:1403] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.012s
I20260709 12:59:37.737354  1736 tablet_bootstrap.cc:654] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:37.739157  1737 raft_consensus.cc:359] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.739868  1737 raft_consensus.cc:385] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:37.740137  1737 raft_consensus.cc:740] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:37.740983  1737 consensus_queue.cc:260] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.742290  1444 catalog_manager.cc:5697] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:37.743436  1738 tablet_bootstrap.cc:492] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:37.743886  1738 ts_tablet_manager.cc:1403] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.005s
I20260709 12:59:37.744264  1737 ts_tablet_manager.cc:1434] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:59:37.745790  1736 tablet_bootstrap.cc:492] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:37.746196  1736 ts_tablet_manager.cc:1403] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 12:59:37.746680  1737 tablet_bootstrap.cc:492] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:37.746850  1738 raft_consensus.cc:359] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.747485  1738 raft_consensus.cc:385] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:37.747757  1738 raft_consensus.cc:740] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:37.748371  1738 consensus_queue.cc:260] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.749258  1854 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.749733  1854 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.752110  1854 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:37.753463  1737 tablet_bootstrap.cc:654] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:37.753585  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:37.757151  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:37.758199  1544 raft_consensus.cc:2393] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 12:59:37.759227  1736 raft_consensus.cc:359] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.759910  1585 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:37.760924  1854 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.761656  1738 ts_tablet_manager.cc:1434] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:59:37.762931  1738 tablet_bootstrap.cc:492] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:37.759895  1736 raft_consensus.cc:385] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:37.767536  1736 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:37.768603  1736 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.767120  1854 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:37.769731  1738 tablet_bootstrap.cc:654] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:37.772099  1736 ts_tablet_manager.cc:1434] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:59:37.774801  1443 catalog_manager.cc:5697] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.794878  1736 tablet_bootstrap.cc:492] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:37.812400  1738 tablet_bootstrap.cc:492] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:37.813159  1738 ts_tablet_manager.cc:1403] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.050s	user 0.024s	sys 0.015s
I20260709 12:59:37.817348  1738 raft_consensus.cc:359] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.818414  1738 raft_consensus.cc:385] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:37.818814  1738 raft_consensus.cc:740] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:37.819779  1738 consensus_queue.cc:260] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.822325  1738 ts_tablet_manager.cc:1434] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:59:37.823810  1738 tablet_bootstrap.cc:492] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:37.830603  1736 tablet_bootstrap.cc:654] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:37.830672  1738 tablet_bootstrap.cc:654] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:37.831317  1831 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.831462  1737 tablet_bootstrap.cc:492] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:37.832520  1737 ts_tablet_manager.cc:1403] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.088s	user 0.032s	sys 0.012s
I20260709 12:59:37.832639  1831 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.836483  1737 raft_consensus.cc:359] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.837342  1737 raft_consensus.cc:385] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:37.837757  1737 raft_consensus.cc:740] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:37.837117  1923 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:37.838910  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:37.838865  1737 consensus_queue.cc:260] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.839681  1544 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:37.840864  1659 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:37.842052  2006 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:37.842454  2006 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.842847  2006 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.860790  1998 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:37.862249  2000 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:37.873916  1737 ts_tablet_manager.cc:1434] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:59:37.875013  1737 tablet_bootstrap.cc:492] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:37.872385  2006 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.880585  1971 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.881582  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:37.881326  1971 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.882390  1831 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:37.882764  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:37.883368  1538 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.885180  1971 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:37.885759  2006 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 12:59:37.888144  1660 leader_election.cc:343] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:37.890329  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:37.891073  1737 tablet_bootstrap.cc:654] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:37.892077  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:37.892820  1694 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:37.895838  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:37.896520  1545 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:37.899406  1585 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:37.900671  1854 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:37.901085  1854 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:37.901686  1660 leader_election.cc:343] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:37.901747  1854 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:37.910485  1538 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:37.920231  2000 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.920989  2000 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.924289  2000 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:37.927786  1738 tablet_bootstrap.cc:492] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:37.928098  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:37.929890  1736 tablet_bootstrap.cc:492] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:37.930361  1736 ts_tablet_manager.cc:1403] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.157s	user 0.010s	sys 0.024s
I20260709 12:59:37.932166  1831 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.932623  1831 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.934490  1831 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:37.938329  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:37.939003  1545 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:37.939445  1738 ts_tablet_manager.cc:1403] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.116s	user 0.021s	sys 0.043s
I20260709 12:59:37.933275  1736 raft_consensus.cc:359] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:37.939875  1512 leader_election.cc:343] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:37.941696  1738 raft_consensus.cc:359] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.942612  1738 raft_consensus.cc:385] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:37.942466  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:37.943004  1736 raft_consensus.cc:385] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:37.941730  1737 tablet_bootstrap.cc:492] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:37.943460  1736 raft_consensus.cc:740] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:37.943792  1737 ts_tablet_manager.cc:1403] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.000s
I20260709 12:59:37.942973  1738 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
W20260709 12:59:37.947789  1511 leader_election.cc:343] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:37.948406  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:37.972270  1925 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:59:37.950737  1659 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:37.948416  1854 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:38.021569  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 70910us
I20260709 12:59:38.022388  2006 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:38.022693  1854 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:38.022891  2006 raft_consensus.cc:697] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:38.023770  2006 consensus_queue.cc:237] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:37.957011  2000 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:37.951325  1736 consensus_queue.cc:260] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.026678  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:38.027383  1544 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:38.027943  1736 ts_tablet_manager.cc:1434] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.097s	user 0.008s	sys 0.012s
I20260709 12:59:38.028102  1659 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:38.028867  1736 tablet_bootstrap.cc:492] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:38.008072  1936 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:37.949510  1737 raft_consensus.cc:359] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.030721  1737 raft_consensus.cc:385] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.031023  1737 raft_consensus.cc:740] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.031644  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:38.031710  1737 consensus_queue.cc:260] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.032373  1619 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:38.033324  1737 ts_tablet_manager.cc:1434] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.089s	user 0.004s	sys 0.006s
I20260709 12:59:38.034251  1737 tablet_bootstrap.cc:492] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:38.015656  1621 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:38.005703  1738 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.037390  1619 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:38.028928  1831 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:38.038025  1831 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.038419  1831 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:38.044000  1544 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
W20260709 12:59:38.049783  1660 consensus_peers.cc:597] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:38.037245  1738 ts_tablet_manager.cc:1434] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.097s	user 0.008s	sys 0.003s
I20260709 12:59:38.046089  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:38.050825  1693 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:38.051301  1738 tablet_bootstrap.cc:492] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:38.056874  1831 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.057346  2000 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:38.059513  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:38.065289  1585 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:38.073944  1736 tablet_bootstrap.cc:654] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.081286  1831 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:38.074908  1854 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:38.076637  2000 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.117573  1879 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:59:38.118754  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:38.123730  2000 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:38.098066  1854 raft_consensus.cc:697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 12:59:38.130121  1738 tablet_bootstrap.cc:654] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.131376  1618 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:38.132546  1923 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.135787  1923 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.135810  1854 consensus_queue.cc:237] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.143798  1693 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 12:59:38.150585  1924 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:38.151948  1923 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:38.154711  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:38.165409  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 53933.8us
I20260709 12:59:38.169977  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:38.169530  1660 leader_election.cc:343] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:38.172834  1511 leader_election.cc:343] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:38.202081  1845 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:38.214761  1736 tablet_bootstrap.cc:492] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:38.215727  1736 ts_tablet_manager.cc:1403] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.187s	user 0.012s	sys 0.013s
I20260709 12:59:38.231081  1618 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:38.232690  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:38.234146  1737 tablet_bootstrap.cc:654] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.236388  1660 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:38.240896  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:38.241535  1545 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:38.239322  1924 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:38.255904  1924 raft_consensus.cc:697] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:38.257270  1738 tablet_bootstrap.cc:492] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:38.257882  1738 ts_tablet_manager.cc:1403] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.207s	user 0.012s	sys 0.022s
I20260709 12:59:38.256189  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:38.280467  1738 raft_consensus.cc:359] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.281270  1738 raft_consensus.cc:385] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.281544  1738 raft_consensus.cc:740] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.282281  1738 consensus_queue.cc:260] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.283687  1540 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:38.272655  1924 consensus_queue.cc:237] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:38.294042  1512 leader_election.cc:343] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:38.294442  1512 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:38.295747  2042 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:38.303861  1738 ts_tablet_manager.cc:1434] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:59:38.308934  1831 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:38.313192  1738 tablet_bootstrap.cc:492] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:38.313431  1444 catalog_manager.cc:5697] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:38.308926  1659 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:38.328670  2006 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:38.312250  1545 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:38.336824  2048 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:38.347442  2048 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.347950  2048 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:38.358837  2000 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.373091  2000 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.376935  1736 raft_consensus.cc:359] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.377732  1736 raft_consensus.cc:385] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.378013  1736 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.379359  1845 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:38.386405  1736 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.387212  1737 tablet_bootstrap.cc:492] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:38.388160  1737 ts_tablet_manager.cc:1403] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.354s	user 0.029s	sys 0.046s
I20260709 12:59:38.393687  1738 tablet_bootstrap.cc:654] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.403946  1736 ts_tablet_manager.cc:1434] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.188s	user 0.006s	sys 0.007s
I20260709 12:59:38.403344  2048 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.413847  2048 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:38.416379  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:38.416978  1540 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:38.430197  1737 raft_consensus.cc:359] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.431195  1737 raft_consensus.cc:385] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.431591  1737 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.432214  1737 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.416988  2000 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:38.428606  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 12:59:38.436185  1660 consensus_peers.cc:597] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:38.437064  1736 tablet_bootstrap.cc:492] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:38.439662  1737 ts_tablet_manager.cc:1434] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:59:38.439643  1616 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:38.447496  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:38.448196  1692 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:38.441872  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:38.449471  1617 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:38.455200  1737 tablet_bootstrap.cc:492] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:38.455734  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:38.459211  1998 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:38.457990  1923 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:59:38.459714  1998 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.468494  1998 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.477346  1616 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:38.472419  1540 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:38.480988  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:38.482368  2048 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:38.483935  2048 raft_consensus.cc:697] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:38.484848  2048 consensus_queue.cc:237] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.491324  1736 tablet_bootstrap.cc:654] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.495081  1738 tablet_bootstrap.cc:492] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:38.495602  1738 ts_tablet_manager.cc:1403] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.186s	user 0.009s	sys 0.018s
I20260709 12:59:38.497498  1998 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.499598  1998 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:38.499727  1737 tablet_bootstrap.cc:654] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.500568  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:38.501197  1617 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.501084  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:38.502161  1692 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.503127  1738 raft_consensus.cc:359] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.504079  1738 raft_consensus.cc:385] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.504431  1738 raft_consensus.cc:740] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.505237  1738 consensus_queue.cc:260] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.509148  1738 ts_tablet_manager.cc:1434] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:59:38.510629  1738 tablet_bootstrap.cc:492] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:38.511442  1617 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 12:59:38.512816  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:38.514349  1845 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:38.515017  1845 raft_consensus.cc:697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:38.515863  1845 consensus_queue.cc:237] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.517522  1738 tablet_bootstrap.cc:654] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.521627  1737 tablet_bootstrap.cc:492] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:38.522475  1737 ts_tablet_manager.cc:1403] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.004s
I20260709 12:59:38.525453  1737 raft_consensus.cc:359] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.526151  1737 raft_consensus.cc:385] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.526789  1737 raft_consensus.cc:740] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.527876  1737 consensus_queue.cc:260] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.530455  1737 ts_tablet_manager.cc:1434] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:59:38.531745  1737 tablet_bootstrap.cc:492] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:38.539475  1998 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.540233  1998 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.541539  1737 tablet_bootstrap.cc:654] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.545104  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:38.547363  1511 leader_election.cc:343] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:38.551594  1692 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 12:59:38.582842  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:38.576059  1441 catalog_manager.cc:5697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:38.590209  2058 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:59:38.594653  1512 leader_election.cc:343] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:38.595098  1512 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:38.596276  2000 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:38.582585  1998 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:38.606371  1737 tablet_bootstrap.cc:492] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:38.607198  1737 ts_tablet_manager.cc:1403] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.011s
I20260709 12:59:38.612731  1923 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.613304  1923 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.616240  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:38.616911  1540 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:38.617993  1659 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:38.618892  2043 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:38.619273  2043 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.619437  1923 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:38.619601  2043 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:38.620685  1443 catalog_manager.cc:5697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 2, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:38.623384  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:38.625029  2052 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:38.626344  1737 raft_consensus.cc:359] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.630589  1737 raft_consensus.cc:385] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.630947  1737 raft_consensus.cc:740] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.631675  1737 consensus_queue.cc:260] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.629004  2043 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:38.633381  1660 leader_election.cc:343] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:38.629683  1736 tablet_bootstrap.cc:492] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:38.634756  2043 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:38.635731  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 12:59:38.637086  1660 leader_election.cc:343] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:38.637377  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:38.638049  1540 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:38.638404  1722 tablet.cc:2406] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:59:38.638679  1737 ts_tablet_manager.cc:1434] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:59:38.640187  1737 tablet_bootstrap.cc:492] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:38.642921  1736 ts_tablet_manager.cc:1403] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.214s	user 0.040s	sys 0.025s
I20260709 12:59:38.646121  1736 raft_consensus.cc:359] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.646835  1736 raft_consensus.cc:385] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.651938  1737 tablet_bootstrap.cc:654] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.660432  1540 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:38.661612  1659 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:38.662690  2043 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:38.663208  2043 raft_consensus.cc:697] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:38.664170  2043 consensus_queue.cc:237] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.668877  1737 tablet_bootstrap.cc:492] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:38.669786  1737 ts_tablet_manager.cc:1403] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.007s
I20260709 12:59:38.674428  1737 raft_consensus.cc:359] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.677968  1737 raft_consensus.cc:385] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.678669  1737 raft_consensus.cc:740] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.675688  1444 catalog_manager.cc:5697] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:38.680327  1737 consensus_queue.cc:260] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.647179  1736 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.682726  1736 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.685211  1737 ts_tablet_manager.cc:1434] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 12:59:38.685894  2043 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:38.686342  1738 tablet_bootstrap.cc:492] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:38.694583  1738 ts_tablet_manager.cc:1403] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.184s	user 0.054s	sys 0.062s
I20260709 12:59:38.694926  1737 tablet_bootstrap.cc:492] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:38.686980  1444 catalog_manager.cc:5697] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:38.686296  2048 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.695557  2048 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.697119  1738 raft_consensus.cc:359] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.697793  1738 raft_consensus.cc:385] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.698055  1738 raft_consensus.cc:740] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.698719  1738 consensus_queue.cc:260] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.699263  2048 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:38.693871  1736 ts_tablet_manager.cc:1434] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 12:59:38.700788  1738 ts_tablet_manager.cc:1434] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:59:38.701263  1737 tablet_bootstrap.cc:654] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.701792  1738 tablet_bootstrap.cc:492] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:38.702330  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:38.701939  1736 tablet_bootstrap.cc:492] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
W20260709 12:59:38.703482  1660 leader_election.cc:343] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:38.704800  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:38.705513  1542 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:38.709254  1738 tablet_bootstrap.cc:654] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.709905  1659 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:38.712452  2043 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:38.712847  2043 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.713526  2043 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:38.719208  1736 tablet_bootstrap.cc:654] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.723155  1738 tablet_bootstrap.cc:492] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:38.723618  1738 ts_tablet_manager.cc:1403] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
I20260709 12:59:38.726647  1738 raft_consensus.cc:359] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.727748  1738 raft_consensus.cc:385] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.728042  1738 raft_consensus.cc:740] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.726912  2043 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.730021  2043 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:38.731127  1737 tablet_bootstrap.cc:492] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:38.730872  1738 consensus_queue.cc:260] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.731259  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:38.731793  1737 ts_tablet_manager.cc:1403] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.007s
W20260709 12:59:38.732625  1660 leader_election.cc:343] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:38.733322  1738 ts_tablet_manager.cc:1434] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:59:38.734356  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:38.735073  1540 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:38.734208  1738 tablet_bootstrap.cc:492] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:38.744964  1738 tablet_bootstrap.cc:654] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.749534  1737 raft_consensus.cc:359] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.751374  1737 raft_consensus.cc:385] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.751711  1737 raft_consensus.cc:740] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.754827  1737 consensus_queue.cc:260] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.756779  1738 tablet_bootstrap.cc:492] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:38.758529  2048 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:38.759837  1442 catalog_manager.cc:5697] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:38.765473  1738 ts_tablet_manager.cc:1403] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.000s
I20260709 12:59:38.768237  1540 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:38.768090  1738 raft_consensus.cc:359] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.768760  1738 raft_consensus.cc:385] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.769754  1737 ts_tablet_manager.cc:1434] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:59:38.770730  1737 tablet_bootstrap.cc:492] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:38.771641  1659 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:38.763238  1736 tablet_bootstrap.cc:492] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:38.769019  1738 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.772652  2048 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:38.778497  2048 raft_consensus.cc:697] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:38.778262  1738 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.779299  2048 consensus_queue.cc:237] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.780530  1738 ts_tablet_manager.cc:1434] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:59:38.777967  1736 ts_tablet_manager.cc:1403] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.001s
I20260709 12:59:38.782097  1738 tablet_bootstrap.cc:492] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:38.788700  1736 raft_consensus.cc:359] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.789471  1736 raft_consensus.cc:385] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.789758  1736 raft_consensus.cc:740] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.795077  1738 tablet_bootstrap.cc:654] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.797190  1736 consensus_queue.cc:260] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.798034  1737 tablet_bootstrap.cc:654] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.800968  1736 ts_tablet_manager.cc:1434] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:59:38.800329  1441 catalog_manager.cc:5697] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:38.802891  1736 tablet_bootstrap.cc:492] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:38.804168  2052 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.804636  2052 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.807060  2052 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:38.810094  1736 tablet_bootstrap.cc:654] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.810400  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:38.826902  2041 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.827476  2041 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.829928  2041 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:38.831779  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:38.834867  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 12:59:38.835152  1660 leader_election.cc:343] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:38.836951  1616 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:38.839407  1587 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:38.860736  2000 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.862655  2000 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.866300  2000 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:38.870579  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:38.873386  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:38.878688  1736 tablet_bootstrap.cc:492] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:38.879145  1736 ts_tablet_manager.cc:1403] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.076s	user 0.022s	sys 0.039s
I20260709 12:59:38.879535  1738 tablet_bootstrap.cc:492] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:38.880129  1738 ts_tablet_manager.cc:1403] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.099s	user 0.015s	sys 0.002s
W20260709 12:59:38.877765  1511 leader_election.cc:343] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:38.881356  1659 leader_election.cc:343] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:38.881525  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:38.881780  1659 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:38.882200  1736 raft_consensus.cc:359] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.882835  1736 raft_consensus.cc:385] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.883137  1736 raft_consensus.cc:740] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.882845  1923 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:59:38.884526  1512 leader_election.cc:343] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:38.884939  1512 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:38.885113  1736 consensus_queue.cc:260] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.889221  1738 raft_consensus.cc:359] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.891721  1736 ts_tablet_manager.cc:1434] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:59:38.892519  1737 tablet_bootstrap.cc:492] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:38.893074  1737 ts_tablet_manager.cc:1403] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.123s	user 0.021s	sys 0.012s
I20260709 12:59:38.893105  1736 tablet_bootstrap.cc:492] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:38.896595  1737 raft_consensus.cc:359] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.897336  1617 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:59:38.889933  1738 raft_consensus.cc:385] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.898283  1738 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.899012  1738 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.899597  1936 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:38.900398  1736 tablet_bootstrap.cc:654] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.904038  1998 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:38.909080  1738 ts_tablet_manager.cc:1434] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:59:38.910282  1738 tablet_bootstrap.cc:492] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:38.910633  1736 tablet_bootstrap.cc:492] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:38.911090  1736 ts_tablet_manager.cc:1403] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:59:38.897302  1737 raft_consensus.cc:385] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.914846  1737 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.915184  1736 raft_consensus.cc:359] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.916031  1736 raft_consensus.cc:385] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:38.916358  1736 raft_consensus.cc:740] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:38.916555  1737 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.917562  2048 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.919690  2048 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.921823  1737 ts_tablet_manager.cc:1434] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:59:38.922621  2048 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:38.924235  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:38.926923  1618 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:38.928717  1660 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:38.917120  1736 consensus_queue.cc:260] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.931025  1736 ts_tablet_manager.cc:1434] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.004s
I20260709 12:59:38.931409  2048 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:38.931866  2048 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.932251  2048 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:38.934279  2000 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.934751  2000 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.936685  2000 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:38.937651  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:38.939066  1511 leader_election.cc:343] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:38.941957  1737 tablet_bootstrap.cc:492] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:38.943353  1954 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:38.946811  2000 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.947324  2000 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:38.949265  1737 tablet_bootstrap.cc:654] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:38.951478  1954 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.951016  1692 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:59:38.951937  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:38.952044  1954 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:38.953214  1511 leader_election.cc:343] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:38.954890  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:38.956848  2000 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:39.010257  2000 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.011052  2000 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.014715  2000 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 12:59:39.017187  1512 leader_election.cc:343] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:39.017678  1512 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:39.018823  1998 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:39.019905  2048 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.022333  2048 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:39.023216  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:39.023977  1540 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:39.026049  1954 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:39.014755  1736 tablet_bootstrap.cc:492] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:39.035219  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:39.036427  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 76998.1us
I20260709 12:59:39.041275  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:39.042187  1618 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:39.042948  1511 leader_election.cc:343] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:39.047741  1737 tablet_bootstrap.cc:492] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:39.048645  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:39.049309  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:39.050035  1737 ts_tablet_manager.cc:1403] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.107s	user 0.040s	sys 0.033s
I20260709 12:59:39.054143  2000 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:39.057482  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:39.058243  1692 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:39.058259  1737 raft_consensus.cc:359] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.059523  1737 raft_consensus.cc:385] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:39.059861  1737 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:39.062026  1738 tablet_bootstrap.cc:654] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:39.062311  1736 tablet_bootstrap.cc:654] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:39.072327  1512 leader_election.cc:343] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:39.062806  2090 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:39.065383  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:39.077448  1736 tablet_bootstrap.cc:492] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:39.078070  1736 ts_tablet_manager.cc:1403] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.064s	user 0.005s	sys 0.008s
I20260709 12:59:39.074805  1618 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:39.062045  1737 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.084939  1660 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:39.085760  1736 raft_consensus.cc:359] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.086194  2090 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:39.086464  1736 raft_consensus.cc:385] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:39.086777  1736 raft_consensus.cc:740] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:39.086997  2090 raft_consensus.cc:697] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:39.087492  1736 consensus_queue.cc:260] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.089592  1736 ts_tablet_manager.cc:1434] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:59:39.093642  1736 tablet_bootstrap.cc:492] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:39.094725  1923 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.094971  1737 ts_tablet_manager.cc:1434] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 12:59:39.095197  1923 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.096287  1737 tablet_bootstrap.cc:492] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:39.097256  1923 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:39.101432  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:39.089149  2090 consensus_queue.cc:237] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.105350  1512 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:39.110185  2000 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:39.111382  1512 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 12:59:39.106187  1660 leader_election.cc:343] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:39.116428  1738 tablet_bootstrap.cc:492] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:39.119629  1738 ts_tablet_manager.cc:1403] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.210s	user 0.008s	sys 0.005s
I20260709 12:59:39.126519  2048 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.126997  1736 tablet_bootstrap.cc:654] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:39.126655  2000 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:39.127270  2048 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.128161  2000 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.128693  2000 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:39.130793  2048 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:39.136976  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:39.138135  1738 raft_consensus.cc:359] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.151467  1738 raft_consensus.cc:385] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:39.152040  1738 raft_consensus.cc:740] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:39.141230  1954 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.153236  1954 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.153599  1738 consensus_queue.cc:260] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.141764  1737 tablet_bootstrap.cc:654] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:39.155717  1954 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:39.157060  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 12:59:39.158382  1587 leader_election.cc:343] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:39.150874  1660 leader_election.cc:343] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:39.152508  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:39.136169  2000 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.159152  1540 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:39.161269  2000 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:39.166191  1540 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:39.170814  1738 ts_tablet_manager.cc:1434] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.003s
I20260709 12:59:39.145630  1736 tablet_bootstrap.cc:492] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:39.178256  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:39.179113  1617 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:39.185150  1738 tablet_bootstrap.cc:492] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:39.188010  1617 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:39.193503  1736 ts_tablet_manager.cc:1403] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.100s	user 0.009s	sys 0.002s
I20260709 12:59:39.193879  1737 tablet_bootstrap.cc:492] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:39.199828  1737 ts_tablet_manager.cc:1403] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.007s
I20260709 12:59:39.195502  1511 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:39.203018  2000 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:39.270583  1585 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:39.259192  2000 raft_consensus.cc:697] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:39.271649  1736 raft_consensus.cc:359] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.272943  1736 raft_consensus.cc:385] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:39.273716  1736 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:39.273356  1971 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:39.274439  1737 raft_consensus.cc:359] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.277101  1737 raft_consensus.cc:385] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:39.277423  1737 raft_consensus.cc:740] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:39.277786  1845 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.278254  1845 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.279791  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:39.279146  1737 consensus_queue.cc:260] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.286173  1738 tablet_bootstrap.cc:654] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:39.287411  2000 consensus_queue.cc:237] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.293366  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:39.293929  1696 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:39.301297  1736 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.304203  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:39.308673  1736 ts_tablet_manager.cc:1434] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.111s	user 0.007s	sys 0.001s
W20260709 12:59:39.309707  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:39.311286  1845 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:39.310981  1736 tablet_bootstrap.cc:492] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:39.317652  1696 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:39.323508  1547 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:39.328598  1615 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:39.328923  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:39.324889  1954 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.340837  1737 ts_tablet_manager.cc:1434] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.141s	user 0.008s	sys 0.018s
W20260709 12:59:39.341053  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 50494.1us
I20260709 12:59:39.339350  1954 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.336380  1618 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
W20260709 12:59:39.346803  1659 leader_election.cc:343] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:39.347931  1659 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:39.348886  1737 tablet_bootstrap.cc:492] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:39.349635  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:39.349845  1585 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 12:59:39.353020  1971 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:39.356208  1971 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.356555  1971 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:39.357282  1736 tablet_bootstrap.cc:654] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:39.358386  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:39.351529  1616 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:39.380657  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 43507.2us
I20260709 12:59:39.362983  2048 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:39.392180  1845 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:39.392642  1845 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.393108  1845 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:39.396358  1660 consensus_peers.cc:597] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:39.362980  2089 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:59:39.390040  1923 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:59:39.419159  1845 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.439541  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 12:59:39.438373  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 46058.4us
W20260709 12:59:39.440723  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 48578.9us
W20260709 12:59:39.449740  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 95188.4us
I20260709 12:59:39.452107  1845 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 12:59:39.450708  1512 leader_election.cc:343] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:39.437439  1954 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:39.468426  1738 tablet_bootstrap.cc:492] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:39.469357  1738 ts_tablet_manager.cc:1403] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.284s	user 0.016s	sys 0.008s
I20260709 12:59:39.469826  1737 tablet_bootstrap.cc:654] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:39.424372  1971 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:39.470471  2105 log.cc:927] Time spent T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:59:39.481675  1736 tablet_bootstrap.cc:492] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:39.482183  1736 ts_tablet_manager.cc:1403] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.172s	user 0.010s	sys 0.019s
I20260709 12:59:39.489733  1971 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 12:59:39.491822  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 77966.3us
I20260709 12:59:39.491269  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:39.493289  1546 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:39.477394  2102 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.495711  2102 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.498189  1659 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:39.498651  2102 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:39.499421  2106 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:39.499979  2106 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.500439  2106 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:39.490881  1738 raft_consensus.cc:359] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.507130  1736 raft_consensus.cc:359] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.509761  1736 raft_consensus.cc:385] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:39.510151  1736 raft_consensus.cc:740] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:39.504261  1738 raft_consensus.cc:385] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:39.518388  1738 raft_consensus.cc:740] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:39.520097  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:39.520714  1738 consensus_queue.cc:260] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.521348  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:39.528724  1512 leader_election.cc:343] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:39.529549  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 70106.4us
I20260709 12:59:39.507685  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:39.532927  1738 ts_tablet_manager.cc:1434] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.002s
I20260709 12:59:39.513765  2102 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:59:39.517071  2089 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.556104  1736 consensus_queue.cc:260] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.585597  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 12:59:39.560508  1660 leader_election.cc:343] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:39.605167  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 44737.4us
I20260709 12:59:39.609117  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:39.612237  1622 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 1: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 12:59:39.627847  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:39.631554  1736 ts_tablet_manager.cc:1434] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.149s	user 0.008s	sys 0.001s
I20260709 12:59:39.635293  1738 tablet_bootstrap.cc:492] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:39.634213  1879 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:39.618379  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:39.641644  1585 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 12:59:39.703281  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 61711.6us
I20260709 12:59:39.560087  1543 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:39.606180  2089 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.706841  1971 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:39.747440  1545 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 12:59:39.776526  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 63135.2us
I20260709 12:59:39.789466  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:39.787556  2089 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:39.801512  1738 tablet_bootstrap.cc:654] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:39.831866  1441 catalog_manager.cc:5697] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:39.847157  1736 tablet_bootstrap.cc:492] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
W20260709 12:59:39.851056  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 63885.3us
I20260709 12:59:39.850045  2106 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.859822  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 12:59:39.861301  1587 leader_election.cc:343] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:39.866492  1659 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:39.876408  1737 tablet_bootstrap.cc:492] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:39.876945  1737 ts_tablet_manager.cc:1403] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.529s	user 0.015s	sys 0.018s
I20260709 12:59:39.878772  2106 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:39.880036  1736 tablet_bootstrap.cc:654] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:39.882467  1924 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:39.882931  1924 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.883584  1924 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:39.900801  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:39.904222  1924 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.906499  2102 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:39.897905  1444 catalog_manager.cc:5697] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:39.911202  1660 leader_election.cc:343] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:39.920539  2111 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.924317  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:39.925122  1538 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:39.921039  2111 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.929634  2111 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:39.931463  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 12:59:39.933513  1587 leader_election.cc:343] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:39.930138  1924 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:39.936491  2110 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:59:39.938239  2098 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:39.940191  1737 raft_consensus.cc:359] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:39.941093  1737 raft_consensus.cc:385] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:39.941459  1737 raft_consensus.cc:740] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:39.943984  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:39.949391  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:39.962150  1538 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:39.963644  1585 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:39.969856  1936 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:39.971258  2111 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:39.972316  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:39.973006  1539 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:39.952637  1544 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:39.946259  2117 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:59:39.988085  1585 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 12:59:39.993904  1971 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:39.994324  1971 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.994683  1971 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:39.954553  1737 consensus_queue.cc:260] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:40.029762  1660 leader_election.cc:343] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:40.033646  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 58388.4us
W20260709 12:59:40.036116  1659 leader_election.cc:343] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:40.036684  1659 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:40.042292  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:40.033629  2110 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.057458  1737 ts_tablet_manager.cc:1434] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.180s	user 0.012s	sys 0.003s
I20260709 12:59:40.064154  1736 tablet_bootstrap.cc:492] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:40.064803  1736 ts_tablet_manager.cc:1403] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.221s	user 0.013s	sys 0.016s
I20260709 12:59:40.052580  2099 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:40.052865  2110 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.074386  2110 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:40.076815  1737 tablet_bootstrap.cc:492] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
W20260709 12:59:40.089311  1660 leader_election.cc:343] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:40.107662  1544 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
W20260709 12:59:40.139686  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 46028.4us
I20260709 12:59:40.141116  1659 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:40.155033  1736 raft_consensus.cc:359] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.156307  1736 raft_consensus.cc:385] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.156453  1738 tablet_bootstrap.cc:492] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:40.156621  1736 raft_consensus.cc:740] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.156962  1738 ts_tablet_manager.cc:1403] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.524s	user 0.032s	sys 0.016s
I20260709 12:59:40.158380  1736 consensus_queue.cc:260] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.159511  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:40.164458  1511 leader_election.cc:343] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:40.168679  2006 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:40.180931  1736 ts_tablet_manager.cc:1434] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.116s	user 0.008s	sys 0.000s
I20260709 12:59:40.182214  1736 tablet_bootstrap.cc:492] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:40.206087  2006 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:40.213644  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:40.214365  2006 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.185442  1971 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.218411  1971 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:40.247591  2108 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.248225  2108 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.263666  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:40.269085  2108 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:40.349207  1737 tablet_bootstrap.cc:654] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:40.351821  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 147598us
W20260709 12:59:40.355075  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 146831us
I20260709 12:59:40.355742  1659 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:40.355899  1738 raft_consensus.cc:359] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.356726  1738 raft_consensus.cc:385] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.357050  2132 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:40.358002  2132 raft_consensus.cc:697] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:40.363735  2118 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.358798  2132 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.357048  1738 raft_consensus.cc:740] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.364490  2118 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:40.365649  1511 leader_election.cc:343] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:40.365852  1738 consensus_queue.cc:260] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.369694  1738 ts_tablet_manager.cc:1434] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.212s	user 0.008s	sys 0.012s
I20260709 12:59:40.371500  2118 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:40.373795  1736 tablet_bootstrap.cc:654] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.378791  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:40.379640  1696 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:40.392700  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:40.393478  1621 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 1: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 12:59:40.420670  1512 leader_election.cc:343] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:40.423090  1512 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:40.425742  1738 tablet_bootstrap.cc:492] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
W20260709 12:59:40.426299  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:59:40.426973  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 57472.6us
I20260709 12:59:40.426821  1444 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42132 (request call id 75) took 1114 ms. Trace:
I20260709 12:59:40.428961  1512 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:40.433758  2100 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:40.418946  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:40.437834  1691 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:40.438185  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:40.442844  1737 tablet_bootstrap.cc:492] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:40.442966  2101 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:40.443370  1737 ts_tablet_manager.cc:1403] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.368s	user 0.021s	sys 0.022s
I20260709 12:59:40.443446  2101 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.443861  2101 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:40.449497  1541 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:40.461535  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:40.466506  1737 raft_consensus.cc:359] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.467041  1737 raft_consensus.cc:385] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.467355  1737 raft_consensus.cc:740] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
W20260709 12:59:40.472864  2140 log.cc:927] Time spent T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.083s	user 0.002s	sys 0.000s
I20260709 12:59:40.477442  1737 consensus_queue.cc:260] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.490427  1736 tablet_bootstrap.cc:492] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:40.491012  1736 ts_tablet_manager.cc:1403] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.309s	user 0.024s	sys 0.002s
I20260709 12:59:40.491263  1737 ts_tablet_manager.cc:1434] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.048s	user 0.002s	sys 0.004s
I20260709 12:59:40.492190  1737 tablet_bootstrap.cc:492] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:40.493481  1736 raft_consensus.cc:359] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.494156  1736 raft_consensus.cc:385] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.494405  1736 raft_consensus.cc:740] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.495100  1736 consensus_queue.cc:260] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.429900  1444 rpcz_store.cc:276] 0709 12:59:39.311489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.311634 (+   145us) service_pool.cc:224] Handling call
0709 12:59:40.425553 (+1113919us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:40.042439 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:40.076741 (+ 34302us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:40.076775 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:59:40.076794 (+    19us) tablet.cc:662] Decoding operations
0709 12:59:40.077171 (+   377us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:40.077245 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:40.077300 (+    55us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:40.077511 (+   211us) tablet.cc:701] Row locks acquired
0709 12:59:40.077531 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:59:40.077670 (+   139us) write_op.cc:270] Start()
0709 12:59:40.077814 (+   144us) write_op.cc:276] Timestamp: P: 1783601980077628 usec, L: 0
0709 12:59:40.077836 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:59:40.078469 (+   633us) log.cc:844] Serialized 540 byte log entry
0709 12:59:40.235430 (+156961us) op_driver.cc:464] REPLICATION: finished
0709 12:59:40.352116 (+116686us) write_op.cc:301] APPLY: starting
0709 12:59:40.352205 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:40.352311 (+   106us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:40.352477 (+   166us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:40.352711 (+   234us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:40.352880 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:40.352920 (+    40us) write_op.cc:312] APPLY: finished
0709 12:59:40.353170 (+   250us) log.cc:844] Serialized 22 byte log entry
0709 12:59:40.354127 (+   957us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:40.366851 (+ 12724us) write_op.cc:454] Released schema lock
0709 12:59:40.370143 (+  3292us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:40.373233 (+  3090us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:40.373260 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6903,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":76337,"apply.run_cpu_time_us":1795,"apply.run_wall_time_us":21114,"num_ops":1,"prepare.queue_time_us":121704,"prepare.run_cpu_time_us":2980,"prepare.run_wall_time_us":38851,"replication_time_us":147311,"thread_start_us":41624,"threads_started":1}]]}
I20260709 12:59:40.501454  1659 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 12:59:40.548126  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 45887.5us
W20260709 12:59:40.551151  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 49781.8us
I20260709 12:59:40.554888  1737 tablet_bootstrap.cc:654] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.560986  1541 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 12:59:40.562448  1585 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:40.563315  2052 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:40.563874  2052 raft_consensus.cc:697] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 12:59:40.564754  2052 consensus_queue.cc:237] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.574543  1691 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 12:59:40.575430  2103 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:40.576436  1736 ts_tablet_manager.cc:1434] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.085s	user 0.005s	sys 0.000s
I20260709 12:59:40.551620  2101 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.577472  1736 tablet_bootstrap.cc:492] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:40.586843  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:40.587390  2101 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 12:59:40.588403  1511 leader_election.cc:343] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:40.563158  1738 tablet_bootstrap.cc:654] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.589445  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:40.592728  1693 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:40.603811  1693 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:40.608783  1737 tablet_bootstrap.cc:492] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:40.609508  1737 ts_tablet_manager.cc:1403] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.117s	user 0.015s	sys 0.000s
I20260709 12:59:40.609688  1736 tablet_bootstrap.cc:654] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.611963  1512 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:40.620252  2101 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:40.620802  2101 raft_consensus.cc:697] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:40.612221  1442 catalog_manager.cc:5697] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:40.613981  1737 raft_consensus.cc:359] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.623277  1737 raft_consensus.cc:385] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.623567  1737 raft_consensus.cc:740] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.624300  1737 consensus_queue.cc:260] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.615150  1738 tablet_bootstrap.cc:492] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:40.626084  1738 ts_tablet_manager.cc:1403] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.201s	user 0.023s	sys 0.003s
I20260709 12:59:40.628368  1737 ts_tablet_manager.cc:1434] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:59:40.629264  1737 tablet_bootstrap.cc:492] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:40.629711  1738 raft_consensus.cc:359] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.631579  1738 raft_consensus.cc:385] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.621636  2101 consensus_queue.cc:237] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.634622  1736 tablet_bootstrap.cc:492] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:40.635079  1736 ts_tablet_manager.cc:1403] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.007s
I20260709 12:59:40.638466  1736 raft_consensus.cc:359] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.639127  1736 raft_consensus.cc:385] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.639412  1736 raft_consensus.cc:740] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.640204  1737 tablet_bootstrap.cc:654] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.632216  1738 raft_consensus.cc:740] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.640074  1736 consensus_queue.cc:260] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.642442  1736 ts_tablet_manager.cc:1434] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:40.641459  1738 consensus_queue.cc:260] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.645752  1738 ts_tablet_manager.cc:1434] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:59:40.643885  1736 tablet_bootstrap.cc:492] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291: Bootstrap starting.
I20260709 12:59:40.652244  1738 tablet_bootstrap.cc:492] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:40.651661  1441 catalog_manager.cc:5697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:40.655037  1441 catalog_manager.cc:5697] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:40.661820  2103 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.662355  2103 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.664263  1736 tablet_bootstrap.cc:654] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.664454  2103 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:40.667100  1738 tablet_bootstrap.cc:654] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.668287  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:40.668880  1541 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:40.670490  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:40.671634  1660 leader_election.cc:343] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:40.672112  1659 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:40.672894  2089 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:40.673257  2089 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.673584  2089 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:40.681433  2089 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.681874  1737 tablet_bootstrap.cc:492] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:40.683416  1737 ts_tablet_manager.cc:1403] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.014s
I20260709 12:59:40.684743  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:40.685926  1737 raft_consensus.cc:359] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.687134  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:40.688001  1737 raft_consensus.cc:385] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.688207  1541 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:40.688309  1737 raft_consensus.cc:740] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.688519  2089 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:40.688997  1737 consensus_queue.cc:260] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.690516  1737 ts_tablet_manager.cc:1434] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:59:40.691480  1737 tablet_bootstrap.cc:492] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:40.695327  1541 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:40.695818  1736 tablet_bootstrap.cc:492] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291: No bootstrap required, opened a new log
I20260709 12:59:40.696247  1736 ts_tablet_manager.cc:1403] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.002s
I20260709 12:59:40.686599  1442 catalog_manager.cc:5697] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:40.686328  1660 leader_election.cc:343] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:40.697009  1659 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:40.699791  2089 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:40.700284  2089 raft_consensus.cc:697] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:40.701181  2089 consensus_queue.cc:237] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.702770  1738 tablet_bootstrap.cc:492] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:40.703330  1738 ts_tablet_manager.cc:1403] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.008s
I20260709 12:59:40.706382  1737 tablet_bootstrap.cc:654] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.706818  1738 raft_consensus.cc:359] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.707967  1738 raft_consensus.cc:385] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.708238  1738 raft_consensus.cc:740] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.698803  1736 raft_consensus.cc:359] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.708454  2101 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.708947  1736 raft_consensus.cc:385] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.708881  1738 consensus_queue.cc:260] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.709079  2101 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.712119  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:40.713464  2101 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:40.714859  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 12:59:40.713585  1511 leader_election.cc:343] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:40.716277  1512 leader_election.cc:343] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:40.716643  1512 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:40.709513  1736 raft_consensus.cc:740] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.717541  2101 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:40.710829  1738 ts_tablet_manager.cc:1434] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:59:40.718951  1738 tablet_bootstrap.cc:492] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:40.721165  1736 consensus_queue.cc:260] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.724406  1736 ts_tablet_manager.cc:1434] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:59:40.727185  1738 tablet_bootstrap.cc:654] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.744141  1737 tablet_bootstrap.cc:492] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:40.744590  1737 ts_tablet_manager.cc:1403] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.004s
I20260709 12:59:40.743971  1442 catalog_manager.cc:5697] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:40.751377  1738 tablet_bootstrap.cc:492] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:40.751919  1738 ts_tablet_manager.cc:1403] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.004s
I20260709 12:59:40.747980  1737 raft_consensus.cc:359] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.752960  1737 raft_consensus.cc:385] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.753218  1737 raft_consensus.cc:740] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.753798  1737 consensus_queue.cc:260] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.754582  2143 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.755072  2143 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.755990  1737 ts_tablet_manager.cc:1434] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:59:40.757872  2143 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:40.758885  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:40.759684  1614 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 1: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 12:59:40.763055  1738 raft_consensus.cc:359] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.763741  1738 raft_consensus.cc:385] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.763985  1738 raft_consensus.cc:740] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.764588  1738 consensus_queue.cc:260] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.765137  1737 tablet_bootstrap.cc:492] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:40.768751  2052 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.768831  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:40.769670  1540 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 1: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 12:59:40.769299  2052 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.770336  1738 ts_tablet_manager.cc:1434] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:59:40.771515  1738 tablet_bootstrap.cc:492] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:40.772851  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:40.773429  1693 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:40.773975  1659 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:40.774484  1587 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:40.775163  2143 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:40.778806  1737 tablet_bootstrap.cc:654] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.775276  1954 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:40.779639  1954 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.780049  1954 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:40.782440  2052 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:40.783140  1738 tablet_bootstrap.cc:654] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.785709  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:40.786948  1541 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:40.790587  1954 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.792629  1954 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:40.793870  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:40.795219  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:40.795686  1540 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:40.797287  1690 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:40.798440  2099 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:40.798218  2143 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:40.804893  2052 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.805539  2052 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.809114  2052 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:40.809517  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:40.810134  1539 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:40.816115  1690 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 12:59:40.818873  1587 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:40.821378  1540 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
W20260709 12:59:40.821967  1660 consensus_peers.cc:597] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:40.822500  2052 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:40.824596  2052 raft_consensus.cc:697] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 12:59:40.825279  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:40.825855  1693 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 0.
I20260709 12:59:40.826762  1587 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:40.827448  1954 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:40.827785  1954 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.828088  1954 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:40.828022  2052 consensus_queue.cc:237] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.836519  1954 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.836977  1737 tablet_bootstrap.cc:492] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:40.837456  1737 ts_tablet_manager.cc:1403] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.001s
I20260709 12:59:40.840060  1737 raft_consensus.cc:359] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.840714  1737 raft_consensus.cc:385] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.840977  1737 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.842926  1954 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:40.843114  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:40.844056  1693 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:40.851776  1737 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.854962  1737 ts_tablet_manager.cc:1434] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:59:40.855592  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:40.857731  1542 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:40.863193  1693 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 12:59:40.864542  1587 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:40.855949  1737 tablet_bootstrap.cc:492] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: Bootstrap starting.
I20260709 12:59:40.866376  1738 tablet_bootstrap.cc:492] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:40.866803  1738 ts_tablet_manager.cc:1403] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.095s	user 0.007s	sys 0.013s
I20260709 12:59:40.867482  2052 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:40.868076  2052 raft_consensus.cc:697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 12:59:40.869184  2052 consensus_queue.cc:237] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.876261  1738 raft_consensus.cc:359] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.875732  1442 catalog_manager.cc:5697] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:40.876950  1738 raft_consensus.cc:385] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.877274  1738 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.878664  1737 tablet_bootstrap.cc:654] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.879041  1738 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.882714  1542 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 12:59:40.882968  1738 ts_tablet_manager.cc:1434] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:59:40.886337  1738 tablet_bootstrap.cc:492] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:40.893733  1738 tablet_bootstrap.cc:654] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:40.901866  1660 consensus_peers.cc:597] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:40.904275  1443 catalog_manager.cc:5697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:40.967432  2052 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:40.974709  2052 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.975478  2052 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.988247  2043 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.991457  2043 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:40.992204  1936 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.993305  2052 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:40.994611  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:40.996487  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:40.997819  2043 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:40.998803  2043 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:41.000108  1587 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:40.992981  1936 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.010028  1954 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:41.008096  2052 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.020078  1954 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:41.027604  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:41.028569  1936 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:41.018262  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:41.029578  1542 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:41.031406  1659 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:41.018639  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:41.034049  1737 tablet_bootstrap.cc:492] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: No bootstrap required, opened a new log
I20260709 12:59:41.036228  1737 ts_tablet_manager.cc:1403] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: Time spent bootstrapping tablet: real 0.180s	user 0.046s	sys 0.045s
I20260709 12:59:41.039480  1738 tablet_bootstrap.cc:492] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:41.039932  1738 ts_tablet_manager.cc:1403] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.154s	user 0.048s	sys 0.055s
I20260709 12:59:41.032811  2052 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 12:59:41.040416  1511 leader_election.cc:343] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.034853  2143 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:59:41.046283  1660 leader_election.cc:343] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.042898  2143 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.046922  2143 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.045315  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:41.061470  1737 raft_consensus.cc:359] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.064615  1737 raft_consensus.cc:385] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.064991  1737 raft_consensus.cc:740] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.068488  2052 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:41.070268  1737 consensus_queue.cc:260] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.071339  1738 raft_consensus.cc:359] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.072144  1738 raft_consensus.cc:385] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.072515  1738 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.073568  1737 ts_tablet_manager.cc:1434] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 12:59:41.073664  1738 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.075721  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:41.076072  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:41.081638  2143 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.082773  1690 raft_consensus.cc:2393] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 1: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 12:59:41.086681  1512 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:41.087869  1998 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.089701  2143 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:41.092244  1738 ts_tablet_manager.cc:1434] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 12:59:41.097627  1738 tablet_bootstrap.cc:492] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:41.097800  1998 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:41.101815  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:41.104262  1738 tablet_bootstrap.cc:654] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:41.104331  1660 leader_election.cc:343] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.105427  1936 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.105897  1936 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.108014  1936 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:41.109668  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:41.117720  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:41.106124  1587 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:41.128805  1954 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:41.117589  1542 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:41.120446  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 12:59:41.130251  1511 leader_election.cc:343] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.130326  1693 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 0.
I20260709 12:59:41.140955  1512 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:41.143297  1936 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:41.143781  1936 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.144300  1936 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.140671  1659 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:41.150804  2099 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:41.152746  2099 raft_consensus.cc:697] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:41.153702  2099 consensus_queue.cc:237] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.163666  1738 tablet_bootstrap.cc:492] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:41.164175  1738 ts_tablet_manager.cc:1403] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.067s	user 0.032s	sys 0.027s
I20260709 12:59:41.166567  1738 raft_consensus.cc:359] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.167176  1738 raft_consensus.cc:385] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.167435  1738 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.168128  1738 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.169822  1738 ts_tablet_manager.cc:1434] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:59:41.170687  1738 tablet_bootstrap.cc:492] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:41.176225  1738 tablet_bootstrap.cc:654] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.172168  1936 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.190945  1936 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:41.197172  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:41.197824  1738 tablet_bootstrap.cc:492] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:41.197825  1613 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.198503  1738 ts_tablet_manager.cc:1403] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.004s
I20260709 12:59:41.199596  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:41.200109  1693 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.201565  1738 raft_consensus.cc:359] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.202284  1738 raft_consensus.cc:385] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.202521  1738 raft_consensus.cc:740] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.203209  1738 consensus_queue.cc:260] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.206876  1442 catalog_manager.cc:5697] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:41.208313  2170 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.208822  2170 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.210820  2170 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:41.212678  1738 ts_tablet_manager.cc:1434] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 12:59:41.213609  1738 tablet_bootstrap.cc:492] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:41.213728  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:41.214488  1691 raft_consensus.cc:2393] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 12:59:41.215540  1614 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.217265  1617 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.217495  2143 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:41.220067  1738 tablet_bootstrap.cc:654] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.221446  1693 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:41.222625  1613 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:41.226254  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:41.227433  2101 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:41.227903  2101 raft_consensus.cc:697] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:41.228775  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:41.231937  1998 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:41.228818  2101 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.239492  1585 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:41.241525  1998 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:41.244510  2052 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:41.291947  1620 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.309723  1616 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.333134  1617 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.330281  1443 catalog_manager.cc:5697] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:41.364821  2170 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.365489  2170 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.379424  2132 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:41.380376  2184 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:41.387539  1738 tablet_bootstrap.cc:492] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:41.388007  1738 ts_tablet_manager.cc:1403] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.175s	user 0.059s	sys 0.078s
I20260709 12:59:41.388510  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:41.402628  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:41.382122  2170 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:41.406814  2170 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:41.408432  1585 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:41.419833  2052 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:41.426407  1954 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 12:59:41.426880  1954 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.434094  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:41.434401  1738 raft_consensus.cc:359] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.435743  1738 raft_consensus.cc:385] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.436012  1738 raft_consensus.cc:740] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.436614  1738 consensus_queue.cc:260] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.438273  1738 ts_tablet_manager.cc:1434] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 12:59:41.439152  1738 tablet_bootstrap.cc:492] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Bootstrap starting.
I20260709 12:59:41.441771  1954 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:41.443406  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:41.457023  1587 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:41.456494  1954 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:59:41.463464  2185 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:41.477872  2089 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.478495  2089 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.480448  2089 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:41.480861  1738 tablet_bootstrap.cc:654] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.484534  2170 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:41.486129  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:41.486800  1539 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 0.
I20260709 12:59:41.487926  1659 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 12:59:41.488767  2132 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:41.489259  2132 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.489765  2132 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.482266  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 12:59:41.497893  1660 leader_election.cc:343] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:41.513720  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:41.533867  2132 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.537176  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 12:59:41.537860  1543 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.536801  2132 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:41.538772  1738 tablet_bootstrap.cc:492] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: No bootstrap required, opened a new log
I20260709 12:59:41.539263  1738 ts_tablet_manager.cc:1403] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent bootstrapping tablet: real 0.100s	user 0.014s	sys 0.015s
I20260709 12:59:41.541419  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 12:59:41.543306  1660 leader_election.cc:343] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.546226  1543 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 12:59:41.545996  1738 raft_consensus.cc:359] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.547278  1659 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 12:59:41.547775  1738 raft_consensus.cc:385] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.548136  1738 raft_consensus.cc:740] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.548316  2089 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:41.548870  2089 raft_consensus.cc:697] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 12:59:41.548960  1738 consensus_queue.cc:260] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.549728  2089 consensus_queue.cc:237] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.551905  1738 ts_tablet_manager.cc:1434] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:59:41.561812  1614 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.565307  1936 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.565809  1936 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.567740  1936 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:41.568974  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 12:59:41.569602  1617 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:41.570694  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:41.571730  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:41.572252  1936 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:41.572363  1691 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 12:59:41.572686  1936 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.573083  1936 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:41.577000  2132 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:41.580876  1936 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.583459  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 12:59:41.583952  1617 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:41.583880  1442 catalog_manager.cc:5697] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:41.589932  1617 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 12:59:41.590919  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 12:59:41.591629  1998 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:41.592136  1998 raft_consensus.cc:697] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 12:59:41.592953  1998 consensus_queue.cc:237] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.601651  2089 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:41.607595  1936 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:41.608510  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 12:59:41.609090  1691 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:41.621757  1691 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 12:59:41.623008  2000 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:41.627923  1442 catalog_manager.cc:5697] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 0 to 2, leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:41.636790  1998 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:41.714521   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:41.723176  2200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:41.723681  2201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:41.725682  2203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:41.747046   431 server_base.cc:1061] running on GCE node
I20260709 12:59:41.748409   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:41.748659   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:41.748894   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601981748863 us; error 0 us; skew 500 ppm
I20260709 12:59:41.749446   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:41.754060   431 webserver.cc:533] Webserver started at http://127.0.107.196:41567/ using document root <none> and password file <none>
I20260709 12:59:41.754658   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:41.754918   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:41.755761   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:41.757372   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-3-root/instance:
uuid: "e8a64798e5f94de8909707bcbd11804a"
format_stamp: "Formatted at 2026-07-09 12:59:41 on dist-test-slave-zhw8"
I20260709 12:59:41.762122   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.005s
I20260709 12:59:41.765616  2208 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:41.766644   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:59:41.766971   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-3-root
uuid: "e8a64798e5f94de8909707bcbd11804a"
format_stamp: "Formatted at 2026-07-09 12:59:41 on dist-test-slave-zhw8"
I20260709 12:59:41.767310   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:41.793982  2183 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.794512  2183 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 12:59:41.796489  2183 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:41.798377  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 12:59:41.804921  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 12:59:41.805707  1543 raft_consensus.cc:2393] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 1: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 12:59:41.807723   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:41.808383  1585 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 12:59:41.810316   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:41.814249  2183 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.818354   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:41.822741  2183 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:41.824986   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:41.825402   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:41.826043   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:41.826609   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260709 12:59:41.926551   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:40413
I20260709 12:59:41.926680  2270 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:40413 every 8 connection(s)
I20260709 12:59:41.934520   431 auto_leader_rebalancer-test.cc:384] add a tserver: e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:41.949167  2271 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43923
I20260709 12:59:41.949671  2271 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:41.950580  2271 heartbeater.cc:507] Master 127.0.107.254:43923 requested a full tablet report, sending...
I20260709 12:59:41.952649  1441 ts_manager.cc:194] Registered new tserver with Master: e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 12:59:41.954282  1441 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58806
I20260709 12:59:41.985738  1619 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:59:41.987891  2000 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:41.998818  1691 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:59:42.001044  1998 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:42.118243  2089 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:42.128585  2089 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:42.591607  1543 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:42.599152  1690 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:42.600515  1879 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:42.611917  2279 raft_consensus.cc:2955] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:42.613382  1619 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:42.617764  1879 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:42.618062  1690 raft_consensus.cc:2955] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
W20260709 12:59:42.628979  1511 consensus_peers.cc:597] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4142f46c85974609aa207df00c3d031e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:42.634673  1619 raft_consensus.cc:2955] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:42.654690  1443 catalog_manager.cc:5697] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:42.662278  1690 consensus_queue.cc:237] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:42.671622  1543 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:42.674942  2089 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:42.681663  1619 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:42.683077  2089 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:42.687566  2098 raft_consensus.cc:2955] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
W20260709 12:59:42.690069  1660 consensus_peers.cc:597] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c97fa1eb9d6548d3852cfed83b346e69. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:42.693264  1543 raft_consensus.cc:2955] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:42.696091  1619 raft_consensus.cc:2955] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:42.725544  1442 catalog_manager.cc:5697] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:42.726922  1614 consensus_queue.cc:237] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:42.736646  1690 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:42.738938  2287 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:42.746096  1543 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:42.754037  2170 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:42.755611  1586 consensus_peers.cc:597] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e3bc16a73cd42baba8ebfcbf2a0e93b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:42.770947  2300 raft_consensus.cc:2955] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:42.777806  1691 raft_consensus.cc:2955] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:42.848124  1543 raft_consensus.cc:2955] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:42.857548  1614 consensus_queue.cc:237] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:42.865546  1443 catalog_manager.cc:5697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:42.886581  1691 raft_consensus.cc:1275] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:42.889497  1543 raft_consensus.cc:1275] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:42.890807  2287 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:59:42.892771  2170 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:42.893373  1586 consensus_peers.cc:597] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 158ebfb5c6324189947e23e5386968e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:42.899345  2287 raft_consensus.cc:2955] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:42.901360  1691 raft_consensus.cc:2955] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:42.917608  1547 raft_consensus.cc:2955] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:42.921180  1443 catalog_manager.cc:5697] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:42.957250  2271 heartbeater.cc:499] Master 127.0.107.254:43923 was elected leader, sending a full tablet report...
I20260709 12:59:42.991012  2311 ts_tablet_manager.cc:933] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 12:59:42.993647  2311 tablet_copy_client.cc:323] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:41871
I20260709 12:59:43.014008  1557 tablet_copy_service.cc:140] P d7158d6c3b634dc7abb69eac58eba291: Received BeginTabletCopySession request for tablet 4142f46c85974609aa207df00c3d031e from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:42858)
I20260709 12:59:43.014712  1557 tablet_copy_service.cc:161] P d7158d6c3b634dc7abb69eac58eba291: Beginning new tablet copy session on tablet 4142f46c85974609aa207df00c3d031e from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:42858: session id = e8a64798e5f94de8909707bcbd11804a-4142f46c85974609aa207df00c3d031e
I20260709 12:59:43.020637  1557 tablet_copy_source_session.cc:215] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:43.024582  2311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4142f46c85974609aa207df00c3d031e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.042279  2311 tablet_copy_client.cc:806] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:43.042990  2311 tablet_copy_client.cc:670] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:43.047676  2311 tablet_copy_client.cc:538] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:43.055286  2311 tablet_bootstrap.cc:492] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:43.074044  2311 tablet_bootstrap.cc:492] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:43.075026  2311 tablet_bootstrap.cc:492] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:43.075677  2311 ts_tablet_manager.cc:1403] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.021s	user 0.022s	sys 0.001s
I20260709 12:59:43.079035  2311 raft_consensus.cc:359] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:43.079890  2311 raft_consensus.cc:740] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:43.080524  2311 consensus_queue.cc:260] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:43.111711  2311 ts_tablet_manager.cc:1434] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.036s	user 0.011s	sys 0.021s
I20260709 12:59:43.126044  1557 tablet_copy_service.cc:342] P d7158d6c3b634dc7abb69eac58eba291: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-4142f46c85974609aa207df00c3d031e received from {username='slave'} at 127.0.0.1:42858
I20260709 12:59:43.126598  1557 tablet_copy_service.cc:434] P d7158d6c3b634dc7abb69eac58eba291: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-4142f46c85974609aa207df00c3d031e on tablet 4142f46c85974609aa207df00c3d031e with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:43.163749  2311 ts_tablet_manager.cc:933] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:43.165450  2311 tablet_copy_client.cc:323] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 12:59:43.174582  1706 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet c97fa1eb9d6548d3852cfed83b346e69 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 12:59:43.175101  1706 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet c97fa1eb9d6548d3852cfed83b346e69 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-c97fa1eb9d6548d3852cfed83b346e69
I20260709 12:59:43.181981  1706 tablet_copy_source_session.cc:215] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:43.184593  2311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97fa1eb9d6548d3852cfed83b346e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.197821  2311 tablet_copy_client.cc:806] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:43.198393  2311 tablet_copy_client.cc:670] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:43.204087  2311 tablet_copy_client.cc:538] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:43.212811  2311 tablet_bootstrap.cc:492] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:43.237334  2311 tablet_bootstrap.cc:492] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:43.238395  2311 tablet_bootstrap.cc:492] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:43.239137  2311 ts_tablet_manager.cc:1403] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.014s
I20260709 12:59:43.242424  2311 raft_consensus.cc:359] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:43.243575  2311 raft_consensus.cc:740] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:43.244387  2311 consensus_queue.cc:260] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:43.246615  2311 ts_tablet_manager.cc:1434] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:43.248673  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-c97fa1eb9d6548d3852cfed83b346e69 received from {username='slave'} at 127.0.0.1:50480
I20260709 12:59:43.249478  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-c97fa1eb9d6548d3852cfed83b346e69 on tablet c97fa1eb9d6548d3852cfed83b346e69 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:43.305338  2311 ts_tablet_manager.cc:933] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:43.307329  2311 tablet_copy_client.cc:323] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39981
I20260709 12:59:43.319077  1632 tablet_copy_service.cc:140] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Received BeginTabletCopySession request for tablet 6e3bc16a73cd42baba8ebfcbf2a0e93b from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50552)
I20260709 12:59:43.319725  1632 tablet_copy_service.cc:161] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Beginning new tablet copy session on tablet 6e3bc16a73cd42baba8ebfcbf2a0e93b from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50552: session id = e8a64798e5f94de8909707bcbd11804a-6e3bc16a73cd42baba8ebfcbf2a0e93b
I20260709 12:59:43.326469  2321 ts_tablet_manager.cc:933] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:43.326987  1632 tablet_copy_source_session.cc:215] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:43.329401  2321 tablet_copy_client.cc:323] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39981
I20260709 12:59:43.330727  2311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e3bc16a73cd42baba8ebfcbf2a0e93b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.331542  1632 tablet_copy_service.cc:140] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Received BeginTabletCopySession request for tablet 158ebfb5c6324189947e23e5386968e4 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50552)
I20260709 12:59:43.332131  1632 tablet_copy_service.cc:161] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Beginning new tablet copy session on tablet 158ebfb5c6324189947e23e5386968e4 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50552: session id = e8a64798e5f94de8909707bcbd11804a-158ebfb5c6324189947e23e5386968e4
I20260709 12:59:43.343384  1632 tablet_copy_source_session.cc:215] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:43.349138  2321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158ebfb5c6324189947e23e5386968e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.366446  2321 tablet_copy_client.cc:806] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:43.367020  2321 tablet_copy_client.cc:670] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:43.373014  2311 tablet_copy_client.cc:806] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:43.373579  2311 tablet_copy_client.cc:670] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:43.384898  2311 tablet_copy_client.cc:538] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:43.393468  2311 tablet_bootstrap.cc:492] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:43.460556  2321 tablet_copy_client.cc:538] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:43.470431  2321 tablet_bootstrap.cc:492] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:43.484127  2311 tablet_bootstrap.cc:492] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:43.484999  2311 tablet_bootstrap.cc:492] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:43.485603  2311 ts_tablet_manager.cc:1403] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.092s	user 0.025s	sys 0.039s
I20260709 12:59:43.488750  2311 raft_consensus.cc:359] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:43.489774  2311 raft_consensus.cc:740] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:43.490567  2311 consensus_queue.cc:260] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:43.501116  2311 ts_tablet_manager.cc:1434] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:59:43.502743  1632 tablet_copy_service.cc:342] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-6e3bc16a73cd42baba8ebfcbf2a0e93b received from {username='slave'} at 127.0.0.1:50552
I20260709 12:59:43.503116  1632 tablet_copy_service.cc:434] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-6e3bc16a73cd42baba8ebfcbf2a0e93b on tablet 6e3bc16a73cd42baba8ebfcbf2a0e93b with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:43.512583  2321 tablet_bootstrap.cc:492] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:43.513574  2321 tablet_bootstrap.cc:492] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:43.514127  2321 ts_tablet_manager.cc:1403] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.015s
I20260709 12:59:43.516541  2321 raft_consensus.cc:359] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:43.517117  2321 raft_consensus.cc:740] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:43.517590  2321 consensus_queue.cc:260] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:43.519372  2321 ts_tablet_manager.cc:1434] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 12:59:43.520903  1632 tablet_copy_service.cc:342] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-158ebfb5c6324189947e23e5386968e4 received from {username='slave'} at 127.0.0.1:50552
I20260709 12:59:43.521302  1632 tablet_copy_service.cc:434] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-158ebfb5c6324189947e23e5386968e4 on tablet 158ebfb5c6324189947e23e5386968e4 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:43.529563  2246 raft_consensus.cc:1217] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:43.701668  2246 raft_consensus.cc:1217] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:43.841650  2246 raft_consensus.cc:1217] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:43.850885  2246 raft_consensus.cc:1217] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:44.030455  1879 raft_consensus.cc:1064] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:44.033213  1879 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:44.049531  1617 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.050359  2246 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.052376  1998 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:44.053217  2325 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:44.054469  1690 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.056988  2000 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:44.065896  1998 raft_consensus.cc:2955] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.070123  2246 raft_consensus.cc:2955] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.073772  1691 raft_consensus.cc:2955] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.077135  1613 raft_consensus.cc:2955] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.086373  1442 catalog_manager.cc:5697] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:44.118695  1542 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:44.124107  2246 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:44.125502  1879 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:44.126368  1691 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:44.127964  1879 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:44.132735  1998 raft_consensus.cc:2955] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.137298  1691 raft_consensus.cc:2955] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.140216  1429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4142f46c85974609aa207df00c3d031e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:44.141263  2246 raft_consensus.cc:2955] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.153452  1444 catalog_manager.cc:5697] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:44.164860  1606 tablet_service.cc:1558] Processing DeleteTablet for tablet 4142f46c85974609aa207df00c3d031e with delete_type TABLET_DATA_TOMBSTONED (TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40006
I20260709 12:59:44.176056  2336 tablet_replica.cc:333] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 12:59:44.177296  2336 raft_consensus.cc:2243] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:44.178092  2336 raft_consensus.cc:2272] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:44.198616  2326 raft_consensus.cc:1064] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:44.201293  2336 ts_tablet_manager.cc:1916] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:44.203035  2326 consensus_queue.cc:237] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:44.210841  1613 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.211287  2246 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.212512  1542 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.214092  2327 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:44.215688  2306 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:44.217864  2326 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:44.237977  2170 raft_consensus.cc:1064] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:44.240888  2170 consensus_queue.cc:237] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:44.257781  2326 raft_consensus.cc:2955] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.269006  1543 raft_consensus.cc:2955] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.259500  1691 raft_consensus.cc:1275] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.273517  1539 raft_consensus.cc:1275] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.275126  2287 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:44.275914  1613 raft_consensus.cc:2955] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.260694  2336 ts_tablet_manager.cc:1929] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:44.264601  2246 raft_consensus.cc:1275] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.302706  2336 log.cc:1199] T 4142f46c85974609aa207df00c3d031e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root/wals/4142f46c85974609aa207df00c3d031e
I20260709 12:59:44.293144  1444 catalog_manager.cc:5697] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.305656  2246 raft_consensus.cc:2955] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.299161  2287 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:59:44.330910  1690 consensus_queue.cc:237] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:44.345971  1613 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:44.347487  2304 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:44.351753  1430 catalog_manager.cc:5028] TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): tablet 4142f46c85974609aa207df00c3d031e (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:44.352488  2343 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:44.357089  2245 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:44.366979  2305 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:44.372536  2327 raft_consensus.cc:2955] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.379602  1617 raft_consensus.cc:2955] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.384668  2246 raft_consensus.cc:2955] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.375664  2170 raft_consensus.cc:2955] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.380136  1692 raft_consensus.cc:2955] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.409958  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c97fa1eb9d6548d3852cfed83b346e69 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:44.417466  1441 catalog_manager.cc:5697] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:44.424081  2287 raft_consensus.cc:1064] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:44.429509  2287 consensus_queue.cc:237] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:44.435992  1531 tablet_service.cc:1558] Processing DeleteTablet for tablet c97fa1eb9d6548d3852cfed83b346e69 with delete_type TABLET_DATA_TOMBSTONED (TS d7158d6c3b634dc7abb69eac58eba291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39608
I20260709 12:59:44.483134  2348 tablet_replica.cc:333] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 12:59:44.484243  2348 raft_consensus.cc:2243] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:44.483717  1442 catalog_manager.cc:5697] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.485481  2348 raft_consensus.cc:2272] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:44.503135  2348 ts_tablet_manager.cc:1916] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:44.520062  2246 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.521318  1692 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.522254  2346 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:44.524129  2347 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:44.515456  2244 raft_consensus.cc:2955] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.532704  1539 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.533353  1542 raft_consensus.cc:2955] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.548893  2348 ts_tablet_manager.cc:1929] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:44.549525  2348 log.cc:1199] T c97fa1eb9d6548d3852cfed83b346e69 P d7158d6c3b634dc7abb69eac58eba291: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root/wals/c97fa1eb9d6548d3852cfed83b346e69
I20260709 12:59:44.551764  1429 catalog_manager.cc:5028] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): tablet c97fa1eb9d6548d3852cfed83b346e69 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:44.556269  2170 raft_consensus.cc:2955] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.562080  1692 raft_consensus.cc:2955] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.576571  2244 raft_consensus.cc:2955] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.591427  1442 catalog_manager.cc:5697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.596768  2346 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:44.614614  1617 consensus_queue.cc:237] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:44.621970  1539 raft_consensus.cc:2955] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.626986  1543 raft_consensus.cc:1275] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:44.626230  2244 raft_consensus.cc:1275] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:44.628342  2170 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:44.629153  2346 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:44.636440  2346 raft_consensus.cc:2955] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.637763  2246 raft_consensus.cc:2955] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.651741  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 158ebfb5c6324189947e23e5386968e4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:44.651994  1444 catalog_manager.cc:5697] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.652835  1542 raft_consensus.cc:2955] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:44.663965  1684 tablet_service.cc:1558] Processing DeleteTablet for tablet 158ebfb5c6324189947e23e5386968e4 with delete_type TABLET_DATA_TOMBSTONED (TS 822e08445eae4a33b2f2fe92060192c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45640
I20260709 12:59:44.669711  2353 tablet_replica.cc:333] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 12:59:44.671327  2353 raft_consensus.cc:2243] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:44.672384  2353 raft_consensus.cc:2272] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:44.675644  2353 ts_tablet_manager.cc:1916] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:44.691731  2353 ts_tablet_manager.cc:1929] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:44.692111  2353 log.cc:1199] T 158ebfb5c6324189947e23e5386968e4 P 822e08445eae4a33b2f2fe92060192c6: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root/wals/158ebfb5c6324189947e23e5386968e4
I20260709 12:59:44.693904  1431 catalog_manager.cc:5028] TS 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): tablet 158ebfb5c6324189947e23e5386968e4 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:45.214612  1617 consensus_queue.cc:237] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:45.218757  2246 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:45.219105  1542 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:45.220324  2287 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:45.221158  2347 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:45.227942  2343 raft_consensus.cc:2955] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:45.230806  2246 raft_consensus.cc:2955] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:45.233572  1542 raft_consensus.cc:2955] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:45.237109  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6e3bc16a73cd42baba8ebfcbf2a0e93b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:45.250238  1441 catalog_manager.cc:5697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:45.278635  1684 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e3bc16a73cd42baba8ebfcbf2a0e93b with delete_type TABLET_DATA_TOMBSTONED (TS 822e08445eae4a33b2f2fe92060192c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45640
I20260709 12:59:45.295382  2359 tablet_replica.cc:333] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 12:59:45.299295  2359 raft_consensus.cc:2243] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:45.300028  2359 raft_consensus.cc:2272] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:45.302196  2359 ts_tablet_manager.cc:1916] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:45.317277  2359 ts_tablet_manager.cc:1929] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:45.317617  2359 log.cc:1199] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P 822e08445eae4a33b2f2fe92060192c6: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root/wals/6e3bc16a73cd42baba8ebfcbf2a0e93b
I20260709 12:59:45.319137  1431 catalog_manager.cc:5028] TS 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): tablet 6e3bc16a73cd42baba8ebfcbf2a0e93b (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:46.367740  1542 consensus_queue.cc:237] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:46.375478  1692 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:46.376240  1617 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:46.376302  1511 consensus_peers.cc:597] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9831a5f16aac472b8ce4f707c039e298. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:46.379148  2360 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:46.381291  2000 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:46.386897  2360 raft_consensus.cc:2955] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:46.388588  1617 raft_consensus.cc:2955] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:46.391611  1692 raft_consensus.cc:2955] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:46.405558  1690 consensus_queue.cc:237] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:46.411628  1442 catalog_manager.cc:5697] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
W20260709 12:59:46.424129  1660 consensus_peers.cc:597] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 05911a041e044f48bce12648b58061be. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:46.424789  1613 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:46.427366  1543 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:46.427372  2364 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:46.430825  2304 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:46.458990  2304 raft_consensus.cc:2955] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:46.474514  1613 raft_consensus.cc:2955] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:46.494019  1692 consensus_queue.cc:237] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:46.499375  1444 catalog_manager.cc:5697] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
W20260709 12:59:46.516042  1660 consensus_peers.cc:597] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2efa93934d6a4a8182f175ae59fc177e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:46.518894  1617 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:46.522621  2304 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:46.526512  1543 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:46.526819  1539 raft_consensus.cc:2955] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:46.530788  2304 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:46.552197  2365 raft_consensus.cc:2955] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:46.558171  1617 raft_consensus.cc:2955] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:46.569020  1543 raft_consensus.cc:2955] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:46.576251  1444 catalog_manager.cc:5697] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.579051  1614 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:46.591419  1692 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:46.593468  2343 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:59:46.594576  1586 consensus_peers.cc:597] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f253020cc7a4b66aa6c8f66a42d44c6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:46.596547  1539 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:46.598855  2343 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:46.610146  2343 raft_consensus.cc:2955] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:46.611590  1690 raft_consensus.cc:2955] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:46.618542  1543 raft_consensus.cc:2955] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:46.634744  1441 catalog_manager.cc:5697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.798436  2386 ts_tablet_manager.cc:933] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 12:59:46.800709  2386 tablet_copy_client.cc:323] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:41871
I20260709 12:59:46.803689  1557 tablet_copy_service.cc:140] P d7158d6c3b634dc7abb69eac58eba291: Received BeginTabletCopySession request for tablet 9831a5f16aac472b8ce4f707c039e298 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:42858)
I20260709 12:59:46.804177  1557 tablet_copy_service.cc:161] P d7158d6c3b634dc7abb69eac58eba291: Beginning new tablet copy session on tablet 9831a5f16aac472b8ce4f707c039e298 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:42858: session id = e8a64798e5f94de8909707bcbd11804a-9831a5f16aac472b8ce4f707c039e298
I20260709 12:59:46.810411  1557 tablet_copy_source_session.cc:215] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:46.813613  2386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9831a5f16aac472b8ce4f707c039e298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:46.830314  2386 tablet_copy_client.cc:806] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:46.830989  2386 tablet_copy_client.cc:670] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:46.835083  2386 tablet_copy_client.cc:538] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:46.842239  2386 tablet_bootstrap.cc:492] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:46.862422  2386 tablet_bootstrap.cc:492] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:46.863281  2386 tablet_bootstrap.cc:492] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:46.864326  2386 ts_tablet_manager.cc:1403] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.004s
I20260709 12:59:46.867740  2386 raft_consensus.cc:359] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:46.868492  2386 raft_consensus.cc:740] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:46.869095  2386 consensus_queue.cc:260] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:46.875630  2386 ts_tablet_manager.cc:1434] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 12:59:46.877390  1557 tablet_copy_service.cc:342] P d7158d6c3b634dc7abb69eac58eba291: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-9831a5f16aac472b8ce4f707c039e298 received from {username='slave'} at 127.0.0.1:42858
I20260709 12:59:46.877952  1557 tablet_copy_service.cc:434] P d7158d6c3b634dc7abb69eac58eba291: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-9831a5f16aac472b8ce4f707c039e298 on tablet 9831a5f16aac472b8ce4f707c039e298 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:46.903465  2386 ts_tablet_manager.cc:933] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:46.905249  2386 tablet_copy_client.cc:323] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 12:59:46.907197  1706 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet 05911a041e044f48bce12648b58061be from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 12:59:46.907835  1706 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet 05911a041e044f48bce12648b58061be from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-05911a041e044f48bce12648b58061be
I20260709 12:59:46.915709  1706 tablet_copy_source_session.cc:215] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:46.918622  2386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05911a041e044f48bce12648b58061be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:46.932871  2386 tablet_copy_client.cc:806] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:46.933465  2386 tablet_copy_client.cc:670] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:46.937813  2386 tablet_copy_client.cc:538] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:46.944674  2386 tablet_bootstrap.cc:492] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:46.964234  2386 tablet_bootstrap.cc:492] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:46.965247  2386 tablet_bootstrap.cc:492] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:46.965943  2386 ts_tablet_manager.cc:1403] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.001s
I20260709 12:59:46.969221  2386 raft_consensus.cc:359] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:46.970101  2386 raft_consensus.cc:740] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:46.970765  2386 consensus_queue.cc:260] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:46.973043  2386 ts_tablet_manager.cc:1434] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:46.974643  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-05911a041e044f48bce12648b58061be received from {username='slave'} at 127.0.0.1:50480
I20260709 12:59:46.975078  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-05911a041e044f48bce12648b58061be on tablet 05911a041e044f48bce12648b58061be with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:46.993358  2386 ts_tablet_manager.cc:933] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:46.995366  2386 tablet_copy_client.cc:323] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39981
I20260709 12:59:46.997365  1632 tablet_copy_service.cc:140] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Received BeginTabletCopySession request for tablet 0f253020cc7a4b66aa6c8f66a42d44c6 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50552)
I20260709 12:59:46.997856  1632 tablet_copy_service.cc:161] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Beginning new tablet copy session on tablet 0f253020cc7a4b66aa6c8f66a42d44c6 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50552: session id = e8a64798e5f94de8909707bcbd11804a-0f253020cc7a4b66aa6c8f66a42d44c6
I20260709 12:59:47.007064  1632 tablet_copy_source_session.cc:215] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:47.009936  2386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f253020cc7a4b66aa6c8f66a42d44c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:47.025372  2386 tablet_copy_client.cc:806] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:47.025951  2386 tablet_copy_client.cc:670] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:47.038353  2386 tablet_copy_client.cc:538] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:47.046406  2386 tablet_bootstrap.cc:492] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:47.091130  2386 tablet_bootstrap.cc:492] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:47.091990  2386 tablet_bootstrap.cc:492] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:47.092605  2386 ts_tablet_manager.cc:1403] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.023s
I20260709 12:59:47.095026  2386 raft_consensus.cc:359] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:47.095677  2386 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:47.096131  2386 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:47.099222  2386 ts_tablet_manager.cc:1434] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:59:47.100662  1632 tablet_copy_service.cc:342] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-0f253020cc7a4b66aa6c8f66a42d44c6 received from {username='slave'} at 127.0.0.1:50552
I20260709 12:59:47.101027  1632 tablet_copy_service.cc:434] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-0f253020cc7a4b66aa6c8f66a42d44c6 on tablet 0f253020cc7a4b66aa6c8f66a42d44c6 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:47.118579  2386 ts_tablet_manager.cc:933] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:47.119935  2386 tablet_copy_client.cc:323] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 12:59:47.121213  1706 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet 2efa93934d6a4a8182f175ae59fc177e from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 12:59:47.121709  1706 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet 2efa93934d6a4a8182f175ae59fc177e from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-2efa93934d6a4a8182f175ae59fc177e
I20260709 12:59:47.127148  1706 tablet_copy_source_session.cc:215] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:47.130164  2386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efa93934d6a4a8182f175ae59fc177e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:47.139947  2386 tablet_copy_client.cc:806] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:47.140848  2386 tablet_copy_client.cc:670] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:47.146162  2386 tablet_copy_client.cc:538] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:47.153703  2386 tablet_bootstrap.cc:492] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:47.171654  2386 tablet_bootstrap.cc:492] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:47.172451  2386 tablet_bootstrap.cc:492] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:47.173026  2386 ts_tablet_manager.cc:1403] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 12:59:47.175395  2386 raft_consensus.cc:359] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:47.175951  2386 raft_consensus.cc:740] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:47.176487  2386 consensus_queue.cc:260] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:47.178463  2386 ts_tablet_manager.cc:1434] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:59:47.180392  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-2efa93934d6a4a8182f175ae59fc177e received from {username='slave'} at 127.0.0.1:50480
I20260709 12:59:47.180864  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-2efa93934d6a4a8182f175ae59fc177e on tablet 2efa93934d6a4a8182f175ae59fc177e with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:47.235852  2246 raft_consensus.cc:1217] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:47.332134  2246 raft_consensus.cc:1217] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:47.491520  2246 raft_consensus.cc:1217] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:47.560197  2246 raft_consensus.cc:1217] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:47.708003  2395 raft_consensus.cc:1064] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:47.710619  2395 consensus_queue.cc:237] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:47.721735  1690 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:47.722239  2246 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:47.723196  2000 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:47.724798  2000 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:47.728132  1617 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:47.732247  2395 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:47.744901  2393 raft_consensus.cc:2955] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:47.749221  2246 raft_consensus.cc:2955] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:47.753233  1617 raft_consensus.cc:2955] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:47.756311  1690 raft_consensus.cc:2955] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:47.763907  1444 catalog_manager.cc:5697] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:47.775137  2304 raft_consensus.cc:1064] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:47.778286  2304 consensus_queue.cc:237] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:47.797775  2246 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:47.798434  1617 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:47.799870  2365 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:47.800599  1539 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:47.803189  2304 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:47.804418  2372 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:47.832930  1539 consensus_queue.cc:237] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:47.838835  2244 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:47.840862  2400 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:47.844924  1692 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:47.847468  2372 raft_consensus.cc:2955] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:47.849452  2393 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:47.850688  2000 raft_consensus.cc:2955] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:47.859901  2245 raft_consensus.cc:2955] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:47.857077  2244 raft_consensus.cc:2955] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:47.876667  1429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9831a5f16aac472b8ce4f707c039e298 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:47.883616  1441 catalog_manager.cc:5697] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:47.886858  1692 raft_consensus.cc:2955] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:47.902251  1606 tablet_service.cc:1558] Processing DeleteTablet for tablet 9831a5f16aac472b8ce4f707c039e298 with delete_type TABLET_DATA_TOMBSTONED (TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40006
I20260709 12:59:47.905495  1614 raft_consensus.cc:2955] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:47.912464  1443 catalog_manager.cc:5697] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:47.924823  1547 raft_consensus.cc:2955] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:47.988758  2414 tablet_replica.cc:333] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 12:59:47.991007  2414 raft_consensus.cc:2243] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:47.991364  1690 consensus_queue.cc:237] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:47.992113  2414 raft_consensus.cc:2272] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:47.995934  2414 ts_tablet_manager.cc:1916] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:47.999622  1617 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:48.000176  2245 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:48.001116  2372 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:48.002043  2417 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:48.013540  2415 raft_consensus.cc:2955] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.017235  2245 raft_consensus.cc:2955] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.021029  1614 raft_consensus.cc:2955] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.034416  1443 catalog_manager.cc:5697] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.052960  1531 tablet_service.cc:1558] Processing DeleteTablet for tablet 05911a041e044f48bce12648b58061be with delete_type TABLET_DATA_TOMBSTONED (TS d7158d6c3b634dc7abb69eac58eba291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39608
I20260709 12:59:48.068082  2419 tablet_replica.cc:333] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 12:59:48.070173  2419 raft_consensus.cc:2243] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:48.068869  2414 ts_tablet_manager.cc:1929] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:48.071134  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 05911a041e044f48bce12648b58061be with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:48.071523  2414 log.cc:1199] T 9831a5f16aac472b8ce4f707c039e298 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root/wals/9831a5f16aac472b8ce4f707c039e298
I20260709 12:59:48.070982  2419 raft_consensus.cc:2272] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:48.082369  2419 ts_tablet_manager.cc:1916] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:48.085266  1430 catalog_manager.cc:5028] TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): tablet 9831a5f16aac472b8ce4f707c039e298 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:48.088583  2372 raft_consensus.cc:1064] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:48.095911  2418 raft_consensus.cc:1064] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:48.091804  2372 consensus_queue.cc:237] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:48.099733  2418 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:48.104252  2419 ts_tablet_manager.cc:1929] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:48.104839  2419 log.cc:1199] T 05911a041e044f48bce12648b58061be P d7158d6c3b634dc7abb69eac58eba291: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root/wals/05911a041e044f48bce12648b58061be
I20260709 12:59:48.106737  1429 catalog_manager.cc:5028] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): tablet 05911a041e044f48bce12648b58061be (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:48.111881  1690 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:48.113525  2245 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:48.113606  2244 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:48.117326  1547 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:48.117295  2420 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:48.119547  2420 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:48.121135  2412 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:48.113783  1617 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:48.126173  2416 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:48.128571  2372 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:48.152881  1547 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:48.154287  2418 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:48.155476  2412 raft_consensus.cc:2955] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.168807  2420 raft_consensus.cc:2955] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.166030  1614 raft_consensus.cc:2955] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.171924  1539 raft_consensus.cc:2955] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.167819  2245 raft_consensus.cc:2955] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.190203  1443 catalog_manager.cc:5697] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.190625  1539 raft_consensus.cc:2955] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.179632  2244 raft_consensus.cc:2955] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.217010  1443 catalog_manager.cc:5697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.232599  1690 consensus_queue.cc:237] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:48.247956  1543 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:48.249440  2416 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:48.262182  1543 raft_consensus.cc:2955] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.261981  2372 raft_consensus.cc:2955] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.285135  1443 catalog_manager.cc:5697] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.288062  2244 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:48.291774  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2efa93934d6a4a8182f175ae59fc177e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:48.294963  2416 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:48.296304  1691 raft_consensus.cc:2955] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.302145  2244 raft_consensus.cc:2955] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.316926  1606 tablet_service.cc:1558] Processing DeleteTablet for tablet 2efa93934d6a4a8182f175ae59fc177e with delete_type TABLET_DATA_TOMBSTONED (TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40006
I20260709 12:59:48.318849  2414 tablet_replica.cc:333] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 12:59:48.320048  2414 raft_consensus.cc:2243] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:48.321028  2414 raft_consensus.cc:2272] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:48.330646  2414 ts_tablet_manager.cc:1916] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:48.342760  1617 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:48.348279  1543 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:48.348299  2244 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:48.349681  2414 ts_tablet_manager.cc:1929] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:48.351073  2414 log.cc:1199] T 2efa93934d6a4a8182f175ae59fc177e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root/wals/2efa93934d6a4a8182f175ae59fc177e
I20260709 12:59:48.353019  1430 catalog_manager.cc:5028] TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): tablet 2efa93934d6a4a8182f175ae59fc177e (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:48.353420  2429 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:48.356433  2429 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:48.363446  2362 raft_consensus.cc:2955] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.364722  1543 raft_consensus.cc:2955] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.377861  2244 raft_consensus.cc:2955] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.380748  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0f253020cc7a4b66aa6c8f66a42d44c6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:48.381467  1443 catalog_manager.cc:5697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:48.402781  1684 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f253020cc7a4b66aa6c8f66a42d44c6 with delete_type TABLET_DATA_TOMBSTONED (TS 822e08445eae4a33b2f2fe92060192c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45640
I20260709 12:59:48.416671  2430 tablet_replica.cc:333] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 12:59:48.417955  2430 raft_consensus.cc:2243] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:48.419070  2430 raft_consensus.cc:2272] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:48.422127  2430 ts_tablet_manager.cc:1916] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:48.432883  2430 ts_tablet_manager.cc:1929] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:48.433238  2430 log.cc:1199] T 0f253020cc7a4b66aa6c8f66a42d44c6 P 822e08445eae4a33b2f2fe92060192c6: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root/wals/0f253020cc7a4b66aa6c8f66a42d44c6
I20260709 12:59:48.434628  1431 catalog_manager.cc:5028] TS 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): tablet 0f253020cc7a4b66aa6c8f66a42d44c6 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:49.467067  1617 consensus_queue.cc:237] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:49.473731  1539 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:49.474053  1586 consensus_peers.cc:597] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c40365464684a5d86c2918b7b0160d4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:49.475622  2433 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.476202  1691 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:49.478006  2362 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.493677  2433 raft_consensus.cc:2955] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:49.497697  1539 raft_consensus.cc:2955] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:49.498206  1690 raft_consensus.cc:2955] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:49.514734  1690 consensus_queue.cc:237] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:49.516321  1442 catalog_manager.cc:5697] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:49.525665  1617 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:49.528863  1660 consensus_peers.cc:597] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e0db569e82e490f9de2c0a9300c24bf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:49.529551  2412 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:49.557976  2412 raft_consensus.cc:2955] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:49.560577  1617 raft_consensus.cc:2955] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:49.569712  1539 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:49.610447  2439 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.619652  1543 raft_consensus.cc:2955] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:49.623684  1690 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:49.634577  1539 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:49.636143  2412 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:49.638942  1660 consensus_peers.cc:597] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 685ae4154c6d4c3abdaf18547da9ffe2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:49.639772  1443 catalog_manager.cc:5697] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.641052  1619 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:49.643887  2412 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.647780  2446 raft_consensus.cc:2955] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:49.649947  1543 raft_consensus.cc:2955] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:49.660719  1619 raft_consensus.cc:2955] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:49.669404  1617 consensus_queue.cc:237] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:49.672029  1443 catalog_manager.cc:5697] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:49.678608  1690 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:49.681380  2438 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.683426  1543 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:49.686076  2362 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:49.693713  1586 consensus_peers.cc:597] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 32470c2737744478bac199459790b787. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:49.703760  2433 raft_consensus.cc:2955] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:49.705423  1690 raft_consensus.cc:2955] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:49.707301  1543 raft_consensus.cc:2955] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:49.720583  1441 catalog_manager.cc:5697] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:49.943172  2456 ts_tablet_manager.cc:933] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:49.945037  2456 tablet_copy_client.cc:323] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 12:59:49.946810  1706 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet 9e0db569e82e490f9de2c0a9300c24bf from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 12:59:49.947350  1706 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet 9e0db569e82e490f9de2c0a9300c24bf from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-9e0db569e82e490f9de2c0a9300c24bf
I20260709 12:59:49.954777  1706 tablet_copy_source_session.cc:215] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:49.958519  2456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0db569e82e490f9de2c0a9300c24bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:49.974509  2456 tablet_copy_client.cc:806] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:49.975354  2456 tablet_copy_client.cc:670] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:49.980760  2456 tablet_copy_client.cc:538] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:49.987658  2456 tablet_bootstrap.cc:492] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:50.011804  2458 ts_tablet_manager.cc:933] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:50.021610  2458 tablet_copy_client.cc:323] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39981
I20260709 12:59:50.022702  2456 tablet_bootstrap.cc:492] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:50.023366  1632 tablet_copy_service.cc:140] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Received BeginTabletCopySession request for tablet 6c40365464684a5d86c2918b7b0160d4 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50552)
I20260709 12:59:50.023607  2456 tablet_bootstrap.cc:492] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:50.023916  1632 tablet_copy_service.cc:161] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Beginning new tablet copy session on tablet 6c40365464684a5d86c2918b7b0160d4 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50552: session id = e8a64798e5f94de8909707bcbd11804a-6c40365464684a5d86c2918b7b0160d4
I20260709 12:59:50.024173  2456 ts_tablet_manager.cc:1403] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.037s	user 0.023s	sys 0.006s
I20260709 12:59:50.026940  2456 raft_consensus.cc:359] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:50.027850  2456 raft_consensus.cc:740] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:50.028698  2456 consensus_queue.cc:260] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:50.032999  1632 tablet_copy_source_session.cc:215] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:50.035274  2456 ts_tablet_manager.cc:1434] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.009s
I20260709 12:59:50.036510  2458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c40365464684a5d86c2918b7b0160d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:50.037101  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-9e0db569e82e490f9de2c0a9300c24bf received from {username='slave'} at 127.0.0.1:50480
I20260709 12:59:50.037523  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-9e0db569e82e490f9de2c0a9300c24bf on tablet 9e0db569e82e490f9de2c0a9300c24bf with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:50.052290  2458 tablet_copy_client.cc:806] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:50.052842  2458 tablet_copy_client.cc:670] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:50.057070  2458 tablet_copy_client.cc:538] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:50.062075  2456 ts_tablet_manager.cc:933] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:50.063849  2456 tablet_copy_client.cc:323] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39981
I20260709 12:59:50.065353  2458 tablet_bootstrap.cc:492] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:50.065505  1632 tablet_copy_service.cc:140] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Received BeginTabletCopySession request for tablet 32470c2737744478bac199459790b787 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50552)
I20260709 12:59:50.066032  1632 tablet_copy_service.cc:161] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Beginning new tablet copy session on tablet 32470c2737744478bac199459790b787 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50552: session id = e8a64798e5f94de8909707bcbd11804a-32470c2737744478bac199459790b787
I20260709 12:59:50.075026  1632 tablet_copy_source_session.cc:215] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:50.078109  2456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32470c2737744478bac199459790b787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:50.093544  2463 ts_tablet_manager.cc:933] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:50.096055  2458 tablet_bootstrap.cc:492] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:50.096961  2458 tablet_bootstrap.cc:492] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:50.097666  2458 ts_tablet_manager.cc:1403] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.013s
I20260709 12:59:50.098213  2456 tablet_copy_client.cc:806] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:50.098778  2456 tablet_copy_client.cc:670] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:50.101233  2463 tablet_copy_client.cc:323] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 12:59:50.101902  2458 raft_consensus.cc:359] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:50.102654  2458 raft_consensus.cc:740] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:50.103111  2458 consensus_queue.cc:260] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:50.105818  1706 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet 685ae4154c6d4c3abdaf18547da9ffe2 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 12:59:50.106359  1706 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet 685ae4154c6d4c3abdaf18547da9ffe2 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-685ae4154c6d4c3abdaf18547da9ffe2
I20260709 12:59:50.107285  2458 ts_tablet_manager.cc:1434] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:59:50.108457  2456 tablet_copy_client.cc:538] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:50.109557  1632 tablet_copy_service.cc:342] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-6c40365464684a5d86c2918b7b0160d4 received from {username='slave'} at 127.0.0.1:50552
I20260709 12:59:50.110002  1632 tablet_copy_service.cc:434] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-6c40365464684a5d86c2918b7b0160d4 on tablet 6c40365464684a5d86c2918b7b0160d4 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:50.114096  1706 tablet_copy_source_session.cc:215] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:50.118789  2463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685ae4154c6d4c3abdaf18547da9ffe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:50.135916  2456 tablet_bootstrap.cc:492] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:50.155725  2463 tablet_copy_client.cc:806] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:50.156409  2463 tablet_copy_client.cc:670] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:50.160879  2463 tablet_copy_client.cc:538] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:50.177924  2463 tablet_bootstrap.cc:492] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:50.215199  2463 tablet_bootstrap.cc:492] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:50.216646  2463 tablet_bootstrap.cc:492] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:50.217675  2463 ts_tablet_manager.cc:1403] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.014s
I20260709 12:59:50.224200  2463 raft_consensus.cc:359] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:50.225546  2463 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:50.226565  2463 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:50.233534  2463 ts_tablet_manager.cc:1434] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:59:50.252592  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-685ae4154c6d4c3abdaf18547da9ffe2 received from {username='slave'} at 127.0.0.1:50480
I20260709 12:59:50.253075  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-685ae4154c6d4c3abdaf18547da9ffe2 on tablet 685ae4154c6d4c3abdaf18547da9ffe2 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:50.258769  2456 tablet_bootstrap.cc:492] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:50.259809  2456 tablet_bootstrap.cc:492] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:50.260536  2456 ts_tablet_manager.cc:1403] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.125s	user 0.046s	sys 0.051s
I20260709 12:59:50.262807  2456 raft_consensus.cc:359] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:50.263468  2456 raft_consensus.cc:740] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:50.263970  2456 consensus_queue.cc:260] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:50.265730  2456 ts_tablet_manager.cc:1434] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:59:50.267802  1632 tablet_copy_service.cc:342] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-32470c2737744478bac199459790b787 received from {username='slave'} at 127.0.0.1:50552
I20260709 12:59:50.268208  1632 tablet_copy_service.cc:434] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-32470c2737744478bac199459790b787 on tablet 32470c2737744478bac199459790b787 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:50.498183  2244 raft_consensus.cc:1217] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:50.526299  2244 raft_consensus.cc:1217] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:50.564462  2244 raft_consensus.cc:1217] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:50.574195  2244 raft_consensus.cc:1217] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:50.992455  2433 raft_consensus.cc:1064] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:50.994777  2433 consensus_queue.cc:237] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:51.001343  2244 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.003471  1542 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.003589  1690 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.004447  2433 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.005385  2438 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.006098  2471 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.020040  2438 raft_consensus.cc:2955] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.022291  1690 raft_consensus.cc:2955] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.028815  1542 raft_consensus.cc:2955] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.039096  1442 catalog_manager.cc:5697] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.052603  2417 raft_consensus.cc:1064] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:51.061160  2471 raft_consensus.cc:1064] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:51.074294  2244 raft_consensus.cc:2955] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.081069  2471 consensus_queue.cc:237] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:51.058883  2417 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:51.106233  1690 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.107100  2245 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.110688  2433 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.111927  2412 raft_consensus.cc:1064] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:51.123775  2412 consensus_queue.cc:237] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:51.128410  2433 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.137028  1614 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.137598  2244 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.138304  1542 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.139712  2467 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:51.142771  2467 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:51.144575  2443 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.167162  1539 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.168535  2433 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.198143  2246 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.198338  1617 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.200073  2417 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.202194  1543 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.203039  2443 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.205601  2417 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:51.264449  2443 raft_consensus.cc:2955] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.285384  2245 raft_consensus.cc:2955] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.296612  2476 raft_consensus.cc:2955] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.308019  2245 raft_consensus.cc:2955] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.319944  2467 raft_consensus.cc:2955] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.327109  1542 raft_consensus.cc:2955] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.330219  1691 raft_consensus.cc:2955] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.338660  1617 consensus_queue.cc:237] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:51.346081  1444 catalog_manager.cc:5697] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.347944  1444 catalog_manager.cc:5697] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.349843  2244 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:51.351945  2438 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:51.362545  2471 raft_consensus.cc:2955] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.369642  1539 raft_consensus.cc:2955] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.386113  2245 raft_consensus.cc:2955] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 12:59:51.391891  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 73446.4us
I20260709 12:59:51.413038  2244 raft_consensus.cc:2955] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.414932  1690 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:51.425043  1614 raft_consensus.cc:2955] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.429427  2244 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:51.431514  2483 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:51.445889  2417 raft_consensus.cc:2955] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.450053  2244 raft_consensus.cc:2955] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.466043  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 685ae4154c6d4c3abdaf18547da9ffe2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:51.469472  1616 raft_consensus.cc:2955] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.496251  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 32470c2737744478bac199459790b787 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:59:51.502235  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 106239us
W20260709 12:59:51.507889  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 111592us
I20260709 12:59:51.510466  1547 raft_consensus.cc:2955] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.523432  1542 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:51.528293  1442 catalog_manager.cc:5697] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.535045  1539 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:51.539769  2500 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:51.544586  2467 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:51.525729  1616 consensus_queue.cc:237] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 12:59:51.548705  1431 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 685ae4154c6d4c3abdaf18547da9ffe2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 12:59:51.566246  1539 raft_consensus.cc:2955] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.572968  1442 catalog_manager.cc:5697] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.579909  1442 catalog_manager.cc:5697] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.581187  2244 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:51.582679  2476 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:51.578058  1547 raft_consensus.cc:2955] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.589139  2471 raft_consensus.cc:2955] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.591614  1690 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:51.594183  2433 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:51.590898  2244 raft_consensus.cc:2955] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.598943  1690 raft_consensus.cc:2955] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.613875  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6c40365464684a5d86c2918b7b0160d4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:51.619473  1606 tablet_service.cc:1558] Processing DeleteTablet for tablet 685ae4154c6d4c3abdaf18547da9ffe2 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:40006
I20260709 12:59:51.621459  1684 tablet_service.cc:1558] Processing DeleteTablet for tablet 32470c2737744478bac199459790b787 with delete_type TABLET_DATA_TOMBSTONED (TS 822e08445eae4a33b2f2fe92060192c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45640
I20260709 12:59:51.645987  1690 consensus_queue.cc:237] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:51.653103  2244 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:51.654666  1442 catalog_manager.cc:5697] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.655404  1614 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:51.657553  2417 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:51.644728  2501 tablet_replica.cc:333] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 12:59:51.659407  2501 raft_consensus.cc:2243] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:51.659168  2417 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:51.660133  2501 raft_consensus.cc:2272] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:51.661487  2502 tablet_replica.cc:333] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 12:59:51.662802  2502 raft_consensus.cc:2243] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:51.663545  2502 raft_consensus.cc:2272] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:51.667922  2501 ts_tablet_manager.cc:1916] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:51.670810  2443 raft_consensus.cc:2955] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.673781  2502 ts_tablet_manager.cc:1916] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:51.674187  1531 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c40365464684a5d86c2918b7b0160d4 with delete_type TABLET_DATA_TOMBSTONED (TS d7158d6c3b634dc7abb69eac58eba291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39608
I20260709 12:59:51.681026  2503 tablet_replica.cc:333] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 12:59:51.682703  2244 raft_consensus.cc:2955] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.682124  2503 raft_consensus.cc:2243] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:51.684535  2503 raft_consensus.cc:2272] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:51.682838  1614 raft_consensus.cc:2955] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:51.689072  2503 ts_tablet_manager.cc:1916] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:51.690829  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9e0db569e82e490f9de2c0a9300c24bf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:51.701058  1444 catalog_manager.cc:5697] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:51.715548  1531 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e0db569e82e490f9de2c0a9300c24bf with delete_type TABLET_DATA_TOMBSTONED (TS d7158d6c3b634dc7abb69eac58eba291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39608
I20260709 12:59:51.729185  2501 ts_tablet_manager.cc:1929] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:51.729714  2501 log.cc:1199] T 685ae4154c6d4c3abdaf18547da9ffe2 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root/wals/685ae4154c6d4c3abdaf18547da9ffe2
I20260709 12:59:51.731343  1430 catalog_manager.cc:5028] TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): tablet 685ae4154c6d4c3abdaf18547da9ffe2 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:51.731600  2503 ts_tablet_manager.cc:1929] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:51.732028  2503 log.cc:1199] T 6c40365464684a5d86c2918b7b0160d4 P d7158d6c3b634dc7abb69eac58eba291: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root/wals/6c40365464684a5d86c2918b7b0160d4
I20260709 12:59:51.733716  2503 tablet_replica.cc:333] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 12:59:51.733721  1429 catalog_manager.cc:5028] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): tablet 6c40365464684a5d86c2918b7b0160d4 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:51.734918  2503 raft_consensus.cc:2243] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:51.735105  2502 ts_tablet_manager.cc:1929] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:51.735561  2502 log.cc:1199] T 32470c2737744478bac199459790b787 P 822e08445eae4a33b2f2fe92060192c6: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root/wals/32470c2737744478bac199459790b787
I20260709 12:59:51.735699  2503 raft_consensus.cc:2272] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:51.736920  1431 catalog_manager.cc:5028] TS 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): tablet 32470c2737744478bac199459790b787 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:51.738305  2503 ts_tablet_manager.cc:1916] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:51.750675  2503 ts_tablet_manager.cc:1929] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:51.751056  2503 log.cc:1199] T 9e0db569e82e490f9de2c0a9300c24bf P d7158d6c3b634dc7abb69eac58eba291: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root/wals/9e0db569e82e490f9de2c0a9300c24bf
I20260709 12:59:51.752416  1429 catalog_manager.cc:5028] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): tablet 9e0db569e82e490f9de2c0a9300c24bf (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:52.787384  1539 consensus_queue.cc:237] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
W20260709 12:59:52.794607  1511 consensus_peers.cc:597] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6817bc4013144ede80163d16316d4860. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:52.795118  1614 raft_consensus.cc:1275] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:52.795749  1690 raft_consensus.cc:1275] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:52.796449  2504 consensus_queue.cc:1048] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:52.798508  2498 consensus_queue.cc:1048] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:52.805337  2504 raft_consensus.cc:2955] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:52.806968  1616 raft_consensus.cc:2955] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:52.808826  1690 raft_consensus.cc:2955] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:52.820027  1539 consensus_queue.cc:237] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:52.831570  1691 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:52.836445  2504 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:52.839763  1616 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:52.827457  1442 catalog_manager.cc:5697] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:52.841094  2499 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:52.845513  1511 consensus_peers.cc:597] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d351fa3549448eda026a66b8c124d58. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:52.859665  2504 raft_consensus.cc:2955] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:52.863683  1616 raft_consensus.cc:2955] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:52.864677  1690 raft_consensus.cc:2955] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:52.901263  1441 catalog_manager.cc:5697] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:52.892879  1614 consensus_queue.cc:237] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:52.915622  1547 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:52.915832  1586 consensus_peers.cc:597] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9c6a5febc6e54b13a4ed0d342e7b7f8f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:52.916781  1690 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:52.917245  2500 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:52.919502  2515 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:52.928135  2500 raft_consensus.cc:2955] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:52.929602  1690 raft_consensus.cc:2955] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:52.932147  1547 raft_consensus.cc:2955] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:52.942133  1539 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:52.944458  1441 catalog_manager.cc:5697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:52.967933  1690 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:52.969388  1511 consensus_peers.cc:597] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b19a10a05aa24743a6d1222179fd4af4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:52.970233  2504 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:52.969290  1614 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:52.977697  2504 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:52.979176  2498 raft_consensus.cc:2955] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:52.982060  1690 raft_consensus.cc:2955] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:52.984658  1614 raft_consensus.cc:2955] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:52.997691  1441 catalog_manager.cc:5697] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:53.268981  2524 ts_tablet_manager.cc:933] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 12:59:53.272346  2524 tablet_copy_client.cc:323] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:41871
I20260709 12:59:53.274667  1557 tablet_copy_service.cc:140] P d7158d6c3b634dc7abb69eac58eba291: Received BeginTabletCopySession request for tablet 2d351fa3549448eda026a66b8c124d58 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:42858)
I20260709 12:59:53.275377  2526 ts_tablet_manager.cc:933] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 12:59:53.275584  1557 tablet_copy_service.cc:161] P d7158d6c3b634dc7abb69eac58eba291: Beginning new tablet copy session on tablet 2d351fa3549448eda026a66b8c124d58 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:42858: session id = e8a64798e5f94de8909707bcbd11804a-2d351fa3549448eda026a66b8c124d58
I20260709 12:59:53.281761  2526 tablet_copy_client.cc:323] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:41871
I20260709 12:59:53.283675  1556 tablet_copy_service.cc:140] P d7158d6c3b634dc7abb69eac58eba291: Received BeginTabletCopySession request for tablet 6817bc4013144ede80163d16316d4860 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:42858)
I20260709 12:59:53.284077  1557 tablet_copy_source_session.cc:215] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:53.284394  1556 tablet_copy_service.cc:161] P d7158d6c3b634dc7abb69eac58eba291: Beginning new tablet copy session on tablet 6817bc4013144ede80163d16316d4860 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:42858: session id = e8a64798e5f94de8909707bcbd11804a-6817bc4013144ede80163d16316d4860
I20260709 12:59:53.287452  2524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d351fa3549448eda026a66b8c124d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.295492  1556 tablet_copy_source_session.cc:215] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:53.299094  2526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6817bc4013144ede80163d16316d4860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.303457  2524 tablet_copy_client.cc:806] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:53.304096  2524 tablet_copy_client.cc:670] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:53.308385  2524 tablet_copy_client.cc:538] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:53.318145  2524 tablet_bootstrap.cc:492] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:53.333909  2526 tablet_copy_client.cc:806] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:53.334579  2526 tablet_copy_client.cc:670] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:53.350585  2526 tablet_copy_client.cc:538] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:53.353375  2524 tablet_bootstrap.cc:492] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:53.354411  2524 tablet_bootstrap.cc:492] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:53.355062  2524 ts_tablet_manager.cc:1403] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.013s
I20260709 12:59:53.358175  2524 raft_consensus.cc:359] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:53.358992  2524 raft_consensus.cc:740] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:53.359648  2524 consensus_queue.cc:260] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:53.364952  2526 tablet_bootstrap.cc:492] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:53.386804  2524 ts_tablet_manager.cc:1434] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.031s	user 0.014s	sys 0.015s
I20260709 12:59:53.389411  1556 tablet_copy_service.cc:342] P d7158d6c3b634dc7abb69eac58eba291: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-2d351fa3549448eda026a66b8c124d58 received from {username='slave'} at 127.0.0.1:42858
I20260709 12:59:53.389923  1556 tablet_copy_service.cc:434] P d7158d6c3b634dc7abb69eac58eba291: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-2d351fa3549448eda026a66b8c124d58 on tablet 2d351fa3549448eda026a66b8c124d58 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:53.398726  2526 tablet_bootstrap.cc:492] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:53.399716  2526 tablet_bootstrap.cc:492] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:53.400388  2526 ts_tablet_manager.cc:1403] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.036s	user 0.028s	sys 0.000s
I20260709 12:59:53.402668  2526 raft_consensus.cc:359] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:53.403311  2526 raft_consensus.cc:740] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:53.403808  2526 consensus_queue.cc:260] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:53.406342  2526 ts_tablet_manager.cc:1434] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:59:53.408643  1556 tablet_copy_service.cc:342] P d7158d6c3b634dc7abb69eac58eba291: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-6817bc4013144ede80163d16316d4860 received from {username='slave'} at 127.0.0.1:42858
I20260709 12:59:53.409040  2524 ts_tablet_manager.cc:933] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 12:59:53.409056  1556 tablet_copy_service.cc:434] P d7158d6c3b634dc7abb69eac58eba291: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-6817bc4013144ede80163d16316d4860 on tablet 6817bc4013144ede80163d16316d4860 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:53.411223  2524 tablet_copy_client.cc:323] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39981
I20260709 12:59:53.413175  1632 tablet_copy_service.cc:140] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Received BeginTabletCopySession request for tablet 9c6a5febc6e54b13a4ed0d342e7b7f8f from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50552)
I20260709 12:59:53.413666  1632 tablet_copy_service.cc:161] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Beginning new tablet copy session on tablet 9c6a5febc6e54b13a4ed0d342e7b7f8f from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50552: session id = e8a64798e5f94de8909707bcbd11804a-9c6a5febc6e54b13a4ed0d342e7b7f8f
I20260709 12:59:53.421156  1632 tablet_copy_source_session.cc:215] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:53.424674  2524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c6a5febc6e54b13a4ed0d342e7b7f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.443786  2524 tablet_copy_client.cc:806] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:53.444366  2524 tablet_copy_client.cc:670] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:53.450915  2524 tablet_copy_client.cc:538] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:53.459910  2524 tablet_bootstrap.cc:492] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:53.461031  2526 ts_tablet_manager.cc:933] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 12:59:53.469038  2526 tablet_copy_client.cc:323] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:41871
I20260709 12:59:53.471046  1556 tablet_copy_service.cc:140] P d7158d6c3b634dc7abb69eac58eba291: Received BeginTabletCopySession request for tablet b19a10a05aa24743a6d1222179fd4af4 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:42858)
I20260709 12:59:53.471580  1556 tablet_copy_service.cc:161] P d7158d6c3b634dc7abb69eac58eba291: Beginning new tablet copy session on tablet b19a10a05aa24743a6d1222179fd4af4 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:42858: session id = e8a64798e5f94de8909707bcbd11804a-b19a10a05aa24743a6d1222179fd4af4
I20260709 12:59:53.483126  1556 tablet_copy_source_session.cc:215] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:53.491972  2526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19a10a05aa24743a6d1222179fd4af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.498600  2524 tablet_bootstrap.cc:492] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:53.500623  2524 tablet_bootstrap.cc:492] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:53.501363  2524 ts_tablet_manager.cc:1403] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.005s
I20260709 12:59:53.504351  2524 raft_consensus.cc:359] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:53.505169  2524 raft_consensus.cc:740] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:53.505785  2524 consensus_queue.cc:260] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:53.510773  2524 ts_tablet_manager.cc:1434] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:59:53.512987  1632 tablet_copy_service.cc:342] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-9c6a5febc6e54b13a4ed0d342e7b7f8f received from {username='slave'} at 127.0.0.1:50552
I20260709 12:59:53.513441  1632 tablet_copy_service.cc:434] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-9c6a5febc6e54b13a4ed0d342e7b7f8f on tablet 9c6a5febc6e54b13a4ed0d342e7b7f8f with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:53.532524  2526 tablet_copy_client.cc:806] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:53.533157  2526 tablet_copy_client.cc:670] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:53.536804  2526 tablet_copy_client.cc:538] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:53.546795  2526 tablet_bootstrap.cc:492] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:53.566821  2526 tablet_bootstrap.cc:492] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:53.567761  2526 tablet_bootstrap.cc:492] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:53.568455  2526 ts_tablet_manager.cc:1403] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.008s
I20260709 12:59:53.571398  2526 raft_consensus.cc:359] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:53.572228  2526 raft_consensus.cc:740] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:53.572883  2526 consensus_queue.cc:260] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:53.575193  2526 ts_tablet_manager.cc:1434] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:59:53.577744  1556 tablet_copy_service.cc:342] P d7158d6c3b634dc7abb69eac58eba291: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-b19a10a05aa24743a6d1222179fd4af4 received from {username='slave'} at 127.0.0.1:42858
I20260709 12:59:53.578173  1556 tablet_copy_service.cc:434] P d7158d6c3b634dc7abb69eac58eba291: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-b19a10a05aa24743a6d1222179fd4af4 on tablet b19a10a05aa24743a6d1222179fd4af4 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:53.693933  2245 raft_consensus.cc:1217] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:53.838660  2245 raft_consensus.cc:1217] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:53.857043  2245 raft_consensus.cc:1217] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:53.899853  2245 raft_consensus.cc:1217] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:54.120993  2498 raft_consensus.cc:1064] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:54.122926  2498 consensus_queue.cc:237] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:54.128865  1690 raft_consensus.cc:1275] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.130545  2245 raft_consensus.cc:1275] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.130793  1614 raft_consensus.cc:1275] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.131319  2498 consensus_queue.cc:1048] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.132707  2504 consensus_queue.cc:1048] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.135104  2498 consensus_queue.cc:1048] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.154971  2504 raft_consensus.cc:2955] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.160043  2245 raft_consensus.cc:2955] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.160413  1614 raft_consensus.cc:2955] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.176759  1442 catalog_manager.cc:5697] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.182152  1690 raft_consensus.cc:2955] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.246418  1539 consensus_queue.cc:237] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:54.257478  2245 raft_consensus.cc:1275] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:54.258523  1614 raft_consensus.cc:1275] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:54.259995  2498 consensus_queue.cc:1048] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.260936  2537 consensus_queue.cc:1048] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.266772  2515 raft_consensus.cc:1064] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:54.269550  2499 raft_consensus.cc:2955] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.272053  2245 raft_consensus.cc:2955] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.275306  1617 raft_consensus.cc:2955] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.279508  2515 consensus_queue.cc:237] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:54.286936  1444 catalog_manager.cc:5697] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.292781  2504 raft_consensus.cc:1064] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:54.295162  2504 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:54.298203  1684 tablet_service.cc:1558] Processing DeleteTablet for tablet 6817bc4013144ede80163d16316d4860 with delete_type TABLET_DATA_TOMBSTONED (TS 822e08445eae4a33b2f2fe92060192c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45640
I20260709 12:59:54.306001  1429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6817bc4013144ede80163d16316d4860 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:54.307431  1690 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.308092  2245 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.309742  2537 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.311211  2498 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.317557  1614 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.319391  2504 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:54.331934  2547 tablet_replica.cc:333] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 12:59:54.333039  2547 raft_consensus.cc:2243] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:54.333845  2547 raft_consensus.cc:2272] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:54.347843  1691 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.349169  2471 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:59:54.353263  2547 ts_tablet_manager.cc:1916] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:54.367622  2245 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.369040  1539 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.372871  2471 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.375931  2536 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.413885  2245 raft_consensus.cc:2955] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.417366  2536 raft_consensus.cc:2955] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.431917  2547 ts_tablet_manager.cc:1929] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:54.432446  2547 log.cc:1199] T 6817bc4013144ede80163d16316d4860 P 822e08445eae4a33b2f2fe92060192c6: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root/wals/6817bc4013144ede80163d16316d4860
I20260709 12:59:54.447012  1444 catalog_manager.cc:5697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.453248  1431 catalog_manager.cc:5028] TS 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): tablet 6817bc4013144ede80163d16316d4860 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:54.477630  2499 raft_consensus.cc:1064] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:54.480225  2499 consensus_queue.cc:237] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:54.489233  2246 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.490828  2498 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.503695  1616 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.507936  2498 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.534094  1692 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.567651  2504 raft_consensus.cc:2955] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.581436  1616 raft_consensus.cc:2955] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.589071  1617 consensus_queue.cc:237] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:54.581321  1690 raft_consensus.cc:2955] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.596236  2246 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:54.598322  2515 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.606037  2471 raft_consensus.cc:2955] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.615944  2246 raft_consensus.cc:2955] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.623215  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9c6a5febc6e54b13a4ed0d342e7b7f8f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:54.652354  1692 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:54.652597  2537 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.594484  2245 raft_consensus.cc:2955] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.669202  1443 catalog_manager.cc:5697] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:54.672387  2536 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.683327  1692 raft_consensus.cc:2955] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.687618  1444 catalog_manager.cc:5697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.705147  2560 raft_consensus.cc:2955] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 12:59:54.708527  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 49900.6us
I20260709 12:59:54.761647  1531 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c6a5febc6e54b13a4ed0d342e7b7f8f with delete_type TABLET_DATA_TOMBSTONED (TS d7158d6c3b634dc7abb69eac58eba291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39608
W20260709 12:59:54.770428  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 68606.4us
I20260709 12:59:54.772652  2564 tablet_replica.cc:333] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 12:59:54.773627  2564 raft_consensus.cc:2243] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:54.774550  2564 pending_rounds.cc:70] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291: Trying to abort 1 pending ops.
I20260709 12:59:54.774816  2564 pending_rounds.cc:77] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305633768520986624 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } } }
I20260709 12:59:54.776114  2564 raft_consensus.cc:2917] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:59:54.776541  2564 raft_consensus.cc:2889] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:59:54.776892  2564 raft_consensus.cc:2272] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:54.781006  2564 ts_tablet_manager.cc:1916] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:54.780462  1616 raft_consensus.cc:2955] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.797915  1441 catalog_manager.cc:5697] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.810992  2245 raft_consensus.cc:2955] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.812383  2564 ts_tablet_manager.cc:1929] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:54.812880  2564 log.cc:1199] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P d7158d6c3b634dc7abb69eac58eba291: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root/wals/9c6a5febc6e54b13a4ed0d342e7b7f8f
I20260709 12:59:54.814396  1429 catalog_manager.cc:5028] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): tablet 9c6a5febc6e54b13a4ed0d342e7b7f8f (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:54.819597  1692 raft_consensus.cc:2955] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.829125  1690 raft_consensus.cc:2955] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.859103  1547 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:54.871758  2245 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:54.871759  1690 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:54.873346  2560 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.874379  2499 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.882519  2562 raft_consensus.cc:2955] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.887907  2245 raft_consensus.cc:2955] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.903160  1429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b19a10a05aa24743a6d1222179fd4af4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:54.911389  1442 catalog_manager.cc:5697] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:54.914276  1690 raft_consensus.cc:2955] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:54.926504  1606 tablet_service.cc:1558] Processing DeleteTablet for tablet b19a10a05aa24743a6d1222179fd4af4 with delete_type TABLET_DATA_TOMBSTONED (TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40006
I20260709 12:59:54.935776  2567 tablet_replica.cc:333] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 12:59:54.936798  2567 raft_consensus.cc:2243] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:54.937533  2567 raft_consensus.cc:2272] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:54.942466  2567 ts_tablet_manager.cc:1916] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:54.960680  2567 ts_tablet_manager.cc:1929] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:54.961440  2567 log.cc:1199] T b19a10a05aa24743a6d1222179fd4af4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root/wals/b19a10a05aa24743a6d1222179fd4af4
I20260709 12:59:54.962924  1430 catalog_manager.cc:5028] TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): tablet b19a10a05aa24743a6d1222179fd4af4 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:55.256844  1543 consensus_queue.cc:237] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:55.262574  2245 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:55.262647  1692 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:55.264436  2560 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:55.265446  2499 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:55.275010  2561 raft_consensus.cc:2955] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:55.277230  2245 raft_consensus.cc:2955] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:55.288923  1429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d351fa3549448eda026a66b8c124d58 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:55.294169  1442 catalog_manager.cc:5697] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:55.306139  1606 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d351fa3549448eda026a66b8c124d58 with delete_type TABLET_DATA_TOMBSTONED (TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40006
I20260709 12:59:55.307220  2567 tablet_replica.cc:333] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 12:59:55.308115  2567 raft_consensus.cc:2243] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:55.308590  2567 raft_consensus.cc:2272] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:55.311846  2567 ts_tablet_manager.cc:1916] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:55.320029  1690 raft_consensus.cc:2955] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:55.340540  2567 ts_tablet_manager.cc:1929] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:55.340902  2567 log.cc:1199] T 2d351fa3549448eda026a66b8c124d58 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root/wals/2d351fa3549448eda026a66b8c124d58
I20260709 12:59:55.342056  1430 catalog_manager.cc:5028] TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): tablet 2d351fa3549448eda026a66b8c124d58 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:56.637362  1693 consensus_queue.cc:237] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
W20260709 12:59:56.676975  1660 consensus_peers.cc:597] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13edebc31dfe4957b3870b909ea5330e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:56.677790  1614 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:56.683995  1542 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:56.688020  2571 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:56.691789  2571 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:56.698132  2570 raft_consensus.cc:2955] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:56.703964  1614 raft_consensus.cc:2955] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:56.707894  1542 raft_consensus.cc:2955] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:56.717428  1543 consensus_queue.cc:237] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:56.742004  1444 catalog_manager.cc:5697] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:56.749993  1693 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:59:56.752226  1511 consensus_peers.cc:597] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f7d1afbc98a49f3a48b32b8d2b9b646. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:56.752257  2561 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:56.755714  1614 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:56.756879  2561 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:56.761875  2573 raft_consensus.cc:2955] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:56.778721  1693 raft_consensus.cc:2955] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:56.783715  1614 raft_consensus.cc:2955] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:56.804253  1542 consensus_queue.cc:237] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:56.812602  1693 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:56.813522  1511 consensus_peers.cc:597] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 89f88fe569c2476cb298d5e6b745bb5c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:56.814292  1619 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:56.814229  2561 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:56.816120  2569 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:56.849179  2573 raft_consensus.cc:2955] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:56.852039  1619 raft_consensus.cc:2955] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:56.853360  1690 raft_consensus.cc:2955] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:56.855176  1442 catalog_manager.cc:5697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:56.863171  1693 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
W20260709 12:59:56.873039  1660 consensus_peers.cc:597] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a2222d3d1694f2d93fb2f0702805e3e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:56.873168  1619 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:56.874881  1542 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:56.875036  2571 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:56.876808  2570 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:56.885286  1444 catalog_manager.cc:5697] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:56.887312  2559 raft_consensus.cc:2955] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:56.889429  1542 raft_consensus.cc:2955] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:56.901134  1619 raft_consensus.cc:2955] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:56.922384  1444 catalog_manager.cc:5697] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 12:59:57.130077  2592 ts_tablet_manager.cc:933] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:57.132973  2592 tablet_copy_client.cc:323] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 12:59:57.135205  1706 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet 13edebc31dfe4957b3870b909ea5330e from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 12:59:57.135871  1706 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet 13edebc31dfe4957b3870b909ea5330e from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-13edebc31dfe4957b3870b909ea5330e
I20260709 12:59:57.143414  1706 tablet_copy_source_session.cc:215] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:57.147979  2592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13edebc31dfe4957b3870b909ea5330e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.166097  2592 tablet_copy_client.cc:806] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:57.166728  2592 tablet_copy_client.cc:670] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:57.172219  2592 tablet_copy_client.cc:538] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:57.180356  2592 tablet_bootstrap.cc:492] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:57.219305  2592 tablet_bootstrap.cc:492] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:57.220268  2592 tablet_bootstrap.cc:492] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:57.220949  2592 ts_tablet_manager.cc:1403] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.010s
I20260709 12:59:57.224041  2592 raft_consensus.cc:359] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:57.224874  2592 raft_consensus.cc:740] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:57.225584  2592 consensus_queue.cc:260] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:57.235697  2592 ts_tablet_manager.cc:1434] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.003s
I20260709 12:59:57.240126  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-13edebc31dfe4957b3870b909ea5330e received from {username='slave'} at 127.0.0.1:50480
I20260709 12:59:57.240633  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-13edebc31dfe4957b3870b909ea5330e on tablet 13edebc31dfe4957b3870b909ea5330e with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:57.360656  2592 ts_tablet_manager.cc:933] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 12:59:57.362591  2592 tablet_copy_client.cc:323] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:41871
I20260709 12:59:57.363659  2596 ts_tablet_manager.cc:933] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 12:59:57.364406  1556 tablet_copy_service.cc:140] P d7158d6c3b634dc7abb69eac58eba291: Received BeginTabletCopySession request for tablet 89f88fe569c2476cb298d5e6b745bb5c from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:42858)
I20260709 12:59:57.364959  1556 tablet_copy_service.cc:161] P d7158d6c3b634dc7abb69eac58eba291: Beginning new tablet copy session on tablet 89f88fe569c2476cb298d5e6b745bb5c from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:42858: session id = e8a64798e5f94de8909707bcbd11804a-89f88fe569c2476cb298d5e6b745bb5c
I20260709 12:59:57.367391  2596 tablet_copy_client.cc:323] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:41871
I20260709 12:59:57.368875  1557 tablet_copy_service.cc:140] P d7158d6c3b634dc7abb69eac58eba291: Received BeginTabletCopySession request for tablet 4f7d1afbc98a49f3a48b32b8d2b9b646 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:42858)
I20260709 12:59:57.369349  1557 tablet_copy_service.cc:161] P d7158d6c3b634dc7abb69eac58eba291: Beginning new tablet copy session on tablet 4f7d1afbc98a49f3a48b32b8d2b9b646 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:42858: session id = e8a64798e5f94de8909707bcbd11804a-4f7d1afbc98a49f3a48b32b8d2b9b646
I20260709 12:59:57.372959  1556 tablet_copy_source_session.cc:215] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:57.376310  2592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f88fe569c2476cb298d5e6b745bb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.378203  1557 tablet_copy_source_session.cc:215] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:57.381807  2596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7d1afbc98a49f3a48b32b8d2b9b646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.396018  2592 tablet_copy_client.cc:806] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:57.396672  2592 tablet_copy_client.cc:670] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:57.397552  2596 tablet_copy_client.cc:806] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:57.398072  2596 tablet_copy_client.cc:670] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:57.401149  2592 tablet_copy_client.cc:538] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:57.402493  2596 tablet_copy_client.cc:538] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:57.410554  2592 tablet_bootstrap.cc:492] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:57.413089  2596 tablet_bootstrap.cc:492] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:57.414044  2599 ts_tablet_manager.cc:933] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 12:59:57.433614  2599 tablet_copy_client.cc:323] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 12:59:57.439518  1706 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet 1a2222d3d1694f2d93fb2f0702805e3e from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 12:59:57.439669  2592 tablet_bootstrap.cc:492] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:57.440094  1706 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet 1a2222d3d1694f2d93fb2f0702805e3e from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-1a2222d3d1694f2d93fb2f0702805e3e
I20260709 12:59:57.440701  2592 tablet_bootstrap.cc:492] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:57.441385  2592 ts_tablet_manager.cc:1403] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.031s	user 0.024s	sys 0.005s
I20260709 12:59:57.445369  2592 raft_consensus.cc:359] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:57.446462  2592 raft_consensus.cc:740] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:57.447832  2592 consensus_queue.cc:260] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:57.451301  2592 ts_tablet_manager.cc:1434] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 12:59:57.455197  1557 tablet_copy_service.cc:342] P d7158d6c3b634dc7abb69eac58eba291: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-89f88fe569c2476cb298d5e6b745bb5c received from {username='slave'} at 127.0.0.1:42858
I20260709 12:59:57.455673  1557 tablet_copy_service.cc:434] P d7158d6c3b634dc7abb69eac58eba291: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-89f88fe569c2476cb298d5e6b745bb5c on tablet 89f88fe569c2476cb298d5e6b745bb5c with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:57.457732  2596 tablet_bootstrap.cc:492] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:57.458194  1706 tablet_copy_source_session.cc:215] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:57.458652  2596 tablet_bootstrap.cc:492] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:57.459371  2596 ts_tablet_manager.cc:1403] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.047s	user 0.027s	sys 0.008s
I20260709 12:59:57.462356  2596 raft_consensus.cc:359] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:57.465967  2596 raft_consensus.cc:740] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:57.466620  2596 consensus_queue.cc:260] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:57.469236  2599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2222d3d1694f2d93fb2f0702805e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.469338  2596 ts_tablet_manager.cc:1434] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:59:57.471856  1557 tablet_copy_service.cc:342] P d7158d6c3b634dc7abb69eac58eba291: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-4f7d1afbc98a49f3a48b32b8d2b9b646 received from {username='slave'} at 127.0.0.1:42858
I20260709 12:59:57.472214  1557 tablet_copy_service.cc:434] P d7158d6c3b634dc7abb69eac58eba291: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-4f7d1afbc98a49f3a48b32b8d2b9b646 on tablet 4f7d1afbc98a49f3a48b32b8d2b9b646 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 12:59:57.487388  2599 tablet_copy_client.cc:806] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:57.487951  2599 tablet_copy_client.cc:670] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:57.495365  2599 tablet_copy_client.cc:538] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:57.505527  2599 tablet_bootstrap.cc:492] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 12:59:57.522522  2599 tablet_bootstrap.cc:492] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:57.523298  2599 tablet_bootstrap.cc:492] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 12:59:57.523910  2599 ts_tablet_manager.cc:1403] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.004s
I20260709 12:59:57.526309  2599 raft_consensus.cc:359] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:57.526947  2599 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 12:59:57.527535  2599 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 12:59:57.530558  2599 ts_tablet_manager.cc:1434] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:59:57.533414  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-1a2222d3d1694f2d93fb2f0702805e3e received from {username='slave'} at 127.0.0.1:50480
I20260709 12:59:57.533805  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-1a2222d3d1694f2d93fb2f0702805e3e on tablet 1a2222d3d1694f2d93fb2f0702805e3e with peer e8a64798e5f94de8909707bcbd11804a
W20260709 12:59:57.644943  2267 debug-util.cc:398] Leaking SignalData structure 0x7b08002725c0 after lost signal to thread 434
W20260709 12:59:57.646042  2267 debug-util.cc:398] Leaking SignalData structure 0x7b08000d85e0 after lost signal to thread 1479
W20260709 12:59:57.647176  2267 debug-util.cc:398] Leaking SignalData structure 0x7b0800040dc0 after lost signal to thread 1571
W20260709 12:59:57.648211  2267 debug-util.cc:398] Leaking SignalData structure 0x7b080022a8e0 after lost signal to thread 1646
W20260709 12:59:57.649226  2267 debug-util.cc:398] Leaking SignalData structure 0x7b08002d44a0 after lost signal to thread 1720
W20260709 12:59:57.650322  2267 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe260 after lost signal to thread 2270
I20260709 12:59:57.702523  2246 raft_consensus.cc:1217] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:57.852290  2245 raft_consensus.cc:1217] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:57.951427  2245 raft_consensus.cc:1217] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:59:57.980178  2245 raft_consensus.cc:1217] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:58.111716  2571 raft_consensus.cc:1064] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:58.114500  2571 consensus_queue.cc:237] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:58.135026  2245 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:58.135593  1619 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:58.137589  2604 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:58.139979  1542 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:58.142939  2604 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:58.153028  2604 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:58.174623  2570 raft_consensus.cc:2955] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.176502  2246 raft_consensus.cc:2955] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.189595  1543 raft_consensus.cc:2955] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.214011  1619 raft_consensus.cc:2955] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.222426  1441 catalog_manager.cc:5697] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.278960  1690 consensus_queue.cc:237] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:58.289599  1614 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:58.290025  2244 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:58.292428  2571 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:58.296641  2604 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:58.306231  2559 raft_consensus.cc:2955] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.318324  1619 raft_consensus.cc:2955] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.338604  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 13edebc31dfe4957b3870b909ea5330e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:58.328759  2246 raft_consensus.cc:2955] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.351169  1444 catalog_manager.cc:5697] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:58.384997  1531 tablet_service.cc:1558] Processing DeleteTablet for tablet 13edebc31dfe4957b3870b909ea5330e with delete_type TABLET_DATA_TOMBSTONED (TS d7158d6c3b634dc7abb69eac58eba291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39608
I20260709 12:59:58.391324  2614 tablet_replica.cc:333] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 12:59:58.392771  2614 raft_consensus.cc:2243] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.393612  2614 raft_consensus.cc:2272] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.397220  2614 ts_tablet_manager.cc:1916] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:58.400480  2561 raft_consensus.cc:1064] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:58.402868  2561 consensus_queue.cc:237] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:58.415686  2614 ts_tablet_manager.cc:1929] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:58.416566  2614 log.cc:1199] T 13edebc31dfe4957b3870b909ea5330e P d7158d6c3b634dc7abb69eac58eba291: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root/wals/13edebc31dfe4957b3870b909ea5330e
I20260709 12:59:58.419054  1429 catalog_manager.cc:5028] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): tablet 13edebc31dfe4957b3870b909ea5330e (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:58.437681  2573 raft_consensus.cc:1064] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:58.440263  2573 consensus_queue.cc:237] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:58.448271  1690 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:58.450551  2244 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 2 LEARNER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:58.452580  2569 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:58.455410  2569 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:58.462349  1619 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:58.465677  2569 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:58.486068  1693 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:58.486318  2246 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:58.489599  2573 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:58.492194  1616 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:58.496692  2618 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:58.497704  2617 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:58.523759  2573 raft_consensus.cc:2955] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.527417  1690 raft_consensus.cc:2955] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.531167  1619 raft_consensus.cc:2955] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.545073  2618 raft_consensus.cc:2955] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.547825  1618 raft_consensus.cc:2955] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.550592  2244 raft_consensus.cc:2955] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.558494  1693 raft_consensus.cc:2955] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.564388  2604 raft_consensus.cc:1064] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 12:59:58.574038  1442 catalog_manager.cc:5697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.570412  1444 catalog_manager.cc:5697] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:58.581604  2604 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:58.701711  2244 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:58.703516  2571 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:59:58.741674  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 159480us
I20260709 12:59:58.826443  1541 consensus_queue.cc:237] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:58.840530  1616 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:58.842978  2630 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:58.849210  2244 raft_consensus.cc:2955] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.866474  1542 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:58.869140  1618 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:58.905061  2604 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:58.908667  2245 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:58.930200  2573 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:58.968178  1543 consensus_queue.cc:237] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:58.982802  2244 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:58.982780  2245 raft_consensus.cc:2955] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:58.983805  1613 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:59:58.984656  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 59093.8us
I20260709 12:59:58.985145  2573 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:59.028573  2569 raft_consensus.cc:2955] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:59.041206  2618 raft_consensus.cc:2955] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:59.050753  2559 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:59.050999  1429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 89f88fe569c2476cb298d5e6b745bb5c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:59.060343  2244 raft_consensus.cc:2955] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:59.063068  2625 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:59.071770  1441 catalog_manager.cc:5697] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:59.078528  1613 raft_consensus.cc:2955] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:59.080941  2571 raft_consensus.cc:2955] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:59.084273  1429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4f7d1afbc98a49f3a48b32b8d2b9b646 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:59.099040  1442 catalog_manager.cc:5697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New cstate: current_term: 2 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:59.117826  1616 raft_consensus.cc:2955] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:59.163627  1441 catalog_manager.cc:5697] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:59.187698  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 108769us
I20260709 12:59:59.202766  1684 tablet_service.cc:1558] Processing DeleteTablet for tablet 89f88fe569c2476cb298d5e6b745bb5c with delete_type TABLET_DATA_TOMBSTONED (TS 822e08445eae4a33b2f2fe92060192c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45640
I20260709 12:59:59.202275  2244 raft_consensus.cc:2955] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:59.210608  1686 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f7d1afbc98a49f3a48b32b8d2b9b646 with delete_type TABLET_DATA_TOMBSTONED (TS 822e08445eae4a33b2f2fe92060192c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45640
I20260709 12:59:59.221109  1621 raft_consensus.cc:2955] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:59.238005  2638 tablet_replica.cc:333] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 12:59:59.239161  2638 raft_consensus.cc:2243] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:59.247819  2638 raft_consensus.cc:2272] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:59.260179  2638 ts_tablet_manager.cc:1916] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:59.274127  1541 raft_consensus.cc:2955] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:59.285097  2638 ts_tablet_manager.cc:1929] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:59.285772  2638 log.cc:1199] T 89f88fe569c2476cb298d5e6b745bb5c P 822e08445eae4a33b2f2fe92060192c6: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root/wals/89f88fe569c2476cb298d5e6b745bb5c
I20260709 12:59:59.285012  1692 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 12:59:59.289659  2638 tablet_replica.cc:333] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 12:59:59.290632  1431 catalog_manager.cc:5028] TS 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): tablet 89f88fe569c2476cb298d5e6b745bb5c (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:59.290987  2638 raft_consensus.cc:2243] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:59.291802  2638 raft_consensus.cc:2272] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:59.297339  2244 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:59.300568  2613 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:59.309502  2571 raft_consensus.cc:2955] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:59.312191  1543 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:59.320118  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1a2222d3d1694f2d93fb2f0702805e3e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:59.322523  2244 raft_consensus.cc:2955] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:59.336918  2571 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:59.354970  1543 raft_consensus.cc:2955] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 12:59:59.370889  2638 ts_tablet_manager.cc:1916] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:59.383744  1441 catalog_manager.cc:5697] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.402899  1606 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a2222d3d1694f2d93fb2f0702805e3e with delete_type TABLET_DATA_TOMBSTONED (TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40006
I20260709 12:59:59.414515  2639 tablet_replica.cc:333] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 12:59:59.416147  2639 raft_consensus.cc:2243] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:59.416860  2639 raft_consensus.cc:2272] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:59.421172  2639 ts_tablet_manager.cc:1916] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:59.437322  2639 ts_tablet_manager.cc:1929] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:59.438265  2639 log.cc:1199] T 1a2222d3d1694f2d93fb2f0702805e3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root/wals/1a2222d3d1694f2d93fb2f0702805e3e
I20260709 12:59:59.440171  1430 catalog_manager.cc:5028] TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): tablet 1a2222d3d1694f2d93fb2f0702805e3e (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 12:59:59.441229  2638 ts_tablet_manager.cc:1929] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:59:59.441740  2638 log.cc:1199] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P 822e08445eae4a33b2f2fe92060192c6: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root/wals/4f7d1afbc98a49f3a48b32b8d2b9b646
I20260709 12:59:59.443264  1431 catalog_manager.cc:5028] TS 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): tablet 4f7d1afbc98a49f3a48b32b8d2b9b646 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
W20260709 12:59:59.757614  1643 debug-util.cc:398] Leaking SignalData structure 0x7b08000a2a60 after lost signal to thread 434
W20260709 12:59:59.758518  1643 debug-util.cc:398] Leaking SignalData structure 0x7b08000da5a0 after lost signal to thread 1479
W20260709 12:59:59.759485  1643 debug-util.cc:398] Leaking SignalData structure 0x7b08002979a0 after lost signal to thread 1571
W20260709 12:59:59.760388  1643 debug-util.cc:398] Leaking SignalData structure 0x7b080029cbc0 after lost signal to thread 1646
W20260709 12:59:59.761263  1643 debug-util.cc:398] Leaking SignalData structure 0x7b0800212340 after lost signal to thread 1720
W20260709 12:59:59.762068  1643 debug-util.cc:398] Leaking SignalData structure 0x7b08002a34e0 after lost signal to thread 2270
I20260709 13:00:00.513098  1692 consensus_queue.cc:237] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
W20260709 13:00:00.559463  1660 consensus_peers.cc:597] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5871ff5fd9c4673b5650490648edf26. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:00.578250  1541 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:00.580487  2636 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:00.582166  1617 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:00.598027  2636 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:00.647512  1619 raft_consensus.cc:2955] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:00.646147  2636 raft_consensus.cc:2955] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:00.679630  1542 raft_consensus.cc:2955] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:00.685312  1441 catalog_manager.cc:5697] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:00.718607  1692 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
W20260709 13:00:00.756417  1660 consensus_peers.cc:597] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4270ae85dd544aeb602acb371def068. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:00.757270  1619 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:00.758040  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 52864.7us
I20260709 13:00:00.762090  1539 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:00.764490  2645 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:00.766357  2649 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:00.820967  2645 raft_consensus.cc:2955] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:00.835878  1621 raft_consensus.cc:2955] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:00.840119  1694 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:00.912949  1542 raft_consensus.cc:2955] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:00.980420  1442 catalog_manager.cc:5697] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:00.994199  1619 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:01.010998  2636 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:01.022297  1539 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:01.047271  1660 consensus_peers.cc:597] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 520ee35af44d4a529e945654996352cc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:01.054522  2666 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:00:01.097822  2670 ts_tablet_manager.cc:933] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:01.122761  2649 raft_consensus.cc:2955] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:01.125306  1543 raft_consensus.cc:2955] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:01.128077  1621 raft_consensus.cc:2955] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:01.136888  2670 tablet_copy_client.cc:323] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 13:00:01.138793  1706 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet b5871ff5fd9c4673b5650490648edf26 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 13:00:01.139411  1706 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet b5871ff5fd9c4673b5650490648edf26 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-b5871ff5fd9c4673b5650490648edf26
I20260709 13:00:01.147599  1706 tablet_copy_source_session.cc:215] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:01.148706  1444 catalog_manager.cc:5697] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:01.156440  2670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5871ff5fd9c4673b5650490648edf26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:01.177770  1543 consensus_queue.cc:237] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:01.269858  2670 tablet_copy_client.cc:806] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:01.270607  2670 tablet_copy_client.cc:670] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:01.290553  2670 tablet_copy_client.cc:538] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:01.299775  2670 tablet_bootstrap.cc:492] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:00:01.325673  1621 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:01.331401  1694 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:01.332319  1511 consensus_peers.cc:597] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa1a194f4d834ee6aa037d727b8f9e2a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:01.337742  2670 tablet_bootstrap.cc:492] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:01.339326  2670 tablet_bootstrap.cc:492] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:00:01.340205  2670 ts_tablet_manager.cc:1403] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.010s
I20260709 13:00:01.341606  2651 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:01.343724  2670 raft_consensus.cc:359] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:01.344792  2670 raft_consensus.cc:740] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:00:01.345558  2670 consensus_queue.cc:260] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:01.347165  2651 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:01.357744  2670 ts_tablet_manager.cc:1434] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.007s
I20260709 13:00:01.371822  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-b5871ff5fd9c4673b5650490648edf26 received from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:01.372278  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-b5871ff5fd9c4673b5650490648edf26 on tablet b5871ff5fd9c4673b5650490648edf26 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:01.384816  2670 ts_tablet_manager.cc:933] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:01.393214  2670 tablet_copy_client.cc:323] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 13:00:01.392417  2650 raft_consensus.cc:2955] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:01.396790  1706 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet c4270ae85dd544aeb602acb371def068 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 13:00:01.397420  1706 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet c4270ae85dd544aeb602acb371def068 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-c4270ae85dd544aeb602acb371def068
I20260709 13:00:01.403959  1690 raft_consensus.cc:2955] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:01.407285  1621 raft_consensus.cc:2955] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:01.409760  1706 tablet_copy_source_session.cc:215] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:01.428380  2670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4270ae85dd544aeb602acb371def068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:01.436951  1444 catalog_manager.cc:5697] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:01.506652  2670 tablet_copy_client.cc:806] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:01.507361  2670 tablet_copy_client.cc:670] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:01.515125  2670 tablet_copy_client.cc:538] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:01.546334  2670 tablet_bootstrap.cc:492] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:00:01.617812  2679 ts_tablet_manager.cc:933] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:01.656566  2241 raft_consensus.cc:1217] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:01.662003  2670 tablet_bootstrap.cc:492] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:01.665930  2679 tablet_copy_client.cc:323] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 13:00:01.668444  1706 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet 520ee35af44d4a529e945654996352cc from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 13:00:01.669008  1706 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet 520ee35af44d4a529e945654996352cc from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-520ee35af44d4a529e945654996352cc
I20260709 13:00:01.671823  2670 tablet_bootstrap.cc:492] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:00:01.676669  2670 ts_tablet_manager.cc:1403] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.131s	user 0.023s	sys 0.009s
I20260709 13:00:01.677423  1706 tablet_copy_source_session.cc:215] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:01.697898  2679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520ee35af44d4a529e945654996352cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:01.724319  2670 raft_consensus.cc:359] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:01.739048  2670 raft_consensus.cc:740] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:00:01.741300  2670 consensus_queue.cc:260] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:01.758451  2670 ts_tablet_manager.cc:1434] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.071s	user 0.003s	sys 0.003s
I20260709 13:00:01.760576  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-c4270ae85dd544aeb602acb371def068 received from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:01.761318  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-c4270ae85dd544aeb602acb371def068 on tablet c4270ae85dd544aeb602acb371def068 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:01.760496  2679 tablet_copy_client.cc:806] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:01.766412  2679 tablet_copy_client.cc:670] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:01.780364  2679 tablet_copy_client.cc:538] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:01.825066  2670 ts_tablet_manager.cc:933] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 13:00:01.825258  2679 tablet_bootstrap.cc:492] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:00:01.858070  2244 raft_consensus.cc:1217] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:01.870088  2670 tablet_copy_client.cc:323] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:41871
I20260709 13:00:01.871837  1557 tablet_copy_service.cc:140] P d7158d6c3b634dc7abb69eac58eba291: Received BeginTabletCopySession request for tablet fa1a194f4d834ee6aa037d727b8f9e2a from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:42858)
I20260709 13:00:01.872365  1557 tablet_copy_service.cc:161] P d7158d6c3b634dc7abb69eac58eba291: Beginning new tablet copy session on tablet fa1a194f4d834ee6aa037d727b8f9e2a from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:42858: session id = e8a64798e5f94de8909707bcbd11804a-fa1a194f4d834ee6aa037d727b8f9e2a
I20260709 13:00:01.890995  2679 tablet_bootstrap.cc:492] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:01.892050  2679 tablet_bootstrap.cc:492] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:00:01.892765  2679 ts_tablet_manager.cc:1403] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.068s	user 0.018s	sys 0.006s
I20260709 13:00:01.895875  2679 raft_consensus.cc:359] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:01.896705  2679 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:00:01.897365  2679 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:01.899767  2679 ts_tablet_manager.cc:1434] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:00:01.910045  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-520ee35af44d4a529e945654996352cc received from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:01.910537  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-520ee35af44d4a529e945654996352cc on tablet 520ee35af44d4a529e945654996352cc with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:01.921602  1557 tablet_copy_source_session.cc:215] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:01.933267  2670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1a194f4d834ee6aa037d727b8f9e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:01.973110  2670 tablet_copy_client.cc:806] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:01.973779  2670 tablet_copy_client.cc:670] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:02.035113   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:02.123647  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 49566.3us
I20260709 13:00:02.130229  2670 tablet_copy_client.cc:538] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:02.150081  2670 tablet_bootstrap.cc:492] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
W20260709 13:00:02.174994  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 50132.8us
I20260709 13:00:02.288234  2246 raft_consensus.cc:1217] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:00:02.299592  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 77423.7us
W20260709 13:00:02.419272  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 89756.3us
W20260709 13:00:02.439457  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 115833us
W20260709 13:00:02.600513  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 160291us
I20260709 13:00:02.783494  2670 tablet_bootstrap.cc:492] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:02.784756  2670 tablet_bootstrap.cc:492] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:00:02.785669  2670 ts_tablet_manager.cc:1403] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.636s	user 0.046s	sys 0.013s
I20260709 13:00:02.830588  2693 raft_consensus.cc:1064] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:00:02.833752  2693 consensus_queue.cc:237] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:02.836153  2670 raft_consensus.cc:359] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:02.842341  1694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1365c85d063446a6a6a589798b355741"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:02.843937  1694 raft_consensus.cc:606] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:02.845299  2670 raft_consensus.cc:740] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:00:02.845973  2670 consensus_queue.cc:260] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:02.846982  1694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:02.847640  1694 raft_consensus.cc:606] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:02.850770  1694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:02.851475  1694 raft_consensus.cc:606] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:02.854660  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:02.855316  1691 raft_consensus.cc:606] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:02.864926  2670 ts_tablet_manager.cc:1434] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.005s
I20260709 13:00:02.904789  2716 raft_consensus.cc:1064] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:00:02.910413  2636 raft_consensus.cc:993] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:02.907136  2716 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:02.911585  2636 raft_consensus.cc:1081] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:02.924404  2722 raft_consensus.cc:993] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:02.924865  2728 raft_consensus.cc:1064] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:00:02.924913  2722 raft_consensus.cc:1081] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:02.927111  1621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:40034
I20260709 13:00:02.927949  1621 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:02.928385  1621 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:02.928921  2728 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:02.938903  2713 raft_consensus.cc:993] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:02.939450  2722 raft_consensus.cc:1081] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:02.939611  2246 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:02.941222  2713 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:00:02.945217  1613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:40034
I20260709 13:00:02.945730  1613 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:02.946043  1613 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:02.948927  1619 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:02.950848  1618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:40034
I20260709 13:00:02.952481  1618 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:02.952896  1618 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:02.953122  2693 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:02.944360  1621 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:02.958616  1619 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:02.969000  1613 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:02.976461  2693 consensus_queue.cc:1059] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:00:02.977908  2636 raft_consensus.cc:3055] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:02.978310  2636 raft_consensus.cc:740] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:02.979156  2636 consensus_queue.cc:260] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:02.980592  2636 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:02.993422  1618 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:02.999166  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.039793  1621 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:03.044801  1613 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:03.092756  1557 tablet_copy_service.cc:342] P d7158d6c3b634dc7abb69eac58eba291: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-fa1a194f4d834ee6aa037d727b8f9e2a received from {username='slave'} at 127.0.0.1:42858
I20260709 13:00:03.095387  1557 tablet_copy_service.cc:434] P d7158d6c3b634dc7abb69eac58eba291: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-fa1a194f4d834ee6aa037d727b8f9e2a on tablet fa1a194f4d834ee6aa037d727b8f9e2a with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:03.096547  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:03.087968  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:03.097376  1618 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:03.098415  1542 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:03.099138  2241 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:03.088932  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:03.101449  1541 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:03.089684  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:03.102964  1690 raft_consensus.cc:3055] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:03.103294  1690 raft_consensus.cc:740] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:03.101135  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:03.097970  1694 raft_consensus.cc:3055] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:03.087113  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:03.105060  1539 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:03.108042  1543 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:03.113674  1690 consensus_queue.cc:260] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:03.114712  1690 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:03.106490  1694 raft_consensus.cc:740] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:03.130815  1542 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
W20260709 13:00:03.144949  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.138029  2665 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:03.151516  2246 raft_consensus.cc:1217] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:03.130030  1694 consensus_queue.cc:260] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:03.167069  1694 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:03.154485  1541 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:03.153817  1539 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:03.175640  1543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:34424
I20260709 13:00:03.180575  1543 raft_consensus.cc:606] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Received request to transfer leadership to TS dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:03.196830  1619 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:03.198661  1585 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:03.199944  1585 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:03.184304  1690 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:03.202445  1691 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:03.203615  2636 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:03.189199  2665 raft_consensus.cc:2955] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:03.202733  1619 raft_consensus.cc:2955] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:03.201524  2721 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:03.219650  2721 raft_consensus.cc:697] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:03.224005  1614 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:03.228194  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:03.229028  1690 raft_consensus.cc:606] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:03.228404  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:03.232167   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:03.236925   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:03.242642  1542 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:03.221031  2721 consensus_queue.cc:237] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:03.251124  1539 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:03.264151  2246 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:03.266131  2698 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:03.249614  2713 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:00:03.297148  2636 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:03.270656  2698 raft_consensus.cc:697] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:03.319300  2702 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:03.319945  2702 raft_consensus.cc:697] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:03.320948  2702 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:03.329916  2688 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:00:03.314301  2697 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:00:03.339372  2705 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:00:03.377511  1694 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:03.380404  2698 consensus_queue.cc:237] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:03.396189  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 48647us
I20260709 13:00:03.437644  2691 raft_consensus.cc:2955] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:03.455994  2730 raft_consensus.cc:993] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291: : Instructing follower dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:03.457454  2696 raft_consensus.cc:1081] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Signalling peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:03.486428  1441 catalog_manager.cc:5697] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:03.536775  1620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:40022
I20260709 13:00:03.538007  1620 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:03.538388  1620 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:03.588084  1543 raft_consensus.cc:2955] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:00:03.596591  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 181364us
I20260709 13:00:03.604826  1541 raft_consensus.cc:2955] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:03.633363  1620 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:03.647449  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:03.648105  1542 raft_consensus.cc:3055] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:03.648391  1542 raft_consensus.cc:740] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:03.649194  1542 consensus_queue.cc:260] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:03.649554  1620 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:03.650256  1542 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:03.655397  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 57941.1us
I20260709 13:00:03.657429  1542 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:03.659572  2705 raft_consensus.cc:2955] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:03.663676  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:03.664268  1694 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:03.680920  1694 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:03.682178  1585 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:03.688215  2702 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:03.688719  2702 raft_consensus.cc:697] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:03.683023  2241 raft_consensus.cc:2955] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:03.688448  1620 raft_consensus.cc:2955] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:03.690049  2702 consensus_queue.cc:237] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:03.693753  1442 catalog_manager.cc:5697] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 1 to 2, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:03.685612  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 81694.4us
I20260709 13:00:03.708175  1541 raft_consensus.cc:2955] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:03.721622  2728 raft_consensus.cc:993] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:03.722146  2728 raft_consensus.cc:1081] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:03.726748  2696 raft_consensus.cc:1064] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:00:03.729400  2696 consensus_queue.cc:237] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:03.764816  2244 raft_consensus.cc:2955] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:03.768571  1614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1365c85d063446a6a6a589798b355741"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:40034
I20260709 13:00:03.769349  1614 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:03.769795  1614 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:03.776075  2246 raft_consensus.cc:2955] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:03.787412  1541 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:03.788936  2695 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:03.796399  2723 raft_consensus.cc:993] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:03.785495  1618 raft_consensus.cc:2955] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:03.819820  2728 raft_consensus.cc:1081] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:03.827898  1614 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:03.834945  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 53408us
I20260709 13:00:03.845067  1614 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:03.848295  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:03.849468  1694 raft_consensus.cc:3055] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:03.849807  1694 raft_consensus.cc:740] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:03.867197  1693 consensus_queue.cc:237] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:03.873971  1619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:40034
I20260709 13:00:03.874538  1619 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:03.874897  1619 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:03.881114  1694 consensus_queue.cc:260] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:03.882635  1694 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:03.884434  1693 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:03.892834  1620 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:03.901161  1616 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:03.911708  1613 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:03.913379  1619 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:03.916057  1619 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:03.917583  2718 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:00:03.930203  2246 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:03.931463  2719 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:00:03.940711  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:03.941536  1690 raft_consensus.cc:3055] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:03.941880  1690 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:03.943153  1693 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:03.922143  1441 catalog_manager.cc:5697] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:03.957103  1694 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:03.953325  1441 catalog_manager.cc:5697] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:03.965912  1690 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:03.966818  1690 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:03.967554  2705 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:00:03.987648  1690 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:03.969731  2698 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 13:00:03.989910  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 160178us
I20260709 13:00:03.993779  1693 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:03.987576  2241 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:03.988570  2690 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:00:04.016302  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:04.016804  1541 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:04.025363  1541 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:04.020228  1587 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:04.039189  2730 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:00:04.039784  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 76543us
I20260709 13:00:04.050896  1690 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:04.058434  1444 catalog_manager.cc:5697] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 1 to 2, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:04.060815  1444 catalog_manager.cc:5697] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 1 to 2, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:04.063743  1541 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:04.063475  1444 catalog_manager.cc:5697] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 1 to 2, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:04.042529  2698 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:04.069414  2698 raft_consensus.cc:697] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:04.069624  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:04.070730  1541 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:04.071220  2698 consensus_queue.cc:237] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:04.077268  1587 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:04.081324  1540 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:04.088698  1690 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:04.089246  2696 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:04.093060  2702 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:04.096781  1541 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:04.120610  2636 raft_consensus.cc:2955] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:04.114187  2768 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:00:04.135846  1691 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:04.140491  1619 raft_consensus.cc:2955] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:04.132005  2721 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:04.152753  2246 raft_consensus.cc:2955] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:04.110503  2695 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 13:00:04.164494  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 65137.3us
I20260709 13:00:04.215552  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b5871ff5fd9c4673b5650490648edf26 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:04.219226  2702 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:00:04.277285  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 71057.8us
W20260709 13:00:04.288239  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 75431.3us
I20260709 13:00:04.295584  1539 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:04.299070  1540 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:04.301244  1619 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:04.301461  2246 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:04.302213  1693 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:04.305111  2240 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:00:04.398577  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 98278us
W20260709 13:00:04.414043  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 96765us
I20260709 13:00:04.416056  2246 raft_consensus.cc:2955] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:04.293493  2702 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:04.440744  2720 raft_consensus.cc:2955] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:00:04.473224  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 43894.9us
I20260709 13:00:04.460700  2767 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:00:04.542022  2773 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:00:04.480052  2723 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:00:04.559041  2636 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:04.412043   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:04.652758  1441 catalog_manager.cc:5697] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:04.696902  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 67609.7us
I20260709 13:00:04.697513  1443 catalog_manager.cc:5697] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:04.772236  1692 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:00:04.772467  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 329546us
W20260709 13:00:04.777635  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 304429us
W20260709 13:00:04.821761  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 350269us
I20260709 13:00:04.786345  2649 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:00:04.821950  1531 tablet_service.cc:1558] Processing DeleteTablet for tablet b5871ff5fd9c4673b5650490648edf26 with delete_type TABLET_DATA_TOMBSTONED (TS d7158d6c3b634dc7abb69eac58eba291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39608
I20260709 13:00:04.859283  2705 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:04.855831  1620 raft_consensus.cc:2955] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:04.845932  2774 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:00:04.992063  1542 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:04.999532  1540 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:00:05.006496  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 143776us
I20260709 13:00:05.047945   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:05.069375  1539 consensus_queue.cc:237] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:05.092435  1613 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:05.101711  2245 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:00:05.111618  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 62961.2us
I20260709 13:00:05.113503  2726 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:05.114287  2726 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:05.122577  2798 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:00:05.128364  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 44321.1us
I20260709 13:00:05.127164  1690 raft_consensus.cc:2955] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:05.120855  2726 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:05.164259  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:05.101711  2695 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:00:05.179015  2784 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:00:05.194274  2795 tablet_replica.cc:333] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:00:05.195809  2795 raft_consensus.cc:2243] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:05.196604  2795 raft_consensus.cc:2272] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:05.220752  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:05.243093  2797 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:00:05.252615  1691 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:05.260800  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:05.264427  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 73661.2us
I20260709 13:00:05.268311  2776 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.191s
I20260709 13:00:05.292739  2719 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:05.307389  2788 raft_consensus.cc:2955] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:05.333786  2807 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:05.334614  2807 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:05.339476  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:05.341588  2807 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:05.349342  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:05.354010  2795 ts_tablet_manager.cc:1916] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:00:05.361290  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 181088us
W20260709 13:00:05.383617  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 117765us
W20260709 13:00:05.420158  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 250646us
I20260709 13:00:05.437597  1586 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:05.442144  2791 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:05.482007  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 308985us
W20260709 13:00:05.496397  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.497964  1511 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:05.506313  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 74252.7us
I20260709 13:00:05.514490  1442 catalog_manager.cc:5697] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 1 to 2, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:05.517292  1442 catalog_manager.cc:5697] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 1 to 2, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:05.522150  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:05.568904  2787 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:05.569036  2766 log.cc:927] Time spent T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:00:05.604208  1694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "520ee35af44d4a529e945654996352cc"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:50220
W20260709 13:00:05.604542  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 47307.9us
I20260709 13:00:05.631042  2692 raft_consensus.cc:2955] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:05.615567  2788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:45640 (request call id 76) took 1487 ms. Trace:
I20260709 13:00:05.644451  2243 raft_consensus.cc:2955] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:05.785305  2723 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:05.785976  2723 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:05.844735  1614 raft_consensus.cc:2955] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:05.857995  1541 raft_consensus.cc:2955] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:00:05.878021  2822 log.cc:927] Time spent T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260709 13:00:05.880888  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 272785us
I20260709 13:00:05.848454  2821 raft_consensus.cc:2955] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:05.889237  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:05.685832  2788 rpcz_store.cc:276] 0709 13:00:04.123795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.124275 (+   480us) service_pool.cc:224] Handling call
0709 13:00:04.160850 (+ 36575us) log.cc:844] Serialized 501 byte log entry
0709 13:00:05.611008 (+1450158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39464,"raft.queue_time_us":51194,"raft.run_cpu_time_us":1481,"raft.run_wall_time_us":42983}
I20260709 13:00:05.904575  2723 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:05.908599  2240 raft_consensus.cc:2955] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:05.920806  2692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:45640 (request call id 75) took 1834 ms. Trace:
I20260709 13:00:05.921166  1614 raft_consensus.cc:2955] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:05.921241  2692 rpcz_store.cc:276] 0709 13:00:04.086025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.086176 (+   151us) service_pool.cc:224] Handling call
0709 13:00:04.098935 (+ 12759us) log.cc:844] Serialized 501 byte log entry
0709 13:00:04.272532 (+173597us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b1800356200. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:00:05.917831 (+1645299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26842,"raft.queue_time_us":30691,"raft.run_cpu_time_us":1734,"raft.run_wall_time_us":86806,"spinlock_wait_cycles":8347008}
I20260709 13:00:05.935207  1694 raft_consensus.cc:606] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:05.923594  2242 raft_consensus.cc:2955] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:05.941481  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:05.947350  2795 ts_tablet_manager.cc:1929] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:05.950356  2795 log.cc:1199] T b5871ff5fd9c4673b5650490648edf26 P d7158d6c3b634dc7abb69eac58eba291: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root/wals/b5871ff5fd9c4673b5650490648edf26
I20260709 13:00:05.951488  2795 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39608 (request call id 72) took 1173 ms. Trace:
I20260709 13:00:05.951896  2795 rpcz_store.cc:276] 0709 13:00:04.778532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.781599 (+  3067us) service_pool.cc:224] Handling call
0709 13:00:05.141532 (+359933us) ts_tablet_manager.cc:1151] Deleting tablet b5871ff5fd9c4673b5650490648edf26
0709 13:00:05.149988 (+  8456us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:00:05.694822 (+544834us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:05.947187 (+252365us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:05.951412 (+  4225us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":257906,"thread_start_us":189477,"threads_started":1}
I20260709 13:00:05.992918  1429 catalog_manager.cc:5028] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): tablet b5871ff5fd9c4673b5650490648edf26 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:00:05.995154  1429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fa1a194f4d834ee6aa037d727b8f9e2a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:05.993100  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c4270ae85dd544aeb602acb371def068 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:05.997884  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 520ee35af44d4a529e945654996352cc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:00:06.047538  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 87300.3us
I20260709 13:00:06.047744  1694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:06.049060  1694 raft_consensus.cc:606] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:06.054380  1694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "646909798f0047ef9e8073d28a784525"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:06.055330  1694 raft_consensus.cc:606] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Received request to transfer leadership to TS dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:06.057610  1660 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:06.070735  1694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:06.097838  2788 raft_consensus.cc:993] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:06.097693  2636 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:06.098512  2788 raft_consensus.cc:993] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:06.098713  2636 raft_consensus.cc:1081] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Signalling peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:06.094081  1694 raft_consensus.cc:606] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:06.132295  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 49142.9us
I20260709 13:00:06.099014  2788 raft_consensus.cc:1081] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:06.153723  1441 catalog_manager.cc:5697] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:06.168043  1441 catalog_manager.cc:5697] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 3 to 4, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:06.185516  1694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7803266de9984fac88726b08bee73921"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:06.186146  1694 raft_consensus.cc:606] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:06.210253  1542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:34424
I20260709 13:00:06.211045  1542 raft_consensus.cc:606] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Received request to transfer leadership to TS dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:06.213511   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:06.230633  1443 catalog_manager.cc:5697] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:06.237349   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:06.245985  1531 tablet_service.cc:1558] Processing DeleteTablet for tablet 520ee35af44d4a529e945654996352cc with delete_type TABLET_DATA_TOMBSTONED (TS d7158d6c3b634dc7abb69eac58eba291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39608
I20260709 13:00:06.249584  2651 raft_consensus.cc:993] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291: : Instructing follower dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
W20260709 13:00:06.249846  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 192455us
I20260709 13:00:06.250358  2731 raft_consensus.cc:1081] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Signalling peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:06.252735  2788 raft_consensus.cc:993] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:06.253543  2692 raft_consensus.cc:1081] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:06.256251  1614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:40022
I20260709 13:00:06.256950  1614 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:06.257401  1614 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.264086  1606 tablet_service.cc:1558] Processing DeleteTablet for tablet c4270ae85dd544aeb602acb371def068 with delete_type TABLET_DATA_TOMBSTONED (TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40006
I20260709 13:00:06.268019  2795 tablet_replica.cc:333] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:00:06.286149  1614 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:06.300755  2636 raft_consensus.cc:993] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:06.301829  2697 raft_consensus.cc:1081] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:06.302875  1613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "646909798f0047ef9e8073d28a784525"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:40034
I20260709 13:00:06.303499  1613 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:06.303836  1613 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:06.309635  1619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:40034
I20260709 13:00:06.310294  1619 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:06.310675  1619 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.319803  1613 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:06.321836  1613 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:06.322031  2795 raft_consensus.cc:2243] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:06.323168  2795 raft_consensus.cc:2272] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:06.327564  2795 ts_tablet_manager.cc:1916] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:06.328006  1616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7803266de9984fac88726b08bee73921"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:40034
I20260709 13:00:06.328609  1616 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:06.328913  1616 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.328984  1614 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:06.331077  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:06.331825  1690 raft_consensus.cc:3055] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:06.332126  1690 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:06.334196  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:06.334833  1691 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.333145  1690 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:06.340457  1690 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:06.341858  1619 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:06.353559  1691 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:06.353909  1619 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:06.357656  1690 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:06.363471  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:06.363847  1684 tablet_service.cc:1558] Processing DeleteTablet for tablet fa1a194f4d834ee6aa037d727b8f9e2a with delete_type TABLET_DATA_TOMBSTONED (TS 822e08445eae4a33b2f2fe92060192c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45640
I20260709 13:00:06.364094  1692 raft_consensus.cc:3055] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:06.364431  1692 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:06.365206  1692 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:06.366309  1692 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.360883  1616 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:06.374594  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:06.375195  1616 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:06.372252  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:06.378531  1541 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.379601  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:06.380193  1547 raft_consensus.cc:3055] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:06.380481  1547 raft_consensus.cc:740] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:06.383965  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:06.378088  1544 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:06.383481  1547 consensus_queue.cc:260] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:06.389038  1542 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.399534  1587 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:06.400728  2773 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:06.401201  2773 raft_consensus.cc:697] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:06.403807  1587 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:06.402930  2773 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:06.409880  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:06.409936  1547 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.415191  2697 raft_consensus.cc:993] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:06.415900  2691 raft_consensus.cc:1081] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:00:06.410514  1694 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:06.416473  1694 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:06.417256  1694 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:06.418165  1694 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.419495  2774 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:06.420023  2774 raft_consensus.cc:697] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:06.420964  2774 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:06.377718  2795 ts_tablet_manager.cc:1929] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:06.424805  1692 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:06.427738  1542 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:06.406879  2837 tablet_replica.cc:333] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:00:06.435523  1547 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:06.435580  1587 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:06.447301  1541 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:06.447680  2241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "520ee35af44d4a529e945654996352cc"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:45882
I20260709 13:00:06.449311  1585 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:06.449471  2241 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:06.449927  2241 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.450220  1544 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:06.450510  2721 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:06.451053  2721 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:06.451964  2721 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:06.458436  2780 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:06.459056  2780 raft_consensus.cc:697] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:06.460028  2780 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:06.473951  2241 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:06.441310  2795 log.cc:1199] T 520ee35af44d4a529e945654996352cc P d7158d6c3b634dc7abb69eac58eba291: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root/wals/520ee35af44d4a529e945654996352cc
I20260709 13:00:06.525053  1621 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:06.528828  1618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:40034
I20260709 13:00:06.529489  1618 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:06.529911  1618 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.545961  1618 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:06.549340  1429 catalog_manager.cc:5028] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): tablet 520ee35af44d4a529e945654996352cc (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:00:06.549573  2838 tablet_replica.cc:333] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:00:06.551095  2838 raft_consensus.cc:2243] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:06.552242  2838 raft_consensus.cc:2272] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:06.551949  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:06.553646  1544 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.556842  2838 ts_tablet_manager.cc:1916] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:06.557667  1613 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:06.557973  1618 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:06.567179  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:06.567785  1691 raft_consensus.cc:3055] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:06.568085  1691 raft_consensus.cc:740] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:06.568797  1691 consensus_queue.cc:260] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:06.569865  1691 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.574726  1544 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:06.575824  1585 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:06.576625  2780 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:06.576769  1691 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:06.548574  1444 catalog_manager.cc:5697] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 1 to 2, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.577262  2780 raft_consensus.cc:697] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:06.578353  2780 consensus_queue.cc:237] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:06.583870  1694 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:06.588580  2837 raft_consensus.cc:2243] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:06.590003  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:06.590615  1619 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.603716  1619 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:06.607092  2241 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:06.617044  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:06.617740  1691 raft_consensus.cc:3055] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:06.617967  1691 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:06.619330  1691 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:06.622202  1691 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.624717  2210 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:06.622725  2837 raft_consensus.cc:2272] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:06.629544  2831 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:06.637573  2837 ts_tablet_manager.cc:1916] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:06.656023  1691 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:06.681772  1618 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:06.687549  2831 raft_consensus.cc:697] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:06.688659  2831 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:06.703069  1442 catalog_manager.cc:5697] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 1 to 2, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:06.707819  2838 ts_tablet_manager.cc:1929] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:06.707393  1444 catalog_manager.cc:5697] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 3 to 4, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.708271  2838 log.cc:1199] T fa1a194f4d834ee6aa037d727b8f9e2a P 822e08445eae4a33b2f2fe92060192c6: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root/wals/fa1a194f4d834ee6aa037d727b8f9e2a
I20260709 13:00:06.709084  1444 catalog_manager.cc:5697] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 1 to 2, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.710736  1431 catalog_manager.cc:5028] TS 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): tablet fa1a194f4d834ee6aa037d727b8f9e2a (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:00:06.710791  1444 catalog_manager.cc:5697] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 1 to 2, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.714383  1444 catalog_manager.cc:5697] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 1 to 2, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.719528  2837 ts_tablet_manager.cc:1929] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:06.720017  2837 log.cc:1199] T c4270ae85dd544aeb602acb371def068 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root/wals/c4270ae85dd544aeb602acb371def068
I20260709 13:00:06.722150  1430 catalog_manager.cc:5028] TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): tablet c4270ae85dd544aeb602acb371def068 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:00:06.787868  1695 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:06.789561  2780 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:06.839502  1541 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:06.841118  2780 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:06.848109  1694 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:06.857417  1544 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:06.858309  2780 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:06.863111  2721 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:06.870803  1539 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:06.881542  2773 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:06.948874  1695 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:06.950704  2773 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:06.976543  1546 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:07.051790  2776 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:07.067082  1694 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:07.069692  1694 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:07.071432  2773 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:07.071727  2774 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:07.102020  1539 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:07.118496  2721 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:07.170104  1695 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:07.171537  2831 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:07.237485  1619 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:07.238670   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:07.239202  2831 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:07.328236   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:07.427310  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05911a041e044f48bce12648b58061be"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:07.427937  1691 raft_consensus.cc:606] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:07.432090  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:34424
I20260709 13:00:07.432693  1541 raft_consensus.cc:606] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Received request to transfer leadership to TS e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:07.437376  1695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:07.437951  1695 raft_consensus.cc:606] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:07.504922  1619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7803266de9984fac88726b08bee73921"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:00:07.505518  1619 raft_consensus.cc:606] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:07.508929  1695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:07.509513  1695 raft_consensus.cc:606] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:07.516498  1695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:07.517091  1695 raft_consensus.cc:606] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:07.518180   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:07.520040   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:07.523867  2819 raft_consensus.cc:993] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291: : Instructing follower e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:07.524374  2819 raft_consensus.cc:1081] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Signalling peer e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:07.529737  2241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:45866
I20260709 13:00:07.530326  2241 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:07.530712  2241 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.537802  2241 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:07.544716  2636 raft_consensus.cc:993] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:07.545224  2636 raft_consensus.cc:1081] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:07.546792  2242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:45882
I20260709 13:00:07.547394  2242 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:07.547767  2242 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.548813  2241 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:07.551136  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:07.551710  1541 raft_consensus.cc:3055] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:07.552016  1541 raft_consensus.cc:740] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:07.552795  1541 consensus_queue.cc:260] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:07.554010  1541 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.555354  2242 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:07.557287  1691 consensus_queue.cc:237] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:07.559562  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:07.559870  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:07.560211  1695 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.560505  1619 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.570513  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:07.571183  1694 raft_consensus.cc:3055] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:07.571504  1694 raft_consensus.cc:740] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:07.572064  1541 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:07.572238  1694 consensus_queue.cc:260] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:07.573669  2209 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:07.574960  2861 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:07.575479  2861 raft_consensus.cc:697] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:07.572602  1695 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:07.559659  2242 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:07.576447  2861 consensus_queue.cc:237] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:07.584976  1694 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.597383  1619 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:07.603012  2210 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:07.604040  2831 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:07.600986  1694 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:07.623914  2831 raft_consensus.cc:697] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:07.624580  1444 catalog_manager.cc:5697] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 1 to 2, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:07.625059  2831 consensus_queue.cc:237] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:07.630944  1660 consensus_peers.cc:597] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03423b07f7be422db9d20b7313be1bab. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:07.631914  1619 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:07.632018  1539 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:07.635842  2691 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:07.639539  2705 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:07.683369  2705 raft_consensus.cc:2955] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:07.697604  1619 raft_consensus.cc:2955] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:07.697409  1539 raft_consensus.cc:2955] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:07.717113  1444 catalog_manager.cc:5697] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:07.723948  1441 catalog_manager.cc:5697] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 1 to 2, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:07.736272  1619 consensus_queue.cc:237] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:07.753732  1691 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:07.757597  2774 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:07.759473  2705 raft_consensus.cc:993] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:07.760015  2705 raft_consensus.cc:1081] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:07.761881  2242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05911a041e044f48bce12648b58061be"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:45882
I20260709 13:00:07.762532  2242 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:07.777789  2691 raft_consensus.cc:993] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:07.778743  2636 raft_consensus.cc:1081] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer e8a64798e5f94de8909707bcbd11804a to start an election
W20260709 13:00:07.779857  1586 consensus_peers.cc:597] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b11a3619de25451bbe5a091f271cfa6b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:07.780687  2636 raft_consensus.cc:993] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:07.781155  2636 raft_consensus.cc:1081] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:07.781599  1539 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:07.782425  2242 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.783164  2776 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:07.786159  2243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:45882
I20260709 13:00:07.786823  2243 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:07.787222  2243 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.791488  2241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:45882
I20260709 13:00:07.792084  2241 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:07.792418  2241 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.803442  2242 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:07.807103  2243 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:07.809876  2242 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:07.810075  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:07.810716  1541 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.811142  2243 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:07.811261  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:07.811895  1619 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.815482  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:07.816082  1694 raft_consensus.cc:3055] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:07.816430  1694 raft_consensus.cc:740] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:07.817194  1694 consensus_queue.cc:260] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:07.818265  1694 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.818691  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:07.819267  1695 raft_consensus.cc:3055] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:07.819550  1695 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:07.820250  1695 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:07.821658  1695 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.823474  1541 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:07.824913  1694 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:07.826869  1619 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:07.826889  2211 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:07.827740  1695 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:07.828399  2831 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:07.828853  2211 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:07.828940  2831 raft_consensus.cc:697] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:07.830142  2861 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:07.830672  2861 raft_consensus.cc:697] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:07.830327  2831 consensus_queue.cc:237] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:07.831861  2241 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:07.832417  2861 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:07.833972  2241 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:07.835767  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:07.836364  1695 raft_consensus.cc:3055] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:07.836674  1695 raft_consensus.cc:740] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:07.835912  2774 raft_consensus.cc:2955] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:07.837191  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:07.837337  1695 consensus_queue.cc:260] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:07.837719  1618 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.838392  1695 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.837648  1691 raft_consensus.cc:2955] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:07.855379  1694 consensus_queue.cc:237] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:07.862257  1695 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:07.864886  2211 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:07.865870  2868 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:07.865037  1618 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:07.877372  1441 catalog_manager.cc:5697] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index -1 to 3, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:07.941382  2868 raft_consensus.cc:697] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:07.954104  1441 catalog_manager.cc:5697] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 1 to 2, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:07.960916  2880 raft_consensus.cc:993] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:00:07.955045  2868 consensus_queue.cc:237] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:07.961576  2880 raft_consensus.cc:1081] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:00:07.965550  1695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7803266de9984fac88726b08bee73921"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:45660
I20260709 13:00:07.966105  1695 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:07.966487  1695 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:07.973371  1695 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:07.976181  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:07.976778  1541 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:07.983750  1541 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:07.985278  1659 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:07.986181  2636 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:07.986646  2636 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:07.987840  2636 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:07.996909  1541 raft_consensus.cc:2955] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:07.998837  1695 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:08.000160  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:08.025084  1619 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:08.025444  1619 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:08.026163  1619 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:08.008590  1691 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:08.028672  1619 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:08.030016  2868 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:08.023123  1443 catalog_manager.cc:5697] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 2 to 3, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:08.053460  1613 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:08.054078  1660 consensus_peers.cc:597] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4b724996f86487f991c761b011e8aaf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:08.065409  2705 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:08.059226  1441 catalog_manager.cc:5697] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 1 to 2, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:08.073529  1441 catalog_manager.cc:5697] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 1 to 2, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:08.047219  1619 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:08.131639  1544 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:08.145815  2705 raft_consensus.cc:2955] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:08.150578  1619 raft_consensus.cc:2955] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:08.168233  1695 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:08.171996  1544 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:08.175365  1443 catalog_manager.cc:5697] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:08.189121  1619 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:08.190382  2705 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:08.192616  2898 ts_tablet_manager.cc:933] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:08.192865  2868 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:08.201900  2898 tablet_copy_client.cc:323] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39981
I20260709 13:00:08.208685  2868 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:08.212278  1632 tablet_copy_service.cc:140] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Received BeginTabletCopySession request for tablet b11a3619de25451bbe5a091f271cfa6b from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50552)
I20260709 13:00:08.212813  1632 tablet_copy_service.cc:161] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Beginning new tablet copy session on tablet b11a3619de25451bbe5a091f271cfa6b from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50552: session id = e8a64798e5f94de8909707bcbd11804a-b11a3619de25451bbe5a091f271cfa6b
I20260709 13:00:08.229907  2901 ts_tablet_manager.cc:933] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:08.230073  1632 tablet_copy_source_session.cc:215] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:08.241845  2898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b11a3619de25451bbe5a091f271cfa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.247591  1619 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:08.249529  1691 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:08.251189  2868 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:08.257748  2831 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:08.281314  1693 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:00:08.281643  1660 consensus_peers.cc:597] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ad3e3b7b46ab493c8eda918df77def64. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:08.283833  2831 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:08.285151  1613 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:08.286718  2636 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:08.293447  1544 raft_consensus.cc:2955] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:08.295097  1541 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:08.308719  2636 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:08.324057  2907 log.cc:927] Time spent T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:00:08.351544  2901 tablet_copy_client.cc:323] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 13:00:08.359656  1706 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet 03423b07f7be422db9d20b7313be1bab from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 13:00:08.360278  1706 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet 03423b07f7be422db9d20b7313be1bab from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-03423b07f7be422db9d20b7313be1bab
I20260709 13:00:08.370297  1706 tablet_copy_source_session.cc:215] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:08.372181  1539 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:08.374469  2868 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:08.380934  1541 raft_consensus.cc:2955] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:08.378328  2705 raft_consensus.cc:2955] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:08.407341  1619 raft_consensus.cc:2955] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:08.427992  1691 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:08.432910  2831 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:08.444770  2901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03423b07f7be422db9d20b7313be1bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.448783  2898 tablet_copy_client.cc:806] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:08.449435  2898 tablet_copy_client.cc:670] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:08.459370  2898 tablet_copy_client.cc:538] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:08.471565  1691 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:08.473650  2861 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:08.509667  1619 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:08.513514  2636 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:08.514825  2898 tablet_bootstrap.cc:492] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:00:08.518049  1441 catalog_manager.cc:5697] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:08.520994   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:08.550206  1618 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:08.551995  2861 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:08.572618  2898 tablet_bootstrap.cc:492] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:08.573693  2898 tablet_bootstrap.cc:492] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:00:08.577200  2898 ts_tablet_manager.cc:1403] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.011s
I20260709 13:00:08.581722  2898 raft_consensus.cc:359] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:08.591598  1544 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:08.594273  2898 raft_consensus.cc:740] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:00:08.595075  2898 consensus_queue.cc:260] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:08.598284  2898 ts_tablet_manager.cc:1434] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:00:08.628537  1632 tablet_copy_service.cc:342] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-b11a3619de25451bbe5a091f271cfa6b received from {username='slave'} at 127.0.0.1:50552
I20260709 13:00:08.629030  1632 tablet_copy_service.cc:434] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-b11a3619de25451bbe5a091f271cfa6b on tablet b11a3619de25451bbe5a091f271cfa6b with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:08.612772  2901 tablet_copy_client.cc:806] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:08.631592  2901 tablet_copy_client.cc:670] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:08.639914  2898 ts_tablet_manager.cc:933] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:08.645550  2901 tablet_copy_client.cc:538] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:08.652993  2636 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:08.695608  2241 raft_consensus.cc:1217] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:00:08.755939  2920 ts_tablet_manager.cc:933] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:08.757664   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:08.778736  2901 tablet_bootstrap.cc:492] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:00:08.753438  2898 tablet_copy_client.cc:323] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 13:00:08.783922  1706 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet e4b724996f86487f991c761b011e8aaf from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 13:00:08.784474  1706 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet e4b724996f86487f991c761b011e8aaf from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-e4b724996f86487f991c761b011e8aaf
I20260709 13:00:08.804375  1706 tablet_copy_source_session.cc:215] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:08.804881  2920 tablet_copy_client.cc:323] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 13:00:08.822652  1705 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet ad3e3b7b46ab493c8eda918df77def64 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 13:00:08.823226  1705 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet ad3e3b7b46ab493c8eda918df77def64 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-ad3e3b7b46ab493c8eda918df77def64
I20260709 13:00:08.830505  2898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b724996f86487f991c761b011e8aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.831419  1705 tablet_copy_source_session.cc:215] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:08.845827  2920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad3e3b7b46ab493c8eda918df77def64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.847271  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4142f46c85974609aa207df00c3d031e"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:34424
I20260709 13:00:08.848145  1538 raft_consensus.cc:606] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Received request to transfer leadership to TS e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:08.852068  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a69de749cce497b83e6489ad367017a"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:34424
I20260709 13:00:08.852741  1538 raft_consensus.cc:606] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:08.856076  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:34424
I20260709 13:00:08.856945  1538 raft_consensus.cc:606] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:08.860047  1618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:00:08.860775  1618 raft_consensus.cc:606] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:08.865582  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:08.866170  1691 raft_consensus.cc:606] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:08.869688   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:08.871264   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:08.891749  2898 tablet_copy_client.cc:806] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:08.892436  2898 tablet_copy_client.cc:670] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:08.926445  2898 tablet_copy_client.cc:538] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:08.926247  2920 tablet_copy_client.cc:806] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:08.930689  2920 tablet_copy_client.cc:670] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:08.933013  2901 tablet_bootstrap.cc:492] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:08.937261  2901 tablet_bootstrap.cc:492] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:00:08.938020  2901 ts_tablet_manager.cc:1403] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.160s	user 0.050s	sys 0.040s
I20260709 13:00:08.939543  2920 tablet_copy_client.cc:538] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:08.941133  2901 raft_consensus.cc:359] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:08.942008  2901 raft_consensus.cc:740] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:00:08.942907  2901 consensus_queue.cc:260] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:08.949368  2901 ts_tablet_manager.cc:1434] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:00:08.953037  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-03423b07f7be422db9d20b7313be1bab received from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:08.953528  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-03423b07f7be422db9d20b7313be1bab on tablet 03423b07f7be422db9d20b7313be1bab with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:08.978259  2898 tablet_bootstrap.cc:492] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:00:08.981611  2920 tablet_bootstrap.cc:492] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:00:09.054927  2920 tablet_bootstrap.cc:492] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:09.055881  2920 tablet_bootstrap.cc:492] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:00:09.063786  2920 ts_tablet_manager.cc:1403] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.082s	user 0.026s	sys 0.001s
I20260709 13:00:09.070729  2893 raft_consensus.cc:993] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:00:09.071298  2819 raft_consensus.cc:1081] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:00:09.058496  2898 tablet_bootstrap.cc:492] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:09.073271  2898 tablet_bootstrap.cc:492] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:00:09.073989  2898 ts_tablet_manager.cc:1403] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.096s	user 0.014s	sys 0.009s
I20260709 13:00:09.075776  1691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a69de749cce497b83e6489ad367017a"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:45652
I20260709 13:00:09.076313  1691 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:09.076654  1691 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.076918  2898 raft_consensus.cc:359] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:09.083094  1691 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:09.085469  1691 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:09.066797  2920 raft_consensus.cc:359] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:09.087007  2920 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:00:09.087790  2920 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:09.090502  2920 ts_tablet_manager.cc:1434] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:00:09.077745  2898 raft_consensus.cc:740] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:00:09.091933  2898 consensus_queue.cc:260] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:09.093356  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:09.094074  1538 raft_consensus.cc:3055] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:09.094458  2898 ts_tablet_manager.cc:1434] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:00:09.094448  1538 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:09.095501  1538 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:09.096870  1538 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.099311  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-ad3e3b7b46ab493c8eda918df77def64 received from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:09.099762  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-ad3e3b7b46ab493c8eda918df77def64 on tablet ad3e3b7b46ab493c8eda918df77def64 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:09.116937  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:09.117573  1618 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.119146  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-e4b724996f86487f991c761b011e8aaf received from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:09.119643  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-e4b724996f86487f991c761b011e8aaf on tablet e4b724996f86487f991c761b011e8aaf with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:09.116473  1538 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:09.129356  1618 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:09.135823  2243 raft_consensus.cc:1217] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:09.137872  1660 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:09.141026  2691 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:09.141634  2691 raft_consensus.cc:697] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:09.141867  2705 raft_consensus.cc:993] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:09.142465  2705 raft_consensus.cc:1081] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:09.142665  2691 consensus_queue.cc:237] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:09.147570  2243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:45882
I20260709 13:00:09.148253  2243 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:09.148705  2243 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.179495  2243 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:09.182695  1445 catalog_manager.cc:5697] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 1 to 2, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:09.184250  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:09.184870  1618 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.191186  2884 raft_consensus.cc:1064] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:00:09.193006  1618 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:09.194264  2210 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:09.196240  2831 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:09.196734  2831 raft_consensus.cc:697] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:09.194007  2884 consensus_queue.cc:237] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:09.197585  2831 consensus_queue.cc:237] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:09.205358  2243 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:09.212740  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:09.213538  1691 raft_consensus.cc:3055] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:09.213907  1691 raft_consensus.cc:740] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:09.214818  1691 consensus_queue.cc:260] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:09.242522  1691 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.234216  1443 catalog_manager.cc:5697] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 1 to 2, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:09.247762  2819 raft_consensus.cc:993] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:00:09.248370  2819 raft_consensus.cc:1081] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:00:09.251187  1695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:45652
I20260709 13:00:09.251813  1695 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:09.252159  1695 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.256485  2243 raft_consensus.cc:1217] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:09.264544  1695 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:09.266832  1695 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:09.268322  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:09.268958  1613 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.276556  1613 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:09.277714  1660 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:09.280156  2774 raft_consensus.cc:993] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:09.282402  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:09.279202  2691 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:09.283017  1541 raft_consensus.cc:3055] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:09.285583  1541 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:09.293884  1541 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:09.295300  1541 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.295378  2243 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 2 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:09.296943  2774 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:09.283442  2885 raft_consensus.cc:1081] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:09.302022  1695 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:09.306259  1541 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:09.312914  2819 raft_consensus.cc:993] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291: : Instructing follower e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:09.313405  2819 raft_consensus.cc:1081] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Signalling peer e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:09.290201  2691 raft_consensus.cc:697] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:09.309358  2774 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:00:09.315069  2691 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:09.316723  2241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4142f46c85974609aa207df00c3d031e"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:45866
I20260709 13:00:09.317292  2241 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:09.317667  2241 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.324771  2242 raft_consensus.cc:1217] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:09.309576  1691 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:09.333352  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39628
I20260709 13:00:09.334975  1541 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:09.335399  1541 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:09.336207  1538 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:09.336834  2241 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:09.338995  2721 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:09.345463  1541 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:09.348256  2241 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:09.355763  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:09.357020  1691 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.357632  1541 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:09.358249  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:09.359493  1613 raft_consensus.cc:3055] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:09.359836  1613 raft_consensus.cc:740] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:09.360569  1613 consensus_queue.cc:260] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:09.361677  1613 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:09.370465  1613 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:09.371865  1511 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:09.372663  2893 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:09.365557  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:09.375973  1691 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:09.376224  1693 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:09.377177  2211 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:09.378018  2831 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:09.378470  2831 raft_consensus.cc:697] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:09.379519  2831 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:09.380424  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:09.381207  1538 raft_consensus.cc:3055] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:09.381578  1538 raft_consensus.cc:740] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:09.384845  1538 consensus_queue.cc:260] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:09.386587  1538 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.382730  2893 raft_consensus.cc:697] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:09.400548  2893 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:09.410202  1693 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:09.427029  2884 raft_consensus.cc:2955] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.431062  1445 catalog_manager.cc:5697] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 1 to 2, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:09.435904  1538 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:09.438732  1539 raft_consensus.cc:2955] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.452920  1443 catalog_manager.cc:5697] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 1 to 2, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:09.453776  2243 raft_consensus.cc:2955] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.475289  1695 raft_consensus.cc:2955] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.490859  1442 catalog_manager.cc:5697] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index 3 to 4, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:09.496874  1441 catalog_manager.cc:5697] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 2 to 3, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:09.523170  2919 raft_consensus.cc:1064] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
W20260709 13:00:09.528319  2933 consensus_queue.cc:1175] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "822e08445eae4a33b2f2fe92060192c6" responder_term: 2 status { last_received { term: 2 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 2 index: 4 } }
I20260709 13:00:09.529251  2919 consensus_queue.cc:237] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:09.565922  1618 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:09.568050  2691 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:09.574018  1619 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:09.575809  2919 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:09.563472  1613 consensus_queue.cc:237] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:09.584796  2242 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:09.586314  2933 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:09.589565  1541 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:09.613422  2883 raft_consensus.cc:2955] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.614463  2243 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:09.616175  2705 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:09.621138  1693 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:09.621178  2242 raft_consensus.cc:2955] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.622794  2774 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:09.624163  2831 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:09.626278  1541 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:09.627612  2919 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:09.637400  1539 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:09.642808  1538 raft_consensus.cc:2955] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.658703  2919 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:00:09.679366  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b11a3619de25451bbe5a091f271cfa6b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:09.681174  1442 catalog_manager.cc:5697] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 4 to 5, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New cstate: current_term: 2 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.682281  1616 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:09.685070  2831 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:09.697082  2691 raft_consensus.cc:2955] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.734017  1544 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:09.739408  2919 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:09.744391  1684 tablet_service.cc:1558] Processing DeleteTablet for tablet b11a3619de25451bbe5a091f271cfa6b with delete_type TABLET_DATA_TOMBSTONED (TS 822e08445eae4a33b2f2fe92060192c6 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45640
I20260709 13:00:09.749183  1613 raft_consensus.cc:2955] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.770684  2705 raft_consensus.cc:1064] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:00:09.773264  2705 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:09.786056  2956 tablet_replica.cc:333] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:00:09.787115  2956 raft_consensus.cc:2243] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:09.787889  2956 raft_consensus.cc:2272] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:09.792495  2956 ts_tablet_manager.cc:1916] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:09.794381  2241 raft_consensus.cc:2955] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.808423  2242 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:09.811277  1619 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:09.812826  2955 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:09.816954  1541 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:09.817480  1539 raft_consensus.cc:2955] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.819044  2919 raft_consensus.cc:1064] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:00:09.819511  2691 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:09.820719  2956 ts_tablet_manager.cc:1929] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:00:09.821166  2956 log.cc:1199] T b11a3619de25451bbe5a091f271cfa6b P 822e08445eae4a33b2f2fe92060192c6: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root/wals/b11a3619de25451bbe5a091f271cfa6b
I20260709 13:00:09.827869  2919 consensus_queue.cc:237] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:09.835296  2955 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:09.836699  1613 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:09.849489  1695 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:09.851836  2705 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:09.869153  2861 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:09.872140   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:09.873287  1443 catalog_manager.cc:5697] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.880501  1538 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:09.885380  2831 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:09.887512  1431 catalog_manager.cc:5028] TS 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): tablet b11a3619de25451bbe5a091f271cfa6b (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:00:09.891572  2691 raft_consensus.cc:2955] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.897727  1613 raft_consensus.cc:2955] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.933087  1691 consensus_queue.cc:237] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:09.933996  2242 raft_consensus.cc:2955] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.951601  2241 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:09.954296  1694 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:09.954938  2636 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:09.957548  2819 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:09.958840  1613 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:09.963286  2241 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:09.965942  1613 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:09.966495  1621 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:09.968153  2941 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:09.968447  2955 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:09.970273  2636 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:09.970503  2955 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:09.975546  1441 catalog_manager.cc:5697] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.985181  2636 raft_consensus.cc:2955] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:09.990392  2241 raft_consensus.cc:2955] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:10.002496  1619 raft_consensus.cc:2955] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:00:10.021716  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 65430us
I20260709 13:00:10.026337  1544 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:10.025828  1539 raft_consensus.cc:2955] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:10.028131  2919 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:10.041568  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e4b724996f86487f991c761b011e8aaf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:10.082255  1441 catalog_manager.cc:5697] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 3 to 4, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:10.093256  2691 raft_consensus.cc:2955] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:10.095067   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:10.194141  1619 raft_consensus.cc:2955] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:10.200105  2242 raft_consensus.cc:2955] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:00:10.266314  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 213531us
I20260709 13:00:10.327533  1546 raft_consensus.cc:2955] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:00:10.525493  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 67564.6us
I20260709 13:00:10.543124  1531 tablet_service.cc:1558] Processing DeleteTablet for tablet e4b724996f86487f991c761b011e8aaf with delete_type TABLET_DATA_TOMBSTONED (TS d7158d6c3b634dc7abb69eac58eba291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39608
W20260709 13:00:10.572854  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 119842us
I20260709 13:00:10.595906  2993 tablet_replica.cc:333] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
W20260709 13:00:10.628093  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 63400.3us
W20260709 13:00:10.636375  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 189370us
W20260709 13:00:10.644021  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 277670us
W20260709 13:00:10.646889  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 188979us
I20260709 13:00:10.702504  2993 raft_consensus.cc:2243] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:10.703459  2993 raft_consensus.cc:2272] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:10.707585  2993 ts_tablet_manager.cc:1916] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:00:10.709311  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 61938.1us
I20260709 13:00:10.725279  1442 catalog_manager.cc:5697] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:10.726624  1691 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:10.729600  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 78665.2us
W20260709 13:00:10.752737  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 102484us
I20260709 13:00:10.754384  1544 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:10.766736  2242 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:10.775219  2636 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:10.782147  1618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:00:10.782706  1618 raft_consensus.cc:606] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
W20260709 13:00:10.786851  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 46930.8us
I20260709 13:00:10.795073  2636 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:10.797446  1544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:34424
I20260709 13:00:10.798040  1544 raft_consensus.cc:606] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Received request to transfer leadership to TS e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:10.801119  1544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:34424
I20260709 13:00:10.801676  1544 raft_consensus.cc:606] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:10.801769  2997 raft_consensus.cc:993] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:10.802307  2997 raft_consensus.cc:1081] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:10.805389  1695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4270ae85dd544aeb602acb371def068"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:10.806038  1695 raft_consensus.cc:606] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:10.809444  2966 raft_consensus.cc:993] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:10.810024  2966 raft_consensus.cc:1081] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:10.811308  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:10.811973  1691 raft_consensus.cc:606] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:10.813067   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:10.816491  1547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39628
I20260709 13:00:10.817015  1547 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:10.817368  1547 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.814661   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:10.830089  1547 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:10.833714  2999 raft_consensus.cc:993] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:00:10.834264  2976 raft_consensus.cc:1081] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:00:10.834740  2966 raft_consensus.cc:2955] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:10.836355  1695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:45652
I20260709 13:00:10.836933  1695 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:10.837332  1695 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.847784  1695 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:10.848608  1538 raft_consensus.cc:2955] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:10.849678  1695 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:10.854136  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:10.854768  1546 raft_consensus.cc:3055] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:10.855059  1546 raft_consensus.cc:740] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:10.855881  1546 consensus_queue.cc:260] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:10.857128  1546 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.860404  1547 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:10.861943  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:10.862541  1613 raft_consensus.cc:3055] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:10.862847  1613 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:10.863675  1613 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:10.864898  1613 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.868602  2243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4270ae85dd544aeb602acb371def068"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:45882
I20260709 13:00:10.869633  2243 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:10.870025  2243 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.870838  2993 ts_tablet_manager.cc:1929] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:10.872997  2993 log.cc:1199] T e4b724996f86487f991c761b011e8aaf P d7158d6c3b634dc7abb69eac58eba291: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root/wals/e4b724996f86487f991c761b011e8aaf
I20260709 13:00:10.874238  1613 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:10.875365  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:10.876288  2983 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:10.876740  2983 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:10.877568  2983 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:10.883415  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:10.883920  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:10.884092  2240 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.884510  2242 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.885388  2976 raft_consensus.cc:993] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291: : Instructing follower e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:10.885829  2976 raft_consensus.cc:1081] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Signalling peer e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:00:10.889869  1546 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:10.892911  2242 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:10.900507  2241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:45866
I20260709 13:00:10.908193  2241 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:10.908576  2241 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.903563  1429 catalog_manager.cc:5028] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): tablet e4b724996f86487f991c761b011e8aaf (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:00:10.905371  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ad3e3b7b46ab493c8eda918df77def64 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:10.913552  2243 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:10.917270  1691 consensus_queue.cc:237] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:10.918632  2241 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:10.918952  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:10.925592  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:10.920708  1441 catalog_manager.cc:5697] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:10.926288  1547 raft_consensus.cc:3055] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:10.926674  1547 raft_consensus.cc:740] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:10.925951  2242 raft_consensus.cc:2955] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:10.927472  1547 consensus_queue.cc:260] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:10.928628  1547 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.928781  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:10.929368  1618 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.932052  2241 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:10.936026  1547 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:10.936657  1546 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.949419  2240 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:10.937080  2241 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:10.939620  1660 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:10.950551  2966 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:10.951066  2966 raft_consensus.cc:697] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:10.942201  2243 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:10.944895  1538 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:10.952940  2705 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:10.955341  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:10.955952  1691 raft_consensus.cc:3055] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:10.956280  1691 raft_consensus.cc:740] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:10.957124  1691 consensus_queue.cc:260] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:10.958050  1546 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:10.958541  1691 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.967151  1606 tablet_service.cc:1558] Processing DeleteTablet for tablet ad3e3b7b46ab493c8eda918df77def64 with delete_type TABLET_DATA_TOMBSTONED (TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40006
I20260709 13:00:10.962056  2967 raft_consensus.cc:993] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:10.968367  2636 raft_consensus.cc:1081] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:10.952037  2966 consensus_queue.cc:237] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:10.966387  2209 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:10.975533  1691 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:10.979043  2211 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:10.980136  2989 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:10.980659  2989 raft_consensus.cc:697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 3 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:10.981032  2987 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:10.982046  2987 raft_consensus.cc:697] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:10.981637  2989 consensus_queue.cc:237] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:10.983310  2987 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:10.990936  2691 raft_consensus.cc:2955] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:10.993124  2241 raft_consensus.cc:2955] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:10.999563  1443 catalog_manager.cc:5697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 1 to 2, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.044118  1618 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:11.055503  3004 tablet_replica.cc:333] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:00:11.059428  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 03423b07f7be422db9d20b7313be1bab with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:11.059027  1546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39612
I20260709 13:00:11.060667  1546 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:11.061038  1546 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.057682  1443 catalog_manager.cc:5697] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 1 to 2, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.065030  2705 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:11.073205  1546 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:11.075479  1546 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:11.076707  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:11.077346  1621 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.086181  1621 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:11.087056  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:11.087738  1693 raft_consensus.cc:3055] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:11.088059  1693 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:11.088743  1693 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:11.089841  1693 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.093600  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:11.098353  2983 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:11.098981  1693 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:11.098989  2983 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:11.100396  2983 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:11.101068  3004 raft_consensus.cc:2243] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:11.102707  3004 raft_consensus.cc:2272] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:11.108662  1445 catalog_manager.cc:5697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 2 to 3, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 3 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.113401  3004 ts_tablet_manager.cc:1916] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:11.117182  1546 raft_consensus.cc:2955] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:11.120415  1441 catalog_manager.cc:5697] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 1 to 2, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.157593  1445 catalog_manager.cc:5697] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 3 to 4, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:11.175834  1445 catalog_manager.cc:5697] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 1 to 2, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.192095  3004 ts_tablet_manager.cc:1929] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:11.200565  3004 log.cc:1199] T ad3e3b7b46ab493c8eda918df77def64 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root/wals/ad3e3b7b46ab493c8eda918df77def64
I20260709 13:00:11.202497  1430 catalog_manager.cc:5028] TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): tablet ad3e3b7b46ab493c8eda918df77def64 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:00:11.208247  1606 tablet_service.cc:1558] Processing DeleteTablet for tablet 03423b07f7be422db9d20b7313be1bab with delete_type TABLET_DATA_TOMBSTONED (TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40006
I20260709 13:00:11.209910  3004 tablet_replica.cc:333] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:00:11.210911  3004 raft_consensus.cc:2243] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:11.211532  3004 raft_consensus.cc:2272] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:11.215148  3004 ts_tablet_manager.cc:1916] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:11.235834  3004 ts_tablet_manager.cc:1929] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:11.236306  3004 log.cc:1199] T 03423b07f7be422db9d20b7313be1bab P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root/wals/03423b07f7be422db9d20b7313be1bab
I20260709 13:00:11.238328  1430 catalog_manager.cc:5028] TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): tablet 03423b07f7be422db9d20b7313be1bab (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:00:11.363605  2241 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:11.364987  2996 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:11.393774  1621 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:11.399821  1547 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:11.401540  2861 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:11.400998  2979 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:00:11.447104  1538 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:11.448688  2705 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:11.457424  1621 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:11.459087  2987 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:11.465507  1546 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:11.467159  2987 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:11.487874  1691 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:11.495253  2995 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:11.501493  1691 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:11.505002  2975 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:11.581110  2241 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:11.583340  2691 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:00:12.538233  1512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.005s	sys 0.002s
W20260709 13:00:12.538718  1512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.006s	sys 0.002s
I20260709 13:00:12.562258  3025 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:12.563027  3025 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.562355  3024 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:12.564730  3024 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:12.566861  3025 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:12.568332  3024 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:12.615906  3024 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:12.616508  3024 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:12.618848  3024 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:12.628258  3030 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:12.628942  3030 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:12.631260  3030 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:12.660825  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:12.663168  3026 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:12.664214  3026 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:12.667523  3027 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:12.668222  3027 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:12.670792  3027 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:12.675256  2979 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:12.676142  2979 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.678802  2979 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:12.709229  1568 debug-util.cc:398] Leaking SignalData structure 0x7b08001ea200 after lost signal to thread 434
I20260709 13:00:12.737262  2995 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:12.769302  2975 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:12.690224  3030 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:12.770032  2975 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.770370  3030 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.739540  3031 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:12.772431  2975 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:12.774940  3030 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:12.776391  3031 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.769004  2995 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:12.783071  2995 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:12.808460  3030 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:00:12.692559  1693 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.121s	user 0.033s	sys 0.043s
I20260709 13:00:12.785550  3031 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:12.679277  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 705) took 1081 ms. Trace:
W20260709 13:00:12.835754  1693 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.265s	user 0.033s	sys 0.045s
I20260709 13:00:12.835680  1546 rpcz_store.cc:276] 0709 13:00:11.598341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.678405 (+1080064us) service_pool.cc:224] Handling call
0709 13:00:12.678704 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.678862 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.678888 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:12.678994 (+   106us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:12.679025 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.679105 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.679206 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:12.836578  1445 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42122 (request call id 235) took 1325 ms. Trace:
I20260709 13:00:12.836943  1445 rpcz_store.cc:276] 0709 13:00:11.511367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.519044 (+  7677us) service_pool.cc:224] Handling call
0709 13:00:12.836472 (+1317428us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:00:12.837338  3031 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:12.838047  3031 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.839102  2975 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:12.839818  2975 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:12.841456  2241 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.251s	user 0.008s	sys 0.013s
I20260709 13:00:12.679663  3024 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:12.685300  3028 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:12.851426  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1473) took 1344 ms. Trace:
I20260709 13:00:12.852260  2983 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:12.851969  1691 rpcz_store.cc:276] 0709 13:00:11.507046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.507176 (+   130us) service_pool.cc:224] Handling call
0709 13:00:11.507458 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.507744 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.507780 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.508301 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:00:11.575050 (+ 66749us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:11.575094 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.575175 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.851138 (+1275963us) raft_consensus.cc:1685] finished
0709 13:00:12.851162 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.851336 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":169,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":66314,"threads_started":1,"wal-append.queue_time_us":68168,"wal-append.run_cpu_time_us":12005,"wal-append.run_wall_time_us":1183022}
I20260709 13:00:12.853245  2983 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:12.854640  2241 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.264s	user 0.009s	sys 0.014s
I20260709 13:00:12.856557  3031 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:12.725152  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:12.675355  3026 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:12.709321  3032 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:12.858263  3025 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:12.717832  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:12.821503  2933 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:12.860335  2933 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.823459  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:12.864327  1618 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 1.
I20260709 13:00:12.825858  2967 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:12.866521  2967 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.867918  2979 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:12.868548  2979 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.868939  2933 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:12.869207  2967 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:12.869761  2967 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:12.870203  2967 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.871165  2979 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:12.872498  2979 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:12.873962   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:12.826432  2966 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:12.828593  1568 debug-util.cc:398] Leaking SignalData structure 0x7b080009f580 after lost signal to thread 1479
I20260709 13:00:12.829257  3034 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:00:12.876185  1568 debug-util.cc:398] Leaking SignalData structure 0x7b0800366760 after lost signal to thread 1571
I20260709 13:00:12.875653  3034 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:12.876528  1568 debug-util.cc:398] Leaking SignalData structure 0x7b080033c9a0 after lost signal to thread 1572
W20260709 13:00:12.877789  1568 debug-util.cc:398] Leaking SignalData structure 0x7b0800206c60 after lost signal to thread 1646
W20260709 13:00:12.878180  1568 debug-util.cc:398] Leaking SignalData structure 0x7b080031f6c0 after lost signal to thread 1647
I20260709 13:00:12.878448  3034 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:12.830318  3035 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:12.806464  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:12.832049  2989 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:00:12.833425  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 123587us
I20260709 13:00:12.846087  2995 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:12.873639  2979 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.857704  2983 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:12.858983  3025 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.856454  2996 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:12.875223  2966 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:12.831629  3037 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:12.849633  3030 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.879547  3035 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:12.880415  1568 debug-util.cc:398] Leaking SignalData structure 0x7b0800340f20 after lost signal to thread 1720
I20260709 13:00:12.872771  2967 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:12.892081  2210 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:12.896579  3039 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:12.850353  3024 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.847939  2975 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:12.832826  3036 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:12.917587  2983 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:12.858898  3032 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.825700  3038 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:12.851421  3028 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:12.874982  3026 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:12.913661  2997 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:12.919267  2933 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:12.884439  2989 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:12.973349  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:12.906332  2995 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:12.930025  3027 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:12.948299  2861 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:12.981604  1695 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:12.948438  2967 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:12.965008  2987 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:12.963569  3048 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:12.979612  3026 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:12.979408  2997 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:12.993023  1568 debug-util.cc:398] Leaking SignalData structure 0x7b0800315520 after lost signal to thread 2270
I20260709 13:00:12.927958  2996 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.990859  2861 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:12.995779  3031 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:13.022431  3023 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:13.022895  3031 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.002008  3034 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.974481  2983 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.984483  2933 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:12.947775  3039 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.056902  3055 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:00:13.018267  1568 debug-util.cc:398] Leaking SignalData structure 0x7b08002ae6e0 after lost signal to thread 2931
I20260709 13:00:12.993242  3027 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.085121  2241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45882 (request call id 395) took 1475 ms. Trace:
I20260709 13:00:12.926920  3037 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.001711  2987 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.066643  3043 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:12.997028  2967 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.023504  3023 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.022521  2861 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:13.096577  3049 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:13.037540  2979 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.065007  3051 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:13.052067  3056 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:13.085624  2241 rpcz_store.cc:276] 0709 13:00:11.586043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.586257 (+   214us) service_pool.cc:224] Handling call
0709 13:00:11.586681 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.588320 (+  1639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.588382 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.590108 (+  1726us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.855106 (+1264998us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:12.948343 (+ 93237us) log.cc:844] Serialized 14 byte log entry
0709 13:00:13.061124 (+112781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.061206 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.061240 (+    34us) raft_consensus.cc:1685] finished
0709 13:00:13.061253 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.061370 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":124017,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":6362,"raft.queue_time_us":66139,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":233,"thread_start_us":1468200,"threads_started":4,"wal-append.queue_time_us":230014,"wal-append.run_cpu_time_us":1653,"wal-append.run_wall_time_us":1004214}
I20260709 13:00:12.964371  3036 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.108035   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:13.068089  3029 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:13.108322  3042 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:12.976063  3038 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.030990  3025 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.114467  3032 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.115226  2933 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.116129  3028 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:13.105995  1568 debug-util.cc:398] Leaking SignalData structure 0x7b08002ae880 after lost signal to thread 2999
I20260709 13:00:13.123062  3041 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:13.172412  3053 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:13.123950  3052 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:13.052773  3034 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.148584  3039 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:13.105831  2978 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:13.126356  2979 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:13.126962  2966 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:13.172130  3030 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.128823  3031 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.142683  3057 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:13.149374  3023 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.180622  3028 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:13.167948  3025 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:13.172851  3061 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:13.192605  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 111) took 1692 ms. Trace:
I20260709 13:00:13.245458  3062 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:13.180626  3024 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.182144  3032 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:13.173636  3035 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:13.240011  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:13.247378  3047 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:13.107012  3055 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.250901  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:13.252940  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 285891us
I20260709 13:00:13.160156  3049 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.246407  3062 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.245497  3061 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.166137  3029 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.259840  3061 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.262934  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.263890  1695 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 13:00:13.245683  1693 rpcz_store.cc:276] 0709 13:00:11.500364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.500517 (+   153us) service_pool.cc:224] Handling call
0709 13:00:11.500781 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.501071 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.501096 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.501548 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:00:11.559541 (+ 57993us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:12.836254 (+1276713us) log.cc:844] Serialized 14 byte log entry
0709 13:00:13.192059 (+355805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.192350 (+   291us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.192394 (+    44us) raft_consensus.cc:1685] finished
0709 13:00:13.192405 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.192548 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19512,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":118645,"raft.run_cpu_time_us":560,"raft.run_wall_time_us":18091,"thread_start_us":1677992,"threads_started":4,"wal-append.queue_time_us":142010,"wal-append.run_cpu_time_us":4701,"wal-append.run_wall_time_us":1103182}
I20260709 13:00:13.019847  3048 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.214812  3027 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:13.294354  3046 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:13.295078  3065 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:13.120797  3043 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.172950  3041 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.235818  3030 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:13.173322  3053 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.168749  3042 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.250113  2995 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:13.302847  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.289402  3024 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:13.214888  2978 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.165989  3056 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.280817  3061 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:13.317353  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:13.291662  2989 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.207728  2979 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.322428  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:13.252914  3055 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.328745  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:13.240962  3028 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.249836  3025 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.310317  3029 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:13.168677  3051 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.200166  3052 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.299084  2996 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.303424  3027 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:13.280267  3032 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } }
I20260709 13:00:13.275913  3057 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.337543  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.311128  3035 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:13.361819  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:13.399493  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:13.377902  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:13.431859  1619 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:13.311555  2983 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.374385  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:13.359208  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:13.427577  3050 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:00:13.332906  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:13.464718  1542 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 1.
I20260709 13:00:13.441406  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.335899  1693 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:13.429004  1546 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 1.
I20260709 13:00:13.467133  1618 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 13:00:13.427661  3035 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } }
I20260709 13:00:13.248728  3047 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.474498  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:13.476027  1613 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:13.393682  3033 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:13.303020  2997 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.320683  3058 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:13.480386  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.438999  3034 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.388341  2987 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.423563  2967 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:13.330899  3062 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.486053  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:13.499792  2241 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 13:00:13.415365  3036 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.497612  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:13.319504  3030 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.450634  3029 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:13.444633  3037 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:13.505012  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.467620  3049 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:13.364494  3024 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.505456  2209 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:13.506014  3023 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:13.329056  3065 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.444339  3027 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.444927  3061 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.517406  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.518313  1690 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 13:00:13.485330  3038 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:13.526784  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:13.521893  2995 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:13.527199  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.527487  1613 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 13:00:13.524890  1586 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:13.548466  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.319645  3046 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.577629  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.510401  3063 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:13.527618  2995 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:13.512547  3023 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.549346  1691 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:13.527895  3056 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:13.580875  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.581476  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.515827  3029 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.585536  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.586303  1690 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 13:00:13.591642  1691 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 13:00:13.592610  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.592828  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:13.593386  1690 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 13:00:13.594476  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.580826  2209 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:13.586282  1696 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:13.589583  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:13.597517  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.519357  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.603587  1690 raft_consensus.cc:2410] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:13.588917  2979 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:13.593359  1619 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 1.
I20260709 13:00:13.607224  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:13.584630  2995 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:13.515391  3058 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.631716  1618 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 1.
W20260709 13:00:13.633543  1513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.010s	sys 0.041s
W20260709 13:00:13.633905  1513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.011s	sys 0.041s
I20260709 13:00:13.583678  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.521925  3066 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:13.540266  3070 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:13.585439  3041 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:13.658478  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 58835.6us
W20260709 13:00:13.684506  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 399732us
I20260709 13:00:13.688867  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:13.690719  3035 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:13.694622  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:13.504671  3033 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.629740  3039 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:13.607657  3042 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.578244  3068 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:13.658213  3028 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.703111  3032 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 13:00:13.599768  3063 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.696591  3066 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:13.683660  1687 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 13:00:13.899556  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:14.097741  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.095819  2210 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:14.095090  3065 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:13.953215  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 411877us
I20260709 13:00:14.086352  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:13.741559  3025 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:14.103331  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:14.103686  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.723506  3054 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:13.724380  3052 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.850831  3068 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:13.961098  3029 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:14.122370  2996 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:13.761607  3039 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:14.123142  2996 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:14.107785  3028 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:14.124100  3028 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:14.124300  3068 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:14.124506  3028 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.125144  2996 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:13.800194  3047 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:14.126638  3051 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:14.126914  3024 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:13.696290  3043 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:13.703434  3070 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:14.129528  3070 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:14.130888  2861 consensus_meta.cc:287] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 1.011s	user 0.005s	sys 0.015s
I20260709 13:00:13.961465  3057 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:13.960270  3023 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:14.144016  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.132426  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.145393  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:13.801335  3061 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:14.133235  3054 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:14.135967  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.137421  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:14.137094  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:13.862735  3053 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.800566  3064 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:13.802086  3026 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:13.928906  3046 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:14.140472  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:14.141966  1544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:34424
I20260709 13:00:13.924459  3077 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:14.001088  3058 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.802457  2978 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:14.037688  3030 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:13.901160  3059 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:13.800971  3078 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:14.148111  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.005s	sys 0.031s
I20260709 13:00:14.151464  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.155462  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:14.155711  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:14.150700  1541 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:14.161821  3064 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:14.340392  3064 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.341198  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.189963  3023 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:14.342368  3023 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:14.343595  3059 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:14.153064  2210 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:14.318257  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.346252  1539 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:14.158176  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.178432  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:14.177999  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:14.339859  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.013s	sys 0.037s
W20260709 13:00:14.346349  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 193378us
I20260709 13:00:14.159438  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.148092  2861 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:14.351212  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:14.372192  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:14.372022  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.159667  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.371447  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.352502  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:14.420956  1618 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
W20260709 13:00:14.421315  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 65666us
I20260709 13:00:14.422756  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:14.419891  3078 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:14.424301  3078 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.424536  3059 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:14.428041  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 610) took 1033 ms. Trace:
W20260709 13:00:14.327622  2995 consensus_meta.cc:287] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.668s	user 0.008s	sys 0.003s
I20260709 13:00:14.430558  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:14.385353  1512 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:34459 timed out after 1.550s (SENT) [suppressed 2 similar messages]
I20260709 13:00:14.192945  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.431365  2210 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:14.371534  3079 raft_consensus.cc:2804] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:14.445779  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:14.446187  3023 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:14.452267  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:14.463534  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:14.464197  2239 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:14.453212  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:14.466964  3079 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:14.468348  3079 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.195226  3066 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:14.439225  1587 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:14.470510  1441 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58806 (request call id 165) took 1181 ms. Trace:
I20260709 13:00:14.190707  2979 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:14.459717  2240 raft_consensus.cc:1240] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:14.470875  1441 rpcz_store.cc:276] 0709 13:00:13.289546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.289890 (+   344us) service_pool.cc:224] Handling call
0709 13:00:14.470444 (+1180554us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10,"reported_tablets":1}
I20260709 13:00:14.459631  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.480495  3083 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:14.460209  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 1870) took 1032 ms. Trace:
I20260709 13:00:14.460393  3055 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:14.457432  3064 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:14.461027  3078 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:14.432546  2995 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:14.468609  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:14.303556  3080 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:14.511348  2242 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:14.428390  1692 rpcz_store.cc:276] 0709 13:00:13.393487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.393640 (+   153us) service_pool.cc:224] Handling call
0709 13:00:14.353571 (+959931us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b58001c3598. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc4966f10a0 00007fc4966f0984 00007fc48fc6b6d4 00007fc48fc6b662
0709 13:00:14.426349 (+ 72778us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12777344}
I20260709 13:00:14.457626  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:14.481662  1617 rpcz_store.cc:276] 0709 13:00:13.427674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.427939 (+   265us) service_pool.cc:224] Handling call
0709 13:00:13.437492 (+  9553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.694019 (+256527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.694046 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:13.694090 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:13.694123 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.459855 (+765732us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54002021d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:14.459898 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.460017 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589486976}
I20260709 13:00:14.192760  3063 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:14.479535  2211 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:14.481431  3083 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:14.487059  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:14.487561  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:14.488029  2861 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:14.485899  2979 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:14.193848  3033 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:14.524551  3064 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:14.525009  2979 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:14.532639  1511 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:14.534782  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:14.536257  2979 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:14.536669  2979 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:14.537048  2979 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:14.517473  3080 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:14.509611  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 78430.7us
I20260709 13:00:14.514473  1587 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:14.526072  3083 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:14.487622  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:14.485651  3055 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:14.515883  2241 raft_consensus.cc:2393] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 2: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:14.343618  3077 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:14.519853  3078 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:14.512902  2245 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
W20260709 13:00:14.543476  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 157155us
I20260709 13:00:14.542650  1587 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:14.546346  2995 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:14.546160  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:14.550980  1587 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:14.550112  1511 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:14.517179  3028 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:14.551329  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 1869) took 1138 ms. Trace:
I20260709 13:00:14.552624  1587 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:14.554611  1587 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:14.547001  3055 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:14.526644  3085 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:14.554746  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:14.548285  3029 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:14.558102  3077 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:14.556639  1587 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:14.554061  1620 rpcz_store.cc:276] 0709 13:00:13.400182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.423758 (+ 23576us) service_pool.cc:224] Handling call
0709 13:00:13.426777 (+  3019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.120125 (+693348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.120152 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.120196 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:14.120464 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.538158 (+417694us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b540033c554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:14.538199 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.538312 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1593875840}
I20260709 13:00:14.561281  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:00:14.564118  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 462701us
W20260709 13:00:14.564384  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.564208  2244 raft_consensus.cc:1240] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:14.565066  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.562960  3058 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:14.566268  3058 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:14.553135  3030 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:14.569271  1587 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:14.566715  3058 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.554232  3043 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:14.575649  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:14.572983  1660 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:14.558997  3064 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:14.555927  3070 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:14.574438  1587 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:14.578989  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:14.577064  3061 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:14.563333  3029 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:14.571213  3030 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:14.577371  3043 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:14.580001  3052 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:14.580303  3064 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:14.581959  3070 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:00:14.602486  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 44012.8us
I20260709 13:00:14.586692  3068 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:14.589274  3080 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:14.588866  3061 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:14.608083  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:14.598470  3030 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.591634  3029 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.610482  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:14.602383  3043 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:14.604748  3070 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.603170  3064 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.601560  3033 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:14.602142  3052 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:14.605532  3068 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:14.639374  3068 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.639928  1660 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:14.639101  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.609634  3066 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:14.641809  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:14.684499  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 44653.7us
I20260709 13:00:14.763767  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.621382  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.674186  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.765172  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:14.699609  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.708776  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.767747  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:14.611704  3061 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:14.612236  3040 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:14.728883  3037 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:14.699198  3057 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:14.618000  2966 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:14.698751  2967 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:14.785377  2967 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:14.785310  2966 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:14.785907  2967 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:14.780215  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 198752us
I20260709 13:00:14.636379  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.781518  3066 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:14.793372  2966 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:14.674695  3046 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:14.798552  3046 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:14.717738  3079 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:14.799636  3048 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:14.780946  3037 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:14.799525  3055 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:14.800778  2239 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:14.801667  3037 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:14.791152  3057 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:14.637223  3028 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:14.804841  1622 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:14.643841  3033 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:14.782606  3040 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:14.794018  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:14.794579  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.643950  3052 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.753686  3027 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:14.798985  3046 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.705765  3047 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:14.782015  3035 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:14.824996  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.733407  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 118) took 1339 ms. Trace:
I20260709 13:00:14.818480  2237 raft_consensus.cc:1240] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:14.818782  1544 raft_consensus.cc:606] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:14.821703  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:14.813388  2242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45882 (request call id 401) took 1065 ms. Trace:
I20260709 13:00:14.852718  1540 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 1.
I20260709 13:00:14.733137  3054 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:14.813036  3040 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:14.799433  2979 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:14.846735  2243 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:14.852605  2242 rpcz_store.cc:276] 0709 13:00:13.748448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.748832 (+   384us) service_pool.cc:224] Handling call
0709 13:00:14.351837 (+603005us) spinlock_profiling.cc:243] Waited 60.5 ms on lock 0x7b5800003998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:00:14.352205 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.511872 (+159667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.813178 (+301306us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54004f1d54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:14.813322 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504326784}
W20260709 13:00:14.868980  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 102221us
I20260709 13:00:14.825449  3035 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:14.851850  3037 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:14.819392  3048 consensus_queue.cc:1059] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:00:14.877915  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:14.847151  3047 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:14.875085  3066 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:14.892459  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:14.881989  3035 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.885548  3037 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:14.859565  3051 consensus_queue.cc:1059] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:00:14.900779  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:14.904970  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:14.847308  1689 rpcz_store.cc:276] 0709 13:00:13.393996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.403345 (+  9349us) service_pool.cc:224] Handling call
0709 13:00:14.699859 (+1296514us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b58001c3598. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:00:14.732865 (+ 33006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.733049 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.733077 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.733122 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:14.733153 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.733216 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.733333 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11450240}
I20260709 13:00:14.901914  3039 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:14.902753  3079 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:14.903959  3066 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:14.910491  3029 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:14.926738  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 105811us
I20260709 13:00:14.907039  3082 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:14.929574  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.945406  3039 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:14.947145  3039 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:14.949491  3039 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:14.935586  3055 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:14.951318  3037 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:14.936089  3066 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:14.954388  3066 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:14.954512  1511 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:14.955883  1587 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:14.955394  3051 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.957168  3032 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:14.960377  3033 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:14.962507  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.966861  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.969357  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:14.969900  2241 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:14.971572  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.972877  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.975193  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.956291  3082 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:14.955071  3064 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:14.926206  3093 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:14.982959  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.984246  3068 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:14.986302  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.991436  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.991412  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.992959  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.994680  1621 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:14.995412  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:14.996999  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:14.996874  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.995276  3033 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:14.998394  3033 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:14.999497  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.999781  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.000555  3033 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:15.000584  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:15.001147  1617 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 13:00:15.001435  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.002023  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.002749  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.003351  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.003499  1622 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 13:00:15.005929  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.006027  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:14.974798  3048 consensus_queue.cc:1059] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:00:15.006419  1619 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 13:00:15.010722  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:15.012609  2983 raft_consensus.cc:3055] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:15.003070  3064 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:15.013000  2983 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:15.013934  2983 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:14.998858  3030 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.007689  3029 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:15.015739  1619 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.008920  3070 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.023164  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.029922  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.024652  3083 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.020778  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.032655  1618 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:15.026060  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.027947  2240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 324) took 1776 ms. Trace:
I20260709 13:00:15.023695  3079 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:15.030813  1617 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:14.989427  3043 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.016638  2983 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.015314  3047 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:15.035516  3083 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:15.046182  2241 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:15.002920  3046 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.038511  1614 raft_consensus.cc:1240] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:15.035957  2240 rpcz_store.cc:276] 0709 13:00:13.251078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.251220 (+   142us) service_pool.cc:224] Handling call
0709 13:00:13.251539 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.480739 (+1229200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.027596 (+546857us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54006243d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:15.027876 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2777224064}
I20260709 13:00:15.014963  3058 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.039615  3068 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:15.048050  1616 raft_consensus.cc:1240] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:15.042295  3079 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.048969  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.049290  2243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45882 (request call id 398) took 1353 ms. Trace:
I20260709 13:00:15.049785  3046 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:15.049719  2243 rpcz_store.cc:276] 0709 13:00:13.696244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.702977 (+  6733us) service_pool.cc:224] Handling call
0709 13:00:14.754011 (+1051034us) spinlock_profiling.cc:243] Waited 85.7 ms on lock 0x7b5800003998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:00:14.824812 (+ 70801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.879441 (+ 54629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.049070 (+169629us) spinlock_profiling.cc:243] Waited 70.4 ms on lock 0x7b54007a3ad0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:15.049231 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359091456}
I20260709 13:00:15.050163  3079 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:15.054024  1511 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:15.055032  3025 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:15.055547  3025 raft_consensus.cc:697] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:15.056115  3058 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:15.056348  3025 consensus_queue.cc:237] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.050184  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.058766  1614 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 13:00:15.060102  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.060417  1445 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42132 (request call id 229) took 1461 ms. Trace:
I20260709 13:00:15.060863  1445 rpcz_store.cc:276] 0709 13:00:13.598689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.598861 (+   172us) service_pool.cc:224] Handling call
0709 13:00:15.060359 (+1461498us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":835461,"reported_tablets":1}
I20260709 13:00:15.064888  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.066026  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.044103  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.067195  3048 consensus_queue.cc:1059] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:15.067768  3023 raft_consensus.cc:3055] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.069172  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:15.070655  1621 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:15.070744  3043 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:15.071281  1613 raft_consensus.cc:1240] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:15.073771  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.077363  3023 raft_consensus.cc:740] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:15.080497  2979 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:15.079394  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.080418  3023 consensus_queue.cc:260] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.081337  1614 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:15.081461  3024 raft_consensus.cc:3055] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.081837  3024 raft_consensus.cc:740] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:15.081946  3053 raft_consensus.cc:3055] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.082472  3053 raft_consensus.cc:740] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:15.082964  3024 consensus_queue.cc:260] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.083418  3053 consensus_queue.cc:260] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.084369  3024 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.084879  3053 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.087471  3051 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.090610  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.099855  3035 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.059998  3061 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.100575  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.101130  1615 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:15.095116  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.102661  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.081828  3023 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.093230  3030 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:15.095928  3070 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:15.096691  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:15.107040  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.097283  2967 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.099745  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.113276  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.101984  3035 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:15.091676  3082 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:15.130367  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.122665  1619 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:15.126296  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:15.136351  1622 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:15.092939  3052 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.076553  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:15.104322  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:14.989087  3093 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.078130  3097 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.097119  3057 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:15.107630  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.108304  3065 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.126214  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:15.161649  3093 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:15.116377  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:15.143635  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.118428  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:00:15.120651  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.123584  3061 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:15.122545  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:15.114765  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.103654  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:15.139137  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.126145  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:15.140618  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.138218  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:15.161717  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:15.109966  1660 consensus_peers.cc:597] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 479456ab418d44c4983d2bb37eb0e700. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:15.166227  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 56381.8us
I20260709 13:00:15.166085  2210 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:15.136204  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.118423  3077 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:00:15.125962  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.170435  2987 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:15.172464  2987 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 3 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:15.173372  2987 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.170915  1620 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:15.171629  3052 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:15.171375  3065 consensus_queue.cc:1059] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:15.183930  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:15.185382  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:15.187453  2211 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:15.189921  3055 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.191604  1587 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.192586  3058 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.192857  2211 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.193895  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:15.195127  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:15.196012  1620 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:15.196931  3069 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.118492  3026 consensus_queue.cc:1059] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:00:15.203292  2211 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.204207  3079 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.203500  3069 raft_consensus.cc:3055] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:15.205924  3069 raft_consensus.cc:740] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:15.206903  3069 consensus_queue.cc:260] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.208325  3069 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.211601  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.212711  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.212827  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.214803  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:15.216261  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.217806  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.218809  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.218915  2967 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:15.218983  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:15.220158  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.221215  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:15.221997  1619 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 2: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:15.223153  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.225059  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:15.226739  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 48888us
I20260709 13:00:15.229382  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:15.231528  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.240660  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.236086  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.245873  3057 raft_consensus.cc:3055] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.246403  3057 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:15.247295  3057 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.248519  3057 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.251701  3093 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.252247  3093 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:15.253357  3093 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.267067  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.254927  3093 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.272514  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.136755  3040 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.276204  1660 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:15.277555  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.279388  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.274080  3046 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:15.282596  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 91491.1us
I20260709 13:00:15.274103  3082 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.278492  3097 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:00:15.291834  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.292119  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.292963  3097 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.293154  2966 consensus_queue.cc:1059] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:15.293877  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:15.293936  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.294618  1620 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 3: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:15.294142  2966 raft_consensus.cc:3055] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.295150  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.295962  1445 catalog_manager.cc:5697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 2 to 3, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 3 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:15.298969  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.280906  3065 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:15.299808  3065 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:15.300284  3065 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.299834  1544 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 13:00:15.302654  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.303678  1692 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 4: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:15.297547  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.294986  3047 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.301741  2966 raft_consensus.cc:740] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:15.312521  2966 consensus_queue.cc:260] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.314700  2966 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.316314  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.316708  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.317713  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.317250  1541 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 13:00:15.320166  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.321247  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.325521  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.325918  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.327679  2243 raft_consensus.cc:1240] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:15.328836  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:15.324261  2978 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.331743  3047 consensus_queue.cc:1059] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:15.332640  2967 raft_consensus.cc:3055] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:15.332980  2967 raft_consensus.cc:740] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:15.333205  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.333895  2967 consensus_queue.cc:260] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.334314  3070 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:15.336843  2983 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.307085  3097 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.339999  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.340837  3070 consensus_queue.cc:1059] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:15.341629  1511 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:15.349025  3070 raft_consensus.cc:3055] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.346961  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.349802  3053 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:15.350193  3053 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:15.350658  3053 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.350272  3065 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.351099  3024 consensus_queue.cc:1059] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:15.347976  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.349400  3070 raft_consensus.cc:740] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:15.356417  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.356715  3070 consensus_queue.cc:260] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.355770  3024 raft_consensus.cc:3055] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.357635  3024 raft_consensus.cc:740] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:15.357894  3070 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.358238  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.358465  3024 consensus_queue.cc:260] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.349402  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.357127  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.359668  3024 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.360863  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.361109  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.361320  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.361886  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.362092  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.363201  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.363579  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.364923  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.365697  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.365904  1541 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:15.366269  1545 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:15.364153  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.367839  3051 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.367892  2979 consensus_queue.cc:1059] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:15.368211  3023 consensus_queue.cc:1059] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:15.368716  3051 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.369349  3023 consensus_queue.cc:1059] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:15.369802  2983 raft_consensus.cc:3055] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.370177  2983 raft_consensus.cc:740] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:15.372437  3040 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:15.363860  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.373304  2967 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.373749  1542 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:15.374476  2979 raft_consensus.cc:3055] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:15.374851  2979 raft_consensus.cc:740] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:15.367816  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.358405  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.372458  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.377439  1544 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 13:00:15.378033  1621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:00:15.378613  1621 raft_consensus.cc:606] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:15.381048  1511 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.384532   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:15.369357  3051 raft_consensus.cc:3055] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:15.385552  3051 raft_consensus.cc:740] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:15.385805  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:15.386497   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:15.386294  3051 consensus_queue.cc:260] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.386574  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.387586  3051 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.371085  2983 consensus_queue.cc:260] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.386788  1617 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 4: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:15.375629  2979 consensus_queue.cc:260] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.391724  2983 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.391957  2979 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:15.383553  3025 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:15.400626  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.400904  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.402264  1540 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:15.402385  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.404026  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.404726  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.407058  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.409025  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.402504  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.411913  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.414438  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.415853  1511 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.418968  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.420034  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.417462  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.421551  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.421646  2209 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:15.422920  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.425648  1511 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.427454  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.427945  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:15.430516  1696 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:15.432031  2209 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.433210  2209 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:15.412874  3023 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.436225  1696 raft_consensus.cc:1240] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:15.433398  1511 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.415314  3025 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.438962  2209 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:15.437209  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.437599  1659 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.442448  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.443673  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.445276  3060 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.445595  1545 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:15.437618  3091 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.446448  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.447150  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:15.436470  2987 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.448565  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:15.441258  3085 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.447008  3091 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.453209  3071 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.453886  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:15.451979  2209 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:15.453178  3077 raft_consensus.cc:2955] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:15.455526  3052 raft_consensus.cc:993] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:15.421300  3048 consensus_queue.cc:1059] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:00:15.454447  1622 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.453039  1659 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.458163  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.458731  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.458746  1545 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:15.459692  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.460371  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.461403  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.431649  2983 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.464359  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.465186  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.465929  1585 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:15.467711  3048 raft_consensus.cc:3055] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.455986  3052 raft_consensus.cc:1081] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:15.470669  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.468111  1692 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:15.471675  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.474812  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.476524  1512 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.449218  3026 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.472193  1693 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:15.477829  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.449771  3065 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:15.484112  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.490238  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.491211  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.478399  1512 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.492228  1659 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.492625  1512 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.494895  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.497974  1585 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:15.498328  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.500738  1585 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:15.501791  1659 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.503293  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.504029  1659 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.505887  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.506570  1545 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 2: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:15.473424  3048 raft_consensus.cc:740] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:15.494042  3091 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.509102  1695 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:15.524261  1546 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:15.496405  1512 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.510030  1539 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:15.505797  3064 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:15.541064  3064 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:15.541507  3064 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.512805  3057 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.515573  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.546448  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.547374  1542 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:15.570629  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.572638  1541 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:15.520679  1659 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.505961  3065 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.520018  1585 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:15.496665  3025 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.517315  3061 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:15.584791  3061 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:15.585273  3061 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.499444  3092 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.500777  2983 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.512426  3071 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:15.587986  3071 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:15.588418  3071 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.587854  1621 raft_consensus.cc:2955] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:15.547801  1546 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:15.548449  3048 consensus_queue.cc:260] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:15.550247  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.551399  3091 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:15.551522  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 55193.3us
I20260709 13:00:15.490231  3069 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:15.500106  3093 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:15.556790  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:15.616626  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 96711.4us
I20260709 13:00:15.617448  1538 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:15.578958  3053 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.581328  1691 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
W20260709 13:00:15.589545  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 81490us
I20260709 13:00:15.623169  1659 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.590030  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.522428  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:15.593242  1544 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:15.600069  1543 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
W20260709 13:00:15.612711  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 179341us
I20260709 13:00:15.621243  1585 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:15.631909  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.613809  1622 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:15.632108  1659 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.578821  3064 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.635771  1512 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.636379  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:15.636894  1659 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.638567  1659 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.640699  1512 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.642454  1511 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.644182  1511 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.633777  1660 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:15.646626  1511 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.651052  1511 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.655815  1659 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.611938  3065 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.661828  1512 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.638095  1585 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:15.615617  3093 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:15.661824  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 136865us
I20260709 13:00:15.616061  3069 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:15.627808  3068 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.673600  1585 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:15.635542  3029 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.640307  3039 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.640169  3057 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.652510  2967 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:15.690897  3104 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.653285  3024 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.655819  3070 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.653633  3091 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.652900  3025 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.653921  3051 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:15.652766  3048 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.699962  1512 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.655606  2979 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.662499  3037 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.662607  3023 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.671165  3040 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.676939  3093 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.676805  3082 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:15.653414  2983 consensus_queue.cc:1059] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:00:15.687359  3069 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.709728  3083 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.693037  3090 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.712752  2967 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:15.731383  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.722517  3077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50474 (request call id 13) took 2389 ms. Trace:
I20260709 13:00:15.737681  3091 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.735220  3109 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.767468  1512 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.769145  3053 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:15.745800  3023 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.741483  2967 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.746094  3051 raft_consensus.cc:3055] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:15.739876  3082 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:15.774192  1512 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.774489  2983 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:15.777073  3105 ts_tablet_manager.cc:933] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:15.783757  1622 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:15.787822  3064 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:15.790690  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.792054  3082 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.800647  3109 consensus_queue.cc:1059] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:15.802027  2983 raft_consensus.cc:3055] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.802387  2983 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:15.744585  3077 rpcz_store.cc:276] 0709 13:00:13.333775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.333977 (+   202us) service_pool.cc:224] Handling call
0709 13:00:13.484933 (+150956us) log.cc:844] Serialized 506 byte log entry
0709 13:00:14.489746 (+1004813us) spinlock_profiling.cc:243] Waited 8.18 ms on lock 0x7b58003a0ad0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491695090 00007fc49168543c 00007fc49168bd53 00007fc49168bcd9 00007fc49168bc69 00007fc49168bc31 00007fc49168adfd 000000000038f354 000000000038f199 00007fc48e63e475 00007fc48e6407c1
0709 13:00:14.562573 (+ 72827us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b18001305a0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e5b8c0a 00007fc497cf8219 00007fc48e640a40 00007fc48e63b4e4 00007fc48e63b455 00007fc491684b0b 00007fc491709b63 00007fc491731752 00007fc4966f1d29
0709 13:00:14.706775 (+144202us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b18001305a0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e60c2a6 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916abb26 00007fc4916a549a 00007fc4916a4714
0709 13:00:14.707706 (+   931us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b5400266720. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916abb26 00007fc4916a549a 00007fc4916a4714 00007fc491684eaa 00007fc49168bd53 00007fc49168bcd9 00007fc49168bc69 00007fc49168bc31 00007fc49168adfd 000000000038f354
0709 13:00:14.976706 (+269000us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b5400266720. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916a4142 00007fc491684eaa 00007fc49168bd53 00007fc49168bcd9 00007fc49168bc69 00007fc49168bc31 00007fc49168adfd 000000000038f354 000000000038f199 00007fc48e63e475
0709 13:00:15.722429 (+745723us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116755,"raft.queue_time_us":656004,"raft.run_cpu_time_us":49959,"raft.run_wall_time_us":1120636,"spinlock_wait_cycles":48532352,"thread_start_us":409204,"threads_started":1,"wal-append.queue_time_us":648703,"wal-append.run_cpu_time_us":1920,"wal-append.run_wall_time_us":1107400}
I20260709 13:00:15.804327  3071 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.803181  2983 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.805776  1691 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:15.805945  2983 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.784503  3091 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.779400  3051 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:15.815704  3051 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.817384  3051 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.799911  1512 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.806931  3071 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:15.825641  1659 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.827319  1659 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.827901  2209 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.828946  2209 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:15.832731  1696 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:15.834962  3026 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.835652  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:15.835068  2209 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.837539  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:15.855089  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 181579us
I20260709 13:00:15.832463  3079 raft_consensus.cc:2804] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:15.824733  3091 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:15.833293  3077 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.856477  1585 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:15.859982  1659 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.863359  1659 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.863359  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:15.865981  1585 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:15.838697  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:15.823412  3085 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:00:15.867388  3104 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.866961  3110 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.858016  2987 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:15.868487  2987 raft_consensus.cc:697] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:15.869376  3083 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.869807  2987 consensus_queue.cc:237] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.870905  1585 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.873015  3110 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:15.873391  3110 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:15.873751  3110 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.856258  3046 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:15.875667  1585 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.856638  3065 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.877190  1659 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.884477  1585 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:15.884516  1659 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.887542  1659 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.888118  1585 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.889091  1659 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.889788  1585 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:15.860136  3091 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:15.865633  3082 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.884728  3061 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.893453  3090 raft_consensus.cc:2804] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:15.897877  3090 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:15.898229  3090 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.899111  1621 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:15.875689  3079 raft_consensus.cc:697] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:15.886220  3037 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.892174  2966 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.904771  1543 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:15.890753  3064 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.890795  3039 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.904299  1547 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:15.908176  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.909528  1545 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:15.913166  1585 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:00:15.913676  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.895740  3091 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.894201  3077 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.908530  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.912557  3104 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:15.919111  3112 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:00:15.921329  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:15.898829  3061 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:15.907317  3071 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:15.934401  3069 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.932726  3037 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.934945  3057 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:15.935446  3079 consensus_queue.cc:237] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:15.934926  1585 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:15.937960  3064 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:15.938421  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:15.939601  1659 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:15.914595  3105 tablet_copy_client.cc:323] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 13:00:15.940724  1659 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.942075  3111 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:15.938509  3064 raft_consensus.cc:697] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:15.947570  2243 raft_consensus.cc:1240] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:15.942698  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:15.950863  3064 consensus_queue.cc:237] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.951649  3111 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:15.952380  3111 raft_consensus.cc:697] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:15.922693  3083 raft_consensus.cc:2764] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:15.955263  1585 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:15.955631  1659 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:15.956686  1585 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:15.959717  3030 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:15.960323  3030 raft_consensus.cc:697] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:15.961529  3030 consensus_queue.cc:237] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.953521  3111 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.963845  3057 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.949770  3037 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.924777  3104 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:15.967473  3104 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.971174  1585 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:15.984603  1539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39628
I20260709 13:00:15.985430  1539 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:15.985821  1539 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.988509  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.988816  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:15.969239  3077 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.969544  3061 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:15.986779  2966 consensus_queue.cc:1059] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:00:15.995528  3067 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:00:15.996655  3061 raft_consensus.cc:697] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:15.997639  3061 consensus_queue.cc:237] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.998596  3070 raft_consensus.cc:993] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:00:15.999107  3070 raft_consensus.cc:1081] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:00:16.004987  1539 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:15.983587  3092 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:16.008324  1706 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet 479456ab418d44c4983d2bb37eb0e700 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 13:00:16.008384  2240 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:16.009223  2966 raft_consensus.cc:3055] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:16.012087  1539 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:16.012290  1659 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:16.016253  1622 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:16.030910  1694 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:45652
I20260709 13:00:16.017704  3037 consensus_queue.cc:1059] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:15.994801  3093 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:16.031571  1694 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:16.020547  3097 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:16.041265  3069 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:16.007768  3067 consensus_queue.cc:1059] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:00:16.018827  2966 raft_consensus.cc:740] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:16.026566  3026 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:16.018854  3092 raft_consensus.cc:697] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:16.016908  3082 consensus_queue.cc:1059] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 13:00:16.039866  3118 log.cc:927] Time spent T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:00:16.040478  3057 raft_consensus.cc:3055] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:16.038419  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:16.037247  1694 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:16.053560  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.025264  1706 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet 479456ab418d44c4983d2bb37eb0e700 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-479456ab418d44c4983d2bb37eb0e700
I20260709 13:00:16.069384  1618 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:16.042896  3067 raft_consensus.cc:3055] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:16.027338  3071 consensus_queue.cc:1059] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:00:16.078120  1547 raft_consensus.cc:2955] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:16.082265  1689 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:16.072253  3057 raft_consensus.cc:740] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:16.036051  3023 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:00:16.084479  3057 consensus_queue.cc:260] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:16.084720  2967 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:16.043682  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:16.027607  3110 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:16.087183  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 88058.8us
I20260709 13:00:16.105283  3033 raft_consensus.cc:3055] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:16.105973  3033 raft_consensus.cc:740] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:16.114239  1441 catalog_manager.cc:5697] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 2 to 3, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.102751  1443 catalog_manager.cc:5697] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.119678  3033 consensus_queue.cc:260] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:16.126151  3033 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:16.144930  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.076251  3067 raft_consensus.cc:740] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:16.150419  1694 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:16.093420  3057 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.164631  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:16.166724  1539 raft_consensus.cc:3055] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:16.167044  1539 raft_consensus.cc:740] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:16.163950  1694 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:16.094466  1688 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:16.188572  3110 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:16.173851  3092 consensus_queue.cc:237] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:16.190366  1706 tablet_copy_source_session.cc:215] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:16.187230  3090 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:16.236951  3091 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:16.240092  3090 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:16.240710  3037 raft_consensus.cc:3055] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:16.241120  3037 raft_consensus.cc:740] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:16.202976  3067 consensus_queue.cc:260] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:16.241940  3037 consensus_queue.cc:260] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:16.242455  3067 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:16.204833  3104 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:16.223012  3093 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:16.246313  3091 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:16.279161  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 256311us
I20260709 13:00:16.330513  3037 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.330737  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:16.318610  1620 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:16.334158  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:16.336251  1539 consensus_queue.cc:260] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:16.345398  3104 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:16.237661  2966 consensus_queue.cc:260] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:16.351171  2966 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.361263  2967 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:16.377220  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:16.386018  1539 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.371683  2239 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:16.390781  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:16.392899  2242 raft_consensus.cc:2393] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 2: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
W20260709 13:00:16.395381  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 51612.3us
W20260709 13:00:16.410596  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.412906  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:16.419515  3105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479456ab418d44c4983d2bb37eb0e700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:16.420203  3071 consensus_queue.cc:1059] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:16.422101  3093 raft_consensus.cc:3055] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:16.422530  3093 raft_consensus.cc:740] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:16.425398  3093 consensus_queue.cc:260] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:16.427011  3093 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.451675   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:16.454506  3136 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:00:16.474195  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 429388us
I20260709 13:00:16.480557  1690 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:16.485215  2211 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:16.486284  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:16.486507  3026 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:00:16.459733  3133 log.cc:927] Time spent T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.195s	user 0.001s	sys 0.001s
W20260709 13:00:16.472821  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:16.500568  1586 consensus_peers.cc:597] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ca86ee366e14bdd8686ea8e5b48be10. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:16.504707  3093 consensus_queue.cc:1059] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:16.507515  1688 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
W20260709 13:00:16.508976  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:16.512676  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.516363  3071 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.517026  3071 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:16.518848  1620 raft_consensus.cc:1275] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:16.519266  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:16.519487  3071 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:16.520366  1621 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 2: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:16.523262  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:16.526248  1620 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:16.527868  2978 consensus_queue.cc:1048] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:16.528988  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:16.499163  3136 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:16.535111  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:00:16.536168  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.535884  3136 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:16.535571  1539 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:16.544947  3079 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:16.493134  1691 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:16.560616  1547 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:16.560880  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:16.564884  2243 raft_consensus.cc:2393] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 2: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:16.570726  3092 consensus_queue.cc:1059] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:16.571897  3083 consensus_queue.cc:1059] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:16.572535  3104 raft_consensus.cc:3055] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:16.572996  3104 raft_consensus.cc:740] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:16.573776  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:16.574056  3104 consensus_queue.cc:260] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:16.574599  1618 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:16.577042  1617 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:16.577795  3030 raft_consensus.cc:3055] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:16.578328  3030 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:16.579842  3071 raft_consensus.cc:3055] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:16.580277  3071 raft_consensus.cc:740] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:16.581486  3071 consensus_queue.cc:260] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:16.583561  3104 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:16.584049  3071 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.586928  3030 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
W20260709 13:00:16.598557  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.599030  1441 catalog_manager.cc:5697] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 1 to 2, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:16.611099  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.611755  1441 catalog_manager.cc:5697] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 1 to 2, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:16.617484  3093 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.628284  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:16.632320  1618 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:16.625643  3030 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:16.630774  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:16.633838  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:16.634354  1443 catalog_manager.cc:5697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 2 to 3, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:16.640080  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:16.644302  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.647797  1547 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:16.658457  1690 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.660832  1541 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:16.662704  1547 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:16.673434  1690 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.663751  3057 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:16.630869  3093 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:16.678135  3057 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.670837  2966 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:00:16.680426  3057 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:16.680485  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:16.681394  1618 raft_consensus.cc:3055] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:16.681753  1618 raft_consensus.cc:740] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:16.682781  1618 consensus_queue.cc:260] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:16.683840  1618 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:16.683993  1622 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:16.684316  3023 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.684914  3023 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:16.686511  1511 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:16.683981  1620 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:16.689378  3091 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:16.691322  1689 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:16.680430  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:16.700425  1585 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:16.687758  3023 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:16.715811  3032 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:16.716379  1585 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:16.716661  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:16.717350  2240 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:16.717556  3137 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:16.723619  3136 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:16.719002  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:16.730618  1689 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:16.735357  3023 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:16.732142  3093 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:16.740059  3023 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.746915  3023 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:16.759622  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:16.768023  2240 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:16.743942  3092 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:00:16.775939  1660 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:00:16.778380  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.777779  3093 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:16.787125  3142 log.cc:927] Time spent T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:00:16.787659  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:16.788383  1616 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 13:00:16.781538  1659 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:16.789588  3091 consensus_queue.cc:1059] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:16.789866  3037 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:16.792925  3037 raft_consensus.cc:697] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:16.791900  1659 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:16.780781  3093 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.816946  3093 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:16.819500  2967 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:16.820426  3126 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:16.820791  3112 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.821000  3126 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:16.821348  3112 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:16.786978  3057 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:16.822767  3023 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:16.794155  3037 consensus_queue.cc:237] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:16.832175  3112 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:16.832480  3146 raft_consensus.cc:3055] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:16.832182  3057 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:16.832844  3146 raft_consensus.cc:740] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:16.833376  3023 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:16.833953  3146 consensus_queue.cc:260] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:16.835608  3057 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:16.835093  1659 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:16.842679  1688 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.844172  3105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45882 (request call id 419) took 1270 ms. Trace:
I20260709 13:00:16.844936  1691 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:16.860059  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:16.861045  1696 raft_consensus.cc:2368] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3.
I20260709 13:00:16.845858  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:16.848172  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:16.848664  3126 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:16.849655  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:00:16.854198  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.854717  2967 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:16.854947  3146 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.875916  2967 raft_consensus.cc:697] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:16.877050  2967 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:16.867072  1616 raft_consensus.cc:2393] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 2: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:16.864996  2240 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:16.864199  3105 rpcz_store.cc:276] 0709 13:00:15.573507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.575538 (+  2031us) service_pool.cc:224] Handling call
0709 13:00:15.791405 (+215867us) ts_tablet_manager.cc:934] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
0709 13:00:16.416968 (+625563us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:16.643498 (+226530us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:16.643621 (+   123us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:16.843124 (+199503us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:16.843503 (+   379us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:16.843855 (+   352us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:16.844024 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":31508,"tablet-copy.queue_time_us":200834,"thread_start_us":180018,"threads_started":2}
I20260709 13:00:16.865171  2211 leader_election.cc:400] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3.
I20260709 13:00:16.869151  3067 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.874235  3032 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:16.882020  2211 leader_election.cc:403] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:00:16.884208  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 98239.8us
I20260709 13:00:16.887348  3067 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:16.895620  1618 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:16.903120  1696 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.914510  1511 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:16.915911  3091 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:16.899215  3105 tablet_copy_client.cc:806] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:16.925294  3105 tablet_copy_client.cc:670] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:16.930053  3091 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:16.939407  1696 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.942345  3071 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.942879  3071 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:16.944037  1538 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:16.945439  1547 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:16.951720  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 48255.9us
I20260709 13:00:16.952436  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:16.954471  1539 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:16.957506  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:16.961974  1547 raft_consensus.cc:2393] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 2: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:16.962055  1688 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.957942  3091 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:16.963194  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:16.966877  1541 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.967653  3091 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:16.964231  1545 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.969424  1538 raft_consensus.cc:2393] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 2: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:16.969496  2240 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:16.970175  3126 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3.
I20260709 13:00:16.970351  3071 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:16.980813  1511 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:16.981755  3091 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:16.982363  3091 raft_consensus.cc:697] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:16.984463  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:16.983448  3091 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:16.985179  2242 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:16.985857  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:16.983040  3067 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:16.987880  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:16.988147  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:16.988551  2243 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:16.988770  1621 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:16.984411  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:16.992166  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.994966  1511 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:16.996685  1443 catalog_manager.cc:5697] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 3 to 4, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:17.003404  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.005015  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:17.008457  3152 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.009191  3152 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.009706  3152 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.015268  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:17.005052  1443 catalog_manager.cc:5697] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 1 to 2, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.017011  1538 raft_consensus.cc:2368] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3.
I20260709 13:00:17.018075  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:17.020395  3150 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:17.021723  3104 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:17.017269  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:17.028940  1618 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:17.032325  1443 catalog_manager.cc:5697] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 2 to 3, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.978948  3093 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:17.066802  1538 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:17.068295  3023 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.068913  3023 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.052352  1443 catalog_manager.cc:5697] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 1 to 2, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.073113  1443 catalog_manager.cc:5697] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 1 to 2, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:17.030548  3032 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:00:17.081262  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:17.093518  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.094122  2210 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:00:17.094939  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 63983.8us
I20260709 13:00:17.095782  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:17.102048  1621 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:17.108834  3091 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.109638  3091 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.112522  3091 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:17.113019  1538 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:17.113983  3088 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:17.114354  3088 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.114729  3088 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:17.112639  3023 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:17.122928  1540 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:17.124584  3088 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:17.126749  3088 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:17.128607  3093 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:17.134321  2242 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:17.136756  1688 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:17.138562  1540 raft_consensus.cc:1275] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:00:17.139214  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 43514.3us
I20260709 13:00:17.139724  3165 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:17.151255  3165 raft_consensus.cc:697] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:17.152514  3165 consensus_queue.cc:237] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:17.141566  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:17.154642  1617 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:17.155401  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:17.156340  3146 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:17.156852  3146 raft_consensus.cc:697] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:17.158001  3146 consensus_queue.cc:237] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:17.159397  3105 tablet_copy_client.cc:538] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:17.147735  1512 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:17.160635  3150 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:17.161264  3150 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:17.160741  1445 catalog_manager.cc:5697] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 1 to 2, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:17.162289  3150 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:17.165558  3158 log.cc:927] Time spent T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.147s	user 0.003s	sys 0.001s
I20260709 13:00:17.170392   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:17.174469  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:17.178725  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:17.181128  1617 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:17.163916  3152 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:17.188038  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.187098  1441 catalog_manager.cc:5697] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 2 to 3, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.203399  3156 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.211854  1691 raft_consensus.cc:2393] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:17.212610  2210 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:17.231210  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:17.206080  2987 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:00:17.237398  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:17.238953  1540 raft_consensus.cc:2393] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 3: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:17.241686  1538 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:17.224367  2239 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.245867  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:17.249614  1539 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:17.250289  1542 raft_consensus.cc:2393] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 3: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:17.253072  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:17.232620  3156 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.253722  1691 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:17.254797  1659 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:17.262862  3105 tablet_bootstrap.cc:492] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:00:17.270236  3152 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:17.272758  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:17.278506  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 65964.2us
I20260709 13:00:17.280303  3071 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.280884  3071 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:17.281343  3071 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.252691  3026 consensus_queue.cc:1048] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:00:17.283612  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:17.284466  1692 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:17.255498  3067 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:17.299619  1512 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:00:17.300643  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 65882.9us
I20260709 13:00:17.297158  3067 raft_consensus.cc:697] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:17.309525  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:17.304629  3023 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.362237  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:17.363667  1691 raft_consensus.cc:2393] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:17.394004  1585 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:17.364516  3023 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.354168  3152 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.404721  3067 consensus_queue.cc:237] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:17.408869  2239 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
W20260709 13:00:17.410375  3169 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:00:17.411463  3112 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:17.412001  3112 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.413887  3091 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.414135  3112 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:17.414659  3112 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:17.414390  3091 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.416489  3091 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:17.418790  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:17.420271  1691 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:17.423481  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:17.424293  1538 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:17.428234  1692 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:17.401664  3023 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:17.461278  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 157674us
I20260709 13:00:17.462512  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:17.464212  1659 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:17.466550  3037 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.466646  3136 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:17.467065  3037 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.467525  3037 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.428791  3091 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.469081  3091 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:17.471227  3091 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:17.491673  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 97742.1us
I20260709 13:00:17.415136  3112 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:17.495960  1585 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:17.497475  3032 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:17.498086  3137 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:17.498454  3032 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:17.498603  1585 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:17.463259  3156 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:17.501127  3032 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:17.512166  1585 leader_election.cc:400] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3.
I20260709 13:00:17.512583  1585 leader_election.cc:403] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:17.466017  3152 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.521128  3173 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.532691  3061 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:17.532797  3071 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.503758  3150 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:17.535523  3173 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:17.539038  3090 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:17.540122  3173 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:17.541046  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:17.542483  3112 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:17.531399  3137 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3.
I20260709 13:00:17.544865  3071 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:17.544870  3152 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:17.546141  3150 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.544662  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:17.548207  3037 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.548853  2243 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:17.550580  3037 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:17.551216  1511 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:17.552379  3091 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.552856  3091 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:17.553341  3091 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.561198  1540 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:00:17.561911  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 306428us
I20260709 13:00:17.530036  3023 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.513876  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:17.564802  3091 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:17.570416  1660 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:17.571419  3090 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:17.572765  3071 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:17.573251  3071 raft_consensus.cc:697] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:17.574107  3071 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:17.575700  3156 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.576185  3156 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:17.578384  3156 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:17.579272  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:17.579874  1694 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:17.584616  2211 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:17.594985  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:17.595777  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:17.595871  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:17.596539  1618 raft_consensus.cc:2393] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 2: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:17.598235  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:17.598269  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:17.599898  2242 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:17.610280  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:17.615031  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:17.615702  1616 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:17.616235  1619 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:17.617596  3023 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:17.620450  3150 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:17.623349  3091 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:17.608556  3067 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.625294  3067 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.625708  3067 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.627645  1619 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:17.632459  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:17.633164  1619 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:17.632618  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:17.632535  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:17.634898  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:17.635464  1546 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.635984  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:17.636515  1541 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.637133  3150 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:17.631827  1512 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:17.640537  1512 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:17.642457  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:17.642810  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:17.632534  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:17.648471  1512 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:17.649979  1540 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:17.651762  3112 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:17.652266  3152 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:17.654279  1511 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:17.643996  3091 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:17.647341  3023 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:17.675761  1541 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:17.657414  3146 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.686744  1511 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:17.662374  3163 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.661059  3023 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:17.691674  1546 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:17.680636  3092 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.684281  3146 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.661453  3152 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 13:00:17.702746  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 44142.2us
I20260709 13:00:17.705411  3092 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.706552  2242 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:17.707831  3092 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:17.694607  3023 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.710707  1511 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:17.709787  3091 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.712302  3183 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:00:17.712605  3091 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:17.713080  3091 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.699918  3163 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:17.716094  3170 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.419s	user 0.007s	sys 0.000s
I20260709 13:00:17.716706  3163 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:17.704676  3146 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.719815  1538 raft_consensus.cc:1240] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:17.722754  1445 catalog_manager.cc:5697] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.737923  1445 catalog_manager.cc:5697] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 2 to 3, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:17.766023  2242 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:17.760706  3152 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:17.775344  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:17.786938  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:17.787496  1690 raft_consensus.cc:606] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:17.787784  1546 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:17.787930  1690 raft_consensus.cc:614] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:17.790648  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:17.793924  3091 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.797945  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:00:17.798624  1613 raft_consensus.cc:606] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:17.809386  3023 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.816272  3091 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:17.821388  1660 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:17.851701  3023 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:17.804932  3067 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:17.834997  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7803266de9984fac88726b08bee73921"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:17.837463  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:17.855891  1689 raft_consensus.cc:606] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:17.844563  3136 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.856930  3136 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.858522  2240 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:17.844743  2966 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:00:17.846163  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 75192.8us
I20260709 13:00:17.854084  3185 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:17.862110  3152 raft_consensus.cc:697] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:17.862728  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:17.863399  1687 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:17.863134  3152 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:17.864202  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:17.864949  1693 raft_consensus.cc:2393] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:17.821712  1442 catalog_manager.cc:5697] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:17.858950  3136 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:17.873185  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 51863.4us
I20260709 13:00:17.873976  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:17.875332  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:17.881026  1693 raft_consensus.cc:2393] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:17.884575  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:17.885774  1617 raft_consensus.cc:2393] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 2: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:17.830534  3146 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.893880  1696 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:17.905036  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:17.905934  1696 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.908362  1659 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:17.909368  1659 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:17.909905  2966 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:17.910284  3157 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:17.910481  2966 raft_consensus.cc:697] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:17.910950  3157 raft_consensus.cc:697] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:17.909399  3165 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:00:17.911566  2966 consensus_queue.cc:237] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.912326  3157 consensus_queue.cc:237] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.916474  3156 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:17.917289  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:17.918080  1542 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:17.917172  3156 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } }
I20260709 13:00:17.923889  1694 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:17.924873  1540 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:17.928208  3156 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:17.923868  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:17.930537  1693 raft_consensus.cc:2393] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:17.930626  1546 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 3: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:17.883400  3163 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.926674  3172 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:00:17.937285  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:17.920348  3071 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.888036  3092 consensus_queue.cc:1059] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:00:17.948328  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:17.960717  2240 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:17.952564  3190 log.cc:927] Time spent T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.183s	user 0.000s	sys 0.003s
I20260709 13:00:17.957757  3146 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:17.933454  3163 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.963452  3163 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.963821  3067 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:17.966967  1696 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:17.973608  3146 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:17.974742  3146 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:17.975133  3146 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:17.976015  3071 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:17.976243  3146 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:17.977908  3146 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.978488  3071 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:17.982481  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:17.983702  1622 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:17.985998  3199 raft_consensus.cc:993] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:00:17.986472  3199 raft_consensus.cc:1081] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:00:17.993031  1617 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.994626  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:17.995323  1615 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:17.996783  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:17.997501  1696 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.997838  1622 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:00:17.998236  1622 pending_rounds.cc:85] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 2
I20260709 13:00:17.998515  1622 pending_rounds.cc:107] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.3
I20260709 13:00:17.998665  1613 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:17.998935  1622 raft_consensus.cc:2917] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Aborting config change with OpId 2.3: Aborted: Op aborted by new leader
I20260709 13:00:17.999450  1622 raft_consensus.cc:2889] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:17.999866  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:18.000145  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50542 (request call id 7) took 2165 ms. Trace:
I20260709 13:00:18.000494  1622 rpcz_store.cc:276] 0709 13:00:15.834421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.834546 (+   125us) service_pool.cc:224] Handling call
0709 13:00:16.068615 (+234069us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b58004e05d0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916870aa 00007fc491709447 00007fc49172670a 00007fc49172776a 00007fc49172691b 00007fc49173203c 00007fc4917316b3 00007fc4966f1d29 00007fc48fc701d4 00007fc48fc70162
0709 13:00:16.087867 (+ 19252us) log.cc:844] Serialized 506 byte log entry
0709 13:00:18.000009 (+1912142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":658,"raft.run_cpu_time_us":3225,"raft.run_wall_time_us":3225,"spinlock_wait_cycles":405598976,"thread_start_us":229775,"threads_started":1,"wal-append.queue_time_us":159864,"wal-append.run_cpu_time_us":2147,"wal-append.run_wall_time_us":1031349}
I20260709 13:00:18.010977  1617 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:18.012874  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:18.013845  1689 raft_consensus.cc:2393] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:18.014703  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:18.015357  1614 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:18.017268  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:18.019658  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:18.019942  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:00:18.024827  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 150352us
I20260709 13:00:18.025959  1585 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:18.048508  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 176298us
I20260709 13:00:18.051189  1696 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:18.055753  1693 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.057480  1542 raft_consensus.cc:2410] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:00:18.062909  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 5ca86ee366e14bdd8686ea8e5b48be10: Aborted: Op aborted by new leader
I20260709 13:00:18.066373  3167 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:18.066994  3167 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.067461  3167 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.074528  1585 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:18.086911  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:18.087947  1696 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.088884  1512 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:18.047606  3157 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:00:18.091637  3165 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.098124  3199 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:18.095428  3091 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:18.135715  1694 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:45660
I20260709 13:00:18.147403  1696 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:18.153914  1512 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:18.135417  3023 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:18.167076  3023 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:18.168980  3187 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:18.169617  3187 raft_consensus.cc:697] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:18.169950  3023 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:18.171026  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:18.170667  3187 consensus_queue.cc:237] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.171828  2240 raft_consensus.cc:2393] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 2: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:18.177301  1616 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:18.148180  3185 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:18.178406  3185 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.161813  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:18.134187  2967 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:00:18.162690  3091 raft_consensus.cc:697] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:18.151510  3199 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.149302  3165 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:18.165771  3163 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:18.094133  3152 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:00:18.184355  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:18.184209  3199 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.195667  1692 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:18.194973  3105 tablet_bootstrap.cc:492] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:18.201704  3173 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:18.187186  3093 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.213382  1545 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:18.218097  1445 catalog_manager.cc:5697] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.205474  1687 raft_consensus.cc:1240] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.236105  3150 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:18.236541  2966 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:18.236678  3150 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.237334  2966 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:18.240653  3197 log.cc:927] Time spent T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:00:18.246829  3150 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:18.223340  3093 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.251684  3093 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:18.255815  3091 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.256551  1694 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:18.257148  1694 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:18.257982  3165 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:18.280289  3057 raft_consensus.cc:993] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:18.281172  3057 raft_consensus.cc:1081] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:18.280171  3185 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:18.291355  3105 tablet_bootstrap.cc:492] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:00:18.292199  3105 ts_tablet_manager.cc:1403] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 1.030s	user 0.043s	sys 0.020s
W20260709 13:00:18.295998  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 244980us
I20260709 13:00:18.298202  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
W20260709 13:00:18.300172  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 186946us
I20260709 13:00:18.298578  1694 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:18.264845  3090 raft_consensus.cc:3055] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:18.302160  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:18.305294  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 230728us
I20260709 13:00:18.309916  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:18.316596  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:18.322160  1696 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:18.307206  1512 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:18.320873  1695 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:18.304256  3090 raft_consensus.cc:740] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:18.332158  1694 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:18.299923  3057 raft_consensus.cc:2764] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:18.312481  3104 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.328020  3037 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:18.331516  3185 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:18.366645  3108 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.358263  3104 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.375984  3210 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:00:18.408963  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:18.359522  3185 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:18.367578  3093 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.419433  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:18.373687  3104 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:18.356050  2967 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:00:18.438561  3163 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:18.443919  3093 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:18.446662  3093 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:18.356626  3167 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.449034  3167 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:18.451076  3105 raft_consensus.cc:359] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:18.452234  3105 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:00:18.453038  3105 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:18.403072  3090 consensus_queue.cc:260] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.456462  3090 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.422803  1539 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 13:00:18.460407  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:18.363055  3165 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 13:00:18.461369  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.411504  3108 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.464838  3108 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:18.422211  3185 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:18.434993  2966 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:18.484864  3199 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.486835  1689 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:18.487635  2240 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:18.492238  1539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7803266de9984fac88726b08bee73921"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39612
I20260709 13:00:18.537181  1539 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:18.537576  1539 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:18.545564  3091 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:18.500566  1445 catalog_manager.cc:5697] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:18.503080  3105 ts_tablet_manager.cc:1434] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.210s	user 0.006s	sys 0.004s
W20260709 13:00:18.549494  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 02b29fae0aae48f28944958f7ef007fa: Illegal state: Replica dcc91bf6e3bd468bbbbfc26e3a7c5e01 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
W20260709 13:00:18.550361  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 237483us
I20260709 13:00:18.551061  1660 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:18.553747  3165 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:18.554164  3165 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.554522  3165 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.554363  2211 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
W20260709 13:00:18.555595  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 242289us
I20260709 13:00:18.556228  3176 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:18.556838  3176 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 3 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:18.512583  3185 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:18.558413  1544 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:18.558284  3176 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:18.513893  3199 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:18.563432  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:18.564275  2242 raft_consensus.cc:2393] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 2: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
W20260709 13:00:18.564363  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 258205us
I20260709 13:00:18.567646  1539 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.569665  3185 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:18.569752  1445 catalog_manager.cc:5697] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 2 to 3, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:18.573038  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:18.573414  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:18.634738  2240 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:18.634909  1539 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:18.573092  1542 consensus_queue.cc:237] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:18.636991  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-479456ab418d44c4983d2bb37eb0e700 received from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:18.637509  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-479456ab418d44c4983d2bb37eb0e700 on tablet 479456ab418d44c4983d2bb37eb0e700 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:18.575012  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:18.639091  2241 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:18.579560  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 271977us
I20260709 13:00:18.569144  3165 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.593995  1622 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:18.594033  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:18.595050  1617 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:18.647984  1619 raft_consensus.cc:3055] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:18.596335  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:18.597007  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:18.648694  1621 raft_consensus.cc:2368] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3.
I20260709 13:00:18.598748  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:18.598850  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:18.594763  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:18.649874  1616 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:18.599969  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:18.650717  1694 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.648352  1619 raft_consensus.cc:740] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:18.601562  1688 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:18.605444  1511 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:18.615367  3112 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:18.621541  3146 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:18.623667  3216 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:18.663669  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 58345.2us
I20260709 13:00:18.665324  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:18.573798  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:18.645007  2243 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:18.666138  1622 raft_consensus.cc:2393] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 2: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:18.666314  2242 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:18.647367  3220 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.653682  3165 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:18.658840  1619 consensus_queue.cc:260] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:18.677539  1660 leader_election.cc:400] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3.
I20260709 13:00:18.668917  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:00:18.669838  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:18.670853  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:18.679600  1621 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.662040  3090 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:18.674011  1694 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:18.674149  2241 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:18.628393  1512 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:18.675901  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:18.677877  1660 leader_election.cc:403] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:18.681794  1622 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:18.682480  1587 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:18.662935  3167 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:00:18.685099  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 56805.8us
I20260709 13:00:18.685921  1512 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:18.686014  1660 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:18.686561  1619 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:18.686920  1620 raft_consensus.cc:2393] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 2: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:18.678388  1616 raft_consensus.cc:606] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:18.695547  2241 raft_consensus.cc:1217] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:18.675850  3185 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:18.687831  3216 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.672619  1687 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:18.687493  3093 consensus_queue.cc:1059] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:00:18.692519  3157 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3.
I20260709 13:00:18.712478  3216 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:18.721827  3232 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:00:18.687768  2966 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:00:18.743345  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:00:18.744310  1615 raft_consensus.cc:606] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:18.713474  3165 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:18.692867  3220 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.677621  3112 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.695626  3091 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:18.677770  3146 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.736433  1587 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:18.744784  1615 raft_consensus.cc:614] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:18.696492  3061 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:18.692220  3156 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.685550  3167 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.752908  1621 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:18.760790  1622 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:18.698179  3090 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:18.765674  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 79713us
I20260709 13:00:18.780084  1660 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:18.788259  1660 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:18.805213  1614 raft_consensus.cc:1275] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:18.759693  3187 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:18.804814   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:18.807745  3061 raft_consensus.cc:697] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:18.812065  3061 consensus_queue.cc:237] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.813865  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:18.814440  1613 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.807215  3057 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:18.816656  1616 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.759581  3091 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:18.809603   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:18.803143  3106 log.cc:927] Time spent T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:00:18.803326  3108 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:18.866818  1613 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:18.808059  3187 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:18.838308  3091 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:18.834023  3057 raft_consensus.cc:697] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:18.787667  3156 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.809840  2966 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:00:18.854179  3108 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.867851  3185 raft_consensus.cc:697] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:18.883447  3187 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:18.898792  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 65927.9us
I20260709 13:00:18.902252  1660 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:18.902887  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 211414us
I20260709 13:00:18.889950  3108 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.904371  1512 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:18.898320  3220 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:18.921955  3235 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260709 13:00:18.922998  3090 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:18.923827  3239 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:18.926906  1539 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:18.926975  3239 raft_consensus.cc:697] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:18.906200  3157 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:18.918490  3185 consensus_queue.cc:237] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.927398  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:18.943784  1544 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:18.928709  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:18.930151  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:18.930737  1616 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:18.944869  1539 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.946049  3156 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:18.932287  1540 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:18.947284  3222 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:18.934333  1546 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:18.937336  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:00:18.939693  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 246676us
I20260709 13:00:18.969174  3222 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.969704  3222 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.953258  1619 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:18.972506  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:18.973412  1621 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:18.973664  1615 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:00:18.964083  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.975862  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:18.975993  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:18.977109  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:18.978245  1617 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:18.984304  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:18.991734  3240 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:18.992584  3240 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:18.996227  3057 consensus_queue.cc:237] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:18.998147  1615 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:19.003211  3165 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.003892  3165 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.012681  3146 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:19.023700  3167 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:19.024981  3163 raft_consensus.cc:3055] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:19.030275  3163 raft_consensus.cc:740] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:18.968958  3112 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:19.041728  1546 raft_consensus.cc:1240] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:19.045342  2240 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:18.956117  3108 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:19.046911  3163 consensus_queue.cc:260] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:19.054327  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:19.054595  3163 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.022737  3187 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:19.057797  3187 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:19.059376  3239 consensus_queue.cc:237] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:19.061466  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:19.062942  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:19.063664  1547 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:19.064494  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:18.988466  3157 raft_consensus.cc:697] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:19.066181  3157 consensus_queue.cc:237] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:18.991721  3242 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:19.070930  1547 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.072741  3108 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:19.078205  3242 raft_consensus.cc:697] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:19.098747  1539 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:19.105723  3091 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:19.110162  1541 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.127173  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:19.128234  1693 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:19.082623  3242 consensus_queue.cc:237] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:19.149838  1541 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:19.080658  3240 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:19.216351  1547 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:19.218029  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:19.225852  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:19.328840  3187 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:19.329725  3187 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:19.342269  1511 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:19.416046  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:19.420336  1539 raft_consensus.cc:2368] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3.
W20260709 13:00:19.476222  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.479604  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 47549.4us
I20260709 13:00:19.511960  3150 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:00:19.541666  3146 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:19.420903  3167 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:19.545538  3167 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:19.548676  3167 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:19.477039  3216 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:19.477843  3243 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:19.613415  3243 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:19.728012  2967 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:19.666486  3183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.011s	sys 0.010s
I20260709 13:00:19.750799  2967 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:19.416625  3222 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:19.739012  3173 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:19.602149  3185 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.189s
I20260709 13:00:19.507028  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:19.855767  3171 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:19.879377  3171 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:19.881567  3171 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:19.882826  3173 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:19.885891  3173 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:19.887283  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.888182  3156 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:19.888602  3236 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:19.888918  3156 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:19.889293  3236 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:19.891770  3156 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:19.892444  2967 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:19.781888  3183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.012s	sys 0.011s
W20260709 13:00:19.912387  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 83030.6us
I20260709 13:00:19.896697  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:19.881570  3165 consensus_meta.cc:287] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.877s	user 0.009s	sys 0.000s
W20260709 13:00:19.917146  3163 consensus_meta.cc:287] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.862s	user 0.011s	sys 0.001s
I20260709 13:00:19.911217  3173 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:19.928828  1689 raft_consensus.cc:2368] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3.
I20260709 13:00:20.365144  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 1569) took 1240 ms. Trace:
I20260709 13:00:20.365711  1689 rpcz_store.cc:276] 0709 13:00:19.124610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.134466 (+  9856us) service_pool.cc:224] Handling call
0709 13:00:20.364797 (+1230331us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b540014fd54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:20.365023 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1428130176}
I20260709 13:00:20.370883  1659 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:19.928030  3157 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.007s	sys 0.015s
I20260709 13:00:19.926734  3165 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:20.371490  3157 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.008s	sys 0.015s
I20260709 13:00:19.947129  3173 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.372989  3165 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:20.373436  3173 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:19.956919  3243 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:19.956128  3236 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:19.959107  3239 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.013s	sys 0.022s
W20260709 13:00:20.374275  3239 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.296s	user 0.013s	sys 0.022s
I20260709 13:00:19.953505  3216 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:20.374446  3236 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:20.016424  3057 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.014s	sys 0.028s
W20260709 13:00:20.176679  3252 log.cc:927] Time spent T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:00:20.190876  2239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45882 (request call id 444) took 1248 ms. Trace:
W20260709 13:00:20.375443  3057 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.014s	sys 0.028s
I20260709 13:00:20.375844  3236 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:20.375584  2239 rpcz_store.cc:276] 0709 13:00:18.942025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.974858 (+ 32833us) service_pool.cc:224] Handling call
0709 13:00:18.990076 (+ 15218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.476314 (+486238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.511341 (+ 35027us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.945194 (+433853us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.148274 (+203080us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:20.149226 (+   952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.150446 (+  1220us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:20.190485 (+ 40039us) raft_consensus.cc:1685] finished
0709 13:00:20.190535 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.190757 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3550,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":83,"thread_start_us":651323,"threads_started":2,"wal-append.queue_time_us":230613}
I20260709 13:00:20.288511  3023 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.289335  3186 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:20.377866  3023 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.379721  3173 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:20.290266  3185 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.380344  3023 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:20.380643  3185 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.375445  3216 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.290616  3146 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:20.384675  3146 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.290802  1512 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:20.387009  3146 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:20.387296  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 96575.1us
I20260709 13:00:20.387670  3146 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:20.316197  3237 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.388581  3237 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.390534  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 1901) took 1464 ms. Trace:
I20260709 13:00:20.390736  3237 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.316447  3260 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:20.317073  3246 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.316587  3242 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.391570  3246 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.318101  3156 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.380345  3173 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.392546  3156 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.393723  3246 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.394569  3156 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:20.318296  2967 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.395102  3173 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:20.395222  2967 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.396004  3237 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:20.397413  2967 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:20.397459  3246 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:20.326023  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.398159  3246 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:20.398537  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 817) took 1132 ms. Trace:
I20260709 13:00:20.399135  1545 rpcz_store.cc:276] 0709 13:00:19.266681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.325741 (+1059060us) service_pool.cc:224] Handling call
0709 13:00:20.398478 (+ 72737us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:20.399397  3246 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.400724  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.401963  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.402382  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 813) took 1347 ms. Trace:
I20260709 13:00:20.402966  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:20.403717  1545 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.317466  3163 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:20.407101  3163 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.402734  1547 rpcz_store.cc:276] 0709 13:00:19.054594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.374503 (+1319909us) service_pool.cc:224] Handling call
0709 13:00:20.374871 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.400342 (+ 25471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.400369 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:20.400415 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:20.400444 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.402159 (+  1715us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b54002fb2d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:20.402200 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.402336 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57810176}
I20260709 13:00:20.391968  3242 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.408615  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.409379  3163 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.409732  3242 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:20.355050  3219 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.410362  3219 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.413969  1545 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:20.377913  3186 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.415043  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.409646  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:20.416124  1547 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.416968  3186 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.289848  3258 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.417743  3258 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.418535  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:20.383857  3185 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:19.939667  3222 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.318778  3210 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:20.420143  3242 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:20.420094  3210 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } }
I20260709 13:00:20.420727  3242 raft_consensus.cc:697] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:20.421562  3242 consensus_queue.cc:237] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.422461  3210 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:20.391513  3260 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.424191  1547 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:20.425249  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:20.425470  3260 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:20.426144  1547 raft_consensus.cc:2393] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 3: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:20.427389  3219 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:20.423678  1545 raft_consensus.cc:2410] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:20.428556  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.429512  3258 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.429677  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.432597  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.435019  3172 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:20.436136  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:20.435858  3172 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.438841  3187 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:20.439476  3172 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:20.435082  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.441041  1547 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:20.442467  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.443928  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.390964  1538 rpcz_store.cc:276] 0709 13:00:18.926599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.926709 (+   110us) service_pool.cc:224] Handling call
0709 13:00:18.926983 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:18.927316 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:18.927343 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:18.927749 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 13:00:19.442299 (+514550us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:19.442352 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.442451 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:20.390274 (+947823us) raft_consensus.cc:1685] finished
0709 13:00:20.390296 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.390444 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14880,"raft.run_cpu_time_us":51029,"raft.run_wall_time_us":1499987,"spinlock_wait_cycles":74883328,"thread_start_us":417310,"threads_started":1,"wal-append.queue_time_us":985787}
I20260709 13:00:20.448788  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 122) took 1030 ms. Trace:
I20260709 13:00:20.449167  1538 rpcz_store.cc:276] 0709 13:00:19.418753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.448012 (+1029259us) service_pool.cc:224] Handling call
0709 13:00:20.448318 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.448489 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.448516 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:20.448557 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:20.448587 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.448638 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.448736 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:20.452059  3163 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:20.452929  3163 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.454927  3091 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:20.357149  3263 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:20.455617  3163 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.446153  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 814) took 1391 ms. Trace:
I20260709 13:00:20.456383  1547 rpcz_store.cc:276] 0709 13:00:19.054868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.445156 (+1390288us) service_pool.cc:224] Handling call
0709 13:00:20.445548 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.445766 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.445798 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:20.445854 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:20.445896 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.445965 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.446092 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:20.462200  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 1909) took 1525 ms. Trace:
I20260709 13:00:20.462657  1541 rpcz_store.cc:276] 0709 13:00:18.936840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.936975 (+   135us) service_pool.cc:224] Handling call
0709 13:00:20.459193 (+1522218us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400160654. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:20.462120 (+  2927us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297602432}
I20260709 13:00:20.480926  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:20.482436  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.483698  3242 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:20.484129  3242 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.484519  3242 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.489084  3172 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.489727  3172 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.490818  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.491892  3172 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:20.494001  1445 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42132 (request call id 237) took 2190 ms. Trace:
I20260709 13:00:20.498541  1445 rpcz_store.cc:276] 0709 13:00:18.303578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.303781 (+   203us) service_pool.cc:224] Handling call
0709 13:00:20.493920 (+2190139us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:18.655983 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:18.656641 (+   658us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:18.656680 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:00:18.656697 (+    17us) tablet.cc:662] Decoding operations
0709 13:00:18.711293 (+ 54596us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:18.711373 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:18.711413 (+    40us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:18.711761 (+   348us) tablet.cc:701] Row locks acquired
0709 13:00:18.711780 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:00:18.711936 (+   156us) write_op.cc:270] Start()
0709 13:00:18.712047 (+   111us) write_op.cc:276] Timestamp: P: 1783602018711890 usec, L: 0
0709 13:00:18.712069 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:00:18.712684 (+   615us) log.cc:844] Serialized 929 byte log entry
0709 13:00:18.937645 (+224961us) op_driver.cc:464] REPLICATION: finished
0709 13:00:19.219729 (+282084us) write_op.cc:301] APPLY: starting
0709 13:00:19.234976 (+ 15247us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:19.266100 (+ 31124us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:19.275457 (+  9357us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:19.275969 (+   512us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:19.276228 (+   259us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:00:19.276303 (+    75us) write_op.cc:312] APPLY: finished
0709 13:00:19.276567 (+   264us) log.cc:844] Serialized 29 byte log entry
0709 13:00:19.276779 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:19.276903 (+   124us) write_op.cc:454] Released schema lock
0709 13:00:19.276958 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:20.324437 (+1047479us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b540016e280. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc495095161 00007fc49516a33d 00007fc4951633c2 00007fc495162b53 00007fc495166d61 00007fc495166d19 00007fc495166ca9 00007fc495166c71 00007fc495165e9d 000000000038f354 000000000038f199
0709 13:00:20.324873 (+   436us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:20.324908 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":174781,"apply.run_cpu_time_us":30027,"apply.run_wall_time_us":1158900,"num_ops":2,"prepare.queue_time_us":2354,"prepare.run_cpu_time_us":3350,"prepare.run_wall_time_us":77677,"replication_time_us":225436,"spinlock_wait_cycles":9109248,"thread_start_us":3517,"threads_started":1}]]}
I20260709 13:00:20.508160  3241 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:20.508812  3241 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.495545  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.498018  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.510684  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.519374  3242 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.526659  3242 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:20.530548  1510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.010s	sys 0.006s
W20260709 13:00:20.535626  1544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.037s	user 0.005s	sys 0.001s
I20260709 13:00:20.535627  3268 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:00:20.536067  1544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.005s	sys 0.001s
I20260709 13:00:20.536770  3268 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.537408  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 809) took 1483 ms. Trace:
I20260709 13:00:20.538542  3067 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:20.541193  3268 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.541399  3067 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:20.542423  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 629074us
I20260709 13:00:20.543804  3067 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:20.540426  1544 rpcz_store.cc:276] 0709 13:00:19.053557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.079578 (+ 26021us) service_pool.cc:224] Handling call
0709 13:00:19.079953 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:19.080210 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:00:19.115365 (+ 35155us) log.cc:844] Serialized 14 byte log entry
0709 13:00:20.537024 (+1421659us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:20.537084 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:20.537127 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.537197 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.537349 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41964,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":452488,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":1421178,"threads_started":2,"wal-append.queue_time_us":833464}
I20260709 13:00:20.548604  3210 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:20.549177  3210 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.551478  3163 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.552058  3163 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.554239  3210 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.554700  3163 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:20.555624  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:20.556322  2239 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.556618  3156 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:20.557164  3156 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.511015  3241 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:20.559206  3156 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.546255  1442 catalog_manager.cc:5697] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.581427  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.588896  3241 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:20.589617  3241 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.571206  3211 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:20.592012  3211 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.592437  3268 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.593113  3268 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.594446  3211 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:20.595043  3211 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:20.603767  1693 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:20.595227  3268 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:20.655802  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.655597  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:20.626878  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.670923  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:20.601528  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:20.592010  3241 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:20.675539  1693 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:20.675871  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:20.641376  3236 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.680778  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.559967  3263 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:20.685151  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 141421us
I20260709 13:00:20.685495  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:20.686702  1693 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 13:00:20.687582  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:20.690325  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:20.691110  1691 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:20.690726  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:20.672570  3187 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.641634  3242 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.668181  1687 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 1.
I20260709 13:00:20.673024  3268 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.694643  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:20.697777  1691 raft_consensus.cc:2368] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3.
I20260709 13:00:20.700168  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:20.701596  1693 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:20.699783  1691 raft_consensus.cc:1275] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:00:20.700130  1512 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:34459 timed out after 1.744s (SENT) [suppressed 23 similar messages]
I20260709 13:00:20.710321  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:20.711714  3272 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:20.711090  1687 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:20.716107  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:20.712491  3272 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:20.717020  1696 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:20.718873  3272 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:20.720630  3272 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:20.704559  3268 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.721215  3272 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.723119  3268 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.697044  3187 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.723599  3272 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.694511  3263 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.728791  3272 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:20.729045  3187 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:20.729363  3272 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.730289  3263 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:20.730912  3263 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.731881  3272 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.560004  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:20.716153  3264 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.706566  3271 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:20.735590  3264 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.737360  1542 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:00:20.737864  1542 pending_rounds.cc:85] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 4
I20260709 13:00:20.738169  1542 pending_rounds.cc:107] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:00:20.738497  1542 raft_consensus.cc:2889] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:20.735857  3271 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.722931  3071 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:20.740974  1539 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
W20260709 13:00:20.742740  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 47210.8us
I20260709 13:00:20.747043  3270 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:20.747172  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:20.748471  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:20.761655  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:20.763797  1585 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:20.762451  1691 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 13:00:20.767186  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:20.768008  1687 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:20.769758  3281 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:20.770546  3281 raft_consensus.cc:993] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:20.770982  3281 raft_consensus.cc:1081] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:20.779601  3264 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:20.747617  3270 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.742187  3278 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.782785  3271 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:20.784127  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 84002.3us
I20260709 13:00:20.740082  3263 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.758198  3071 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.785931  1687 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:20.791493  3282 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:00:20.793530  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 102946us
I20260709 13:00:20.794234  1585 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:20.792351  3285 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:20.796047  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:20.787994  3278 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.800606  1691 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
W20260709 13:00:20.800711  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 96725.2us
I20260709 13:00:20.788252  3270 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.800755  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.803570  3278 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:20.806435  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.807876  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:20.807910  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.808744  1538 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 13:00:20.796625  3271 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.804749  3270 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:20.798858  3258 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.811563  1659 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:20.793260  3279 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:20.801698  3152 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.803333  3285 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.812587  3271 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.815766  3278 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:20.816411  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.821261  1545 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:20.822265  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:20.823179  1691 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:20.820611  3278 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.823953  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:20.824438  3278 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.825393  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:20.820689  3071 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.815174  3258 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.827739  3281 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:20.824446  3271 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:20.818372  3152 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.829300  3271 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:20.829432  3258 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.829769  3271 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.830971  3152 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:20.821997  3270 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:20.831759  3271 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.831872  3270 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.833847  3270 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.835408  3263 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:20.836799  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:20.837138  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:20.837397  1691 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:20.838760  1512 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:20.839922  1687 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.840147  1512 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:20.841310  1512 leader_election.cc:400] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3.
I20260709 13:00:20.841593  1512 leader_election.cc:403] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:20.842861  1512 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:20.828641  3281 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.846858  1512 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:20.847677  1512 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:20.848397  1512 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:20.845701  3258 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:20.849382  3278 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.850562  3281 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:20.851197  3216 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:20.851907  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 47391.2us
I20260709 13:00:20.860913  3258 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3.
I20260709 13:00:20.861771  3258 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:20.851675  3216 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.863629  3216 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.863739  3263 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.864274  3263 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.697050  3242 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.866443  3263 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:20.867048  1696 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:20.852442  3152 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:00:20.873605  1585 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:20.875507  1585 leader_election.cc:400] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3.
I20260709 13:00:20.875784  1585 leader_election.cc:403] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:20.818522  3279 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:20.873694  1512 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:20.877996  1512 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:20.880803  3288 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:20.878513  3242 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:20.867273  3258 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:00:20.890697  3287 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3.
I20260709 13:00:20.877219  3243 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:20.898329  3243 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:20.898680  3152 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:20.873173  3270 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:20.897450  3278 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:20.897850  3258 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:20.898826  3243 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:20.899212  3152 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.954905   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:20.805727  3282 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:20.943912  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 66898.2us
I20260709 13:00:20.968443  3152 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:20.905656  3258 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:21.001796  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.002260  3258 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.899523  3270 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:21.044824  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.121116  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:21.123736  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.008083  3288 raft_consensus.cc:697] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:21.136864  3270 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:21.140223  3088 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:21.140558  3091 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:21.140955  3091 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:21.140899  3088 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:21.141500  3091 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:21.147596  3284 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:21.148196  3284 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.154135  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 1976) took 2346 ms. Trace:
I20260709 13:00:21.128371  3285 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:21.158500  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 280511us
I20260709 13:00:21.160020  1512 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:21.154881  1616 rpcz_store.cc:276] 0709 13:00:18.804107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.804548 (+   441us) service_pool.cc:224] Handling call
0709 13:00:18.804862 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.945097 (+140235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.150266 (+2205169us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b540033ca54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:21.150510 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26815232}
I20260709 13:00:21.160928  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.161633  1619 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:21.170277  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.170961  1619 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:21.172673  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.173233  1622 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 1.
I20260709 13:00:21.166697  3216 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.180599  3216 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:21.183221  3216 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:21.184998  3216 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:21.185477  3216 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:21.185956  3216 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:21.175370  3152 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:20.560086  3210 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:21.207762  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 1905) took 2272 ms. Trace:
I20260709 13:00:21.201328  3288 consensus_queue.cc:237] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.208272  3282 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:21.209553  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.209934  1688 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:21.210592  1543 rpcz_store.cc:276] 0709 13:00:18.930022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.930173 (+   151us) service_pool.cc:224] Handling call
0709 13:00:18.930616 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:18.947931 (+ 17315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:18.947960 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:18.948405 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.311757 (+1363352us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b4800002958. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc496654aa1 00007fc49664bb37 00007fc49664b9ca 00007fc49674326f 00007fc496742f37 00007fc49675755c 00007fc496757508 00007fc496757488 00007fc496757443 00007fc4967566ec 00007fc495680a96
0709 13:00:20.968256 (+656499us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b18003408a0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb0d1 00007fc4916e6a0f
0709 13:00:21.119692 (+151436us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:21.119730 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.126947 (+  7217us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.201979 (+ 75032us) raft_consensus.cc:1685] finished
0709 13:00:21.202546 (+   567us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.202724 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11409,"raft.queue_time_us":46345,"raft.run_cpu_time_us":21165,"raft.run_wall_time_us":1285351,"spinlock_wait_cycles":86690944,"thread_start_us":151243,"threads_started":1,"wal-append.queue_time_us":2176548}
I20260709 13:00:21.220486  3284 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:21.204279  3210 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:21.223781  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:21.226912  3152 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:21.233283  3152 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:21.233804  3152 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:21.227600  3186 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:21.235016  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:21.235816  1689 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:21.236322  3258 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.225364  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1572) took 2097 ms. Trace:
I20260709 13:00:21.227893  3210 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:21.238709  3258 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:21.228449  3245 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:21.239213  3245 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:21.220633  3172 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.243100   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:21.243631  3172 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:21.246069  3296 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:21.246465  3091 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.240267  3216 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.248569  3091 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:21.249074  3216 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:21.243887  3245 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:21.252447  3152 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:21.238719  1688 rpcz_store.cc:276] 0709 13:00:19.125494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.134157 (+  8663us) service_pool.cc:224] Handling call
0709 13:00:21.209378 (+2075221us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b58001c3598. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606eee 0000000000375939 00007fc49667a1e0 00007fc4967430c4 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:00:21.209562 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:21.214705 (+  5143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.222695 (+  7990us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34552704}
I20260709 13:00:21.257750  3210 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.257942  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:21.258332  3210 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.251881  3172 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:21.260799  3210 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:21.266072  3243 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.268440  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:21.271307  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:21.272076  1543 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 2: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:21.278347  3150 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:21.279644  3243 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:21.278903  3150 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:21.281008  3245 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.284106  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.284996  3288 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:21.290632  3288 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.293044  1544 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:21.294409  3288 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:21.296113  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.296829  2238 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
W20260709 13:00:21.297640  3157 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.009s	sys 0.020s
I20260709 13:00:21.298712  1586 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:21.299613  3288 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:21.299969  3288 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:21.300361  3288 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:21.298030  3157 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.009s	sys 0.020s
I20260709 13:00:21.306511  1660 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:21.315950  1695 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:21.329777  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:21.333374  3283 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:21.348155  1688 raft_consensus.cc:2368] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3.
I20260709 13:00:21.348446  3283 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.348860  3283 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:21.350740  2239 consensus_meta.cc:287] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.794s	user 0.016s	sys 0.001s
W20260709 13:00:21.352766  3156 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.005s	sys 0.019s
I20260709 13:00:21.354346  2239 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:21.356755  3219 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:21.357424  3108 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:21.358031  3108 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } }
I20260709 13:00:20.690181  3236 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.360208  3108 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 13:00:21.361028  3290 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.361541  3290 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.361726  3236 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:21.366580  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:21.366643  1587 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:21.367940  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:21.368036  3156 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.006s	sys 0.020s
I20260709 13:00:21.372921  3287 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:21.378335  3146 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:21.378770  3287 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.378899  3146 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.381014  3146 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:21.381860  1511 consensus_peers.cc:597] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5814bf31e900408885160ea0f89d6189. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:21.379169  3287 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:21.381947  3290 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:21.386830  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:21.387650  1543 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 1.
I20260709 13:00:21.395341  1587 leader_election.cc:400] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3.
I20260709 13:00:21.395704  1587 leader_election.cc:403] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:21.398988  3291 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3.
I20260709 13:00:21.397119  1587 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:21.393129  3285 consensus_queue.cc:1059] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:00:21.402587  3199 raft_consensus.cc:3055] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:21.401790  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:21.404680  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:21.405297  1543 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:21.406935  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:21.402941  3288 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:21.402932  3199 raft_consensus.cc:740] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:21.407622  3291 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:21.419363  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:21.420231  1622 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:21.420562  1542 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:21.407915  3243 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:00:21.424703  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.424954  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.426136  1621 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 13:00:21.427700  3288 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:21.428114  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.429172  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:21.429860  2239 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:21.429932  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.431517  3199 consensus_queue.cc:260] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.432653  3199 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:21.429297  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:21.434672  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:20.597811  3211 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.442741  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 1916) took 1053 ms. Trace:
I20260709 13:00:21.443778  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.443167  1547 rpcz_store.cc:276] 0709 13:00:20.389143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.460916 (+ 71773us) service_pool.cc:224] Handling call
0709 13:00:20.488113 (+ 27197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.488413 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.488452 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:20.488491 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:20.488518 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.488573 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.442560 (+953987us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b5400160650. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:21.442680 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":174,"spinlock_wait_cycles":61748224}
W20260709 13:00:21.446938  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.450008  3287 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:21.451669  3302 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:00:21.458935  1659 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:21.460115  2209 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:21.460351  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.463678  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:21.464490  1696 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 2: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:21.465250  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:21.466104  3236 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:21.466266  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:21.466723  3236 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.467209  3236 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:21.467483  3245 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:21.475533  3211 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:21.476334  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:21.476701  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:21.477274  1693 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:21.477468  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:21.478082  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:21.478449  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:21.479487  3156 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:21.456885  3283 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.482590  3176 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:21.484707  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.484227  3067 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:21.486104  3067 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:21.486493  3067 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.694371  3241 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:21.487923  3283 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:21.487694  3241 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.489360  3287 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:21.489777  3241 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:21.490862  3088 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:21.479103  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:21.494072  1693 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:21.496431  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:21.498203  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.498808  1616 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 13:00:21.500595  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.501113  1616 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:21.501575  1659 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:21.504673  1512 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:21.504916  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:21.507217  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:21.507468  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:21.508972  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.512516  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:21.513156  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:21.514892  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:21.515178  1547 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:00:21.517885  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:21.521381  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:21.521463  3173 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:21.521962  1696 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:21.522295  3173 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:21.522645  3173 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:21.523447  3173 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:21.509469  3156 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:21.508291  3241 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:21.524510  3156 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:21.527456  3156 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:21.530094  1696 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:21.530161  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.524539  3173 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:21.531004  3276 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:21.531442  3276 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:21.531814  3276 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:21.532081  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.532196  1512 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:21.533963  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.505906  2239 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:21.541440  3243 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:21.542203  3243 raft_consensus.cc:697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:21.542438  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.539340  3241 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:21.544256  3241 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:21.543154  3243 consensus_queue.cc:237] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.546578  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:21.539089  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:21.548110  1586 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:21.555764  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:21.556048  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.556216  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:21.555523  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.556900  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:21.557829  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.558012  1692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:21.558746  1692 raft_consensus.cc:606] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:21.562701  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.563603  3270 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:21.565420  3270 raft_consensus.cc:697] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:21.537344  3176 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:21.566468  3270 consensus_queue.cc:237] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:21.566624  3176 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:21.585587  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.587548  1613 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:21.589427  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.594871  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.596920  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.597867  1616 raft_consensus.cc:2393] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 3: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:21.600199  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.601030  1616 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:21.601933  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.602869  1613 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:21.605175  1689 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:21.612898  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.615845  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:21.618564  3236 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:21.620889  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 48586.1us
I20260709 13:00:21.624511  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.624635  1619 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:21.626147  1696 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:21.628104  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:21.634037  1587 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:21.636001  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 77150.7us
I20260709 13:00:21.636723  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.637290  2245 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 13:00:21.637687  1587 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:21.638505  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.640545  1587 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:21.643657  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.645465  1587 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:21.638003  3271 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:21.647420  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.646760  1587 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:21.645911  1660 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:21.631166  3067 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:21.637940  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.644275  3287 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:21.646526  3108 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:21.660876  3108 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:21.660763  1660 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:21.660231  1659 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:21.661309  3108 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:21.662680  3210 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:21.664727  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:21.660382  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.666764  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.667163  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.667584  2245 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 13:00:21.672194  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:21.647773  3061 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:21.672801  1545 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:21.674798  2211 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:21.673846  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:21.676168  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:21.648823  3211 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:21.663046  3210 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:21.680135  3284 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:21.694891  2241 raft_consensus.cc:2410] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:21.696020  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.696936  2239 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 1.
I20260709 13:00:21.699468  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.699939  3276 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.700624  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.681905  1660 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:21.682348  3222 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:21.677350  2211 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:21.677246  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:21.686004  1545 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:21.653518  3283 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:21.686959  2244 raft_consensus.cc:1240] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:21.687825  2245 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:21.691511  3175 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:21.705497  3283 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:21.705955  3283 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:21.706148  1659 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:21.706295  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:21.707600  1717 debug-util.cc:398] Leaking SignalData structure 0x7b0800197a00 after lost signal to thread 434
I20260709 13:00:21.707857  2244 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:21.708101  3175 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:21.708518  3175 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:21.708724  1717 debug-util.cc:398] Leaking SignalData structure 0x7b080018c7c0 after lost signal to thread 1479
I20260709 13:00:21.708930  3175 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:21.709131  1717 debug-util.cc:398] Leaking SignalData structure 0x7b080014af60 after lost signal to thread 1493
W20260709 13:00:21.704869  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 1570) took 2579 ms (client timeout 1912 ms). Trace:
W20260709 13:00:21.711721  1690 rpcz_store.cc:269] 0709 13:00:19.124967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.125070 (+   103us) service_pool.cc:224] Handling call
0709 13:00:21.677094 (+2552024us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b58001c3598. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc4966f10a0 00007fc4966f0984 00007fc48fc6b6d4 00007fc48fc6b662
0709 13:00:21.704779 (+ 27685us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21331200}
I20260709 13:00:21.719254  1660 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:21.687062  3088 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:21.727670  3088 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:21.728845  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.729075  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.730216  2240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45882 (request call id 450) took 1170 ms. Trace:
I20260709 13:00:21.728253  3088 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:21.731841  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
W20260709 13:00:21.719450  1717 debug-util.cc:398] Leaking SignalData structure 0x7b080031bb60 after lost signal to thread 1571
I20260709 13:00:21.702152  3210 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:21.734652  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.744948  1660 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:21.745445  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:21.720856  3284 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:21.730391  3241 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.751036  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:00:21.738677  1717 debug-util.cc:398] Leaking SignalData structure 0x7b080031bcc0 after lost signal to thread 1572
I20260709 13:00:21.751787  1545 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:21.735419  3278 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:21.770144  1660 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:21.771364  1660 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:21.740696  3236 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:21.759554  3218 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:21.732293  2240 rpcz_store.cc:276] 0709 13:00:20.560294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.683927 (+1123633us) service_pool.cc:224] Handling call
0709 13:00:21.730156 (+ 46229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:21.740059  3222 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:21.763708  3176 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:21.719985  3287 consensus_queue.cc:1059] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:00:21.746956  2239 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:21.741477  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.759716  1693 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:21.777603  3263 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:21.777352  3165 raft_consensus.cc:1064] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:00:21.775424  3284 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:21.811362  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 134086us
W20260709 13:00:21.791788  3315 log.cc:927] Time spent T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:00:21.820542  1545 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:21.823268  1693 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:21.827958  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:21.777915  3260 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:21.778683  3218 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:21.835973  1511 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:21.838382  1511 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:21.843511  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:00:21.831359  1717 debug-util.cc:398] Leaking SignalData structure 0x7b080039c780 after lost signal to thread 1646
W20260709 13:00:21.849790  3314 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:00:21.846730  3146 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:21.850919  3313 log.cc:927] Time spent T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:00:21.855274  3216 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:21.855733  3216 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:21.856117  3216 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:21.856361  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.844707  3299 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:21.867641  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:21.872884  3241 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:21.821144  3222 raft_consensus.cc:697] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:21.820760  3263 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:21.833214  3218 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:21.881340  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 110055us
W20260709 13:00:21.876185  1717 debug-util.cc:398] Leaking SignalData structure 0x7b080039c7c0 after lost signal to thread 1647
I20260709 13:00:21.847819  3236 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:21.877489  3263 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:21.893549  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:21.900661  1512 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:00:21.907074  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 81613.2us
I20260709 13:00:21.906652  1512 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:21.913450  3260 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:21.914582  3165 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:21.915880  3222 consensus_queue.cc:237] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.917526  1660 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:21.919194  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:21.921466  1660 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:21.923966  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.924989  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:21.903548  3293 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.904137  3236 raft_consensus.cc:697] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:21.925140  1660 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
W20260709 13:00:21.920248  1717 debug-util.cc:398] Leaking SignalData structure 0x7b0800153520 after lost signal to thread 1720
I20260709 13:00:21.903626  3067 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:21.920857  3290 consensus_queue.cc:1059] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:00:21.927938  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:00:21.941227  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.919420  3187 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:21.919634  3245 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:21.921034  3156 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.929728  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:21.985526  3319 ts_tablet_manager.cc:933] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 13:00:22.051349  3185 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:22.095791  3185 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:22.097342  3246 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.097868  3185 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:22.051556  3108 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.926271  3268 consensus_queue.cc:1059] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:00:21.926373  3157 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:21.920789  3278 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:22.063323  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 138238us
I20260709 13:00:21.997123  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:22.028182  3260 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:22.072774  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:21.932694  3293 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:21.986583  3283 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.053475  3146 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:00:22.078764  3318 log.cc:927] Time spent T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:00:22.079159  3175 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:22.085837  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:22.087561  3088 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:22.088074  1717 debug-util.cc:398] Leaking SignalData structure 0x7b0800346e40 after lost signal to thread 2270
I20260709 13:00:22.088551  3241 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:22.071415  3242 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:22.109939  2210 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:22.147886  3067 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:22.148376  3067 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:00:22.129891  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.132423  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50552 (request call id 171) took 1229 ms. Trace:
I20260709 13:00:22.134389  1546 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:22.149925  1692 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:22.113155  3278 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:22.132261  1687 raft_consensus.cc:2393] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 3: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:22.103767  3245 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:22.140959  3175 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:22.135679  3268 raft_consensus.cc:3055] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:22.163050  3268 raft_consensus.cc:740] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:22.163197  3283 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:22.164018  3268 consensus_queue.cc:260] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.164820  3156 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:22.164994  3268 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.161736  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:22.166460  3263 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.141919  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:22.198202  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:22.198879  1690 raft_consensus.cc:2393] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 4: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:22.139410  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:22.199805  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 60468.3us
I20260709 13:00:22.144389  3293 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:22.203915  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:22.145555  3236 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.147748  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:22.128168  3187 raft_consensus.cc:697] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:22.209596  3187 consensus_queue.cc:237] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.210387  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:22.210942  1690 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:22.212009  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:22.151540  2210 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:00:22.213076  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 61671.6us
I20260709 13:00:22.149359  1614 rpcz_store.cc:276] 0709 13:00:20.899567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.899957 (+   390us) service_pool.cc:224] Handling call
0709 13:00:22.072618 (+1172661us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b58000f9998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc4966f10a0 00007fc4966f0984 00007fc48fc6b6d4 00007fc48fc6b662
0709 13:00:22.129011 (+ 56393us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15950080}
I20260709 13:00:22.103505  3108 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:22.135824  1717 debug-util.cc:398] Leaking SignalData structure 0x7b0800343780 after lost signal to thread 2271
I20260709 13:00:22.140960  3088 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:22.214437  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.168066  3242 raft_consensus.cc:697] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:22.171094  3322 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:22.171787  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:22.136474  3146 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.159145  3278 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.161944  3241 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:22.178040  3210 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.148823  3067 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.181538  3211 raft_consensus.cc:3055] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:22.183586  3216 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:22.247439  3211 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:22.248577  3322 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:22.249114  3216 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:22.186309  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.250692  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.187706  3279 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:22.188369  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.251610  1613 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:22.251703  2238 raft_consensus.cc:1240] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:22.252046  1617 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:22.189420  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.253238  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:22.188377  3245 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:22.254766  3307 log.cc:927] Time spent T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.573s	user 0.002s	sys 0.007s
I20260709 13:00:22.255800  3146 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:22.190497  2239 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:22.191576  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.257604  3241 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:22.196683  1546 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:22.200606  1696 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:22.201000  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:22.258805  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:22.259617  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:00:22.260169  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 59235.3us
I20260709 13:00:22.260094  3218 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } }
I20260709 13:00:22.202199  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.259429  3172 raft_consensus.cc:2764] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:22.258785  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:22.261387  3271 raft_consensus.cc:3055] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:22.260941  1660 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:22.261878  3271 raft_consensus.cc:740] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:00:22.205093  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.101132  3150 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:22.213212  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:22.264048  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:22.265161  2211 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:22.265525  2240 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:22.259613  3276 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:22.266322  2211 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:22.266886  3326 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:22.267441  3218 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:22.267086  3088 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:22.262667  3271 consensus_queue.cc:260] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:22.268711  3271 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:22.268680  3088 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:22.269603  3150 consensus_queue.cc:1059] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:22.270406  3150 raft_consensus.cc:3055] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:22.270787  3150 raft_consensus.cc:740] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:22.267464  3222 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:22.271589  3150 consensus_queue.cc:260] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:22.272707  3150 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.217132  2210 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:22.226037  1690 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:22.273896  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:22.274209  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 57158.4us
I20260709 13:00:22.261138  1615 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.274895  2210 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:22.215790  3242 consensus_queue.cc:237] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.243351  3210 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:22.202919  3057 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:22.278569  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.278779  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.321568  1622 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 4: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:22.321453  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:22.279421  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.279806  1613 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:22.280107  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 206) took 1624 ms. Trace:
I20260709 13:00:22.280836  1692 raft_consensus.cc:2393] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 2: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:22.221994  3263 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:22.323192  1694 rpcz_store.cc:276] 0709 13:00:20.655503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.656383 (+   880us) service_pool.cc:224] Handling call
0709 13:00:20.656795 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:21.226878 (+570083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.226918 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:21.226966 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:21.227028 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.279904 (+1052876us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b5400097254. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:22.279945 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.280058 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1310380928}
I20260709 13:00:22.328871  1693 raft_consensus.cc:606] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:22.332067  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.332609  1619 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:22.332962  1694 raft_consensus.cc:1240] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:22.325104  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.335623  1694 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:22.251058  3322 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:22.339284  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 48130.9us
W20260709 13:00:22.340495  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.271602  3222 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:22.290578  3175 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:22.348340  1660 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:22.352053  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.343685  1694 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:22.320423  3279 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.395211  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.356643  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.413784  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.351462  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.415138  1692 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:22.416002  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:22.349450  2209 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:22.412163  2243 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:22.394644  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:22.414929  1512 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:22.418907  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 69512us
I20260709 13:00:22.294020  3176 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:22.420014  3176 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:22.357355  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.422353  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:22.423167  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 74872.2us
I20260709 13:00:22.331961  3241 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:22.343102  3219 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:22.434679  3219 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:22.437301  3219 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:22.440448  3330 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:00:22.443503  3299 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:22.443699  1689 raft_consensus.cc:1240] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:00:22.345480  3319 tablet_copy_client.cc:323] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:41871
I20260709 13:00:22.445293  1512 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:22.446561  3268 consensus_queue.cc:1059] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:22.447417  3328 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:22.448705  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:22.345511  3187 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:22.450313  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:22.455783  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:22.450986  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:22.452055  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:22.456590  1539 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:22.453155  1540 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:22.386976  3222 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:22.453692  1547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39628
I20260709 13:00:22.486543  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:22.489033  1547 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:22.388775  3165 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:22.489463  1547 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:22.491978  1696 raft_consensus.cc:1275] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:22.508023  1619 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:22.432123  3171 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:22.344924  3287 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.145s
I20260709 13:00:22.431021  3331 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:22.510937  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.511934  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:22.515465  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.389117  3157 consensus_queue.cc:1059] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:00:22.517408  1620 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 2: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:22.524900  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:22.525209  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.428071  3176 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:22.494194  3165 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:22.448014  3268 consensus_queue.cc:1059] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:00:22.528239  3157 consensus_queue.cc:1243] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:22.529017  3290 consensus_queue.cc:1059] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:22.529588  3260 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:22.422124  3156 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:00:22.526685  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:22.531900  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.455559  3241 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.562029  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.532334  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:22.523460  1547 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:22.523687  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.564289  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.565330  1619 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 2: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:22.567451  1541 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:22.545965  3165 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.446496  3278 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.427783  3279 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:22.547034  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 141969us
I20260709 13:00:22.584029  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:22.500574  3187 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.573405  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:22.574079  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.574700  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.584817  1539 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:22.516393  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:22.595203  1545 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 13:00:22.597100  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.600894  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.602948  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.603392  1694 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:22.603989  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.586107  1547 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:22.590485  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 160769us
I20260709 13:00:22.569298  3245 raft_consensus.cc:3055] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:22.606254  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.562001  3328 raft_consensus.cc:697] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:00:22.598155  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 79486.6us
I20260709 13:00:22.620524  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.608592  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:22.609452  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.613420  1693 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:22.616820  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:22.674881  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.675032  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.619208  3245 raft_consensus.cc:740] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:22.610250  3290 consensus_queue.cc:1059] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:00:22.620642  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:22.687314  3329 raft_consensus.cc:3055] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:22.689709  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.692026  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:22.768599  1547 raft_consensus.cc:2410] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:00:22.696952  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.618791  1660 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:22.688453  3337 log.cc:927] Time spent T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:00:22.766367  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:22.769793  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 151130us
I20260709 13:00:22.771359  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.777257  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:22.782290  1547 raft_consensus.cc:1240] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:22.775054  3236 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:22.801085  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.803061  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.810282  1620 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:22.776337  2239 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:22.808545  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 144381us
I20260709 13:00:22.780624  3157 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:22.815543  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.778901  3329 raft_consensus.cc:740] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:22.816381  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.817674  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.817785  3341 consensus_queue.cc:1059] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:00:22.816159  1547 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:22.823191  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.819430  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.783528  3276 consensus_queue.cc:1059] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:00:22.784214  3216 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:22.825065  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.826107  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.783761  3218 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:00:22.832046  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:22.836053  1620 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:22.835877  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.835992  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.837630  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.814023  3171 raft_consensus.cc:697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:22.841166  3357 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:22.841773  3357 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:22.841625  3171 consensus_queue.cc:237] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:22.837332  3067 consensus_meta.cc:287] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.000s
I20260709 13:00:22.846531  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.852779  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.855181  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.855191  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.855584  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.856386  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.806224  3328 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.859557  1547 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:22.859997  3338 log.cc:927] Time spent T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:00:22.835623  3279 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:22.869163  1621 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:22.869498  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:22.870980  3339 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:00:22.871497  1660 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:22.871855  3357 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:22.851728  3278 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:22.867885  3246 consensus_meta.cc:287] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.770s	user 0.010s	sys 0.003s
I20260709 13:00:22.881551  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.853183  3187 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:22.884094  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:22.839692  3216 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:22.890964  3329 consensus_queue.cc:260] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.882766  3156 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:00:22.866168  3341 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:00:22.881120  3271 consensus_meta.cc:287] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
I20260709 13:00:22.900878  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:22.903570  1539 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:22.834012  3245 consensus_queue.cc:260] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.904904  1691 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:22.905740  1443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58806 (request call id 173) took 4338 ms. Trace:
I20260709 13:00:22.917074  2211 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:22.858284  3067 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:22.882938  3279 raft_consensus.cc:3055] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:22.883315  3157 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:22.884666  3236 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:00:22.906337  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.929298  1619 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:22.921182  1546 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:22.923641  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:22.924433  2241 raft_consensus.cc:1240] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:22.918380  1443 rpcz_store.cc:276] 0709 13:00:18.563155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.563345 (+   190us) service_pool.cc:224] Handling call
0709 13:00:22.901090 (+4337745us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":339397,"reported_tablets":2}
I20260709 13:00:22.933450  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:22.933993  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:22.917877  1615 consensus_meta.cc:287] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
I20260709 13:00:22.911510  3278 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:22.947999  1622 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:22.946385  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.946915  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:22.914433  3088 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.924242  3067 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:22.926167  3279 raft_consensus.cc:740] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:22.923945  3284 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.913717  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:22.919883  3348 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:22.922505  1557 tablet_copy_service.cc:140] P d7158d6c3b634dc7abb69eac58eba291: Received BeginTabletCopySession request for tablet 5814bf31e900408885160ea0f89d6189 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:42858)
I20260709 13:00:22.960201  1511 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:22.955054  3176 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:22.964798  1660 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:22.957779  3150 consensus_meta.cc:287] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.685s	user 0.008s	sys 0.002s
I20260709 13:00:22.937463  3245 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.938433  3329 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:22.963670  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.956880  3088 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:22.967558  3347 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:22.999457  1585 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:23.002684  1585 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:22.965674  1511 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:23.004696  1511 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:22.969897  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:22.947783  1615 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:22.972528  3216 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:22.972266  3279 consensus_queue.cc:260] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.972790  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:22.965270  3284 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.974937  3211 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.976015  1557 tablet_copy_service.cc:161] P d7158d6c3b634dc7abb69eac58eba291: Beginning new tablet copy session on tablet 5814bf31e900408885160ea0f89d6189 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:42858: session id = e8a64798e5f94de8909707bcbd11804a-5814bf31e900408885160ea0f89d6189
I20260709 13:00:22.976197  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:22.976065  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:22.918556  3341 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:22.980556  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:22.982021  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:22.993276  3165 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:22.995786  3327 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.896s	user 0.000s	sys 0.017s
I20260709 13:00:22.996659  3176 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:22.997006  3156 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:23.046100  3156 raft_consensus.cc:697] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:23.047078  3156 consensus_queue.cc:237] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:22.998041  2244 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:23.050103  2240 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:22.998210  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:22.968044  2239 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:23.010260  1618 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:23.011962  1511 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:22.959668  3290 consensus_queue.cc:1243] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer 822e08445eae4a33b2f2fe92060192c6 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:00:23.019467  2243 raft_consensus.cc:2410] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:23.019533  1617 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:23.058988  1621 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:23.059419  1617 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:23.020642  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:23.022136  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:23.002020  3108 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:23.025972  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:23.026775  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:23.060557  1619 raft_consensus.cc:3055] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:23.060909  1619 raft_consensus.cc:740] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:23.026979  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32470c2737744478bac199459790b787"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:00:23.019354  3187 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:23.014739  3150 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:22.995095  3222 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:23.032101  3336 log.cc:927] Time spent T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.485s	user 0.007s	sys 0.000s
I20260709 13:00:23.066648  1659 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:23.035964  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:23.036375  1542 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:23.039338  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:23.043740  3335 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:00:23.056360  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 44502.7us
I20260709 13:00:23.058300  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:23.070367  1540 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:23.062204  1614 raft_consensus.cc:606] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:23.062266  1621 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:23.063603  1585 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:23.065073  1617 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:23.068011  1619 consensus_queue.cc:260] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:23.071777  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:23.071713  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:23.082999  1619 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.073156  1585 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:23.084796  1585 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:23.073650  3335 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:23.088254  1659 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:23.088845  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:23.089284  1696 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:23.090234  1694 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:23.074760  3341 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:23.061064  3347 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:23.075956  2237 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:23.066746  3357 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:23.066102  1615 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:23.055609  3061 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:23.077260  3167 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:23.058537  3279 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:23.104830  3219 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:23.105104  2246 raft_consensus.cc:1240] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:23.076383  3331 raft_consensus.cc:3055] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:23.106007  3061 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.106601  3331 raft_consensus.cc:740] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:23.107499  3331 consensus_queue.cc:260] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:23.108140  3061 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:23.108494  3331 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.073518  3222 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:23.105072  3357 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:23.111987  3357 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.112604  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:23.095374  3108 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:23.114782  3088 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:23.116436  1546 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:23.085889  1585 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:23.086495  1547 raft_consensus.cc:2393] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 3: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:23.117386  3335 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:23.091118  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:23.115948  1615 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:23.118762  1694 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:23.119272  3241 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:23.120229  1694 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:23.086872  3290 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:23.094961  3150 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:23.061902  3165 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:23.122892  1694 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:23.097298  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:23.097566  1692 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:23.131428  1692 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:23.132571  1692 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:23.054661  3363 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:23.098115  1616 raft_consensus.cc:3055] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:23.134686  1616 raft_consensus.cc:740] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:23.076344  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:23.137025  1616 consensus_queue.cc:260] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.137794  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42114 (request call id 267) took 4621 ms. Trace:
I20260709 13:00:23.137959  1616 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:23.138094  1557 tablet_copy_source_session.cc:215] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:00:23.139719  1691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 1603) took 1661 ms (client timeout 1912 ms). Trace:
I20260709 13:00:23.140043  1539 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:23.141956  1695 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:23.142580  1543 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:23.104645  3276 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:23.145856  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.144546  1616 raft_consensus.cc:1275] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:23.095913  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:23.126227  3357 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.126986  1547 raft_consensus.cc:1240] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:23.157986  1538 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:23.128886  3279 consensus_queue.cc:1059] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:00:23.159672  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 73829.7us
I20260709 13:00:23.160596  3279 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:23.160954  3279 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:23.161334  3279 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.161528  1585 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:23.163208  3167 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:23.165627  3284 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:23.166745  3352 raft_consensus.cc:3055] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:23.167110  3352 raft_consensus.cc:740] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:23.167968  3352 consensus_queue.cc:260] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.135876  1511 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:23.168519  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:23.169539  3352 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.169749  1688 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 4: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:23.170357  1541 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:23.170415  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:23.099619  1512 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:23.090190  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:23.143648  1543 raft_consensus.cc:1240] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:23.145006  1545 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:00:23.173661  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:23.117293  1659 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:23.174990  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 57776.1us
I20260709 13:00:23.135469  3329 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:23.140133  1691 rpcz_store.cc:269] 0709 13:00:21.477873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.478247 (+   374us) service_pool.cc:224] Handling call
0709 13:00:23.139546 (+1661299us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400449654. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:23.139661 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3241536768}
I20260709 13:00:23.143173  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1609) took 1660 ms. Trace:
I20260709 13:00:23.168215  1585 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:23.147780  1619 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
W20260709 13:00:23.175606  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 76088.7us
I20260709 13:00:23.176268  1618 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:23.177624  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:23.182016  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:23.180516  1695 rpcz_store.cc:276] 0709 13:00:21.482698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.869034 (+386336us) service_pool.cc:224] Handling call
0709 13:00:23.141600 (+1272566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.142332 (+   732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.142971 (+   639us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400449650. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:23.143097 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2925426944}
I20260709 13:00:23.185712  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:23.184365  3146 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:23.190281  3241 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:23.190888  3187 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:23.191731  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:23.192731  3347 consensus_queue.cc:1048] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:23.197005  1585 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:23.160976  3293 raft_consensus.cc:3055] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:23.185091  3150 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:23.197036  1511 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:23.198966  1585 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:23.200006  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:23.208081  3032 consensus_queue.cc:1059] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:23.227927  3272 consensus_queue.cc:1059] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:23.228837  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:23.229866  3287 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:23.186100  3284 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:23.230854  3032 raft_consensus.cc:3055] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:23.231377  3290 consensus_queue.cc:1059] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:23.216847  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:23.232925  1689 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:23.233173  3333 consensus_queue.cc:1059] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:23.233718  3187 consensus_queue.cc:1059] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:23.208405  1690 raft_consensus.cc:1240] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:23.234508  3268 raft_consensus.cc:3055] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:23.234649  3333 raft_consensus.cc:3055] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:23.208757  3363 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:23.234965  3268 raft_consensus.cc:740] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:23.236366  1587 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:23.236837  3272 consensus_queue.cc:1243] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer 822e08445eae4a33b2f2fe92060192c6 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:00:23.236388  3268 consensus_queue.cc:260] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.237879  1619 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:23.220068  3260 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:00:23.240725  3167 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:23.237865  3268 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.238008  3341 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:23.219770  3061 consensus_queue.cc:1059] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:00:23.245939  3061 raft_consensus.cc:3055] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:23.246340  3061 raft_consensus.cc:740] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:23.247357  3216 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:23.210377  3293 raft_consensus.cc:740] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:23.250547  3328 consensus_queue.cc:1059] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:23.251111  3293 consensus_queue.cc:260] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:23.251791  3341 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:23.251910  3347 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:23.213552  1617 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:23.252980  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 54124.1us
W20260709 13:00:23.253371  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 56366.2us
I20260709 13:00:23.217231  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:23.227737  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:23.231225  3032 raft_consensus.cc:740] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:23.176977  3245 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:23.254743  1511 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:23.273098  3185 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:23.273491  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:23.274413  1614 raft_consensus.cc:3055] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:23.274747  1614 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:23.275553  1614 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.276520  3341 consensus_queue.cc:1059] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:23.277488  3341 raft_consensus.cc:3055] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:00:23.277643  3282 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:00:23.277854  3341 raft_consensus.cc:740] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:23.248924  3216 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:00:23.256635  2210 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:23.225206  1660 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:23.280961  1511 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:23.281689  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 56564us
I20260709 13:00:23.281963  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:23.285218  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:23.287246  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:23.260145  1587 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:23.262776  1585 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:23.252517  3293 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:23.138196  1442 rpcz_store.cc:276] 0709 13:00:18.515932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.516079 (+   147us) service_pool.cc:224] Handling call
0709 13:00:23.137732 (+4621653us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:20.805605 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:20.822269 (+ 16664us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:20.840535 (+ 18266us) write_op.cc:435] Acquired schema lock
0709 13:00:20.842680 (+  2145us) tablet.cc:662] Decoding operations
0709 13:00:20.861023 (+ 18343us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:20.861098 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:20.861132 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:20.861323 (+   191us) tablet.cc:701] Row locks acquired
0709 13:00:20.861348 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:00:20.861496 (+   148us) write_op.cc:270] Start()
0709 13:00:20.861628 (+   132us) write_op.cc:276] Timestamp: P: 1783602020861454 usec, L: 0
0709 13:00:20.861649 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:00:20.862350 (+   701us) log.cc:844] Serialized 536 byte log entry
0709 13:00:21.267351 (+405001us) op_driver.cc:464] REPLICATION: finished
0709 13:00:21.560959 (+293608us) write_op.cc:301] APPLY: starting
0709 13:00:21.561079 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:21.561223 (+   144us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:21.561342 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:21.561648 (+   306us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:21.561845 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:21.561912 (+    67us) write_op.cc:312] APPLY: finished
0709 13:00:21.562158 (+   246us) log.cc:844] Serialized 23 byte log entry
0709 13:00:21.562363 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:21.562486 (+   123us) write_op.cc:454] Released schema lock
0709 13:00:21.562537 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:21.565811 (+  3274us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:21.565853 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":725619,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":293325,"apply.run_cpu_time_us":1967,"apply.run_wall_time_us":4829,"num_ops":1,"prepare.queue_time_us":205960,"prepare.run_cpu_time_us":26265,"prepare.run_wall_time_us":102622,"raft.queue_time_us":62966,"raft.run_cpu_time_us":511,"raft.run_wall_time_us":511,"replication_time_us":405542,"thread_start_us":192787,"threads_started":3,"wal-append.queue_time_us":267380,"wal-append.run_cpu_time_us":22053,"wal-append.run_wall_time_us":1438242}]]}
I20260709 13:00:23.266146  3290 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:23.298571  1585 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:23.211202  3335 consensus_queue.cc:1059] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:00:23.198278  3108 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:23.220628  3146 consensus_queue.cc:1059] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
W20260709 13:00:23.268452  3369 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:00:23.269886  3279 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.313759  3279 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:23.315284  1618 raft_consensus.cc:1240] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:23.270612  3357 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:23.235105  3333 raft_consensus.cc:740] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:23.316481  1659 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:23.317426  3165 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:23.301107  3185 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:00:23.317589  3333 consensus_queue.cc:260] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:23.255761  3061 consensus_queue.cc:260] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.318655  3165 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:23.276783  1614 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:23.290112  2209 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:23.262662  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:23.302855  1660 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:23.305559  1585 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:23.252725  3347 raft_consensus.cc:3055] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:23.309607  3370 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:23.311223  3335 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.311713  3328 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:23.311769  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 767) took 1085 ms. Trace:
I20260709 13:00:23.318830  3185 raft_consensus.cc:3055] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:23.319547  3061 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.319964  3093 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:23.321565  2238 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:00:23.322058  3219 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:23.318867  3333 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:23.323292  3146 raft_consensus.cc:3055] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:23.255342  1622 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:23.278905  3341 consensus_queue.cc:260] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.324270  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:00:23.374274  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 50090.6us
I20260709 13:00:23.374470  1694 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:00:23.328534  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.262477  3260 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:23.274762  3329 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:23.330438  3216 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.330561  1615 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:00:23.331525  3032 consensus_queue.cc:260] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.336519  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:23.323644  3246 raft_consensus.cc:993] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:23.340107  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:23.340636  3150 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:23.341110  3347 raft_consensus.cc:740] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:23.341291  3352 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:23.308748  3176 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:23.345975  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:23.263105  3241 consensus_queue.cc:1059] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:00:23.357950  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:23.307317  3282 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:23.360395  1441 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42122 (request call id 238) took 4624 ms. Trace:
I20260709 13:00:23.407931  1441 rpcz_store.cc:276] 0709 13:00:18.735999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.736215 (+   216us) service_pool.cc:224] Handling call
0709 13:00:23.360305 (+4624090us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":7}
I20260709 13:00:23.372023  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:23.373337  3146 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:23.381323  1692 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:23.343938  3185 raft_consensus.cc:740] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:23.393280  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:23.343838  1687 rpcz_store.cc:276] 0709 13:00:22.226693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.260502 (+ 33809us) service_pool.cc:224] Handling call
0709 13:00:22.981884 (+721382us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b58001c3598. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606e9c 00007fc48e606a5b 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc4966f10a0 00007fc4966f0984 00007fc48fc6b6d4 00007fc48fc6b662
0709 13:00:23.311463 (+329579us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b54002689d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:23.311683 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165752832}
I20260709 13:00:23.385238  1585 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:23.400841  3352 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:23.358006  2238 pending_rounds.cc:85] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Aborting all ops after (but not including) 4
I20260709 13:00:23.344204  3328 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:23.358242  3278 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:23.383876  3271 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:23.383445  3187 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.376343  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:23.386646  3245 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:23.390714  1615 pending_rounds.cc:85] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 1
I20260709 13:00:23.389031  3171 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:23.416704  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 70787.1us
I20260709 13:00:23.407702  3331 raft_consensus.cc:1081] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:23.401160  3150 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:23.386091  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 96099.1us
I20260709 13:00:23.389369  3260 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:23.439826  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 54639.7us
I20260709 13:00:23.388769  3243 consensus_queue.cc:1059] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:00:23.421238  3093 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:23.395293  3216 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.427311  3341 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.422315  3282 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:00:23.447014  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:23.439080  3352 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:23.384239  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.449164  1587 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:23.475996  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:23.442472  2238 pending_rounds.cc:107] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:00:23.452036  3278 raft_consensus.cc:697] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:23.485136  2209 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:23.490033  3173 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:23.490566  3173 raft_consensus.cc:697] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:23.455654  3245 raft_consensus.cc:697] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:23.491467  3173 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:23.492606  3245 consensus_queue.cc:237] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:23.497530  3319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5814bf31e900408885160ea0f89d6189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:23.478258  2238 raft_consensus.cc:2889] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:23.502213  1687 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:23.463140  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.443975  3328 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.442950  3032 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.444399  3290 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:23.469080  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 84889.6us
I20260709 13:00:23.442035  3353 consensus_queue.cc:1059] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:00:23.511059  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:23.429939  3176 raft_consensus.cc:697] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:23.448984  1615 pending_rounds.cc:107] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:00:23.444586  3157 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:23.505697  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:23.509171  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:23.451761  3187 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.482844  3333 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:23.478363  3342 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:23.495767  3332 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:23.525276  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:23.521921  1660 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:23.447419  3146 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.503896  3363 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.465906  3185 consensus_queue.cc:260] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:23.508920  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:23.518184  1615 raft_consensus.cc:2889] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:23.539655  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:23.540060  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:23.522298  3290 raft_consensus.cc:697] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:23.524981  3165 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:23.509737  3331 consensus_queue.cc:1059] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:00:23.517843  3219 consensus_queue.cc:1059] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:00:23.549304  3187 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:23.548925  3185 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:23.555537  3187 consensus_queue.cc:1059] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:23.552126  2240 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:23.541498  3246 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:23.565495  1692 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
W20260709 13:00:23.568742  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 61009.6us
W20260709 13:00:23.571266  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 92626.9us
I20260709 13:00:23.570648  1511 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:23.534695  3363 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:23.570629  3374 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:00:23.585541  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:23.567034  3335 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:23.589169  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:23.586627  1538 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:23.589053  1544 raft_consensus.cc:1240] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:23.568415  3246 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:23.591737  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:23.588438  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:23.593850  1614 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:23.594417  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:23.606958  1616 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:23.612773  1540 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:23.558220  3278 consensus_queue.cc:237] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.596639  3150 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:23.605610  3246 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:23.611470  3361 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:00:23.632450  3385 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:00:23.615993  3260 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:23.653283  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.684520  3383 log.cc:927] Time spent T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:00:23.700271  3380 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 13:00:23.737782  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 156995us
W20260709 13:00:23.760618  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.579882  3176 consensus_queue.cc:237] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:23.619807  3388 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:23.853678  3293 consensus_meta.cc:287] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.007s
I20260709 13:00:23.605559  3290 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.617640  3335 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.833148  3270 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:00:23.847644  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.853272  3378 log.cc:927] Time spent T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.193s	user 0.007s	sys 0.013s
I20260709 13:00:23.859186  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:23.842137  3242 raft_consensus.cc:3055] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:23.870366  1511 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:23.852528  3260 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.886092  3386 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:23.872926  3242 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:23.886607  3386 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:23.887064  3386 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.889789  1511 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:23.902031  3185 consensus_queue.cc:1048] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:23.902900  3061 consensus_meta.cc:287] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.007s
I20260709 13:00:23.868847  3270 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:23.905560  3270 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:23.877345  3388 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:23.898208  3260 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.911175  3150 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:23.925419  3352 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.883311  3243 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:00:23.887257  3242 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.942579  3352 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:23.942921  3271 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:23.943552  3271 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:23.944716  3260 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:23.946080  3246 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.948148  3246 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:23.960587  3216 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:23.869012  3335 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:23.975193  3211 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:23.975682  3373 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.481s	user 0.000s	sys 0.004s
W20260709 13:00:23.980904  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 360186us
I20260709 13:00:23.991943  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:23.981108  3386 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.056588  3245 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:24.218708  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.178627  3243 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.175287  3241 raft_consensus.cc:3055] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:24.001847  3363 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:23.978508  3328 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:24.247002  1542 raft_consensus.cc:1240] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:24.237232  3241 raft_consensus.cc:740] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:24.234288  3245 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.237814  3243 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.263335  3347 consensus_queue.cc:260] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:24.265112  3347 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.276684  3319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45866 (request call id 383) took 2641 ms. Trace:
I20260709 13:00:24.277261  3319 rpcz_store.cc:276] 0709 13:00:21.635277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.635400 (+   123us) service_pool.cc:224] Handling call
0709 13:00:22.101316 (+465916us) ts_tablet_manager.cc:934] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
0709 13:00:23.487403 (+1386087us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:23.907951 (+420548us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:23.909297 (+  1346us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:24.275817 (+366520us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:24.276153 (+   336us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:24.276511 (+   358us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:24.276587 (+    76us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":124204,"tablet-copy.queue_time_us":259385,"thread_start_us":258340,"threads_started":2}
I20260709 13:00:24.280205  3386 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:24.256727  3241 consensus_queue.cc:260] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.284744  3245 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:24.287197  3243 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:24.288511  3319 tablet_copy_client.cc:806] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:24.293594  3271 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.294456  3156 raft_consensus.cc:3055] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:24.294847  3156 raft_consensus.cc:740] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:24.295205  3328 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:24.296051  3271 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:24.298178  1613 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:24.298667  3032 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.299139  3032 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:24.300094  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 1535) took 1898 ms (client timeout 2201 ms). Trace:
I20260709 13:00:24.299894  3156 consensus_queue.cc:260] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:24.300431  1613 rpcz_store.cc:269] 0709 13:00:22.401667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.422151 (+ 20484us) service_pool.cc:224] Handling call
0709 13:00:24.299928 (+1877777us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b540024efd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:24.300039 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4307574016}
I20260709 13:00:24.300896  3156 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:24.302587  3032 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:24.304334  3319 tablet_copy_client.cc:670] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
W20260709 13:00:24.305605  3376 log.cc:927] Time spent T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.738s	user 0.007s	sys 0.024s
I20260709 13:00:24.306691  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1637) took 1009 ms. Trace:
I20260709 13:00:24.307034  1690 rpcz_store.cc:276] 0709 13:00:23.297532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.298164 (+   632us) service_pool.cc:224] Handling call
0709 13:00:23.309940 (+ 11776us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.321085 (+ 11145us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:00:23.321116 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.321540 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:00:23.437702 (+116162us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:23.437738 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.437805 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.305320 (+867515us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b24001f7d38. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e4c49c4 00007fc48e4c2acb 00007fc48e67ddc9 00007fc48e67da55 00007fc48e67d09d 00007fc4912af10e 00007fc4912c688c 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221
0709 13:00:24.306418 (+  1098us) raft_consensus.cc:1685] finished
0709 13:00:24.306441 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.306637 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10214,"raft.queue_time_us":12466,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":101,"spinlock_wait_cycles":4138880,"thread_start_us":115882,"threads_started":1,"wal-append.queue_time_us":217495}
I20260709 13:00:24.323676  3398 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:24.324288  3398 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:24.326506  3398 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:24.329406  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2038) took 1117 ms. Trace:
I20260709 13:00:24.329828  1615 rpcz_store.cc:276] 0709 13:00:23.211844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.263925 (+ 52081us) service_pool.cc:224] Handling call
0709 13:00:23.268152 (+  4227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.549750 (+281598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.329134 (+779384us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b54003205d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:24.329318 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142338432}
W20260709 13:00:24.338002  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.338634  2243 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:24.339351  2240 raft_consensus.cc:1240] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:24.339793  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:24.345415  3146 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:24.350582  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:24.351966  1511 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:24.353174  3385 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:24.354681  3385 consensus_queue.cc:1059] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:24.356065  3385 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.356714  3385 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:24.374579  3381 raft_consensus.cc:3055] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:24.375123  3381 raft_consensus.cc:740] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:24.376057  3381 consensus_queue.cc:260] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:24.377493  3381 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:24.385403  3335 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:24.389120  1614 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:24.389921  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:24.391126  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:24.391073  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:24.389010  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:24.394619  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 51155.1us
I20260709 13:00:24.395387  2209 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:24.397657  3249 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:24.394757  1688 raft_consensus.cc:606] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:24.400959  1622 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:24.339061  1660 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:24.402537  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 63556us
I20260709 13:00:24.403899  3284 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:00:24.405539  3394 log.cc:927] Time spent T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.425s	user 0.000s	sys 0.001s
W20260709 13:00:24.408365  3401 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.168s	user 0.001s	sys 0.001s
I20260709 13:00:24.408488  3284 raft_consensus.cc:2955] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:24.415112  1696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7aca6dcf002947d6841150860825871b"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:24.415949  1696 raft_consensus.cc:606] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:24.417043  3287 raft_consensus.cc:3055] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:24.417503  3287 raft_consensus.cc:740] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:24.417263  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:24.418210  1688 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:24.418362  3287 consensus_queue.cc:260] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.422147  1538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39612
I20260709 13:00:24.422659  1538 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:24.423017  1538 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.423296  1543 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:24.423894  1539 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:24.424322  1546 raft_consensus.cc:1240] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:24.424830  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:24.425500  1545 raft_consensus.cc:2393] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 4: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:24.426566  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:24.428864  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:24.430481  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:24.427127  1539 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:24.433012  1696 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:24.433858  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:24.427902  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:24.437903  1696 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:24.443830   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:24.446384   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:24.447221  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.452145  1621 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:00:24.454105  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:24.454835  1621 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:24.456753  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:24.457749  1613 raft_consensus.cc:2393] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 4: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 13:00:24.462224  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.466998  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:24.467821  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:24.455937  3341 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.469630  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:24.476106  1614 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:24.476464  1620 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:24.472673  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:24.455180  3287 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:24.472734  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:24.474562  1585 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:24.480042  1692 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:24.460764  3357 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.478376  1538 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.485482  1539 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:24.480800  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:00:24.480078  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.495900  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:24.444041  3324 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:00:24.463629  3363 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:24.518312  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:24.519207  1546 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:24.477591  1613 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:24.504627  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:24.506165  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:24.507320  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:24.524595  1538 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:24.511700  1512 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:24.460557  3240 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:00:24.520704  1546 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:00:24.532718  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 48909.2us
I20260709 13:00:24.469168  3088 consensus_queue.cc:1059] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:00:24.465677  3093 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:00:24.531141  1693 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:24.529474  1692 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:24.470806  3278 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:00:24.501086  3357 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.543524  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:24.523768  3290 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:24.492969  3341 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.532152  3363 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.554723  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:24.566816  3240 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:24.533126  3250 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 13:00:24.563417  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 51815.2us
I20260709 13:00:24.576738  1695 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:24.589346  1694 raft_consensus.cc:2393] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:24.484326  3398 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:00:24.592378  3357 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:24.585651  1688 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:24.598009  1618 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:24.600486  3242 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:24.601450  3241 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:24.603863  3219 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.604048  3341 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:24.604755  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.605794  3363 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:24.566519  3391 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.612497  1512 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:24.584867  3176 raft_consensus.cc:3055] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:24.615247  3219 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.625950  3176 raft_consensus.cc:740] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:24.621850  3245 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:00:24.647665  3319 tablet_copy_client.cc:538] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:24.627300  3391 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:24.651854  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.636404  3385 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:24.656142  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 181706us
I20260709 13:00:24.664043  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:00:24.682292  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.690310  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 198335us
W20260709 13:00:24.692152  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 206829us
W20260709 13:00:24.695194  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.643297  3088 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:00:24.684768  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:24.704401  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:24.707526  1585 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:00:24.709759  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 284675us
I20260709 13:00:24.691888  3385 raft_consensus.cc:697] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:24.692463  3397 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:24.690217  3398 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:00:24.743702  1585 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:24.727926  3287 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:24.704084  3187 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.745487  3271 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:24.698488  3349 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:00:24.750314  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 45410.9us
I20260709 13:00:24.703106  3278 consensus_queue.cc:1059] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:00:24.730376  3399 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.750038  3187 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.756943  3399 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.758229  3187 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:24.758921  3399 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:24.735062  3397 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.769485  3397 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:24.774927  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:24.783026  3409 log.cc:927] Time spent T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:00:24.798719  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 88640.6us
W20260709 13:00:24.807446  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.735986  1587 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:24.737710  3341 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.745792  3093 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:24.729750  3410 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:24.754391  3271 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.815557  3271 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:24.815336  3341 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:24.816304  3271 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:24.810837  3287 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.817663  3341 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 13:00:24.761348  3219 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:24.761189  3088 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:24.711030  3357 consensus_queue.cc:1059] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:00:24.762132  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:24.762341  3349 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:24.754361  3361 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:24.811439  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 75521.5us
I20260709 13:00:24.813045  3093 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.802073  3245 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.730572  3176 consensus_queue.cc:260] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:24.827196  1618 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:24.817808  3287 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:24.809885  3333 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:24.829725  3357 raft_consensus.cc:3055] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:24.821635  3341 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:24.850004  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 106388us
I20260709 13:00:24.820430  3165 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:24.860690  1585 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:24.825475  3361 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.865376  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:24.867578  3032 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:24.873034  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:24.874048  1621 raft_consensus.cc:2393] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:24.870191  1585 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:24.875622  1585 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:24.882009  1614 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:24.845958  3357 raft_consensus.cc:740] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:24.885030  1621 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:24.892241  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:24.894008  1541 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:24.869474  3361 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:24.895220  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:24.901582  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:24.844610  3245 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.902647  1620 raft_consensus.cc:1240] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:24.903123  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:24.903826  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:24.846876  3333 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.911831  1543 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:24.905053  1688 raft_consensus.cc:3055] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:24.818612  3385 consensus_queue.cc:237] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.902230  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:24.912742  1511 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:24.923470  1511 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:24.924629  1511 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:24.913416  1541 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:24.869421  3165 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:24.882053  3391 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:24.882309  3412 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:24.926994  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:24.866058  3341 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:24.935461  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:24.946082  1620 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:24.902098  3032 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.944103  1547 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:24.944191  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:24.895784  3381 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:24.905880  3211 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.907686  3388 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:24.947213  1621 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:24.947969  1696 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 4: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:24.918556  1688 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:24.956192  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:24.956796  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:24.934022  3187 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:24.958869  1690 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:24.960547  1613 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:24.943893  3146 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:24.948758  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:24.923666  3219 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:00:24.923872  3347 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:00:24.964982  3333 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:24.965310  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:24.965965  1688 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:24.965975  3415 log.cc:927] Time spent T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:00:24.969623  3165 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:24.952984  3391 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:24.974079  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:24.975986  3093 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:24.959720  3187 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:24.970832  3421 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260709 13:00:24.972219  3422 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:00:24.963330  3357 consensus_queue.cc:260] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.009388  3357 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.990760  3410 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:00:24.994105  3391 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:25.013463  3391 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:25.015095  1539 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 3: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:24.992158  3361 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.954867  3211 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:24.997284  3341 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:24.953734  3381 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.025035  3381 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:25.025807  1621 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
W20260709 13:00:25.001085  3416 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:00:24.972915  3432 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:25.002461  3411 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:00:25.056311  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:25.005015  3287 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:24.997861  1689 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:24.956171  3388 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.007570  3245 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:24.990345  1615 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.039502  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:25.072031  1690 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:24.988535  1687 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:25.014338  3187 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:25.060199  1618 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 4: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:25.023054  3211 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.064663  3397 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.083326  3388 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.085100  3397 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:25.059199  3260 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:25.088757  3260 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.090781  3260 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:25.059474  3432 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.092329  3391 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.070999  1587 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:25.061998  3429 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:00:25.095077  3287 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:25.095504  3242 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.095657  3287 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.096099  3242 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.079805  3335 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:25.097801  3335 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.098318  3242 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:25.099817  3319 tablet_bootstrap.cc:492] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:00:25.100040  3335 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:25.101282  3245 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.102056  3211 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.101935  3245 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.068907  3361 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.082480  3176 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.105826  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:25.106284  3245 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:25.106740  1689 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 4: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:25.096112  3287 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.092816  3432 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:25.117445  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:25.101059  1587 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:25.118597  1545 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:25.074812  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:25.062237  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 137655us
I20260709 13:00:25.102617  3211 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.105324  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:25.105680  1687 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:25.116079  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:25.123301  1544 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:25.120507  1659 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:25.125211  3397 raft_consensus.cc:993] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:25.125113  3165 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:25.125774  3165 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:25.120807  1541 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.119740  1617 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:25.126098  3093 raft_consensus.cc:1081] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:25.125775  3397 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:25.128683  3397 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.131536  3397 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:25.144088  1659 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:25.133299  3242 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.134716  3211 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.126307  3165 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.121433  1511 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:25.140350  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:25.150681  1585 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:25.132537  3361 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:25.152135  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:25.153518  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:25.154942  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:25.156270  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:25.161314  1541 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:25.151705  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:25.171198  1544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39612
I20260709 13:00:25.181304  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:25.179944  1659 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:25.182353  1693 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:25.183099  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:25.119798  3391 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.172219  1546 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:25.170012  1538 raft_consensus.cc:2955] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:25.195180  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:25.196069  1691 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:25.169701  3396 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:25.168789  3093 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:25.169114  3361 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.168977  3432 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.165980  3271 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:00:25.199123  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:25.199425  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 273381us
I20260709 13:00:25.147306  3187 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:25.198912  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 48320.4us
I20260709 13:00:25.204041  1587 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
W20260709 13:00:25.204428  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 52411.6us
I20260709 13:00:25.190291  3218 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:25.239715  1511 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:25.192934  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:25.200383  3363 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:25.242830  1512 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:25.243201  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:25.243831  1691 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:25.245792  1587 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:25.240360  1544 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:25.247749  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:25.248404  1544 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.171335  3242 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:25.239132  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.251345  3242 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:25.201049  3396 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:25.207201  3361 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.209204  3381 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.202737  3093 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.238193  3444 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:25.202178  3446 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.256131  3410 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:25.241245  3218 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.241044  3357 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.266188  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:25.266453  1512 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:25.261683  1544 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.242287  3363 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:25.253494  3432 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.283494  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:25.210254  3397 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:25.274768  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 475006us
I20260709 13:00:25.263398  3396 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.276561  3218 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.280205  3241 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:25.280023  3357 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.294478  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:25.295200  1622 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:25.296754  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:25.297639  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:25.281615  3187 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.281733  3335 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:25.303364  3335 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.306268  3335 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:25.268028  3391 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:25.307075  3391 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:25.307646  3391 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.308369  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:25.310060  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:25.311398  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:25.312369  2243 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:25.270754  3093 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:25.282778  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:25.316066  1538 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:25.284089  1539 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:25.275086  3347 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:25.270043  3242 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.254281  3146 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:00:25.273296  3328 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:00:25.272388  3444 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.276723  3410 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.318337  1586 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:25.282867  3245 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:25.337798  1586 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:25.275408  3446 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.282779  3414 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:00:25.326262  3413 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.624s	user 0.004s	sys 0.000s
I20260709 13:00:25.326699  3242 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.334712  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:25.353611  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:25.354185  2244 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
W20260709 13:00:25.355437  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.321069  3347 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.283782  3363 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.339818  1586 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:25.358999  3088 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:25.366561  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:25.341583  3245 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.342545  3410 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.344357  1585 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:25.293191  3241 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.349852  3287 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:25.352701  3357 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.331547  3444 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:25.382025  1511 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:25.336107  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:25.331811  3397 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:25.344115  3430 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.372184  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:25.365888  3088 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.357811  3349 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:25.362757  3347 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.418087  1621 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:00:25.370942  3245 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:25.373641  3435 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:25.407801  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 63555us
I20260709 13:00:25.410578  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:25.394469  3241 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.423552  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:25.423662  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:25.415210  3397 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.424216  1614 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:25.433758  1614 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:25.436210  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:25.407397  3444 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:25.490739  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 46282.3us
I20260709 13:00:25.418146  3211 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:25.492734  1511 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:25.492544  3444 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.356745  3414 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.421554  3435 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.497287  3444 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.429522  3243 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.498164  3211 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.507771  3211 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.512758  3391 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.519956  3287 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 13:00:25.520685  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:25.522503  3391 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.525832  3446 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:25.525167  3211 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.499136  3146 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:25.526902  3146 raft_consensus.cc:697] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:25.527951  3146 consensus_queue.cc:237] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.535583  3211 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.500958  3435 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.490487  3412 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:25.543751  3412 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.492278  3381 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:00:25.498271  3426 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:25.548884  3426 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.518596  3396 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.565987  1618 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:25.617777   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:25.421983  3349 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.587033  3432 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:25.629097  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.615602  3211 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.616374  3391 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.587450  3243 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:00:25.699288  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:25.660197  3242 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:25.666109  3412 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.730897  3386 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:25.661574  3211 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.739338  3349 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.741623  3211 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.665406  3391 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.745694  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:25.749747  1544 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:25.750294  1621 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.730594  3410 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:25.767787  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.008s	sys 0.004s
I20260709 13:00:25.736846  3386 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:00:25.768258  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.008s	sys 0.004s
W20260709 13:00:25.768944  1661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.033s	sys 0.047s
W20260709 13:00:25.781663  1661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.033s	sys 0.048s
I20260709 13:00:25.783686  1619 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:00:25.737142  3381 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:00:25.784616  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:25.781687  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 538834us
I20260709 13:00:25.736944  3093 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.794925  1660 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:25.795899  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:25.787961  3165 consensus_meta.cc:287] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.001s
I20260709 13:00:25.796482  1695 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:25.752396  3218 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.812847  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:25.820007  1659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.016s	sys 0.033s
I20260709 13:00:25.810067  3242 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:25.804399  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:25.804730  3396 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.810887  3426 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.795605  3241 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.822535  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:25.823096  1546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.008s	sys 0.014s
I20260709 13:00:25.811686  3165 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.828872  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:00:25.834827  1546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.009s	sys 0.014s
I20260709 13:00:25.806043  3250 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:25.836526  1690 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.828096  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:25.842396  1694 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:25.824848  1687 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:25.830454  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:25.829718  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:25.837990  3410 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.833462  1621 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
W20260709 13:00:25.824677  1659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.016s	sys 0.034s
W20260709 13:00:25.857429  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 577682us
I20260709 13:00:25.838523  3218 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:25.832442  1587 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:25.818557  3333 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:00:25.848799  1692 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 4: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:25.852541  3250 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.867607  3088 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.852272  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:25.868489  1695 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.868584  3241 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.869247  2244 raft_consensus.cc:2955] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:25.870494  3165 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:25.872351  3245 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.864724  3412 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.874559  3245 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.875293  1695 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
W20260709 13:00:25.875500  3458 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:00:25.876133  3250 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.876466  1690 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
W20260709 13:00:25.838193  3361 consensus_meta.cc:287] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.003s
I20260709 13:00:25.831341  3414 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.826949  3093 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:25.895705  1659 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:25.895731  1660 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:25.834853  1689 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 13:00:25.899725  3446 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:25.903270  3446 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:25.908188  2209 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.040s	sys 0.064s
W20260709 13:00:25.908538  2209 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.040s	sys 0.064s
W20260709 13:00:25.908812  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 548369us
I20260709 13:00:25.897324  3211 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:25.893745  3435 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.898936  3361 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.915437  3093 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:25.917238  3391 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:25.926674  3388 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:25.929497  3426 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:25.932446  3457 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:25.933214  3446 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:25.931100  3245 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:25.937544  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:25.933116  3284 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:25.936758  3093 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.963188  3093 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:25.925515  3211 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.949805  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:25.973421  3211 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:25.977221  3462 log.cc:927] Time spent T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 13:00:25.978654  3459 log.cc:927] Time spent T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:00:25.978780  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:25.979526  1622 raft_consensus.cc:2368] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:25.980329  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:25.980671  3352 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:25.981402  3352 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:25.941455  3335 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.022s	sys 0.027s
W20260709 13:00:25.983443  3335 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.022s	sys 0.027s
I20260709 13:00:25.985430  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:25.986333  1617 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 4: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 13:00:25.987747  3471 log.cc:927] Time spent T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:00:25.958732  3333 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:25.989039  3363 consensus_meta.cc:287] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.615s	user 0.002s	sys 0.009s
I20260709 13:00:25.988816  3333 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.989391  3363 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.990828  3333 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:25.958871  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:25.946933  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:25.992276  2239 raft_consensus.cc:2393] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 2: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:25.992432  3284 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:25.945356  3388 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.994555  1688 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.995258  3388 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:25.995628  3435 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:25.971262  3410 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:25.964946  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:25.996205  3410 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.997521  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:25.998041  1621 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:25.998278  3410 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:25.980830  1622 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.998761  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:25.955741  3032 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:25.999686  3032 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.001161  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:26.001596  3032 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.001835  1619 raft_consensus.cc:2368] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3.
W20260709 13:00:26.002475  3347 consensus_meta.cc:287] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
I20260709 13:00:26.002631  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:26.002856  3347 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.005461  3347 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:26.005978  3347 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:26.006394  3347 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.008093  1622 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:26.008795  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:26.008975  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:26.009583  1622 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:26.009871  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:26.009951  3444 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.010589  1618 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:25.945726  3457 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:26.016580  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:25.950697  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.019007  1619 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.987188  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:26.015478  1621 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:26.023653  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:26.029789  1622 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:26.012089  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:26.057107  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:26.058086  2242 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.002749  3093 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.043682  1618 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:26.024858  2239 raft_consensus.cc:2393] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 4: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:25.988837  3352 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:25.976424  3361 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:26.020562  3457 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:26.024818  3463 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:25.952082  3426 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:25.967118  3245 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.074143  3418 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.087986  2242 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:26.089797  1586 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:26.092269  3361 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.093015  3361 raft_consensus.cc:697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:26.080143  3284 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:26.101035  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:26.101352  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:26.099676  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:26.101971  1621 raft_consensus.cc:2393] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 4: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:26.102157  1622 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:26.097630  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:26.100303  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:26.102947  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:26.103554  2245 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:26.102067  1614 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:26.085141  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:26.113030  3361 consensus_queue.cc:237] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.105301  3243 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:26.115733  3243 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.118063  3243 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:26.094424  3418 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.120509  3245 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:26.108600  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:26.123452  1511 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:26.088728  3460 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:26.105608  3388 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.145212  3240 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:26.146073  3240 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.085638  3463 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.166018  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:26.169252  1614 raft_consensus.cc:2393] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 4: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:26.128940  3245 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:26.121109  3418 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:26.128715  3243 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.174758  1660 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:26.181960  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:26.182487  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:26.183142  2239 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:26.184799  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:26.185539  1586 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:26.185947  1587 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:26.186666  3032 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:26.187021  3432 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.187024  3032 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:26.187481  3432 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:26.187737  3032 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.187901  3432 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.189332  1688 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:26.190188  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 1651) took 1550 ms. Trace:
I20260709 13:00:26.190653  1688 rpcz_store.cc:276] 0709 13:00:24.639677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.640860 (+  1183us) service_pool.cc:224] Handling call
0709 13:00:24.904928 (+264068us) spinlock_profiling.cc:243] Waited 59.7 ms on lock 0x7b5400264e20. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916a2dc0 00007fc49172ee18 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:25.994114 (+1089186us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b58002903d0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916870aa 00007fc491709447 00007fc491721fe7 00007fc4917237de 00007fc49172f27c 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c
0709 13:00:26.190101 (+195987us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1837593216}
I20260709 13:00:26.192621  1616 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:26.192792  1660 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:26.194175  1587 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:26.130604  3396 consensus_queue.cc:1059] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:00:26.172675  3414 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.168077  3333 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:26.170908  3480 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:26.174122  3245 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:26.219511  3480 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.221043  3426 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:26.221570  3480 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.222442  3410 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:26.223047  3410 raft_consensus.cc:697] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:26.223902  3410 consensus_queue.cc:237] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.226171  3444 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.227507  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:26.228224  1688 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:26.204362  3461 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:26.229269  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:26.229876  3463 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.206406  3396 raft_consensus.cc:3055] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:26.210247  3093 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:26.209895  3457 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.197935  3241 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:00:26.198057  3278 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:00:26.210623  3414 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.211046  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:26.256400  3414 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:26.168345  3460 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.256672  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 1657) took 1109 ms. Trace:
I20260709 13:00:26.256835  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:26.257442  1689 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.257146  1687 rpcz_store.cc:276] 0709 13:00:25.147120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.152134 (+  5014us) service_pool.cc:224] Handling call
0709 13:00:26.256463 (+1104329us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b540044be54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:26.256611 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1302235264}
I20260709 13:00:26.258220  3460 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.167135  3388 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.258999  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:26.237983  3444 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:26.259969  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:26.260586  1692 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.260069  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:26.261616  3457 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:26.261742  1695 raft_consensus.cc:3055] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:26.262105  1695 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:26.262847  3032 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.263048  1687 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:26.262818  1695 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.212265  3454 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:26.180446  3347 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:26.191854  3284 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.264963  3284 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.214067  1587 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:26.266882  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 52869.1us
I20260709 13:00:26.267966  1587 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:26.214936  1694 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:26.268688  3435 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.269181  3435 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:26.269639  3435 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.269825  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:26.270545  1694 raft_consensus.cc:2393] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:26.231968  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:26.218977  3245 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.271358  2239 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.271425  3211 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.272135  3211 raft_consensus.cc:697] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:26.273003  3211 consensus_queue.cc:237] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:26.229892  1688 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:26.253728  3241 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.276840  3241 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.224375  3240 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:26.237468  3333 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:26.269203  3469 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.381s	user 0.001s	sys 0.002s
I20260709 13:00:26.279948  3284 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:26.280665  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:26.281083  3333 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.281352  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 801) took 1265 ms. Trace:
I20260709 13:00:26.281718  1696 rpcz_store.cc:276] 0709 13:00:25.016227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.016406 (+   179us) service_pool.cc:224] Handling call
0709 13:00:25.016856 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:25.017374 (+   518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:25.017415 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:25.017976 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:00:25.494635 (+476659us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b1800426b20. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb0d1 00007fc4916e6a0f
0709 13:00:25.812234 (+317599us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:25.812277 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.812344 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:26.268729 (+456385us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:26.281155 (+ 12426us) raft_consensus.cc:1685] finished
0709 13:00:26.281175 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.281298 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":31156,"spinlock_wait_cycles":16857216,"thread_start_us":316439,"threads_started":1,"wal-append.queue_time_us":870173}
I20260709 13:00:26.283545  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:26.233366  3396 raft_consensus.cc:740] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:26.287551  3435 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.287690  3396 consensus_queue.cc:260] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.288848  3396 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:26.280678  1693 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:26.293534  1620 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:26.294539  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:26.295073  3319 tablet_bootstrap.cc:492] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:00:26.260068  3388 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.211829  3398 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:26.296089  3319 tablet_bootstrap.cc:492] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:00:26.295856  3398 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.255095  3385 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.218878  3432 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.268587  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:26.300195  2241 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 13:00:26.300673  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:26.259780  3444 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.297030  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:26.297359  1692 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:26.297053  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:26.301985  1690 raft_consensus.cc:2393] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 4: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:26.302465  1621 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:00:26.303117  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:26.304780  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:26.305163  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 107680us
I20260709 13:00:26.305294  1616 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:26.298501  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:26.308876  1696 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:26.309383  1695 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.314909  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:26.318025  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:26.318773  1619 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:26.314543  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:26.319793  1618 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:26.323712  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:26.324302  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:26.320921  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:26.325766  1696 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:26.326084  1511 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:26.329478  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:26.332955  1690 raft_consensus.cc:2393] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 4: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:26.322341  3319 ts_tablet_manager.cc:1403] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 1.223s	user 0.018s	sys 0.044s
I20260709 13:00:26.312996  3435 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.342136  1695 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:26.428254  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:26.428960  1538 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:26.430370  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:26.432407  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 94273us
I20260709 13:00:26.437620  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:26.438584  1546 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:26.441596  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:26.442624  1544 raft_consensus.cc:2368] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3.
I20260709 13:00:26.443836  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:26.445137  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 107525us
I20260709 13:00:26.331456  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:26.446468  2210 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:26.448330  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:26.450230  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:26.468278  1543 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:26.331529  3489 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.331177  3032 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.478035   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:26.481809  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:26.339481  3388 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.316285  3385 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.338973  3335 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:26.445422  3381 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:26.501314  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:26.502800  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:26.503473  1543 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:26.445544  3435 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:26.467417  3347 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:26.505786  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:26.469595  2239 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:26.477051  3489 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.559669  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:26.424521  3241 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:00:26.468046  3243 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:00:26.499810  3032 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:26.477417  3465 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:26.479547  3290 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:26.585250  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:26.487668  3427 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:26.566128  1546 raft_consensus.cc:2393] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 4: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:00:26.566123  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.563951  3489 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.583352  3146 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:26.569914  3319 raft_consensus.cc:359] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } }
I20260709 13:00:26.569407  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:26.604753  1545 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:26.563478  1547 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:26.500125  3335 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.497011  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:26.563005  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:26.591209  1693 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.565101  3388 raft_consensus.cc:697] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:26.506382  3381 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.589401  3494 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:26.590857  3427 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.612159  1540 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:26.613840  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:26.616425  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:26.562462  3435 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.564599  3347 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.597846  3412 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.625515  1540 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:26.609724  3219 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:26.630106  3219 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.633646  3219 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.626926  1693 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:26.639870  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:26.640957  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:26.642117  1693 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:26.643549  3412 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.646020  3412 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:26.601663  3146 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.651477  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:26.655467  3398 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.656215  3432 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.657621  3388 consensus_queue.cc:237] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.665815  3245 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.675340  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:26.611439  3335 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:26.589733  3032 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.592571  3465 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.615921  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:26.618489  3427 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:26.592854  3290 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.622501  3494 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.698918  3464 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:26.703959  3319 raft_consensus.cc:740] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:00:26.715992  3494 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:26.710353  3464 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.720470  3381 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:26.720877  3465 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.722043  3464 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:26.756699  1538 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 4: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:26.761018  1540 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:26.696190  1687 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:26.765460  1613 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:26.719870  3385 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.768529  3385 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.769656  3385 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:26.776616  1512 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:26.776770  3319 consensus_queue.cc:260] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:26.773592  3385 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:26.786864  3319 ts_tablet_manager.cc:1434] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.448s	user 0.003s	sys 0.007s
I20260709 13:00:26.713074  3245 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:26.782397  3500 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:26.787511  3290 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.724828  3435 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:26.795326  3363 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:26.798215  1689 consensus_meta.cc:287] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.540s	user 0.005s	sys 0.005s
I20260709 13:00:26.798735  1689 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:26.802472  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:26.807163  3356 consensus_queue.cc:1059] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:26.809232  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:26.816892  1539 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:26.762925  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:26.773604  3032 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:26.822942  3385 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:26.828897  3385 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:26.831537  1544 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:26.831108  3385 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.837661  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:26.840065  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:26.841042  3385 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.841151  1620 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
W20260709 13:00:26.846776  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.848213  1538 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:26.858922  3347 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.862859  2210 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:26.866525  3347 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:26.873839  3347 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.876224  3347 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:26.862859  3386 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.881718  3386 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:26.877868  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 118588us
I20260709 13:00:26.883487  1546 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:26.883534  3032 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:26.885720  3032 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.886214  1512 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:26.889292  3032 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:26.914171  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 51642.4us
I20260709 13:00:26.915668  3347 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:26.923136  3426 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:26.923650  3426 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.871541  3427 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.924945  3426 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:26.930860  3444 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:26.919553  3032 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:26.934880  3341 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.935429  3032 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.935730  3341 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.943534  3435 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:26.944420  3435 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:26.947948  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:26.948920  1695 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.950378  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:26.951794  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:26.952744  2244 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:26.952636  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:26.956462  2239 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:26.958185  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:26.959820  1586 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:26.961890  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:26.962435  3363 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.962625  1619 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:26.963002  3363 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:26.963591  3363 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.965498  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:26.965633  1512 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:26.974665  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:26.971355  3489 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:26.998620  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:26.999421  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:26.975703  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.002496  1691 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 2: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:27.004287  1691 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:26.988207  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:00:26.978912  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 45622.9us
I20260709 13:00:27.011727  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:27.002602  3427 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:26.978461  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:26.982797  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:27.015460  1621 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:26.987335  1545 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:27.016029  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.017107  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:27.017917  1691 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:26.981575  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.003455  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.019668  3496 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:00:26.991102  3508 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:00:27.027452  3498 consensus_queue.cc:1059] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:27.028491  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:27.028968  3432 raft_consensus.cc:3055] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:27.029368  3432 raft_consensus.cc:740] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:27.003309  3388 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.030218  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:26.976763  3363 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:27.030555  3432 consensus_queue.cc:260] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.031908  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:27.033383  3363 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:27.033597  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:27.022312  3496 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.034416  1619 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.034857  1441 catalog_manager.cc:5697] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:27.036048  3496 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:27.024780  3410 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:27.037025  3410 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.037429  1441 catalog_manager.cc:5697] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:27.041020  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:27.041764  2239 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.025386  1690 raft_consensus.cc:2368] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:26.992412  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:26.989089  3341 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:26.977998  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:27.046005  3146 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:27.046296  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:27.056998  1512 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:26.973140  3290 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:00:26.989297  3435 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:26.967461  3335 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.030665  3388 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:27.039593  3410 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:27.025871  1696 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:27.059772  3388 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:27.063339  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:27.062559  3388 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:27.060622  1512 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:27.065024  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:27.066102  1543 raft_consensus.cc:2368] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5.
I20260709 13:00:27.066584  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:27.067353  2241 raft_consensus.cc:2393] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:27.067535  3335 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:27.068305  3335 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:27.060478  3146 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:27.069772  3146 raft_consensus.cc:697] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:27.070927  2239 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:27.070986  3146 consensus_queue.cc:237] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.072996  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:26.994217  3032 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:27.023643  1695 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:27.073658  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:27.000228  3489 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:27.078202  1441 catalog_manager.cc:5697] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:27.072938  1512 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:27.088203  1621 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:27.089641  2210 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:27.092787  1620 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:27.099538  1619 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:27.099848  1586 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:27.103521  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:27.104818  1622 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:27.098757  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:27.107811  2238 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.109736  1512 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:27.118224  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:27.123507  3410 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:27.119324  3427 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:27.117194  3032 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.122612  3388 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:27.131616  1441 catalog_manager.cc:5697] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 1 to 4, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:27.146225  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 49455.6us
I20260709 13:00:27.131537  3356 consensus_queue.cc:1059] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:00:27.139675  3410 raft_consensus.cc:697] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:27.138389  3427 raft_consensus.cc:697] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:27.135386  3335 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:27.153700  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:27.151883  3418 consensus_queue.cc:1059] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:00:27.158452  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:27.159420  3418 raft_consensus.cc:3055] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:27.160092  3418 raft_consensus.cc:740] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:27.160876  3410 consensus_queue.cc:237] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:27.161365  3418 consensus_queue.cc:260] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:27.145776  3032 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.159471  3432 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.148340  3489 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:27.165867  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:27.166630  1616 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:27.166934  3427 consensus_queue.cc:237] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:27.163180  3418 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.168911  3489 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:27.171018  1441 catalog_manager.cc:5697] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 1 to 2, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:27.184687  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:27.176344  3335 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:27.179934  1587 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:27.189246  1511 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:27.184904  3489 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.194677  3435 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:27.198068  3435 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:27.198268  3032 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:27.198585  3435 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.198767  1587 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:27.199584  3347 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:27.200067  1587 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:27.205713  2238 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:27.189910  3335 raft_consensus.cc:697] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:00:27.208796  1585 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.609s (SENT) [suppressed 34 similar messages]
I20260709 13:00:27.209129  1616 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:27.212270  3032 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:27.212483  3341 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:27.212944  3032 raft_consensus.cc:697] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:27.213256  3341 raft_consensus.cc:697] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:27.214077  3032 consensus_queue.cc:237] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:27.200251  3347 raft_consensus.cc:697] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:27.214468  3341 consensus_queue.cc:237] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.216336  3347 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:27.190062  3426 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:27.226930  1512 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:27.233088  3249 raft_consensus.cc:3055] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:27.233611  3249 raft_consensus.cc:740] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:27.235138  2240 raft_consensus.cc:2368] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:27.234692  3249 consensus_queue.cc:260] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:27.236846  3249 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.237008  3426 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:27.241364  3513 log.cc:927] Time spent T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
I20260709 13:00:27.243124  1586 leader_election.cc:400] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:27.246928  1586 leader_election.cc:403] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:00:27.247797  3496 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:27.250216  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:27.251211  2238 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
W20260709 13:00:27.252323  3512 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:00:27.252585  1512 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:27.253432  3363 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:27.254009  3386 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:27.254034  3363 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.254901  3386 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:27.255645  3386 raft_consensus.cc:697] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:27.255116  1441 catalog_manager.cc:5697] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 1 to 2, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:27.256703  3363 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:27.256908  3386 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:27.258286  1512 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:27.259673  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:27.256942  1441 catalog_manager.cc:5697] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 2 to 3, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:00:27.267155  3514 log.cc:927] Time spent T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.108s	user 0.000s	sys 0.002s
I20260709 13:00:27.267845  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:27.268972  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:27.230463  3511 log.cc:927] Time spent T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:00:27.271631  3504 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.272023  1512 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:27.273407  1512 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:27.273540  3388 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:27.273350  3504 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:27.274317  3504 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:27.274890  3444 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:27.274838  3504 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.275527  3444 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:27.295424  3444 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.270500  1441 catalog_manager.cc:5697] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 1 to 2, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:27.298277  1441 catalog_manager.cc:5697] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 4 to 5, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:27.310109  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.298218  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:27.317809  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:27.326967  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 116902us
I20260709 13:00:27.313570  3496 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:27.209129  3335 consensus_queue.cc:237] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:27.332551  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 101023us
I20260709 13:00:27.339229  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:27.325217  3435 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:27.343708  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 45617.8us
I20260709 13:00:27.346052  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:27.333170  3146 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:27.351445  1512 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:27.367311  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:27.368290  1542 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.369421  3391 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.369812  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.373730  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:27.371085  3032 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:00:27.381357  3504 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:27.383054  3504 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:27.370741  3496 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:00:27.358359  3240 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:27.395722  1587 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:27.400041  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:27.409554  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:27.416498  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:27.404280  1660 leader_election.cc:400] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:27.438309  1660 leader_election.cc:403] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:27.407929  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.408389  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.440421  1543 raft_consensus.cc:2368] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:27.441516  1541 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.439818  1616 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:27.440488  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:27.440851  1545 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:27.443189  3240 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:27.409475  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:27.363096  3435 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:27.447384  1547 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:27.371008  3386 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:27.450193  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.451143  1546 raft_consensus.cc:2393] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 4: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:00:27.451979  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 79972.5us
I20260709 13:00:27.395800  3388 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:27.454108  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:27.454860  1587 leader_election.cc:400] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:27.455289  1587 leader_election.cc:403] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:00:27.457019  3032 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.444996  3240 raft_consensus.cc:697] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:27.457690  3032 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.458664  3240 consensus_queue.cc:237] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.400413  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:27.464149  1618 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:27.447532  3432 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.373214  3444 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.470134  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.471318  1543 raft_consensus.cc:2368] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:27.472442  3278 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:27.477319  3032 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:27.477190  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1365c85d063446a6a6a589798b355741"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:00:27.471076  3290 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:27.472455  3435 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.488909  3435 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:27.490262  3489 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.491294  1615 raft_consensus.cc:606] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:27.491922  3435 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:27.492527  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.493487  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:27.494402  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:27.495589  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:27.496001  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.498275  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.514233  1545 raft_consensus.cc:2368] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:27.499397  3444 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:27.500756  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 96804.6us
I20260709 13:00:27.501699  1692 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:27.503288  2210 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:27.503921  1541 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:27.504769  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.473766  1587 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:27.519461  1543 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:27.507576  1542 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
W20260709 13:00:27.520135  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 51821.4us
I20260709 13:00:27.520677  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.520931  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.522086  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.522439  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.519728  3341 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:27.523276  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.523537  3341 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.523643  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.524062  3341 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.524402  1695 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:27.525696  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.521466  1543 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:27.525806  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.512889  1615 raft_consensus.cc:614] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:27.528347  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.529699  1543 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:27.530396  3489 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:27.531169  1543 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:27.531607  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.531694  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.529632  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:27.524362  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.526407  2246 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 1 LEARNER]: Advancing to term 3
I20260709 13:00:27.472074  3388 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:00:27.533665  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.534425  1542 raft_consensus.cc:2410] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:27.535597  1541 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:27.538797  2243 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
I20260709 13:00:27.538839  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.539800  1539 raft_consensus.cc:2393] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 4: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:27.543089  1660 leader_election.cc:400] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3.
I20260709 13:00:27.543627  1660 leader_election.cc:403] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:27.543696  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.544692  1545 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:27.549006  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:27.549031  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:27.549810  1622 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:27.550020  1613 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.553248  2209 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:27.554730  2209 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:27.556773  3249 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:27.557204  3249 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:27.557258  3356 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:27.557695  3249 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.557921  3356 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:27.558499  3356 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.559538  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:27.560240  1616 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:27.561549  3435 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:27.562476  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.562295  3435 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.566804  3435 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:27.567585  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.568197  1694 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:27.569231  2246 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 3 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:27.534137  3427 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:27.570354  3427 raft_consensus.cc:697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:27.571334  3427 consensus_queue.cc:237] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:27.572926  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:27.578667  1616 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:27.580744  3426 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:27.581862  3426 raft_consensus.cc:3055] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:27.582230  3426 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:27.583154  3426 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:27.584739  3426 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.583861  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.556787  2209 leader_election.cc:400] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3.
I20260709 13:00:27.579066  1613 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:27.585959  2209 leader_election.cc:403] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:27.585134  1660 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:27.591742  1692 raft_consensus.cc:2410] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:27.583379  3388 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.592505  3388 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.592931  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.594038  3356 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:27.597249  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:27.600731  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 44088.5us
I20260709 13:00:27.603979  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:27.604815  1613 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:27.607043  1694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:27.607741  1694 raft_consensus.cc:606] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:27.608129  1694 raft_consensus.cc:614] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:27.600258  3347 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:27.610944  1511 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:27.611871  3444 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:27.612339  3444 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.608297  3435 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:00:27.612862  3444 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:27.609616  3418 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3.
I20260709 13:00:27.618610  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.617293  3347 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:27.610800  3388 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:27.634891  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 49886.5us
I20260709 13:00:27.636444  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:27.637329  1620 raft_consensus.cc:2368] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5.
I20260709 13:00:27.637624  1660 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:27.639132  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:27.624385  3347 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.646270  3533 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:27.660720  1620 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:27.665326  3356 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:27.664479  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 46223us
I20260709 13:00:27.666869  1659 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:27.674805  1695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7803266de9984fac88726b08bee73921"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:27.666177  3532 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:27.675534  1695 raft_consensus.cc:606] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:27.675920  1695 raft_consensus.cc:614] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:27.675999  3532 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.682232  3532 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:27.682855  3532 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.685499  3532 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:27.686693  1695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:27.686507  3341 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.687345  1695 raft_consensus.cc:606] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:27.690660  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:27.692521  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.693581  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.694684  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.708761  1659 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:27.709587  3536 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.711784  3536 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:27.712208  3536 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.712630  3536 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.714531  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:27.714780  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 75765.4us
I20260709 13:00:27.715560  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.712203  3249 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:27.717233  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.718832  3249 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:27.719421  1695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:27.728137  1618 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:27.728367  1695 raft_consensus.cc:606] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:27.728735  1695 raft_consensus.cc:614] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:27.719869  3278 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3.
I20260709 13:00:27.721058  1620 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:27.721463  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:27.722685  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:27.722898  2209 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:27.721446  1622 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:27.722214  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:27.739981  1613 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:27.721969  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:27.743726  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.747864  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:27.748842  1688 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:00:27.749871  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 75359.2us
I20260709 13:00:27.751088  3414 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:27.752640  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:27.753080  3341 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:27.753539  1614 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:27.753885  3426 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:27.754422  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:27.703440  3533 raft_consensus.cc:697] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:27.757285  3533 consensus_queue.cc:237] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.768445  2209 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:27.770402  3426 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.761873  1587 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:27.788570  2243 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:27.758719  1615 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:27.836452  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:27.837445  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 53908.8us
W20260709 13:00:27.840793  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 118767us
I20260709 13:00:27.836252  3032 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 13:00:27.844465  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.842782  1587 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:27.842065  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:27.850276  1694 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:27.856510  1691 raft_consensus.cc:3055] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:27.856716  2243 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:27.851346  1587 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:27.856982  1691 raft_consensus.cc:740] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:27.838990  2238 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:27.782724  3388 consensus_queue.cc:1059] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:00:27.865500  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:27.860486   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:27.871197  1690 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:27.848341  3341 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:27.872720  2243 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:27.858999  3290 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:27.874720  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:27.864081  3410 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.867161  3531 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:27.902390  1660 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:27.901026   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:27.871431  3532 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.897392  3290 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.876245  3341 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.918134  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:27.919389  3541 consensus_queue.cc:1059] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:27.924517  3341 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.870301  3335 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:00:27.927987  1691 consensus_queue.cc:260] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:27.929337  1691 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:27.972311  3538 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:00:27.930873  3532 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:27.973699  3542 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:00:27.973838  1688 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:27.974697  3532 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:27.974460  3536 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:27.975471  3410 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:27.976410  1615 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:27.977794  2243 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:27.978734  1696 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:27.915746  3290 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.992455  1691 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:00:27.995293  3537 log.cc:927] Time spent T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.256s	user 0.005s	sys 0.000s
I20260709 13:00:28.001134  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:28.001438  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:27.930356  3432 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:28.002377  1542 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:28.002926  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 140673us
I20260709 13:00:28.006181  1544 raft_consensus.cc:1240] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:28.008684  1694 raft_consensus.cc:2368] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4.
I20260709 13:00:28.009814  1538 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:28.010170  3536 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:28.011390  3243 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:28.011925  3243 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:28.013902  3243 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:28.014374  3243 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:28.016167  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:28.016984  1688 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:28.019884  3347 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:28.023610  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:28.027187  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:28.028025  1539 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:28.028520  1542 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:28.014791  3243 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:28.033171  3388 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.033756  3388 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:28.036031  3388 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:28.038777  3541 consensus_queue.cc:1243] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:28.039583  3278 raft_consensus.cc:3055] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:28.040000  3278 raft_consensus.cc:740] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:28.040422  3531 raft_consensus.cc:697] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:28.040958  3278 consensus_queue.cc:260] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:28.041828  3531 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:28.042672  3278 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:28.054215  1541 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:28.075345  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:28.003371  3146 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:28.110412  1690 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:00:28.111049  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 208610us
I20260709 13:00:27.993283  3444 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:28.115908  1693 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:28.180261  1557 tablet_copy_service.cc:342] P d7158d6c3b634dc7abb69eac58eba291: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-5814bf31e900408885160ea0f89d6189 received from {username='slave'} at 127.0.0.1:42858
I20260709 13:00:28.179924  3146 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:28.047819  3341 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:28.068491  1688 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:28.076265  3432 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:28.190909  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:28.251979  1539 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
W20260709 13:00:28.247941  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 346903us
W20260709 13:00:28.244432  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 174199us
W20260709 13:00:28.268083  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 191646us
I20260709 13:00:28.240471  3426 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:28.287673  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.287792  1512 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:28.254514  1557 tablet_copy_service.cc:434] P d7158d6c3b634dc7abb69eac58eba291: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-5814bf31e900408885160ea0f89d6189 on tablet 5814bf31e900408885160ea0f89d6189 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:28.248678  3496 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:00:28.276190  3534 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:28.295871  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:28.296175  3432 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:28.296337  3146 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:28.298542  2244 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:28.303557  1585 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:28.305233  1690 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:28.310304  1512 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:28.301400  3534 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.290069  3335 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:00:28.314932  1512 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:28.316517  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:28.321688  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.282348  3556 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:00:28.311223  3559 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:28.312587  3534 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:28.325531  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 126146us
I20260709 13:00:28.317142  3146 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:28.331691  3544 log.cc:927] Time spent T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:00:28.318281  3550 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:28.361084  1660 leader_election.cc:400] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5.
I20260709 13:00:28.361443  1660 leader_election.cc:403] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:00:28.364388  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 74593.2us
I20260709 13:00:28.335479  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:28.317343  3290 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:28.364513  3444 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:28.381073  1585 leader_election.cc:400] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:28.381569  1585 leader_election.cc:403] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:00:28.382929  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 68055us
I20260709 13:00:28.384034  1512 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:28.359942  3541 consensus_queue.cc:1059] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 13:00:28.392514  3554 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:00:28.387578  3432 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:28.399062  3444 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:28.374374  3341 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:28.391367  3561 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:28.391625  1512 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:28.407429  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:28.391094  3564 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:28.428771  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 60161.2us
W20260709 13:00:28.431730  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 54908.2us
I20260709 13:00:28.435146  1512 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:28.435971  1585 leader_election.cc:400] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:28.442952  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:28.445369  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:28.434926  3504 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:28.450519  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:28.452211  1585 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:28.454461  1585 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:28.436781  3444 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:28.458345  3571 consensus_queue.cc:1059] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:28.460175  3278 raft_consensus.cc:3055] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:28.460702  3278 raft_consensus.cc:740] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:28.462003  3278 consensus_queue.cc:260] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:28.479801  1585 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:28.437085  3536 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5.
W20260709 13:00:28.499197  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 96065.5us
W20260709 13:00:28.494273  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 59181.4us
I20260709 13:00:28.494271  3432 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:28.501225  1512 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:28.492059  3435 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:28.456914  3341 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:28.503502  1585 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:28.470700  3391 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:00:28.457598  3550 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:28.504981  3341 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:28.506067  3570 consensus_queue.cc:1059] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:00:28.506975  3410 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:28.045717  3532 consensus_queue.cc:1175] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" responder_term: 5 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:00:28.508468  3548 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.221s	user 0.002s	sys 0.000s
I20260709 13:00:28.510349  3536 consensus_queue.cc:1059] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:28.511646  1659 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:28.511873  3290 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:28.512974  3243 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:28.515026  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:28.543715  1688 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:28.545562  3534 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:28.515848  1585 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:28.547851  1659 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:28.549587  1659 leader_election.cc:400] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5.
I20260709 13:00:28.549803  1585 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:28.527331  1587 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:28.528803  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 69034.2us
I20260709 13:00:28.556456  1616 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:28.529403  1512 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:28.559016  1512 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:28.490684  3541 raft_consensus.cc:3055] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:28.529929  3032 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:00:28.450477  3561 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:28.504549  3504 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:28.575373  3504 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:28.576499  3561 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:28.576586  3504 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:28.579066  1660 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:28.573971  3534 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:28.582732  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 55492.3us
I20260709 13:00:28.556409  3278 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:28.585579  3496 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:28.587116  3556 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:28.588819  3556 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:28.589481  3556 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:28.584299  3391 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:28.532186  3341 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:28.590587  3550 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:28.589948  3556 raft_consensus.cc:697] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:00:28.581641  3567 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:00:28.604087  3470 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:00:28.604470  1585 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:28.569972  3541 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:28.613214  3541 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:28.570307  3432 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:28.614486  3556 consensus_queue.cc:237] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:28.591843  3386 raft_consensus.cc:3055] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:28.619530  3386 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:28.620790  1696 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:28.622725  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 844) took 1062 ms. Trace:
I20260709 13:00:28.623133  1687 rpcz_store.cc:276] 0709 13:00:27.560498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.560621 (+   123us) service_pool.cc:224] Handling call
0709 13:00:27.561126 (+   505us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:27.605517 (+ 44391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.605919 (+   402us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:27.836587 (+230668us) log.cc:844] Serialized 532 byte log entry
0709 13:00:28.008411 (+171824us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:28.008470 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.008562 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.507525 (+498963us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:28.622414 (+114889us) raft_consensus.cc:1685] finished
0709 13:00:28.622440 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.622643 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23416,"raft.queue_time_us":68840,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":21229,"spinlock_wait_cycles":5559168,"thread_start_us":182164,"threads_started":2,"wal-append.queue_time_us":416004}
I20260709 13:00:28.626027  3573 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:28.620457  3386 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:28.626997  1585 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:28.637705  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:00:28.629247  3533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.000s	sys 0.021s
I20260709 13:00:28.660755  3550 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:28.628647  3534 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:28.631821  3146 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.664448  3386 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:28.670042  1585 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:00:28.668354  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 94287.3us
W20260709 13:00:28.672787  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 93797.8us
W20260709 13:00:28.668144  3533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.000s	sys 0.021s
I20260709 13:00:28.664803  3573 raft_consensus.cc:697] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:28.669037  3243 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.667852  3570 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:28.726181  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 52498.3us
I20260709 13:00:28.674129  3574 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:00:28.685729  1512 leader_election.cc:400] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4.
I20260709 13:00:28.730114  1512 leader_election.cc:403] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:00:28.734005  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 48451.6us
I20260709 13:00:28.690111  3496 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:28.715003  3032 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:28.682076  3146 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:28.737282  3391 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:28.717711  3243 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:28.744415  3240 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:28.744632  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:28.750600  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:28.690377  3559 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
W20260709 13:00:28.745368  3552 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.002s	sys 0.012s
W20260709 13:00:28.746848  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.785104  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:28.774158  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.750886  1538 raft_consensus.cc:2376] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4. Re-sending same reply.
I20260709 13:00:28.788350  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:28.785259  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:00:28.749718  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 79795.4us
I20260709 13:00:28.789069  1539 raft_consensus.cc:2368] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
W20260709 13:00:28.790230  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.793129  1694 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:28.793588  1693 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:28.787683  3552 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.002s	sys 0.012s
I20260709 13:00:28.801107  2209 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:28.803081  1545 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:28.783815  3240 consensus_queue.cc:1243] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer 822e08445eae4a33b2f2fe92060192c6 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:28.812281  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:28.802346  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:28.811659  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:28.855576  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:28.856029  1540 raft_consensus.cc:2368] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:28.855882  1694 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:28.856571  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:28.856727  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:28.857123  1622 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:28.834729  1542 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:28.857369  1693 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:28.859200  1616 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:28.861215  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:28.835439  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:28.786824  3534 raft_consensus.cc:697] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:28.871893  3464 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:28.872545  3464 raft_consensus.cc:697] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:28.873835  1615 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:28.874569  3581 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.875108  3581 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:28.858418  3290 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:28.800781  3444 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.871937  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.877826  3560 raft_consensus.cc:2955] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:28.873515  3464 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:28.879570  3290 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:28.887284  1694 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:28.891435  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:28.898355  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:28.801164  1688 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:28.902258  1613 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:28.898986  1616 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:28.905085  1619 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:28.812657  3414 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:00:28.802713  3426 consensus_queue.cc:1059] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:00:28.885351  3410 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.947660  1696 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:28.912113  1585 leader_election.cc:400] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:28.944224  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:28.949980  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:28.897564  3559 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:28.902624  3574 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:00:28.958797  3584 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:00:28.953737  3410 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:28.960001  3576 log.cc:927] Time spent T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:00:28.959797  3534 consensus_queue.cc:237] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:28.961581  3410 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:28.961810  3391 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4.
W20260709 13:00:28.961973  3578 log.cc:927] Time spent T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:00:28.896518  3444 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:28.972472  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 60486.4us
I20260709 13:00:28.974674  2241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 471) took 1105 ms. Trace:
I20260709 13:00:28.984550  3146 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:28.979002  2241 rpcz_store.cc:276] 0709 13:00:27.869574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.869744 (+   170us) service_pool.cc:224] Handling call
0709 13:00:27.879683 (+  9939us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:27.908865 (+ 29182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.908896 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:28.527423 (+618527us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b2c00012be8. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc490024a11 00007fc490034372 00007fc491766a01 00007fc49172b43a 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2
0709 13:00:28.527928 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:00:28.724136 (+196208us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:28.724178 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.724250 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.963518 (+239268us) raft_consensus.cc:1685] finished
0709 13:00:28.963539 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.974566 (+ 11027us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30670,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":64893,"spinlock_wait_cycles":6751360,"thread_start_us":195793,"threads_started":1,"wal-append.queue_time_us":325860}
I20260709 13:00:28.963816  3559 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.006534   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:28.835565  3573 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:29.017865  1613 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:29.003194  3391 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:28.996692  3574 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.037472  3574 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:29.040910  3290 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:29.045642  3391 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:29.048023  3391 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:29.048084  3588 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:29.048761  3588 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.051858  3587 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:00:29.052744  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:29.052767  1660 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:29.053571  1546 raft_consensus.cc:2376] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3. Re-sending same reply.
I20260709 13:00:29.053668  3570 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:29.054412  3587 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:29.054342  3570 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.054430  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:29.056824  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:29.058167  1660 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:29.058974  3243 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:29.058976  3598 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.059896  3598 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:29.073299  3547 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 1.055s	user 0.001s	sys 0.001s
I20260709 13:00:29.074471  3598 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:29.060868  3536 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:29.061223  3418 raft_consensus.cc:3055] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:29.076292  3418 raft_consensus.cc:740] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:29.077353  3418 consensus_queue.cc:260] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.078912  3418 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:29.068321  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:29.070236  1693 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
W20260709 13:00:29.063270  1585 leader_election.cc:336] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.501s (SENT)
I20260709 13:00:29.062973  3341 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:29.062101  3591 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:29.125047  3591 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:29.125577  3591 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:29.090245  1547 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:29.059212  1660 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:29.091102  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:29.122790  3341 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:29.123471  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:29.124547  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:29.129900  1622 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 4: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:29.131735  2246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 468) took 1354 ms. Trace:
I20260709 13:00:29.136077  1616 raft_consensus.cc:2393] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:29.132226  2246 rpcz_store.cc:276] 0709 13:00:27.777874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.778008 (+   134us) service_pool.cc:224] Handling call
0709 13:00:27.788224 (+ 10216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:27.788606 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:00:27.788639 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:27.789108 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:00:27.909771 (+120663us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:27.909834 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.909941 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:29.072559 (+1162618us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:29.082779 (+ 10220us) raft_consensus.cc:1685] finished
0709 13:00:29.082822 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.131661 (+ 48839us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":885,"raft.run_cpu_time_us":5797,"raft.run_wall_time_us":55758,"spinlock_wait_cycles":61556096,"thread_start_us":113327,"threads_started":1,"wal-append.queue_time_us":162843}
W20260709 13:00:29.138770  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 75564.1us
I20260709 13:00:29.030566  3599 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:29.142589  1585 leader_election.cc:336] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.609s (SENT)
I20260709 13:00:29.068113  3570 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:29.091218  3556 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.142941  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:00:29.178668  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.141849  3588 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:29.184901  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:29.180383  1691 raft_consensus.cc:2955] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
W20260709 13:00:29.185739  1585 leader_election.cc:336] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.636s (SENT)
I20260709 13:00:29.142966  3290 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:29.184567  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 125397us
I20260709 13:00:29.190637  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:29.171936  3587 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:29.191357  1695 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:29.196043  1511 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:29.200016  1660 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:29.149005  3599 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:29.183346  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:29.231930  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:29.205958  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:29.199692  3603 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:29.187532  3556 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.231868  1587 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:29.208500  3598 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:29.230669  3588 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:29.237365  3590 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:29.257861  3533 raft_consensus.cc:3055] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:29.260843  3470 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.262717  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:29.239136  3444 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:29.278304  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 70762.5us
I20260709 13:00:29.267681  3541 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:29.280797  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 74909us
I20260709 13:00:29.243911  3598 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.292011  3598 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:29.294468  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:29.295622  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:29.295673  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:29.295992  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:29.296378  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:29.296732  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:29.297011  1693 raft_consensus.cc:2368] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3.
I20260709 13:00:29.297395  1696 raft_consensus.cc:2368] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3.
I20260709 13:00:29.297538  3347 consensus_queue.cc:1059] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:29.280405  3533 raft_consensus.cc:740] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:29.301604  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:29.282104  3489 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:29.301656  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:29.273705  3559 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:29.274430  3607 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:29.314203  3599 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:29.318037  2244 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:29.318302  2241 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:29.320067  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:29.320631  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:29.331898  2211 leader_election.cc:400] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3.
W20260709 13:00:29.316622  3540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.009s	sys 0.025s
I20260709 13:00:29.244443  3603 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.365273  2211 leader_election.cc:400] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3.
W20260709 13:00:29.369432  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.329658  3414 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:29.329900  3290 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:29.283133  3470 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.287375  3590 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:29.374800  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 124632us
W20260709 13:00:29.366829  3540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.085s	user 0.009s	sys 0.026s
I20260709 13:00:29.375380  1538 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:29.366206  3347 raft_consensus.cc:3055] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:29.377207  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:00:29.375705  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 83755.4us
I20260709 13:00:29.380625  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:29.389552  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:29.381723  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:29.377995  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:29.377315  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:29.392287  1538 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:29.373198  3341 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.372994  3489 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:29.402124  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:29.403028  1539 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:29.378489  3290 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.395052  3595 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:29.418192  3556 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:29.396665  1538 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:29.373857  3444 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:29.413609  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 48554.7us
I20260709 13:00:29.422015  2211 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:29.372709  3588 consensus_queue.cc:1059] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:00:29.385927  3386 consensus_meta.cc:287] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.000s
I20260709 13:00:29.400424  1614 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:29.401126  2246 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:29.393239  1546 raft_consensus.cc:2393] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:29.388460  3347 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:29.404536  3568 raft_consensus.cc:3055] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:29.405593  3619 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:29.411021  3570 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:00:29.415745  3609 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:00:29.419526  3290 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:29.428782  3590 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:29.429716  3606 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:00:29.383149  3599 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:00:29.412498  3522 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:00:29.420228  3489 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:29.433470  3432 consensus_meta.cc:287] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.819s	user 0.011s	sys 0.000s
I20260709 13:00:29.434343  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:29.504235  1618 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:29.387939  3533 consensus_queue.cc:260] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.412078  3341 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.397944  1511 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:29.508983  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 111129us
I20260709 13:00:29.512688  3569 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:29.513547  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:29.433533  3598 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:29.514123  3561 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:29.515461  1547 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:29.515800  3598 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:29.446745  3575 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.729s	user 0.000s	sys 0.004s
I20260709 13:00:29.516281  1688 pending_rounds.cc:85] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 2
I20260709 13:00:29.516588  1688 pending_rounds.cc:107] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:00:29.449394  3581 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:29.516876  1688 raft_consensus.cc:2889] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:29.517567  2239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 450) took 1009 ms. Trace:
I20260709 13:00:29.517941  2239 rpcz_store.cc:276] 0709 13:00:28.507895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.508047 (+   152us) service_pool.cc:224] Handling call
0709 13:00:28.508427 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.508846 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.508878 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:28.509366 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:00:28.624118 (+114752us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:28.624162 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.624237 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:29.446016 (+821779us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:29.517255 (+ 71239us) raft_consensus.cc:1685] finished
0709 13:00:29.517278 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.517511 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":13944704,"thread_start_us":114355,"threads_started":1,"wal-append.queue_time_us":158911}
I20260709 13:00:29.455560  1542 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:29.519922  2241 raft_consensus.cc:1240] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:29.520097  3612 log.cc:927] Time spent T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:00:29.520315  3564 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.520880  3341 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:29.462061  3588 consensus_queue.cc:1243] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer e8a64798e5f94de8909707bcbd11804a log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:29.520820  3564 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:29.462204  3603 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:29.467445  3613 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.176s	user 0.000s	sys 0.003s
I20260709 13:00:29.523514  3561 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:29.524534  3561 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:29.468420  1544 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:29.469167  3503 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:29.527396  3607 consensus_queue.cc:1059] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:00:29.527969  3503 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.528501  2210 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:29.529201  3573 consensus_queue.cc:1059] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:29.530120  3503 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:29.530252  3573 raft_consensus.cc:3055] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:29.530614  3573 raft_consensus.cc:740] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:29.469599  3418 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:29.459563  3444 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.471163  1541 raft_consensus.cc:2410] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:29.473783  1539 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:29.474869  1690 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:00:29.523000  3564 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:29.428680  3470 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:29.509042  3432 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:29.491175  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:29.491873  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:29.493788  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 71876.4us
I20260709 13:00:29.493924  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:29.494815  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:29.500576  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 268775us
I20260709 13:00:29.489888  3570 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.500888  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:29.476516  3568 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:00:29.425776  3032 consensus_meta.cc:287] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.001s
I20260709 13:00:29.495361  3386 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:29.536360  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:29.485549  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 156225us
I20260709 13:00:29.545740  1659 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:29.561475  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:29.562726  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:29.563777  3553 consensus_queue.cc:1059] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:29.564543  3553 consensus_queue.cc:1243] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:00:29.565312  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:29.565783  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:29.566761  3582 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:29.567628  3563 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:29.568034  3563 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.568372  3563 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:29.567384  2239 raft_consensus.cc:2955] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 3 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:29.541322  3569 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.568849  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:29.559525  1690 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:29.555476  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:29.555586  1542 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:29.572862  1540 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 4: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:29.496069  3619 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.580420  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:29.583539  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:29.585543  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:29.572973  3335 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:29.587204  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:29.587111  3388 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:29.589923  1512 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:29.592666  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:29.539397  3418 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.560570  3032 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:29.587145  3335 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:29.598884  1621 raft_consensus.cc:2393] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 3: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:29.542752  3540 consensus_queue.cc:1059] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:00:29.556787  3628 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.569839  3532 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:29.631580  1512 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:29.585232  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:29.593461  1618 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:29.640749  1613 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:29.639417  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:29.551896  3607 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:00:29.662483  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:29.634157  3560 consensus_meta.cc:287] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.000s
I20260709 13:00:29.663484  3388 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:29.673210  1659 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:29.675694   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:29.676529  1659 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:29.573174  3386 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:29.674240  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.640949  3335 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:29.547715  3347 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.582609  3569 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.711715  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:29.716871  1512 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:29.650990  3564 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:29.715464  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 165510us
I20260709 13:00:29.664645  3628 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:29.559422  3573 consensus_queue.cc:260] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:29.676402  3591 consensus_meta.cc:287] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.005s
I20260709 13:00:29.741653  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:29.745699  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:29.747151  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:29.702178  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:29.753755  1621 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:29.742496  1617 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:29.748795  1545 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:29.751009  1616 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:29.747871  1619 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:29.718178  3444 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:29.641175  3568 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:29.683671  3522 consensus_queue.cc:1059] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:00:29.675714  3599 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:00:29.778193  1618 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:29.714457  3601 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:29.730186  3564 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:29.782969  1617 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:00:29.797288  1622 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:29.725383  3540 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:29.772418  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:29.792085  3629 log.cc:927] Time spent T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:00:29.792495  3249 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:29.792689  3569 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:29.747421  3335 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:29.793365  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:29.796329  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:29.799700  1614 raft_consensus.cc:2410] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:29.805320  1616 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:29.752198  3347 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:29.814038  1618 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
W20260709 13:00:29.807209  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.807686  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:00:29.747314  3603 consensus_queue.cc:1175] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "822e08445eae4a33b2f2fe92060192c6" responder_term: 3 status { last_received { term: 1 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: [2.4-2.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:29.815369  2210 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:29.819267  1622 raft_consensus.cc:1275] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:00:29.819905  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 143431us
W20260709 13:00:29.810671  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 83016.6us
I20260709 13:00:29.824728  3642 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.825389  3642 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:29.804203  3444 raft_consensus.cc:3055] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:29.804351  3564 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:29.829210  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:29.823454  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:29.830130  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:29.748495  3591 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.828069  3642 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:29.815892  3335 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.838442  1585 leader_election.cc:400] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:29.840221  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:29.840714  3614 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:29.841008  3633 log.cc:927] Time spent T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:00:29.840776  3601 consensus_queue.cc:1059] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:29.842298  3587 raft_consensus.cc:3055] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:29.846230  3563 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.813268  3540 raft_consensus.cc:697] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:29.822443  3568 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:29.855067  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:29.850404  1585 leader_election.cc:403] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:29.830910  3414 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:29.852041  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:29.852645  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.833542  3570 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:29.832779  3444 raft_consensus.cc:740] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:29.865061  2240 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:29.870199  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:29.873979  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:29.850236  3335 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:29.850175  3636 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:00:29.865906  3541 consensus_meta.cc:287] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.000s
I20260709 13:00:29.851879  3587 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:29.856138  3642 consensus_queue.cc:1059] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:00:29.878677  3617 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:29.890813  3563 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:29.861371  3414 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:29.894059  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 55729.3us
I20260709 13:00:29.895102  1585 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:29.896705  1585 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:29.899637  1695 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:29.878264  1689 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:29.878476  3570 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:29.905720  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:29.899998  3590 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:29.908672  3590 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:29.909092  3590 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:29.909317  3540 consensus_queue.cc:237] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:29.912632  1613 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:29.913914  1585 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:29.918058  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:29.921663  3555 raft_consensus.cc:993] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:29.921955  3619 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:29.922463  3146 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:29.923341  3146 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:29.924834  3522 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.925343  3522 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:29.923520  3432 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:29.898876  3414 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:29.921522  3386 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:29.928711  1585 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:29.929911  3628 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:29.930819  3522 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:29.949103  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:29.912827  3617 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:29.950556  1585 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:29.926234  3146 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:29.928153  3550 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:29.962869  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.868899  3614 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:29.935995  3541 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:29.971769  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:29.928308  3570 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:29.980505  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:29.985365  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:29.964763  3628 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:29.988873  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:29.993789  1694 raft_consensus.cc:2393] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 4: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:29.947185  3607 consensus_queue.cc:1059] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:00:29.989163  1585 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:29.916661  3444 consensus_queue.cc:260] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:29.976989  3534 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:30.001138  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:30.001368  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:30.007054  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:29.898522  3636 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:30.014096  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:30.015893  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:30.016749  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.017416  1511 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:30.010950  1618 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:30.020227  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:30.011648  1587 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:30.010959  1547 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:30.023170  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:30.023700  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:30.023700  1585 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:30.027271  1618 raft_consensus.cc:2393] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:29.978169  3642 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.022935  3444 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:30.028695  3592 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:30.028904  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:30.029279  1547 raft_consensus.cc:1275] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:30.029502  3410 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:29.998807  3541 raft_consensus.cc:1081] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:30.031385  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:30.035413  1511 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:30.001968  3550 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:30.047320  3647 raft_consensus.cc:3055] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:30.047875  3647 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:30.047999  3644 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:30.048594  3644 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:30.048971  3647 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:30.047484  1694 raft_consensus.cc:2410] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:30.051496  3614 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:30.052139  3614 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:30.052882  3386 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:30.056008  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:30.060415  1694 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:30.059329  1511 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:30.058918  3555 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:30.034945  3628 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:30.052667  3614 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:30.062264  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:30.064780  1511 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:29.967195  3587 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:30.037820  3522 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:30.071403  1587 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:30.068771  3386 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:30.063486  3591 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:30.068940  3628 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.042394  3642 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:30.076871  3619 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:30.083856  3581 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:00:30.097301  3619 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:30.097787  3619 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:30.100349  3570 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:30.101008  3628 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:30.101312  3614 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:30.077317  3522 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.102149  3522 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.084015  3592 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:30.102888  3592 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.095898  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:30.104525  1694 raft_consensus.cc:2393] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:30.105623  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:30.103945  3386 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:30.089229  3648 log.cc:927] Time spent T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:00:30.112639  3386 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:30.085742  3589 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:30.103384  3592 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:30.120931  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:30.093555  3335 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:30.127519  3414 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:30.129612  3414 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:30.131273  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:30.096913  3636 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:30.126935  3335 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:30.116576  3570 raft_consensus.cc:3055] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:30.090898  3590 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:30.134267  1511 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:30.149360  1511 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:30.154116  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 278569us
I20260709 13:00:30.141758  3570 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:30.143489  3581 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:30.173362  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:30.176569  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:30.182360  1660 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:30.183858  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:30.155565  3146 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:30.159062  3598 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:30.216958  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 174841us
W20260709 13:00:30.185746  3290 consensus_meta.cc:287] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.002s
I20260709 13:00:30.221127  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:30.229142  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:30.231853  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:30.232241  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:30.249217  1619 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:30.259588  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 105784us
I20260709 13:00:30.259920  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:30.260924  1511 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:30.263973  1511 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:30.265797  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.215965  3614 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:30.218300  3591 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:30.267096  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.258831  3626 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:30.225178  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:30.186029  3571 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:00:30.186189  3593 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:00:30.269347  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:30.275508  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.277088  3335 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:30.277992  1690 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:30.266944  3146 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:30.281034  3642 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:30.281472  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:30.273864  3570 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:30.282425  3540 consensus_queue.cc:1059] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:30.270268  3591 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:30.283191  3591 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:30.283471  3570 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:30.286034  3619 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:30.248179  3290 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:30.266693  3598 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:30.288465  3590 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:30.217338  3564 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:30.290395  1616 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:30.288793  3290 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:30.290096  3656 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:30.292090  1547 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:30.289170  1617 raft_consensus.cc:2368] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4.
I20260709 13:00:30.291167  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:30.302995  1618 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:30.303833  3659 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:30.293071  3564 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:30.304185  3647 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:30.288626  3598 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:30.306502  3598 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:30.310278  3533 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:30.311201  3290 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.315610  1660 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:30.292616  2239 consensus_meta.cc:287] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.000s
I20260709 13:00:30.311797  3290 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:30.334482  3290 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:30.335347  1694 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
W20260709 13:00:30.345974  3662 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.063s	user 0.002s	sys 0.000s
I20260709 13:00:30.347793  3628 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:30.350142  3628 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:30.352252  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:30.353580  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:30.354171  1689 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:30.354683  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:30.355367  1543 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:30.334889  3591 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:30.356279  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:30.357368  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:30.357649  3591 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:30.357950  1543 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:30.359921  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:30.366098  1690 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:30.360575  3347 consensus_meta.cc:287] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.540s	user 0.007s	sys 0.004s
I20260709 13:00:30.274312  3626 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:30.323118  3593 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:30.374624  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:30.377351  1542 raft_consensus.cc:2410] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 13:00:30.383464  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 108338us
I20260709 13:00:30.386373  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:30.387225  1543 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:30.390831  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:30.384557  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 921) took 1592 ms (client timeout 1777 ms). Trace:
I20260709 13:00:30.375607  3146 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:30.392030  1541 rpcz_store.cc:269] 0709 13:00:28.787552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.793904 (+  6352us) service_pool.cc:224] Handling call
0709 13:00:30.378286 (+1584382us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b5400187ed4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:30.378432 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1397294848}
I20260709 13:00:30.394608  3664 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.379343  3593 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.377964  3647 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.375816  3603 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.382562  3571 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:30.388263  3591 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:00:30.393479  3660 log.cc:927] Time spent T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.101s	user 0.002s	sys 0.001s
I20260709 13:00:30.427393  3571 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:30.428465  3489 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:30.429538  3571 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:30.430186  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:30.430907  1538 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:30.394694  1543 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:00:30.388664  3347 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:00:30.434928  1543 pending_rounds.cc:85] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 1
I20260709 13:00:30.435359  1543 pending_rounds.cc:107] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:00:30.411729  3522 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:30.413024  3647 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:30.445699  3647 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:30.414000  3619 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:30.447711  3522 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:30.416271  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:00:30.417444  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.403043  3386 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:30.419663  3591 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:30.420650  3626 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:30.420750  3581 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:30.401470  3146 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:30.424355  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:30.789526  1691 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:30.409965  3664 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:30.795053  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 1715) took 1317 ms. Trace:
I20260709 13:00:30.795570  1695 rpcz_store.cc:276] 0709 13:00:29.477578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.477732 (+   154us) service_pool.cc:224] Handling call
0709 13:00:30.794809 (+1317077us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b540027b0d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:30.794949 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":805880704}
I20260709 13:00:30.794937  3664 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:30.434218  3603 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:30.382735  3388 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:00:30.435707  1543 raft_consensus.cc:2889] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:30.404490  3593 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.805167  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 935) took 1126 ms. Trace:
I20260709 13:00:30.805723  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 929) took 1230 ms. Trace:
I20260709 13:00:30.806085  1539 rpcz_store.cc:276] 0709 13:00:29.574917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.575043 (+   126us) service_pool.cc:224] Handling call
0709 13:00:30.741556 (+1166513us) spinlock_profiling.cc:243] Waited 7.41 ms on lock 0x7b5800002d98. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:00:30.741821 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.742244 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.742275 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.742780 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.804805 (+ 62025us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:30.804842 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.804902 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.805406 (+   504us) raft_consensus.cc:1685] finished
0709 13:00:30.805423 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.805647 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6343,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":17044352,"thread_start_us":61655,"threads_started":1,"wal-append.queue_time_us":42135}
I20260709 13:00:30.807876  3644 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:30.805516  1543 rpcz_store.cc:276] 0709 13:00:29.678838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.393936 (+715098us) service_pool.cc:224] Handling call
0709 13:00:30.394323 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.804903 (+410580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.805110 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:30.809520  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:30.438694  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:30.469278  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:30.593146  2239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 482) took 1026 ms. Trace:
I20260709 13:00:31.087105  2239 rpcz_store.cc:276] 0709 13:00:29.566651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.566758 (+   107us) service_pool.cc:224] Handling call
0709 13:00:29.567046 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.567263 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:30.332294 (+765031us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.591705 (+259411us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.592777 (+  1072us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.592824 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:30.592860 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.592945 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.593095 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":126756,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":8798,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":5423,"thread_start_us":60262,"threads_started":1,"wal-append.queue_time_us":155505}
I20260709 13:00:30.647987  1659 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:31.090135  3689 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:00:31.090500  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 442533us
I20260709 13:00:31.090699  3689 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.091292  1659 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:30.651834  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.657756  2238 raft_consensus.cc:2368] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:30.722270  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 926) took 1161 ms. Trace:
I20260709 13:00:30.724017  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:30.731076  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.094308  1617 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:31.094576  1545 raft_consensus.cc:2410] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:00:30.750111  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2112) took 1040 ms. Trace:
I20260709 13:00:30.753787  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:30.757956  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:30.804221  1691 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:30.810948  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:30.813609  1539 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:30.854784  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1717) took 1375 ms. Trace:
I20260709 13:00:30.858353  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:31.095891  3532 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:31.095710  3540 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:31.097106  3532 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.097815  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.098429  1691 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:31.098863  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:31.099294  3532 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:30.895113  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:31.097021  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:31.100023  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:31.100250  1539 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.101092  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:31.101572  1617 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:30.881805  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:31.102702  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:00:30.896822  1689 consensus_meta.cc:287] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.542s	user 0.013s	sys 0.000s
I20260709 13:00:31.103220  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:31.103475  1689 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:31.103981  1619 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 3: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:31.103921  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:31.104400  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.104890  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:30.932145  2211 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:30.937006  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.117386  1617 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
W20260709 13:00:30.945698  1540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.016s	sys 0.027s
W20260709 13:00:31.118711  1540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.017s	sys 0.027s
I20260709 13:00:30.941701  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 209) took 1263 ms. Trace:
I20260709 13:00:30.963388  3681 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:00:30.954303  1618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.007s	sys 0.009s
I20260709 13:00:31.119626  1547 rpcz_store.cc:276] 0709 13:00:29.678345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.078703 (+400358us) service_pool.cc:224] Handling call
0709 13:00:30.078986 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.300196 (+221210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.941421 (+641225us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54001284d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:30.941624 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489628928}
I20260709 13:00:31.119834  3681 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.121236  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.122423  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:30.972124  1538 consensus_meta.cc:287] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.002s
I20260709 13:00:30.958101  3432 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:30.951556  3534 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:30.769829  3335 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:30.930048  3581 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:31.158303  3581 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.158774  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 928) took 1586 ms. Trace:
I20260709 13:00:31.160573  3581 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:30.906775  3588 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:30.957881  3589 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:30.489923  3591 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:30.813884  3593 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.168013  3593 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:30.803717  3603 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:30.905333  3607 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:30.875454  3620 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:30.881501  3624 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:30.646133  3626 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:30.690806  3628 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:31.175669  3626 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.176379  3628 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.177615  3626 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:31.178534  3628 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:30.833321  3631 log.cc:927] Time spent T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 1.038s	user 0.000s	sys 0.003s
W20260709 13:00:30.609750  3634 log.cc:927] Time spent T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.769s	user 0.000s	sys 0.003s
I20260709 13:00:31.183260  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1714) took 1706 ms. Trace:
I20260709 13:00:31.183880  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 865) took 2557 ms. Trace:
I20260709 13:00:31.183699  1688 rpcz_store.cc:276] 0709 13:00:29.477208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.478420 (+  1212us) service_pool.cc:224] Handling call
0709 13:00:29.508711 (+ 30291us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:29.517585 (+  8874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.517621 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:29.518198 (+   577us) log.cc:844] Serialized 52 byte log entry
0709 13:00:29.586680 (+ 68482us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:29.722164 (+135484us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.887120 (+164956us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.936922 (+ 49802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.950548 (+ 13626us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.352223 (+401675us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b18004279c0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e522 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:00:30.609071 (+256848us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:31.182980 (+573909us) raft_consensus.cc:1685] finished
0709 13:00:31.183003 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.183172 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29142,"prepare.queue_time_us":594713,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":70,"raft.queue_time_us":186756,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":16692,"spinlock_wait_cycles":74007680,"thread_start_us":153142,"threads_started":2,"wal-append.queue_time_us":319189}
I20260709 13:00:31.184543  1687 rpcz_store.cc:276] 0709 13:00:28.626308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.635348 (+  9040us) service_pool.cc:224] Handling call
0709 13:00:28.688585 (+ 53237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.751695 (+ 63110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.788815 (+ 37120us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:29.368212 (+579397us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b1800427180. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e60c2a6 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc490024a11 00007fc490034372 00007fc491766a01 00007fc49172b43a
0709 13:00:29.437759 (+ 69547us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b2c00151d48. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc490024a11 00007fc490034372 00007fc491766a01 00007fc49172b43a 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2
0709 13:00:29.438314 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:00:29.543055 (+104741us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:29.553297 (+ 10242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.559938 (+  6641us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.832630 (+1272692us) spinlock_profiling.cc:243] Waited 58.1 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:31.183628 (+350998us) raft_consensus.cc:1685] finished
0709 13:00:31.183656 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.183799 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47779,"raft.queue_time_us":46520,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":24365,"spinlock_wait_cycles":205796352,"thread_start_us":102342,"threads_started":1,"wal-append.queue_time_us":289788}
I20260709 13:00:30.904770  3643 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:31.188203  3643 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.190411  3643 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:30.863443  3639 log.cc:927] Time spent T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 1.071s	user 0.000s	sys 0.004s
I20260709 13:00:31.192449  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 207) took 1723 ms. Trace:
I20260709 13:00:30.907284  3644 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:31.192873  1546 rpcz_store.cc:276] 0709 13:00:29.468539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.485283 (+ 16744us) service_pool.cc:224] Handling call
0709 13:00:29.497379 (+ 12096us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.553140 (+ 55761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.553185 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:29.572749 (+ 19564us) log.cc:844] Serialized 26 byte log entry
0709 13:00:29.644108 (+ 71359us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:29.817641 (+173533us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.817895 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.711820 (+893925us) spinlock_profiling.cc:243] Waited 7.18 ms on lock 0x7b1800364f00. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:00:30.862724 (+150904us) spinlock_profiling.cc:243] Waited 69.8 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:30.865654 (+  2930us) spinlock_profiling.cc:243] Waited 54.7 ms on lock 0x7b54002e5254. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:30.865719 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.192211 (+326492us) raft_consensus.cc:1685] finished
0709 13:00:31.192240 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.192382 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":592,"prepare.queue_time_us":179754,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":1041,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":7818,"spinlock_wait_cycles":303209728,"thread_start_us":173631,"threads_started":2,"wal-append.queue_time_us":204361}
W20260709 13:00:30.859006  3658 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.571s	user 0.002s	sys 0.002s
I20260709 13:00:30.460785  3341 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:31.196847  3341 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:30.505496  3386 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:31.201645  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:30.868247  3418 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:30.655867  3522 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.204632  3522 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.192934  1695 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.206117  1546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39612
I20260709 13:00:31.206784  3522 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:30.651274  3568 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.207945  3568 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.209828  3568 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:30.738288  3573 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:30.464430  3592 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:30.419061  3598 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.228494  1546 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:31.228926  1546 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.230079  3598 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:30.919377  3599 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:31.236832  1546 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.237107  3599 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.238076  1541 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 5. Ops: []
W20260709 13:00:30.923224  3663 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.631s	user 0.003s	sys 0.000s
I20260709 13:00:30.802824  3664 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:31.242388  3664 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:00:30.994741  1690 consensus_meta.cc:287] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.623s	user 0.007s	sys 0.002s
I20260709 13:00:31.243395  1690 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:31.243888  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 1736) took 1098 ms. Trace:
I20260709 13:00:30.996178  3587 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:30.997397  3682 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:30.980279  3388 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.002842  3683 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:00:31.010960  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.043943  3686 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:00:31.044827  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.050871  3661 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.657s	user 0.002s	sys 0.001s
I20260709 13:00:31.044761  3032 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:31.251811  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:31.069651  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 49347us
I20260709 13:00:31.254071  1546 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:31.254644  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:39612 (request call id 2087) took 1029 ms. Trace:
I20260709 13:00:31.254941  1546 rpcz_store.cc:276] 0709 13:00:30.251161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.205959 (+954798us) service_pool.cc:224] Handling call
0709 13:00:31.252944 (+ 46985us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b5400160654. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc491722a3d 00007fc4966f2cd0 00007fc48fc77254 00007fc48fc771e2 00007fc48fc77111 00007fc48fc7708c 00007fc48fc76342 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:31.254563 (+  1619us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50084736}
I20260709 13:00:31.256479  1546 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:31.071779  1620 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:31.092365  1659 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:31.094061  1542 rpcz_store.cc:276] 0709 13:00:29.571905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.577145 (+  5240us) service_pool.cc:224] Handling call
0709 13:00:30.722030 (+1144885us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54000b6b54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:30.722191 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814682496}
W20260709 13:00:31.095031  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.257191  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2111) took 1582 ms. Trace:
I20260709 13:00:30.859481  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.257622  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 1692) took 1250 ms. Trace:
I20260709 13:00:31.257822  1694 raft_consensus.cc:2376] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4. Re-sending same reply.
I20260709 13:00:31.257992  1542 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:00:31.258397  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 278) took 1044 ms. Trace:
I20260709 13:00:31.258838  1694 rpcz_store.cc:276] 0709 13:00:30.214262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.859178 (+644916us) service_pool.cc:224] Handling call
0709 13:00:31.258343 (+399165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.257014  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2090) took 1004 ms. Trace:
I20260709 13:00:31.259428  3032 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.259780  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:31.260105  1546 rpcz_store.cc:276] 0709 13:00:30.252575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.255887 (+1003312us) service_pool.cc:224] Handling call
0709 13:00:31.256280 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.256783 (+   503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.256956 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.261425  1694 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:31.099197  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.105219  1689 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 3: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:31.261976  3522 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:31.257625  1620 rpcz_store.cc:276] 0709 13:00:29.674412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.674584 (+   172us) service_pool.cc:224] Handling call
0709 13:00:31.071349 (+1396765us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b58000f9998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:00:31.071574 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.256917 (+185343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.257100 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11739392}
I20260709 13:00:31.257993  1614 rpcz_store.cc:276] 0709 13:00:29.999930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.000748 (+   818us) service_pool.cc:224] Handling call
0709 13:00:30.033336 (+ 32588us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.038164 (+  4828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.038199 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.063766 (+ 25567us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.266977 (+203211us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:30.267031 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.267109 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.922618 (+655509us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:31.243316 (+320698us) raft_consensus.cc:1685] finished
0709 13:00:31.243347 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.249769 (+  6422us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4576,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":19984,"spinlock_wait_cycles":50316160,"thread_start_us":180906,"threads_started":1,"wal-append.queue_time_us":218160}
I20260709 13:00:30.910796  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.265794  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.266247  1511 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:31.267139  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.105615  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2116) took 1238 ms. Trace:
I20260709 13:00:31.267652  1617 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:31.267900  3683 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.267951  1622 rpcz_store.cc:276] 0709 13:00:29.857639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.857822 (+   183us) service_pool.cc:224] Handling call
0709 13:00:30.757755 (+899933us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b58000f9998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc4966f10a0 00007fc4966f0984 00007fc48fc6b6d4 00007fc48fc6b662
0709 13:00:31.095768 (+338013us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8567168}
I20260709 13:00:31.269366  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:31.269708  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:31.096078  3601 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.094966  1621 rpcz_store.cc:276] 0709 13:00:29.709895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.710448 (+   553us) service_pool.cc:224] Handling call
0709 13:00:29.733601 (+ 23153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.754246 (+ 20645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.749792 (+995546us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b54001e8554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:30.750028 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36213504}
I20260709 13:00:31.104660  1615 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.270480  3601 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:31.106443  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:31.262036  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 872) took 1420 ms. Trace:
I20260709 13:00:31.271529  1545 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:31.271389  1694 rpcz_store.cc:276] 0709 13:00:29.841958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.260859 (+1418901us) service_pool.cc:224] Handling call
0709 13:00:31.261125 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.261802 (+   677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.261981 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:31.111997  3632 log.cc:927] Time spent T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 1.299s	user 0.000s	sys 0.003s
I20260709 13:00:31.272420  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.249711  3388 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.272989  1545 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:31.273458  3522 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:31.274024  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.274590  1545 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:31.274722  3388 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:31.113690  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:31.113822  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 181742us
I20260709 13:00:31.113940  3605 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:31.257443  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 165118us
W20260709 13:00:31.257519  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.276381  3605 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.276825  3605 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.118054  3689 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:31.278625  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.278777  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.279310  2243 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:31.279424  3643 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.279897  3643 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:31.120486  1618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.008s	sys 0.010s
W20260709 13:00:30.703094  3560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.004s	sys 0.001s
I20260709 13:00:31.122989  1547 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:31.290218  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.290845  1547 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
W20260709 13:00:30.514674  3561 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.009s	sys 0.008s
W20260709 13:00:31.294629  3561 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.646s	user 0.010s	sys 0.008s
I20260709 13:00:31.126581  1538 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:31.251861  3686 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:31.295351  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 934) took 1719 ms (client timeout 1733 ms). Trace:
W20260709 13:00:31.295713  1538 rpcz_store.cc:269] 0709 13:00:29.576189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.589868 (+ 13679us) service_pool.cc:224] Handling call
0709 13:00:30.430002 (+840134us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b5800002d98. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc4966f10a0 00007fc4966f0984 00007fc48fc6b6d4 00007fc48fc6b662
0709 13:00:31.295292 (+865290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43836160}
I20260709 13:00:31.122860  3681 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:31.296842  3686 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:31.297425  1543 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:31.270936  3601 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.298727  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2081) took 1467 ms. Trace:
I20260709 13:00:31.299046  1543 rpcz_store.cc:276] 0709 13:00:29.831678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.810851 (+979173us) service_pool.cc:224] Handling call
0709 13:00:31.297268 (+486417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.297806 (+   538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.298561 (+   755us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54002fa3d0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:31.298675 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1117760384}
I20260709 13:00:31.300082  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:31.300565  1543 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:31.301934  1615 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:31.249194  3592 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:31.139815  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 46773.7us
I20260709 13:00:31.296790  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.144033  3688 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:31.135960  3432 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.249244  3664 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.148903  1442 catalog_manager.cc:5697] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 3 to 4, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 4 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:31.317900  3664 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.318825  3432 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:31.312508  3568 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:31.152451  1441 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42132 (request call id 238) took 7529 ms. Trace:
I20260709 13:00:31.319697  3568 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.321745  3568 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:31.152559  3692 consensus_queue.cc:1059] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:31.279151  3605 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:31.153962  3534 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.323872  3605 raft_consensus.cc:3055] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:31.324249  3605 raft_consensus.cc:740] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:31.325151  3605 consensus_queue.cc:260] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.312620  3573 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:31.326298  3605 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.155503  3335 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.326337  3573 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.159770  1540 rpcz_store.cc:276] 0709 13:00:29.574458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.574778 (+   320us) service_pool.cc:224] Handling call
0709 13:00:30.411474 (+836696us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b5800002d98. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:00:30.411774 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.119212 (+707438us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:00:31.119277 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:31.119871 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:00:31.138692 (+ 18821us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:31.138728 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.138808 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.158348 (+ 19540us) raft_consensus.cc:1685] finished
0709 13:00:31.158384 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.158684 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16754,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":16924544,"thread_start_us":725035,"threads_started":2,"wal-append.queue_time_us":18635}
I20260709 13:00:31.328811  3335 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:31.328810  3573 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:31.163888  3589 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.170187  3607 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.333503  3607 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:31.172801  3624 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.336499  3589 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:31.187131  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:31.337459  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 288) took 1117 ms. Trace:
I20260709 13:00:31.338128  3624 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:31.194476  3644 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.339560  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:31.340317  2240 raft_consensus.cc:2393] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 4: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:31.340152  3688 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.340854  3644 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:30.489791  3146 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:31.199024  3341 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:31.212414  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.307876  3532 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:31.342365  3688 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:31.218257  1613 raft_consensus.cc:2368] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:31.342878  3681 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:31.343407  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.343502  3681 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.222695  1695 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:31.345827  3681 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:31.345986  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:31.337838  1688 rpcz_store.cc:276] 0709 13:00:30.219534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.186845 (+967311us) service_pool.cc:224] Handling call
0709 13:00:31.337381 (+150536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.239750  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2079) took 1416 ms. Trace:
W20260709 13:00:31.248773  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.261941  3032 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:31.262619  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 287) took 1043 ms. Trace:
I20260709 13:00:30.917063  2241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 480) took 1355 ms. Trace:
I20260709 13:00:31.318907  1442 catalog_manager.cc:5697] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 3 to 4, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:31.350222  2241 rpcz_store.cc:276] 0709 13:00:29.564155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.564294 (+   139us) service_pool.cc:224] Handling call
0709 13:00:29.564579 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.663979 (+ 99400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.664024 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.664081 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:29.664124 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.916766 (+1252642us) spinlock_profiling.cc:243] Waited 99.1 ms on lock 0x7b5400631d54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:30.916825 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.916986 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227970944}
I20260709 13:00:31.261561  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:31.351483  1546 raft_consensus.cc:2376] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3. Re-sending same reply.
I20260709 13:00:31.270018  3683 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:31.272912  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 873) took 1430 ms. Trace:
I20260709 13:00:31.352135  1694 rpcz_store.cc:276] 0709 13:00:29.842205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.272210 (+1430005us) service_pool.cc:224] Handling call
0709 13:00:31.272469 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.272638 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.272661 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:31.272698 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:31.272731 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.272778 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.272864 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.096496  1692 rpcz_store.cc:276] 0709 13:00:29.479055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.479512 (+   457us) service_pool.cc:224] Handling call
0709 13:00:29.491531 (+ 12019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.577099 (+ 85568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.577137 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.577177 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:29.577204 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.854485 (+1277281us) spinlock_profiling.cc:243] Waited 85.4 ms on lock 0x7b540044b454. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:30.854539 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.854709 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196336896}
I20260709 13:00:31.111899  1693 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:31.247851  3682 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.350037  1689 rpcz_store.cc:276] 0709 13:00:30.219331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.104169 (+884838us) service_pool.cc:224] Handling call
0709 13:00:31.262561 (+158392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.357534  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.358384  3682 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:30.893832  3249 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.281077  1587 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:31.361290  3249 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.362352  3032 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.362766  3032 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:31.363384  3032 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.286583  1512 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:31.286691  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.367959  1546 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:31.368409  2244 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:31.286831  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.287623  3591 consensus_queue.cc:1059] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:31.288376  3540 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:31.352257  3644 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:31.370445  3540 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.370741  3644 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.372790  3540 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:31.288879  3541 consensus_queue.cc:1059] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:00:31.289477  3560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.511s	user 0.007s	sys 0.001s
I20260709 13:00:31.373656  3541 raft_consensus.cc:3055] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:31.374032  3541 raft_consensus.cc:740] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:31.375029  3560 raft_consensus.cc:1064] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:00:31.374780  3541 consensus_queue.cc:260] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.375645  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:31.376000  3541 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:31.376767  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.377352  1692 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:31.378161  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.289686  3643 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.370061  3591 raft_consensus.cc:3055] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:31.350340  3587 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:31.379707  3591 raft_consensus.cc:740] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:31.380131  3587 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:31.380580  3591 consensus_queue.cc:260] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.380720  1442 catalog_manager.cc:5697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 1 to 2, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:31.381739  3591 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:31.383145  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 96619.3us
I20260709 13:00:31.383944  1512 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:31.292407  1511 leader_election.cc:400] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4.
I20260709 13:00:31.131552  1539 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:31.384506  1511 leader_election.cc:403] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:31.350234  3599 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:31.372808  3644 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:31.303608  1544 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:31.385249  3599 raft_consensus.cc:2764] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:31.310312  1538 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 3: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:31.378026  3560 consensus_queue.cc:237] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.389165  1512 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:31.284343  1585 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:31.162358  3588 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.334448  1691 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:31.316460  1586 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:31.391384  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 107085us
I20260709 13:00:31.391455  3681 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.341351  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.391990  3681 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:31.345992  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.392388  3681 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:31.392441  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 76091.1us
I20260709 13:00:31.347414  1541 rpcz_store.cc:276] 0709 13:00:29.823046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.412530 (+589484us) service_pool.cc:224] Handling call
0709 13:00:30.412848 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.238544 (+825696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.239464 (+   920us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b5400160654. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:31.239676 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897195392}
I20260709 13:00:31.394107  1541 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:31.394701  3249 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:31.244248  1690 rpcz_store.cc:276] 0709 13:00:30.145521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.359666 (+214145us) service_pool.cc:224] Handling call
0709 13:00:31.243840 (+884174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.320086  1441 rpcz_store.cc:276] 0709 13:00:23.628760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.633910 (+  5150us) service_pool.cc:224] Handling call
0709 13:00:31.152358 (+7518448us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:27.463003 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:27.463877 (+   874us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:27.463939 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:00:27.463979 (+    40us) tablet.cc:662] Decoding operations
0709 13:00:27.503641 (+ 39662us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:27.503736 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:27.503761 (+    25us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:00:27.504646 (+   885us) tablet.cc:701] Row locks acquired
0709 13:00:27.504697 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:00:27.504878 (+   181us) write_op.cc:270] Start()
0709 13:00:27.505028 (+   150us) write_op.cc:276] Timestamp: P: 1783602027504815 usec, L: 0
0709 13:00:27.505059 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:00:27.505747 (+   688us) log.cc:844] Serialized 3622 byte log entry
0709 13:00:28.037678 (+531931us) op_driver.cc:464] REPLICATION: finished
0709 13:00:28.533325 (+495647us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc48e6210ac 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc495161ef0
0709 13:00:29.314083 (+780758us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b1800383fe0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e60c2a6 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497ae79e1 00007fc497ae664c 00007fc495162845 00007fc495166d61
0709 13:00:29.315143 (+  1060us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b540016e328. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497ae79e1 00007fc497ae664c 00007fc495162845 00007fc495166d61 00007fc495166d19 00007fc495166ca9 00007fc495166c71 00007fc495165e9d 000000000038f354 000000000038f199 00007fc48e63e475
0709 13:00:29.315258 (+   115us) write_op.cc:301] APPLY: starting
0709 13:00:29.315376 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:29.315627 (+   251us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:29.315672 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:29.471179 (+155507us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:29.471615 (+   436us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:00:29.471697 (+    82us) write_op.cc:312] APPLY: finished
0709 13:00:29.472115 (+   418us) log.cc:844] Serialized 71 byte log entry
0709 13:00:29.642600 (+170485us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:29.659918 (+ 17318us) write_op.cc:454] Released schema lock
0709 13:00:29.684778 (+ 24860us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:29.759313 (+ 74535us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:29.770353 (+ 11040us) write_op.cc:454] Released schema lock
0709 13:00:30.607734 (+837381us) spinlock_profiling.cc:243] Waited 7.94 ms on lock 0x7b1800383fe0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
Metrics: {"mutex_wait_us":184530,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":712197,"apply.run_cpu_time_us":12122,"apply.run_wall_time_us":942346,"num_ops":9,"prepare.queue_time_us":46641,"prepare.run_cpu_time_us":10081,"prepare.run_wall_time_us":122770,"raft.queue_time_us":263582,"raft.run_cpu_time_us":24142,"raft.run_wall_time_us":796139,"replication_time_us":532407,"spinlock_wait_cycles":100423424,"thread_start_us":1157588,"threads_started":5,"wal-append.queue_time_us":410781,"wal-append.run_cpu_time_us":16968,"wal-append.run_wall_time_us":1421457}]]}
I20260709 13:00:31.396055  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.396627  1690 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:31.397449  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:31.329382  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.310859  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.399608  1540 raft_consensus.cc:2393] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 3: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:31.342681  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 881) took 1402 ms. Trace:
I20260709 13:00:31.399868  3681 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.360384  2211 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:31.401110  3249 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:31.349207  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.401602  3249 raft_consensus.cc:697] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:31.401988  1688 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
W20260709 13:00:31.361847  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 80851.9us
I20260709 13:00:31.402451  3249 consensus_queue.cc:237] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.362668  3593 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:31.403131  1587 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:31.403523  3593 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.404314  1587 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:31.404872  3589 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:31.405386  3589 raft_consensus.cc:697] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:31.405579  3593 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:31.283842  1696 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:31.406088  3689 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:31.385305  3682 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4.
I20260709 13:00:31.395116  3432 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:31.400087  1687 rpcz_store.cc:276] 0709 13:00:29.939930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.187041 (+1247111us) service_pool.cc:224] Handling call
0709 13:00:31.342621 (+155580us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.342754  3532 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.353826  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 884) took 1060 ms. Trace:
W20260709 13:00:31.385226  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 102959us
I20260709 13:00:31.402949  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.291654  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.402091  1545 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:31.348315  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.382393  1442 catalog_manager.cc:5697] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 1 to 2, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:31.435425  2211 leader_election.cc:336] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Timed out: RequestConsensusVote RPC to 127.0.107.195:34459 timed out after 1.586s (SENT)
I20260709 13:00:31.395195  1541 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:31.428740  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:31.391433  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 282) took 1176 ms. Trace:
W20260709 13:00:31.408181  1696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 277) took 1194 ms (client timeout 1586 ms). Trace:
W20260709 13:00:31.440061  1696 rpcz_store.cc:269] 0709 13:00:30.213305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.281196 (+ 67891us) service_pool.cc:224] Handling call
0709 13:00:31.407980 (+1126784us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b540014fd54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:31.408113 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2206809856}
I20260709 13:00:31.442281  1511 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:31.435858  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.444005  1692 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:31.410358  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.438486  2211 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:31.423556  1660 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:31.439613  1691 rpcz_store.cc:276] 0709 13:00:30.215499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.098994 (+883495us) service_pool.cc:224] Handling call
0709 13:00:31.391293 (+292299us) spinlock_profiling.cc:243] Waited 72.1 ms on lock 0x7b5400097254. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:31.391384 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165720832}
I20260709 13:00:31.440919  1693 rpcz_store.cc:276] 0709 13:00:30.293119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.858075 (+564956us) service_pool.cc:224] Handling call
0709 13:00:31.353764 (+495689us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.457139  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.458077  1660 leader_election.cc:400] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:31.458693  1660 leader_election.cc:403] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:00:31.411553  1585 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:31.458954  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:31.459933  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 48459.5us
I20260709 13:00:31.460501  1693 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
W20260709 13:00:31.461198  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 72098.1us
I20260709 13:00:31.443023  1547 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:31.462548  3599 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:31.463060  3599 raft_consensus.cc:697] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:31.463204  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:31.464027  3599 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.464473  1512 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:31.464946  3386 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:31.465524  1512 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:31.465917  3561 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:31.465755  3386 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:31.469712  1512 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:31.470719  3522 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:31.471379  3561 raft_consensus.cc:697] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:31.472352  3561 consensus_queue.cc:237] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.473766  1511 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:31.474692  3598 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:31.476452  1511 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:31.478492  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:31.480258  1544 raft_consensus.cc:2410] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:00:31.481192  3335 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:31.483100  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.483349  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.485630  3335 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.486248  3335 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.489055  3335 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:31.491866  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:31.491952  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.492664  1613 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.484431  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:31.494077  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 202257us
I20260709 13:00:31.494985  2209 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:31.495990  3418 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.496387  3418 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.496732  3418 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.500176  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:31.500996  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.497294  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:31.503697  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:31.504326  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:31.504904  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.506520  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:31.506594  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.495587  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:31.509951  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:31.510602  1622 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:31.513183  1613 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:31.513953  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.514657  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.514923  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.514998  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.515363  2237 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:31.516801  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.516829  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:31.517644  2237 raft_consensus.cc:2368] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:31.518312  1511 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:31.519133  3686 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.519694  3686 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.520123  3686 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.522441  3695 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:31.520066  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:31.526764  1511 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:31.530277  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:31.532347  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.532812  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:31.533703  3603 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.534112  3603 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.534494  3599 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:31.534056  3686 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.535691  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.534672  3603 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.543588  1619 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:31.536206  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.544296  2210 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:31.544505  1696 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:31.534070  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:31.537470  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:31.538414  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 80522.3us
I20260709 13:00:31.540946  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:31.550278  1693 raft_consensus.cc:606] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:31.550737  1693 raft_consensus.cc:614] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:31.552515  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:31.632961  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 78849.1us
I20260709 13:00:31.553383  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:31.635391  1585 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:31.636276  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 102285us
I20260709 13:00:31.562043  1691 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:31.359107  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.638036  1620 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:31.638743  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:31.639607  1614 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:31.642031  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:31.642802  1695 raft_consensus.cc:3055] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:31.643178  1695 raft_consensus.cc:740] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:31.410285  3588 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:31.650637  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.382400  3587 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:31.656878  1693 raft_consensus.cc:2393] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 4: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:31.534263  3561 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:31.536633  3692 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:31.543393  3593 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:31.542330  3624 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.537925  1688 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:31.547289  3688 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.543171  3644 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:31.541371  3573 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 13:00:31.407536  3592 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.245s
I20260709 13:00:31.645301  3620 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:31.694396  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:31.686986  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.684911  1695 consensus_queue.cc:260] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.668442  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.699721  1695 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:00:31.688293  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 254726us
I20260709 13:00:31.701771  1511 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:31.652659  3664 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:31.682873  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:31.406224  3589 consensus_queue.cc:237] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.693786  2246 raft_consensus.cc:2393] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 4: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:31.662272  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:31.706503  1587 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:31.705308  1622 raft_consensus.cc:2368] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:31.678269  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:31.719910  1692 raft_consensus.cc:2393] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 4: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:31.685093  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.717128  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.723502  1696 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:31.688131  3689 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:31.702804  1511 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:31.684432  3624 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:31.707865  3598 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.725292  1587 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:31.732072  1543 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:31.536669  3601 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:31.712308  3660 log.cc:927] Time spent T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:00:31.735613  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.776252  1693 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:31.735960  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:31.778891  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 53680.2us
I20260709 13:00:31.779657  1587 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:31.711478  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 76164us
I20260709 13:00:31.703550  3701 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:31.741324  1660 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:31.712430  3561 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:31.773350  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 213578us
I20260709 13:00:31.770043  1614 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:31.784849  1587 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:31.747485  3689 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:31.790606  3689 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.785791  1695 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:31.693388  3643 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:31.793797  3643 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:31.795809  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 237605us
I20260709 13:00:31.753258  1687 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
W20260709 13:00:31.811225  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 69972.8us
I20260709 13:00:31.752426  3624 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.706413  3534 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.721853  3620 raft_consensus.cc:697] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:31.751933  3599 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:31.813961  1660 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:31.787566  3146 raft_consensus.cc:2764] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:31.827581  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:31.831751  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:31.829150  1659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.009s	sys 0.048s
W20260709 13:00:31.833861  1659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.010s	sys 0.048s
W20260709 13:00:31.834363  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.834813  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.806510  3561 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.771885  3690 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:31.843343  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.815430  3643 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:31.817340  3628 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:31.845613  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:31.859055  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.815761  3432 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:31.862267  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.864388  1660 leader_election.cc:400] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:31.864332  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.867364  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:31.867456  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:31.883906  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.833516  1688 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:31.885869  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:31.844077  3690 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:31.844318  3644 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:31.843868  3561 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.831385  3700 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:31.975924  3432 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:31.890799  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:31.992717  3689 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:32.007655  3341 raft_consensus.cc:1027] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: attempt to promote peer e8a64798e5f94de8909707bcbd11804a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260709 13:00:31.988656  2267 debug-util.cc:398] Leaking SignalData structure 0x7b080017c800 after lost signal to thread 434
W20260709 13:00:32.065306  2267 debug-util.cc:398] Leaking SignalData structure 0x7b0800256d60 after lost signal to thread 1479
W20260709 13:00:31.991794  3708 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:00:31.978197  1687 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:31.950037  2211 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:32.066747  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 281928us
W20260709 13:00:31.992425  3705 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:00:31.989118  3692 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.977962  3653 consensus_queue.cc:1059] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.077s
W20260709 13:00:31.998550  3541 consensus_meta.cc:287] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.622s	user 0.005s	sys 0.002s
I20260709 13:00:31.993644  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:31.889704  3681 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:31.990559  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:32.085744  1695 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:32.085988  1693 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:31.859318  3599 raft_consensus.cc:697] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:31.883841  3686 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:31.883497  3587 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:00:31.860343  3628 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:32.085129  3603 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:31.911389  3690 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:32.022415  3707 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:00:31.869279  3588 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:32.023772  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 876) took 2161 ms. Trace:
I20260709 13:00:32.146538  1696 rpcz_store.cc:276] 0709 13:00:29.861968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.739904 (+1877936us) service_pool.cc:224] Handling call
0709 13:00:31.828285 (+ 88381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.829010 (+   725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.856047 (+ 27037us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:31.856176 (+   129us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:31.856255 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.856385 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.023405 (+167020us) spinlock_profiling.cc:243] Waited 78.8 ms on lock 0x7b5400097c50. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:32.023682 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181190016}
I20260709 13:00:31.857597  3593 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:32.041976  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 244604us
W20260709 13:00:32.018936  3704 log.cc:927] Time spent T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 13:00:32.065711  2267 debug-util.cc:398] Leaking SignalData structure 0x7b0800335d20 after lost signal to thread 1493
W20260709 13:00:32.153306  2267 debug-util.cc:398] Leaking SignalData structure 0x7b08000d8340 after lost signal to thread 1571
W20260709 13:00:32.153703  2267 debug-util.cc:398] Leaking SignalData structure 0x7b08000d82c0 after lost signal to thread 1572
W20260709 13:00:32.154999  2267 debug-util.cc:398] Leaking SignalData structure 0x7b08002d06c0 after lost signal to thread 1646
W20260709 13:00:32.155346  2267 debug-util.cc:398] Leaking SignalData structure 0x7b08002d0620 after lost signal to thread 1647
W20260709 13:00:32.156647  2267 debug-util.cc:398] Leaking SignalData structure 0x7b080038fc20 after lost signal to thread 1720
I20260709 13:00:32.011137  3626 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:00:32.067924  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 117972us
I20260709 13:00:32.128686  3607 raft_consensus.cc:3055] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:32.178683  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 230538us
I20260709 13:00:32.011714  3601 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:32.068184  1587 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:32.016258  3573 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:00:32.184809  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 116670us
I20260709 13:00:31.889454  3712 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:32.086989  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:32.190994  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:32.199254  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:32.096025  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.097237  3689 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:32.050976  3720 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:31.963321  3532 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:32.051079  3432 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.127688  1690 raft_consensus.cc:2410] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:00:32.157723  2267 debug-util.cc:398] Leaking SignalData structure 0x7b080038fe40 after lost signal to thread 1721
W20260709 13:00:32.230149  2267 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd680 after lost signal to thread 2270
W20260709 13:00:32.230512  2267 debug-util.cc:398] Leaking SignalData structure 0x7b08002ae000 after lost signal to thread 2271
I20260709 13:00:32.036880  3620 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.178890  3701 raft_consensus.cc:697] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:31.990975  3418 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:32.130204  3628 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.178989  1545 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:32.180320  1659 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:00:32.267068  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 482939us
I20260709 13:00:32.267370  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:32.206254  1693 raft_consensus.cc:606] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Received request to transfer leadership to TS dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:32.095098  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:32.268380  1693 raft_consensus.cc:614] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:32.268564  1695 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:32.200356  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:32.084844  3695 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:32.208912  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:32.137494  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 879) took 2242 ms. Trace:
I20260709 13:00:32.210219  1619 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:00:32.214308  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 211) took 1348 ms. Trace:
I20260709 13:00:32.230854  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 880) took 2340 ms. Trace:
I20260709 13:00:32.179371  3534 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:32.179708  3541 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:32.178977  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:32.179534  3607 raft_consensus.cc:740] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:32.239496  1587 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:32.294569  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 55156.1us
I20260709 13:00:32.216218  3335 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:32.180967  3626 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.272253  1696 rpcz_store.cc:276] 0709 13:00:29.890362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.204424 (+2314062us) service_pool.cc:224] Handling call
0709 13:00:32.230329 (+ 25905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.230520 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.230555 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.230596 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:32.230630 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.230687 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.230802 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.273484  2244 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 3 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:00:32.278702  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 883) took 2241 ms. Trace:
W20260709 13:00:32.287328  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 107094us
I20260709 13:00:32.287997  3593 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:32.288264  3643 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.323421  1695 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:32.289080  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:00:32.290925  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 116162us
I20260709 13:00:32.297551  1585 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:32.207420  3573 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.270889  1542 rpcz_store.cc:276] 0709 13:00:30.866269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.258839 (+392570us) service_pool.cc:224] Handling call
0709 13:00:31.259152 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.262052 (+  2900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.262087 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:31.262611 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:00:31.551898 (+289287us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:31.786550 (+234652us) log.cc:844] Serialized 14 byte log entry
0709 13:00:32.213949 (+427399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.214029 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:32.214067 (+    38us) raft_consensus.cc:1685] finished
0709 13:00:32.214081 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.214239 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44220,"prepare.queue_time_us":254489,"prepare.run_cpu_time_us":695,"prepare.run_wall_time_us":8125,"raft.queue_time_us":34354,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":5880,"spinlock_wait_cycles":8492416,"thread_start_us":842533,"threads_started":3,"wal-append.queue_time_us":445934}
I20260709 13:00:32.299141  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 882) took 2327 ms. Trace:
I20260709 13:00:32.330022  1691 rpcz_store.cc:276] 0709 13:00:29.952507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.273788 (+2321281us) service_pool.cc:224] Handling call
0709 13:00:32.279449 (+  5661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.279601 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.279623 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.279658 (+    35us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:32.279689 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.279746 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.279828 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.241529  3589 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:32.311775  1693 rpcz_store.cc:276] 0709 13:00:30.036864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.277965 (+2241101us) service_pool.cc:224] Handling call
0709 13:00:32.278247 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.278405 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.278430 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.278468 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:32.278500 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.278548 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.278648 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.271117  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:32.324636  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:32.334233  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1735) took 2284 ms. Trace:
I20260709 13:00:32.335752  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:32.337862  1693 rpcz_store.cc:276] 0709 13:00:30.050284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.333249 (+2282965us) service_pool.cc:224] Handling call
0709 13:00:32.333611 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.333828 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.333865 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.333919 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:32.333978 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.334047 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.334169 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.336228  3734 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:32.339634  3734 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:32.339988  3734 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:32.309505  3599 consensus_queue.cc:237] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.340415  3418 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:32.341276  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:32.341470  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:32.235630  3720 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.344763  3720 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:32.313436  3605 consensus_meta.cc:287] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.987s	user 0.009s	sys 0.003s
W20260709 13:00:32.348726  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 51700.6us
I20260709 13:00:32.349604  1585 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:32.353253  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 280) took 2138 ms. Trace:
I20260709 13:00:32.353937  1693 rpcz_store.cc:276] 0709 13:00:30.214827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.352127 (+2137300us) service_pool.cc:224] Handling call
0709 13:00:32.352550 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.352806 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.352848 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.352910 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:32.352964 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.353040 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.353172 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.338141  2238 raft_consensus.cc:2368] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:32.358428  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:32.360816  1693 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:32.361657  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 281) took 2146 ms. Trace:
I20260709 13:00:32.362812  1693 rpcz_store.cc:276] 0709 13:00:30.215113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.359963 (+2144850us) service_pool.cc:224] Handling call
0709 13:00:32.360391 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.361356 (+   965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.361588 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.313663  3593 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.362922  1696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7803266de9984fac88726b08bee73921"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:32.368511  1696 raft_consensus.cc:606] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:32.368966  1696 raft_consensus.cc:614] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:32.365103  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 283) took 2149 ms. Trace:
I20260709 13:00:32.273018  1687 rpcz_store.cc:276] 0709 13:00:29.890055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.833750 (+1943695us) service_pool.cc:224] Handling call
0709 13:00:31.887249 (+ 53499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.082622 (+195373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.132870 (+ 50248us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:32.348845  3032 consensus_meta.cc:287] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.985s	user 0.010s	sys 0.001s
I20260709 13:00:32.365314  2245 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:32.302254  3541 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:32.380096  1585 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:32.332895  3589 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:32.362555  3587 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:32.373780  1693 rpcz_store.cc:276] 0709 13:00:30.215749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.364044 (+2148295us) service_pool.cc:224] Handling call
0709 13:00:32.364413 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.364641 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.364681 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.364749 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:32.364822 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.364896 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.365035 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.362100  3560 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:00:32.381628  1660 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:32.363636  3689 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:32.332836  3643 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.397369  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1737) took 2178 ms. Trace:
I20260709 13:00:32.401392  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 285) took 2183 ms. Trace:
I20260709 13:00:32.419417  1696 rpcz_store.cc:276] 0709 13:00:30.218399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.376927 (+2158528us) service_pool.cc:224] Handling call
0709 13:00:32.400676 (+ 23749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.400969 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.401008 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.401062 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:32.401121 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.401193 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.401323 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.372087  3593 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:32.381109  3715 log.cc:927] Time spent T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:00:32.422603  1660 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:32.418633  1693 rpcz_store.cc:276] 0709 13:00:30.219001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.396139 (+2177138us) service_pool.cc:224] Handling call
0709 13:00:32.396693 (+   554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.396933 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.396970 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.397026 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:32.397075 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.397162 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.397298 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.384481  3693 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:32.431128  1660 leader_election.cc:400] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:32.393651  3589 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:32.434829  1660 leader_election.cc:403] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:32.438678  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 892) took 1129 ms. Trace:
I20260709 13:00:32.439069  1692 rpcz_store.cc:276] 0709 13:00:31.309367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.444623 (+135256us) service_pool.cc:224] Handling call
0709 13:00:32.438498 (+993875us) spinlock_profiling.cc:243] Waited 80.1 ms on lock 0x7b54002c6854. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:32.438619 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184133888}
I20260709 13:00:32.441982  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 888) took 2001 ms. Trace:
I20260709 13:00:32.442389  1696 rpcz_store.cc:276] 0709 13:00:30.440573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.432253 (+1991680us) service_pool.cc:224] Handling call
0709 13:00:32.441525 (+  9272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.441690 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.441717 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.441756 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:32.441786 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.441839 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.441926 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.421047  3341 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:32.423514  3532 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.424258  3603 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:32.430763  3573 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:32.409348  3534 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:00:32.439203  3700 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:32.451155  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1748) took 1127 ms. Trace:
I20260709 13:00:32.481542  1695 rpcz_store.cc:276] 0709 13:00:31.323945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.450068 (+1126123us) service_pool.cc:224] Handling call
0709 13:00:32.450498 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.450729 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.450772 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.450824 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:32.450879 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.450951 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.451076 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.384105  3032 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.430320  3587 raft_consensus.cc:697] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:32.460573  3561 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.445358  3418 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:32.366842  3701 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:32.525638  3723 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:32.531502  3561 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:32.531935  3723 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:32.534065  3723 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:32.534525  3341 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.535128  3341 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.537352  3341 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:32.541201  3643 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:32.541553  3598 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:32.542042  3598 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:32.466919  3710 log.cc:927] Time spent T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 13:00:32.527482  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.443734  3644 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:32.545352  1614 raft_consensus.cc:1240] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:32.649950  1621 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:32.453744  1687 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:32.568094  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:32.568804  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1749) took 1244 ms. Trace:
I20260709 13:00:32.669039  1695 rpcz_store.cc:276] 0709 13:00:31.324217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.482838 (+1158621us) service_pool.cc:224] Handling call
0709 13:00:32.568252 (+ 85414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.568425 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.568451 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.568494 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:32.568538 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.568605 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.568738 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.727262  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:32.728879  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 297844us
I20260709 13:00:32.735782  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:32.725032  3715 log.cc:927] Time spent T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:00:32.535143  3418 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:32.744511  1660 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:32.715278  3688 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:32.753412  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1745) took 1434 ms. Trace:
W20260709 13:00:32.755873  3733 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 13:00:32.755685  1692 rpcz_store.cc:276] 0709 13:00:31.318855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.440080 (+1121225us) service_pool.cc:224] Handling call
0709 13:00:32.453512 (+ 13432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.453660 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:32.461561 (+  7901us) log.cc:844] Serialized 14 byte log entry
0709 13:00:32.752995 (+291434us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.753049 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:32.753103 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.753223 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.753353 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8194,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":280646,"threads_started":1}
I20260709 13:00:32.752425  3735 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.758767  3735 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.762136  3735 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:32.762039  2245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45882 (request call id 506) took 1248 ms. Trace:
I20260709 13:00:32.749595  3573 consensus_queue.cc:1059] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:00:32.749396  3700 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:32.767107  2245 rpcz_store.cc:276] 0709 13:00:31.513944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.514668 (+   724us) service_pool.cc:224] Handling call
0709 13:00:32.761752 (+1247084us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b54007012d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:32.761876 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1953707264}
W20260709 13:00:32.768059  3725 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.526s	user 0.008s	sys 0.003s
I20260709 13:00:32.768144  3643 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:32.732359  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 286) took 2513 ms. Trace:
I20260709 13:00:32.769415  3573 raft_consensus.cc:3055] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:32.769816  3573 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:32.769582  1687 rpcz_store.cc:276] 0709 13:00:30.218661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.394567 (+2175906us) service_pool.cc:224] Handling call
0709 13:00:32.438234 (+ 43667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.684290 (+246056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.729851 (+ 45561us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.770687  3573 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.771517  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 290) took 1036 ms. Trace:
I20260709 13:00:32.772107  3573 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:32.771924  1687 rpcz_store.cc:276] 0709 13:00:31.734862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.770591 (+1035729us) service_pool.cc:224] Handling call
0709 13:00:32.770941 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.771119 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.771147 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.771196 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:32.771259 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.771327 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.771460 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.776016  3418 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:32.780893  3653 consensus_queue.cc:1059] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:32.782326  3643 raft_consensus.cc:3055] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:32.782743  3643 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:32.783906  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 874) took 2941 ms. Trace:
I20260709 13:00:32.784160  3643 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.784587  1688 rpcz_store.cc:276] 0709 13:00:29.842441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.734316 (+1891875us) service_pool.cc:224] Handling call
0709 13:00:31.813165 (+ 78849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.918652 (+105487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.783524 (+864872us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b54001b7454. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:32.783816 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6043392}
I20260709 13:00:32.786453  1660 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:32.787436  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 1744) took 1468 ms. Trace:
I20260709 13:00:32.787921  1690 rpcz_store.cc:276] 0709 13:00:31.318626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.397248 (+ 78622us) service_pool.cc:224] Handling call
0709 13:00:32.787170 (+1389922us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b54001b6f54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:32.787369 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1676951424}
W20260709 13:00:32.788602  2211 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:34459 timed out after 1.506s (SENT) [suppressed 15 similar messages]
I20260709 13:00:32.754951  1695 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:32.790234  1660 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:32.790900  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1750) took 1466 ms. Trace:
I20260709 13:00:32.791219  1695 rpcz_store.cc:276] 0709 13:00:31.324454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.732848 (+1408394us) service_pool.cc:224] Handling call
0709 13:00:32.754701 (+ 21853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.790668 (+ 35967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.790846 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.796496  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:32.800396  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:32.802748  1691 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:00:32.742487  3591 consensus_meta.cc:287] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 1.360s	user 0.011s	sys 0.002s
I20260709 13:00:32.804701  1660 leader_election.cc:400] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
W20260709 13:00:32.782925  3692 consensus_meta.cc:287] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.697s	user 0.008s	sys 0.000s
I20260709 13:00:32.806488  3700 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:32.806587  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:32.806849  1694 raft_consensus.cc:2410] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:00:32.810742  1587 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:32.682986  3696 consensus_queue.cc:1059] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:00:32.721185  3593 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:32.806020  1660 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:32.804646  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 222) took 1239 ms. Trace:
I20260709 13:00:32.829028  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:32.790428  3688 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:32.830945  1660 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:32.831409  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 1723) took 1322 ms. Trace:
I20260709 13:00:32.835176  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:32.836136  1690 raft_consensus.cc:2393] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 4: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:32.836875  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:32.837165  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:32.828287  1544 rpcz_store.cc:276] 0709 13:00:31.564934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.565509 (+   575us) service_pool.cc:224] Handling call
0709 13:00:31.565965 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.692232 (+126267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.692278 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:31.703922 (+ 11644us) log.cc:844] Serialized 26 byte log entry
0709 13:00:32.217201 (+513279us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:32.217243 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.731511 (+514268us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54003223d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:32.731583 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:32.792845 (+ 61262us) raft_consensus.cc:1685] finished
0709 13:00:32.792873 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.804582 (+ 11709us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4510,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9890,"spinlock_wait_cycles":289260288,"thread_start_us":465178,"threads_started":1,"wal-append.queue_time_us":707590}
I20260709 13:00:32.801201  3532 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.803797  3653 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.839887  1690 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:32.832875  1618 rpcz_store.cc:276] 0709 13:00:31.508752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.508866 (+   114us) service_pool.cc:224] Handling call
0709 13:00:31.509190 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:31.539127 (+ 29937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.539154 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:31.548880 (+  9726us) log.cc:844] Serialized 52 byte log entry
0709 13:00:31.887849 (+338969us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:32.048993 (+161144us) log.cc:844] Serialized 14 byte log entry
0709 13:00:32.213869 (+164876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.213942 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:32.831162 (+617220us) raft_consensus.cc:1685] finished
0709 13:00:32.831181 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.831334 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52471,"prepare.queue_time_us":159222,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":169235,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":119683,"spinlock_wait_cycles":1792,"thread_start_us":348457,"threads_started":2,"wal-append.queue_time_us":418982}
I20260709 13:00:32.832404  3534 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:32.844296  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:32.844997  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:32.825083  3692 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:32.846139  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:32.802850  3418 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:32.850757  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:32.825697  3681 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:32.852272  1695 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:32.841323  3742 raft_consensus.cc:2764] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:32.841213  3735 consensus_queue.cc:1059] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:00:32.855093  2238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45882 (request call id 505) took 1341 ms. Trace:
I20260709 13:00:32.856686  3593 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:32.857549  3432 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:32.751585  3587 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.859447  3418 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:32.860379  3690 consensus_meta.cc:287] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.700s	user 0.001s	sys 0.010s
W20260709 13:00:32.861351  3628 consensus_meta.cc:287] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.564s	user 0.003s	sys 0.006s
W20260709 13:00:32.862401  3734 consensus_meta.cc:287] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.001s
W20260709 13:00:32.853015  3624 consensus_meta.cc:287] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 1.027s	user 0.012s	sys 0.000s
W20260709 13:00:32.847011  3712 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.011s	sys 0.015s
I20260709 13:00:32.838452  3591 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.892517  3532 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.870520  3626 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:32.825147  3720 consensus_queue.cc:1059] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:00:32.871733  3032 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:32.872134  3607 consensus_queue.cc:260] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.873533  3653 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:32.874075  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7aca6dcf002947d6841150860825871b"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:32.875893  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 942) took 1999 ms. Trace:
I20260709 13:00:32.876679  3711 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:32.877090  3541 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:32.877628  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.876688  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:32.878263  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.866621  3589 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.936721  1546 rpcz_store.cc:276] 0709 13:00:30.876742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.369579 (+492837us) service_pool.cc:224] Handling call
0709 13:00:31.369892 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.421347 (+ 51455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.421382 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:31.421880 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:00:31.652049 (+230169us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:31.865005 (+212956us) log.cc:844] Serialized 14 byte log entry
0709 13:00:32.021408 (+156403us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b18002db4a0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e5b8c0a 00007fc497cf8219 00007fc4955ff58f 00007fc48e63e571 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd
0709 13:00:32.216693 (+195285us) spinlock_profiling.cc:243] Waited 8.99 ms on lock 0x7b18002db4a0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:00:32.875588 (+658895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.875663 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:32.875701 (+    38us) raft_consensus.cc:1685] finished
0709 13:00:32.875713 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.875829 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1107056,"prepare.queue_time_us":163592,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1071757,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":91469,"spinlock_wait_cycles":27437824,"thread_start_us":394328,"threads_started":2,"wal-append.queue_time_us":424405}
I20260709 13:00:32.896369  3598 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.881219  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:32.882207  3729 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:32.948276  3418 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:32.950675  3607 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:32.880856  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 1721) took 1374 ms. Trace:
I20260709 13:00:32.951383  1621 rpcz_store.cc:276] 0709 13:00:31.506917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.507041 (+   124us) service_pool.cc:224] Handling call
0709 13:00:31.507367 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.650520 (+1143153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.880626 (+230106us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002d3a54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:32.880789 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2626876288}
I20260709 13:00:32.893663  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 897) took 1446 ms. Trace:
I20260709 13:00:32.952358  1692 rpcz_store.cc:276] 0709 13:00:31.447479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.757502 (+1310023us) service_pool.cc:224] Handling call
0709 13:00:32.757885 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.758112 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:32.779397 (+ 21285us) log.cc:844] Serialized 14 byte log entry
0709 13:00:32.893363 (+113966us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.893414 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:32.893451 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.893512 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.893611 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20667,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":404,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5871,"thread_start_us":112740,"threads_started":1,"wal-append.queue_time_us":135175}
I20260709 13:00:32.954505  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:32.901228  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1747) took 1577 ms. Trace:
I20260709 13:00:32.941320  3653 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.956084  3561 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:32.957267  3653 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:32.956888  3561 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:32.957674  3722 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:32.958200  3722 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.915179  3690 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:32.960208  3722 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:32.961031  3690 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:32.955086  1692 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:32.962180  1619 raft_consensus.cc:1240] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:32.963384  1688 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:32.920269  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:32.922451  3388 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:32.966275  3388 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.968225  3388 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:32.944344  3711 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:32.916525  3712 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.011s	sys 0.015s
I20260709 13:00:32.969045  3712 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:32.969897  3712 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.970625  3711 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:32.880824  3522 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.971490  3522 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:32.972597  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:32.973842  3522 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:32.940974  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.915501  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:32.975076  2239 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:32.936806  1691 raft_consensus.cc:606] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:32.984150  2239 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:32.943789  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2106) took 1105 ms. Trace:
I20260709 13:00:32.900161  2238 rpcz_store.cc:276] 0709 13:00:31.513569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.513710 (+   141us) service_pool.cc:224] Handling call
0709 13:00:32.854891 (+1341181us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b540050f354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:32.855035 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1799581568}
I20260709 13:00:32.918463  3624 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:32.916671  3734 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:32.954613  3644 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:32.955358  1696 rpcz_store.cc:276] 0709 13:00:31.323679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.443290 (+1119611us) service_pool.cc:224] Handling call
0709 13:00:32.467822 (+ 24532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.518210 (+ 50388us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:32.660515 (+142305us) log.cc:844] Serialized 14 byte log entry
0709 13:00:32.900803 (+240288us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.900867 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:32.900928 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.901008 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.901158 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3021,"prepare.queue_time_us":136661,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":50,"raft.queue_time_us":67491,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":5558,"thread_start_us":163143,"threads_started":1}
I20260709 13:00:32.928993  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:32.883109  3701 raft_consensus.cc:3055] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:32.916285  3628 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:32.927687  3720 raft_consensus.cc:3055] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:32.916904  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 128300us
W20260709 13:00:33.067387  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.074150  1587 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:32.864909  1694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 1742) took 1546 ms (client timeout 1790 ms). Trace:
W20260709 13:00:33.096551  1694 rpcz_store.cc:269] 0709 13:00:31.318144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.428415 (+110271us) service_pool.cc:224] Handling call
0709 13:00:32.864708 (+1436293us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400033754. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:32.864849 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3144103296}
I20260709 13:00:33.075403  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:33.100630  1511 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:33.100963  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:33.073361  1547 rpcz_store.cc:276] 0709 13:00:31.838592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.840604 (+  2012us) service_pool.cc:224] Handling call
0709 13:00:31.840990 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.841247 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:31.858602 (+ 17355us) log.cc:844] Serialized 14 byte log entry
0709 13:00:32.767530 (+908928us) spinlock_profiling.cc:243] Waited 6.54 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:32.942235 (+174705us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.942290 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:32.942330 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.942391 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.943743 (+  1352us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":931024,"prepare.queue_time_us":28048,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":870449,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8312,"spinlock_wait_cycles":15038720,"thread_start_us":248006,"threads_started":2,"wal-append.queue_time_us":352058}
W20260709 13:00:33.073501  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 89326.2us
W20260709 13:00:33.082577  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 97134.3us
I20260709 13:00:33.091569  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:33.093202  1621 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:33.104420  1587 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:33.108639  1619 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:33.107447  1660 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:33.111431  1619 raft_consensus.cc:1240] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:33.112607  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:33.113425  1621 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.114019  2210 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:33.113191  1660 leader_election.cc:400] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:33.115078  1660 leader_election.cc:403] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:33.095471  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:33.117045  1613 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:33.101629  1618 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:33.128038  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.129010  1695 raft_consensus.cc:2393] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:33.073348  3146 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:33.130414  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:33.131408  1547 raft_consensus.cc:2393] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 4: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:33.116050  3722 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:33.074043  3588 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.119812  3573 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:33.085260  3653 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.144922  1659 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:33.147104  1694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:33.085490  3690 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:33.084573  3603 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:33.152612  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:33.099391  3701 raft_consensus.cc:740] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:33.116171  3522 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.104513  2237 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:33.153437  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:33.130962  3561 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:33.148347  1694 raft_consensus.cc:606] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:33.136831  1660 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:33.157217  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:33.159130  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:33.195976  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 59257.6us
I20260709 13:00:33.194844  1694 raft_consensus.cc:614] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:33.197702  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.159607  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.198117  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.129967  3532 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.098987  3720 raft_consensus.cc:740] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:33.133602  3722 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:00:33.128003  3249 raft_consensus.cc:2764] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:00:33.164633  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:33.253450  1696 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.165537  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:33.166726  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:33.136473  3643 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:33.086166  3688 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.116364  3388 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:33.127848  3541 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:33.163527  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:33.138430  1615 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:33.280330  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 139069us
I20260709 13:00:33.138078  3739 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:33.199079  1694 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:33.196019  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:33.168768  3418 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:33.201504  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:33.286726  1545 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:33.138404  3560 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:33.138257  3432 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:33.202873  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:33.210579  1621 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:33.121338  3696 consensus_queue.cc:1059] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:00:33.250875  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:33.202581  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:33.290333  1621 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:33.154100  3573 raft_consensus.cc:697] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:33.134632  3681 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:00:33.273561  1660 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:33.292063  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:33.277143  1614 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:33.282570  1539 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:00:33.161633  3690 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.184036  3757 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.152038  3653 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.248984  3700 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:33.199138  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.202857  3686 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.202358  3386 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:33.248638  3682 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:33.248040  3593 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.152730  3588 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.161172  3726 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:33.290438  1540 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 7: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:33.290889  1547 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:33.290367  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:33.289942  3730 raft_consensus.cc:3055] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:33.343093  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:33.274020  3532 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.293635  1694 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:00:33.294142  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:33.257812  3561 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.196673  3713 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:33.249872  3756 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:33.167450  3724 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 13:00:33.138943  3146 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:33.306515  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 161275us
I20260709 13:00:33.326372  3700 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:33.301261  3249 consensus_queue.cc:1059] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:00:33.372777  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:33.373467  1538 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
W20260709 13:00:33.374048  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 123288us
I20260709 13:00:33.314314  1696 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:33.202562  3664 consensus_queue.cc:1059] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:00:33.302804  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:33.340315  3730 raft_consensus.cc:740] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:33.196600  3522 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.159276  3603 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.326637  2211 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:33.326894  1695 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:33.279724  3695 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:33.285175  3739 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.251459  3626 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.321007  3541 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:33.321305  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 875) took 3473 ms. Trace:
I20260709 13:00:33.438009  1541 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:33.342360  3682 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.342057  3593 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.360072  3591 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.296027  3418 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.304497  3599 consensus_queue.cc:1059] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:00:33.337049  3386 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.370409  3688 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:33.299129  3738 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:00:33.434388  3601 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.331837  3759 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:33.300514  3432 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.336448  3620 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.378542  1547 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:33.297950  3560 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.382117  1540 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:00:33.397239  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.359081  3713 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:33.336088  3686 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.464186  3768 raft_consensus.cc:3055] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:33.362116  3589 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:33.377607  3700 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:33.327500  3720 consensus_queue.cc:260] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:33.448504  3746 log.cc:927] Time spent T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
W20260709 13:00:33.456055  3754 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260709 13:00:33.415153  3695 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.380313  3598 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:33.414793  3739 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.358933  3561 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.406715  3696 consensus_queue.cc:1059] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:00:33.460501  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:33.468302  3681 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:33.522246  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:33.438197  3541 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:33.440639  3644 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:33.444638  3734 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:33.323916  3757 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.412984  3624 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:33.341279  3701 consensus_queue.cc:260] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.307447  1621 raft_consensus.cc:1240] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:33.459110  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 79025.9us
W20260709 13:00:33.478780  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 152206us
I20260709 13:00:33.382994  3573 consensus_queue.cc:237] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:33.483690  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:33.484527  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 290644us
I20260709 13:00:33.437567  3626 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:33.504117  3761 log.cc:927] Time spent T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:00:33.505185  3722 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:33.508297  3682 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:33.509076  3432 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:33.509770  3560 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:33.510488  3146 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:33.460229  3249 raft_consensus.cc:3055] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:33.540678  3522 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:33.541213  3249 raft_consensus.cc:740] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:33.542161  3249 consensus_queue.cc:260] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.516727  1542 raft_consensus.cc:2393] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:00:33.514998  3607 consensus_meta.cc:287] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.564s	user 0.004s	sys 0.003s
I20260709 13:00:33.468099  3713 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:33.371539  3756 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.452543  3591 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.479704  3768 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:33.560117  1619 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:33.555941  1690 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:33.485991  3653 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:33.519922  3720 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.464488  3765 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:00:33.465540  3620 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.540251  3690 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:33.526153  3541 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:33.528647  3681 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.546455  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1741) took 2228 ms. Trace:
I20260709 13:00:33.462211  3759 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.557091  1618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:00:33.574127  1618 raft_consensus.cc:606] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:33.574496  1618 raft_consensus.cc:614] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:33.555558  3249 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.462769  3601 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.534014  3388 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:33.564002  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.564996  3775 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:33.556655  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:33.462487  3730 consensus_queue.cc:260] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.570628  1693 rpcz_store.cc:276] 0709 13:00:31.317906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.435685 (+1117779us) service_pool.cc:224] Handling call
0709 13:00:32.435992 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.436848 (+   856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.436876 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:32.442658 (+  5782us) log.cc:844] Serialized 26 byte log entry
0709 13:00:32.889313 (+446655us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:32.889352 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.889449 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.546166 (+656717us) raft_consensus.cc:1685] finished
0709 13:00:33.546197 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.546378 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":396,"raft.queue_time_us":2195,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":4267,"thread_start_us":334870,"threads_started":1,"wal-append.queue_time_us":625913}
I20260709 13:00:33.585455  1616 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:33.579167  3780 raft_consensus.cc:3055] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:33.582319  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:00:33.584271  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 53009.6us
I20260709 13:00:33.587481  1544 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:33.588114  1693 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:33.588249  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:33.588474  3724 consensus_queue.cc:1059] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:33.588932  1544 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:33.589514  3724 consensus_queue.cc:1059] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:33.589804  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:33.590530  1546 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:33.570231  3386 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:33.591663   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:33.593055  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.593802   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:33.576365  3532 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:33.602036  3773 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:00:33.608564  1693 raft_consensus.cc:2393] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 4: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:33.604157  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:33.578433  3603 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:33.614673  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:33.615362  1546 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:33.616142  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:33.600666  3730 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.438177  1689 rpcz_store.cc:276] 0709 13:00:29.853711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.740303 (+1886592us) service_pool.cc:224] Handling call
0709 13:00:32.723412 (+983109us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b58001c3598. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:00:32.736946 (+ 13534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.790374 (+ 53428us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:32.838074 (+ 47700us) log.cc:844] Serialized 14 byte log entry
0709 13:00:32.974387 (+136313us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b1800427ea0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb23a 00007fc491735a2a
0709 13:00:33.262165 (+287778us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:33.271130 (+  8965us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:33.280163 (+  9033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.288855 (+  8692us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.316449 (+ 27594us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32726,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2888,"raft.queue_time_us":16695,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":46150,"spinlock_wait_cycles":85322368,"thread_start_us":188342,"threads_started":1,"wal-append.queue_time_us":521333}
I20260709 13:00:33.620272  3601 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:33.621109  3588 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:33.599546  3573 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.607649  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:33.608417  3695 leader_election.cc:290] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:33.624147  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:33.604892  3777 raft_consensus.cc:3055] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:33.595988  3780 raft_consensus.cc:740] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:33.633636  2241 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:33.622432  3686 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:33.644420  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:33.624941  3681 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:33.648383  2244 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:33.649295  3759 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:33.646073  1512 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:33.653317  3688 raft_consensus.cc:3055] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:33.656630  3688 raft_consensus.cc:740] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:33.660209  3757 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:33.660297  3688 consensus_queue.cc:260] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.660844  3757 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:33.630040  3573 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.661356  3757 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:33.662038  3757 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.663033  3573 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:33.660992  1512 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:33.664319  3620 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:33.661535  3688 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.651055  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:33.643152  3777 raft_consensus.cc:740] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:33.667770  1660 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:33.667924  3759 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:33.668622  1512 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:33.671970  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 98699.3us
I20260709 13:00:33.681406  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2147) took 1486 ms. Trace:
I20260709 13:00:33.684566  3692 raft_consensus.cc:3055] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:33.685009  3692 raft_consensus.cc:740] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:33.665454  2237 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:33.693193  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:33.681890  1617 rpcz_store.cc:276] 0709 13:00:32.195394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.196017 (+   623us) service_pool.cc:224] Handling call
0709 13:00:32.196396 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.267297 (+ 70901us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:32.307731 (+ 40434us) log.cc:844] Serialized 14 byte log entry
0709 13:00:32.730499 (+422768us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b18004020a0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb23a 00007fc491735a2a
0709 13:00:33.192975 (+462476us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.291817 (+ 98842us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:33.291869 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:33.291918 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.681164 (+389246us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b54000e6354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:33.681215 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.681337 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":429861,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":4707,"raft.queue_time_us":87810,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":16838,"spinlock_wait_cycles":132460544,"thread_start_us":544296,"threads_started":3,"wal-append.queue_time_us":609524}
I20260709 13:00:33.694131  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:33.643114  3695 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:00:33.612962  3768 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.698808  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:33.700562  3756 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:33.705678  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:33.709350  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:33.688318  3573 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:33.695003  3603 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:33.691586  3626 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:33.670658  3759 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:33.726022  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:33.713409  1512 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:33.694877  3591 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:33.701289  3777 consensus_queue.cc:260] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.718897  3603 raft_consensus.cc:697] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:33.725622  3768 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.731547  3603 consensus_queue.cc:237] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.685874  3692 consensus_queue.cc:260] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.716773  3573 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.740065  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:33.742686  3591 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.743777  3591 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.747090  3591 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:33.747648  3418 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:33.736833  3386 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:33.731551  3777 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.748783  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:33.749792  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.761090  3341 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.750666  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:33.761621  3341 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.763058  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.763832  3341 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:33.733194  3759 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:33.760818  1512 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:33.765563  3756 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:33.739719  3747 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.619s	user 0.001s	sys 0.006s
I20260709 13:00:33.768694  2246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 512) took 1090 ms. Trace:
I20260709 13:00:33.769048  2246 rpcz_store.cc:276] 0709 13:00:32.677930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.678131 (+   201us) service_pool.cc:224] Handling call
0709 13:00:32.678904 (+   773us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.679394 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.679434 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:32.682069 (+  2635us) log.cc:844] Serialized 564 byte log entry
0709 13:00:32.908109 (+226040us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:32.908155 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.908415 (+   260us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.637058 (+728643us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:33.768296 (+131238us) raft_consensus.cc:1685] finished
0709 13:00:33.768325 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.768617 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8488832,"thread_start_us":225685,"threads_started":1,"wal-append.queue_time_us":350184}
W20260709 13:00:33.771670  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.750579  1693 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:33.772734  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:33.778379  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.763734  1695 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:33.752636  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.779171  1694 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:33.748595  3573 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.766978  1512 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:33.766861  3756 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:33.782508  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:33.783905  3749 log.cc:927] Time spent T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.502s	user 0.002s	sys 0.000s
I20260709 13:00:33.787407  1691 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:33.788745  1587 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:33.789897  1545 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:33.791595  3701 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:33.789301  1689 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:33.793715  1587 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:33.789927  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:33.795557  1587 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:33.788652  3768 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:33.792373  3690 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:33.799984  1585 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:33.790663  3688 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:00:33.800505  2238 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:33.803932  1585 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:33.805400  1660 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:33.805764  3681 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:33.806226  3643 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:33.806226  3734 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:33.805809  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:33.806819  3643 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.809773  1585 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:33.811302  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:33.811352  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:33.798462  3032 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:33.813742  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:33.797277  3626 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:33.815490  1585 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:33.814013  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:33.816148  3776 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:33.823503  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:33.824026  3776 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:33.824045  3729 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:33.824527  3776 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.807602  3768 raft_consensus.cc:697] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:33.805855  3560 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:33.826769  1622 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:33.821293  3712 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:33.814440  3620 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:33.811198  3643 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:33.832785  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:33.810510  3690 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.820040  3032 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.835101  1622 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:33.820748  3626 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.803133  3700 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.826525  3386 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:33.844277  3712 raft_consensus.cc:697] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:33.826068  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.848649  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:33.848147  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:33.850761  3653 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:33.851156  3653 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.851512  3653 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.845906  3386 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.860209  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.866122  3573 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.856956  3532 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:00:33.869445  3643 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.843139  3032 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:33.872119  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.872841  1694 raft_consensus.cc:2393] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:33.873989  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.875735  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.879307  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.881773  3032 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.844681  3626 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.883718  1692 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:33.891636  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.894886  2242 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:33.831527  3541 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.896185  1694 raft_consensus.cc:2393] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:33.897323  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.898319  1694 raft_consensus.cc:2410] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:33.901227  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.901710  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:33.902829  1694 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:33.903017  3032 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:33.903688  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.904250  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:33.863116  3386 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:33.875484  3713 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.906581  1511 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:33.906490  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:33.909372  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:33.910395  1694 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:33.909741  1512 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:33.859965  3712 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.901409  3522 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.916518  1511 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:33.896107  3732 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.007s	sys 0.008s
I20260709 13:00:33.908970  3771 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:33.920449  2239 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:33.920887  1511 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:33.909237  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:33.916071  3603 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:33.921717  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:33.921413  3732 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.007s	sys 0.008s
I20260709 13:00:33.918778  3386 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:33.934598  1511 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:00:33.936208  3791 log.cc:927] Time spent T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:00:33.936386  3790 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:00:33.923123  3756 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:33.939725  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.950011  1659 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:33.951411  3742 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:33.951162  3759 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.953337  3682 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:33.953758  3682 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:33.954185  3682 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:33.953823  3780 consensus_queue.cc:260] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:33.922909  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:33.902354  3768 consensus_queue.cc:237] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.921860  3522 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.935380  3386 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:33.941553  3560 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:33.941718  3643 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:33.942414  3700 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:33.945940  3757 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:33.948319  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:33.954449  3573 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:33.956030  1659 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:33.939918  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:33.960180  3386 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:33.920039  3722 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:00:33.933378  3771 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.966132  1659 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:33.968865  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:33.969810  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:33.970355  2246 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.970041  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:33.931915  2238 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:33.970543  1659 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:33.983171  3700 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:33.983605  3700 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:33.983982  3700 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:33.967186  3588 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:33.976058  3532 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:33.978361  3756 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:33.991994  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:33.987738  3335 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.002206  3573 raft_consensus.cc:993] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:34.002709  3573 raft_consensus.cc:1081] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:34.004562  3541 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:34.004663  2246 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:34.008170  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:34.012725  3588 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:34.013209  3588 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.014027  3588 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:34.016229  3522 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:34.019748  3776 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.021256  1622 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:34.019798  3032 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:34.022660  3032 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.024573  3032 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:34.024562  3776 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:34.025167  3742 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:34.025673  3742 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.027698  3742 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:34.032331  3789 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.218s	user 0.003s	sys 0.000s
I20260709 13:00:34.030673  3626 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:34.032599  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:34.033111  3785 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:00:33.993613  1689 raft_consensus.cc:2410] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:34.034621  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:34.035420  1689 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:34.035686  3626 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:34.038100  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.039577  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.040053  3757 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:34.040762  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:34.034921  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:33.964461  3560 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.049414  3653 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:34.050414  3560 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:34.042999  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:33.994201  3780 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.046262  1694 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:33.976392  3739 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.059654  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.048573  3593 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:34.058573  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:34.060451  1547 raft_consensus.cc:2393] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:34.064898  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.059685  1540 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:34.067600  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:34.068909  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.061081  1545 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:34.073110  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.075960  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.077160  1613 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:34.082231  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.082715  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:34.083424  1547 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:34.083045  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.086021  1545 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:34.086692  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 295) took 1661 ms. Trace:
I20260709 13:00:34.091847  3653 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:34.063992  3713 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:34.098096  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:34.096468  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:34.054587  1694 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:34.102025  1694 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:34.104543  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.109071  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.151882  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.154150  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.156064  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:34.157450  1545 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:34.158766  1545 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:34.161981  1547 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:34.163677  1547 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:34.162132  1545 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:34.165020  1547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7aca6dcf002947d6841150860825871b"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39612
I20260709 13:00:34.165700  1547 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:34.166708  1547 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:34.168339  1545 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:34.100724  3601 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.176474  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:34.165632  3750 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.014s	sys 0.018s
W20260709 13:00:34.178689  3750 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.014s	sys 0.018s
I20260709 13:00:34.163125  3626 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:34.179656  3626 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:34.181766  3626 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:34.183732  3628 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:34.185758  3792 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:00:34.099269  1615 rpcz_store.cc:276] 0709 13:00:32.425097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.430274 (+  5177us) service_pool.cc:224] Handling call
0709 13:00:32.465331 (+ 35057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.287482 (+822151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.086373 (+798891us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b540042ca54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:34.086616 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1495753088}
I20260709 13:00:34.178689  3601 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.188392  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 1731) took 1061 ms. Trace:
I20260709 13:00:34.188817  1613 rpcz_store.cc:276] 0709 13:00:33.129296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.129503 (+   207us) service_pool.cc:224] Handling call
0709 13:00:33.129739 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.077642 (+947903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.188178 (+110536us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b54003205d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:34.188338 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2178108672}
I20260709 13:00:34.176769  1547 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.193938  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 905) took 1317 ms. Trace:
I20260709 13:00:34.194311  1690 rpcz_store.cc:276] 0709 13:00:32.876283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.876435 (+   152us) service_pool.cc:224] Handling call
0709 13:00:34.193776 (+1317341us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54002251d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:34.193881 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1422571264}
I20260709 13:00:34.100196  3682 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.198539  1547 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:34.153491  3700 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.195948  3734 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:34.213783  1696 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:34.216480  1617 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:34.231184  3601 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:34.233556  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.234459  1538 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:34.241997  3682 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:34.245157  3739 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:34.247196  3692 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.250440  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1764) took 1095 ms. Trace:
I20260709 13:00:34.250877  1692 rpcz_store.cc:276] 0709 13:00:33.155490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.155654 (+   164us) service_pool.cc:224] Handling call
0709 13:00:33.204387 (+ 48733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.888954 (+684567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.250197 (+361243us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b54002c5e54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:34.250378 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1545380224}
I20260709 13:00:34.252838  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:34.247948  3755 log.cc:927] Time spent T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.964s	user 0.004s	sys 0.000s
I20260709 13:00:34.264649  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:00:34.264887  3766 log.cc:927] Time spent T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.902s	user 0.002s	sys 0.000s
I20260709 13:00:34.266829  3690 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:34.264905  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 898) took 2073 ms. Trace:
I20260709 13:00:34.267726  1619 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
W20260709 13:00:34.270648  3760 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:00:34.271821  3700 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:34.274353  3588 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.283278  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:34.286568  1660 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:34.288000  3601 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:34.304029  3601 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:34.267776  1687 rpcz_store.cc:276] 0709 13:00:32.191771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.777568 (+585797us) service_pool.cc:224] Handling call
0709 13:00:32.777852 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.801551 (+ 23699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.803962 (+  2411us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:32.876007 (+ 72045us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.098088 (+222081us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:33.102388 (+  4300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.119615 (+ 17227us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.194803 (+1075188us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:34.261243 (+ 66440us) raft_consensus.cc:1685] finished
0709 13:00:34.261591 (+   348us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.264822 (+  3231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2191,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":68397824,"thread_start_us":65729,"threads_started":1,"wal-append.queue_time_us":283693}
I20260709 13:00:34.280586  3771 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:34.306017  3742 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:34.306473  3742 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.306705  1692 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:34.306857  3742 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:34.312304  3750 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.312508  3601 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:34.312690  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 965) took 1118 ms. Trace:
I20260709 13:00:34.312860  3750 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:34.313226  1543 rpcz_store.cc:276] 0709 13:00:33.194023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.194168 (+   145us) service_pool.cc:224] Handling call
0709 13:00:33.260926 (+ 66758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.458210 (+197284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.458239 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:33.458281 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:33.458310 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.312483 (+854173us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400069ad4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:34.312529 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.312639 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453233408}
I20260709 13:00:34.314637  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:34.315732  3750 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:34.317464  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:34.317902  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:34.318783  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:34.319319  1546 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:34.319625  3700 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:34.320027  3700 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.320344  3700 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:34.320459  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.321790  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.322665  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:34.323490  1511 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:34.324656  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.325188  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:34.326674  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:34.326835  3765 consensus_queue.cc:1059] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:34.327668  3765 raft_consensus.cc:3055] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:34.328064  3765 raft_consensus.cc:740] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:34.328230  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:34.328796  1617 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:34.328933  3765 consensus_queue.cc:260] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:34.329907  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:34.330339  3765 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:34.331199  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:34.331692  3713 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.331979  1586 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:34.332239  3713 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:34.332690  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:34.333611  3739 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:34.334095  3739 raft_consensus.cc:697] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:34.334344  3713 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:34.334573  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 232) took 1190 ms. Trace:
I20260709 13:00:34.333972  3734 raft_consensus.cc:2955] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:34.334967  1541 rpcz_store.cc:276] 0709 13:00:33.143831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.146843 (+  3012us) service_pool.cc:224] Handling call
0709 13:00:34.334426 (+1187583us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54000d1454. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:34.334518 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553995008}
I20260709 13:00:34.335534  3593 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:34.336098  3593 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.337888  3759 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:34.338828  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:34.340221  3593 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:34.341851  3759 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:34.335060  3739 consensus_queue.cc:237] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:34.345296  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:34.345635  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:34.345861  1511 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:34.347898  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:34.349062  1616 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:34.352713  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:34.353412  1616 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:34.330905  2209 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:34.345703  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:34.331732  1617 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:34.361007  1587 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:34.349103  3541 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:34.364564  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:34.365458  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:34.363739  2209 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:34.366057  1691 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:00:34.370755  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:34.374122  1659 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:34.374455  2209 leader_election.cc:304] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:34.404883  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 43965.2us
I20260709 13:00:34.356042  3146 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:34.427989  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:34.372663  1692 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:34.466629  1587 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:34.371637  3711 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.327761  3386 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.405277  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:34.471877  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:34.468250  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 93895.8us
I20260709 13:00:34.427618  3729 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:34.487859  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:34.488231  1587 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:34.488538  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 65363.3us
I20260709 13:00:34.471187  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:34.476444  2209 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:34.479779  1660 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:34.362349  3686 consensus_queue.cc:1059] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 13:00:34.362036  3682 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 13:00:34.433939  3146 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.493237  1692 raft_consensus.cc:3055] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:34.465960  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:34.480850  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:34.362141  3771 consensus_queue.cc:1059] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 13:00:34.496306  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:34.467388  3762 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:34.497328  1692 raft_consensus.cc:740] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:34.405107  3541 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.499539  1542 raft_consensus.cc:2410] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:34.470417  3738 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.501452  1660 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:34.475903  3620 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:34.375965  3724 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.503388  2209 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:34.529093  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:34.503756  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 129707us
I20260709 13:00:34.505273  2241 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:34.376183  3643 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:34.502699  3603 consensus_queue.cc:1059] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:00:34.504890  3601 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:34.511044  3620 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:34.512434  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:34.491968  3626 consensus_queue.cc:1059] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:00:34.514640  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:34.502676  3692 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.483754  3592 consensus_queue.cc:1059] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:00:34.494503  1615 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:34.520560  3588 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:34.497876  3701 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:00:34.502349  3713 consensus_queue.cc:1059] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:00:34.533006  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:34.554425  2245 raft_consensus.cc:2410] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:00:34.540696  3620 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:34.510670  3762 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.475555  3573 consensus_queue.cc:1059] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:00:34.498951  3146 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:34.483160  3742 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.497259  3729 raft_consensus.cc:697] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:34.538656  1620 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:34.504563  3776 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:34.512604  3653 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:34.532065  1659 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:34.552549  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:34.548000  3724 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:34.371855  3644 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:34.546351  3759 consensus_queue.cc:1059] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:00:34.542312  3643 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:34.633137  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 87017.5us
I20260709 13:00:34.509428  3764 consensus_queue.cc:1059] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:00:34.560393  3560 raft_consensus.cc:3055] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:00:34.637214  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 78549.7us
I20260709 13:00:34.595539  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:34.560834  3588 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:34.556420  3732 raft_consensus.cc:3055] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:34.632114  3776 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:34.656282  1511 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:34.662899  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.658177  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:34.639293  3724 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:00:34.671391  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.631997  3686 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:34.660281  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:00:34.686393  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 184960us
W20260709 13:00:34.687759  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 178800us
I20260709 13:00:34.657437  3560 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:34.659493  3732 raft_consensus.cc:740] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:34.774435  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:34.659101  3588 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:34.663106  3776 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:34.648080  3388 consensus_queue.cc:1059] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:00:34.773581  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:00:34.731652  3805 log.cc:927] Time spent T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:00:34.652118  3644 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:34.673681  3724 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:34.788976  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:34.660218  3757 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.122s
W20260709 13:00:34.793514  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 149892us
I20260709 13:00:34.776402  3764 raft_consensus.cc:3055] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:34.783350  3588 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:34.783069  3541 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:34.776811  3686 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:34.804797  1585 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:00:34.813594  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 281588us
I20260709 13:00:34.829892  1659 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:34.830097  1585 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:34.794274  3653 raft_consensus.cc:697] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:34.822460  1615 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:34.805681  3764 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:34.831025  1659 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:34.816501  3815 raft_consensus.cc:3055] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:34.804580  3688 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:34.833402  3815 raft_consensus.cc:740] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:34.832360  3653 consensus_queue.cc:237] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:34.833587  3688 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:34.832502  3541 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:34.813759  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 157521us
I20260709 13:00:34.834864  3541 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:34.835654  3688 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:34.836071  1659 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:34.836195  3688 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:34.836838  3541 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:34.832479  3764 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:34.835805  3815 consensus_queue.cc:260] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:34.838152  3815 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:34.838053  3764 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:34.838371  3541 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:34.839706  1511 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:34.841028  1511 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:34.836750  3688 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:34.842056  1659 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:34.843155  1659 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:34.844749  1511 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:34.845820  1511 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:34.840807  3541 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:34.849282  3541 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:34.849797  3541 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.851110  3688 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:34.851934  3688 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:34.852547  3688 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:34.854818  3688 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:34.855612  3541 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:34.863214  1585 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:34.889446  1585 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:34.776594  3729 consensus_queue.cc:237] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.890971  1585 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:34.805486  3768 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.865564  3739 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:34.794948  3814 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:34.918464  3032 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:34.919137  3032 raft_consensus.cc:697] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:34.920253  3032 consensus_queue.cc:237] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.902963  3561 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:34.901130  3628 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.926275  3722 raft_consensus.cc:3055] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:34.926702  3722 raft_consensus.cc:740] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:34.894904  3341 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.927467  3722 consensus_queue.cc:260] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.928248  3823 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:34.928089  3813 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:34.928767  3823 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:34.929188  3823 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:34.901284  3712 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.819536  3560 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:34.934463  3686 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:34.935025  3686 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.935644  3686 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:34.938010  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 47148.9us
I20260709 13:00:34.937386  1620 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:34.938771  1585 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:00:34.939515  3810 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:00:34.947345  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:34.916906  3816 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.947937  3681 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:00:34.935662  2238 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:34.940049  3742 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:34.918686  3821 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.966847  1660 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:34.967585  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 134812us
I20260709 13:00:34.944677  3814 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.970144  1585 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:34.944460  3763 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:34.966741  3809 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 13:00:34.940186  3817 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:34.979782  1585 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:34.973634  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:34.965078  3643 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:34.966351  3628 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:34.948696  3739 consensus_queue.cc:1059] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:00:34.962584  3593 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:00:34.979121  3811 log.cc:927] Time spent T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:00:34.958132  3341 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:00:34.991926  3032 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:34.973058  3701 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:34.978863  3762 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:34.985153  3742 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.990059  3821 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.977252  3712 consensus_queue.cc:1059] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 13:00:35.024756  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 178969us
I20260709 13:00:34.992544  3737 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:35.029825  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:35.031667  3815 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:35.034648  3700 consensus_meta.cc:287] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.714s	user 0.010s	sys 0.000s
I20260709 13:00:34.964767  3816 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.037060  3816 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:35.037940  3764 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.038491  3764 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.040252  3712 raft_consensus.cc:3055] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:35.040678  3712 raft_consensus.cc:740] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:00:35.040876  3765 consensus_meta.cc:287] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.005s
I20260709 13:00:34.981317  3814 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.041543  3712 consensus_queue.cc:260] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.043789  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:35.045003  3823 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.046360  3591 raft_consensus.cc:3055] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:35.046816  3591 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:35.047214  3823 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:35.047619  2239 raft_consensus.cc:2410] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:35.035089  3700 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.023994  3739 raft_consensus.cc:3055] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:00:35.049852  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 61702.9us
I20260709 13:00:35.042999  3712 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.047816  1692 consensus_queue.cc:260] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.058897  1511 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:35.059351  1692 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:35.059156  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 79459.4us
I20260709 13:00:35.060073  1511 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:35.065279  3815 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:35.065712  3815 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.066051  3815 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:35.066682  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:35.068159  3335 raft_consensus.cc:3055] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:35.068542  3335 raft_consensus.cc:740] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:35.071164  1690 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:35.072242  3750 raft_consensus.cc:3055] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:35.072631  3750 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:35.073462  3750 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.063915  3823 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:35.075851  3776 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.078172  3776 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:35.030717  3644 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:35.058305  3739 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:35.080281  3739 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.081238  3739 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.020054  3593 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.084923  3593 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:35.025056  3701 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.085935  3724 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:34.661430   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:35.087664  3701 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:35.088009  3724 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:35.088354  1616 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:35.088907  3146 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.090955  3146 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:35.092190  3764 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:35.091899  1443 catalog_manager.cc:5697] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 3 to 4, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:35.048741  3814 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:35.094560  3700 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:35.082726  3620 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.106518  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:35.101817  1511 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:35.110526  2244 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:35.111101  1511 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:35.111491  1690 raft_consensus.cc:2368] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6.
I20260709 13:00:35.098620  3588 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.092752  3541 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.115648  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:35.116283  2244 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:35.116343  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:35.117079  1696 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:35.117528  1511 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:35.121024  3601 consensus_meta.cc:287] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.000s
I20260709 13:00:35.120777  3690 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:35.121690  3601 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:35.122562  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.102610  3593 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:35.124241  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:35.074270  3815 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.129730  1619 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:35.130882  1620 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:35.139485  1692 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:35.139586  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.131093  1693 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:35.125114  2244 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:35.131105  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:35.167099  3780 raft_consensus.cc:3055] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:35.113860  3146 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:35.177732  3780 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:35.178396  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:35.179034  1695 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
W20260709 13:00:35.165894  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 48419.9us
I20260709 13:00:35.127977  3759 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:35.112528  3764 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.202595  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:35.168551  3817 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:35.185377  3588 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:35.188433  3541 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:35.191099  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.208295  1615 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:35.178620  3692 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:00:35.202487  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:35.210150  1619 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:35.177168  3741 consensus_queue.cc:1059] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:35.211468  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.214043  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:35.215116  3541 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:35.116353  3591 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.215795  3541 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.216148  3591 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.217648  2240 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:35.218710  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.203383  2244 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:35.220118  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:35.222239  3541 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:35.206466  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:35.165429  3593 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.206569  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:35.224251  2241 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:35.206846  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:35.225201  2238 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:35.225498  3593 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:35.205118  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.216353  1619 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:00:35.226497  3817 raft_consensus.cc:697] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:35.173578  3341 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.227494  3341 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.227691  3817 consensus_queue.cc:237] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.231794  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:35.232499  2238 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:35.233768  1586 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:35.230927  3341 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:35.167080  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 43662.7us
I20260709 13:00:35.203270  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.238338  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:35.241714  3688 raft_consensus.cc:3055] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:35.242141  3688 raft_consensus.cc:740] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:35.239197  1620 raft_consensus.cc:2393] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:35.251748  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:35.251786  1660 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:35.253456  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58806 (request call id 174) took 10910 ms. Trace:
I20260709 13:00:35.199463  3759 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.257477  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:35.172525  3601 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
W20260709 13:00:35.251968  3840 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:00:35.200387  3620 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:35.260130  3759 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.268489  1443 catalog_manager.cc:5697] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 1 to 3, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:35.256186  3541 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:35.242975  3688 consensus_queue.cc:260] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.239210  3764 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.260195  3588 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:35.259349  3841 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:35.261422  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:35.261188  3692 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:35.262349  3593 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:35.277402  1622 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:35.268633  3700 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:35.280709  1443 catalog_manager.cc:5697] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:00:35.255295  1442 rpcz_store.cc:276] 0709 13:00:24.343041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.357573 (+ 14532us) service_pool.cc:224] Handling call
0709 13:00:35.253391 (+10895818us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:32.098780 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:32.348582 (+249802us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:32.356279 (+  7697us) write_op.cc:435] Acquired schema lock
0709 13:00:32.364346 (+  8067us) tablet.cc:662] Decoding operations
0709 13:00:32.464638 (+100292us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:32.464748 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:32.464789 (+    41us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:00:32.465364 (+   575us) tablet.cc:701] Row locks acquired
0709 13:00:32.465390 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:00:32.465627 (+   237us) write_op.cc:270] Start()
0709 13:00:32.465780 (+   153us) write_op.cc:276] Timestamp: P: 1783602032465577 usec, L: 0
0709 13:00:32.465807 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:00:32.468637 (+  2830us) log.cc:844] Serialized 1686 byte log entry
0709 13:00:33.321916 (+853279us) op_driver.cc:464] REPLICATION: finished
0709 13:00:33.545154 (+223238us) write_op.cc:301] APPLY: starting
0709 13:00:33.554047 (+  8893us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:33.570014 (+ 15967us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:33.586805 (+ 16791us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:33.611497 (+ 24692us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:33.618006 (+  6509us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:00:33.624051 (+  6045us) write_op.cc:312] APPLY: finished
0709 13:00:33.636000 (+ 11949us) log.cc:844] Serialized 41 byte log entry
0709 13:00:33.647432 (+ 11432us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:33.654664 (+  7232us) write_op.cc:454] Released schema lock
0709 13:00:33.655638 (+   974us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:33.663902 (+  8264us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:33.663931 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14389,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":205867,"apply.run_cpu_time_us":3612,"apply.run_wall_time_us":128723,"num_ops":4,"prepare.queue_time_us":343988,"prepare.run_cpu_time_us":97235,"prepare.run_wall_time_us":659584,"raft.queue_time_us":500415,"raft.run_cpu_time_us":21428,"raft.run_wall_time_us":246457,"replication_time_us":826545,"thread_start_us":681382,"threads_started":4,"wal-append.queue_time_us":293346,"wal-append.run_cpu_time_us":18035,"wal-append.run_wall_time_us":1904332}]]}
I20260709 13:00:35.271642  3815 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:35.274153  3541 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:35.284587  1443 catalog_manager.cc:5697] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:00:35.288280  3620 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.288877  3620 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.283227  3593 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:35.295589  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.296861  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:35.297422  1620 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:35.297515  1688 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 2.
I20260709 13:00:35.278935  3588 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.293310  3764 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:35.281953  2238 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:35.298473  2210 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:35.299428  3764 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:35.299470  3588 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:35.299929  3764 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.293324  3750 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:35.300370  3688 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:35.300627  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.278530  3841 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.312481  1692 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:35.315909  1696 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:00:35.308171  1688 raft_consensus.cc:2955] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:35.306977  1587 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:35.317775  3032 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:35.294206  3541 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:35.291200  3620 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:35.317405  3841 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.323177  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:35.320672  1587 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:35.302536  3593 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.305174  3764 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.283713  3692 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.337357  3386 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:35.370481  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.360107  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:35.363859  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 988) took 1531 ms. Trace:
I20260709 13:00:35.324625  3759 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.371769  1542 rpcz_store.cc:276] 0709 13:00:33.832685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.155482 (+322797us) service_pool.cc:224] Handling call
0709 13:00:35.363564 (+1208082us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54001603d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:35.363778 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741048576}
I20260709 13:00:35.362771  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:35.368911  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:35.374231  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:35.374837  1620 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:35.384346  1619 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:35.384258  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.355530  3776 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:35.370656  2237 raft_consensus.cc:2955] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:35.404439  1620 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:35.409754  3759 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:35.411672  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:35.412627  3846 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:00:35.412930  1694 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:35.414296  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:35.416496  1587 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:35.417769  1511 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:35.418823  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:35.419441  1620 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:35.419449  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:35.420221  1619 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.420917  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:35.423417  2242 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.426065  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:35.377660  3690 consensus_queue.cc:1059] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:00:35.416335  1660 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:35.432875  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:35.433207  1620 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:35.431337  3386 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:35.438946  1619 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:35.448007  1688 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.455005  2242 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:35.460907  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:35.429893  3688 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:35.464262  1688 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:35.471282  1691 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:35.445740  3700 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:35.471427  1511 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:35.475711  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1790) took 1058 ms. Trace:
I20260709 13:00:35.476138  1693 rpcz_store.cc:276] 0709 13:00:34.417177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.417317 (+   140us) service_pool.cc:224] Handling call
0709 13:00:34.898406 (+481089us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b58001c3598. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:00:34.898635 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.179944 (+281309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.475479 (+295535us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b5400459554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:35.475652 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558201344}
I20260709 13:00:35.424645  3522 consensus_queue.cc:1059] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:00:35.465186  3561 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:35.455735  3386 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:00:35.479192  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.479874  1587 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:35.463261  3837 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:35.485318  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:35.485771  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.470664  3734 raft_consensus.cc:3055] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:35.466372  3815 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:35.490249  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.466632  3688 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:35.472546  3696 raft_consensus.cc:3055] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:35.472518  3700 raft_consensus.cc:697] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:35.488394  3837 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.495558  3561 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:35.496882  3837 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:35.497212  3561 raft_consensus.cc:697] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:35.497514  1511 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:35.484124  3386 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:35.499878  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.509066  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:35.509640  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:35.509915  1544 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:35.511104  1547 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:35.491881  3734 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:35.513700  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:35.513839  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:35.515344  2209 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:35.525686  1546 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:35.516873  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:35.516687  3700 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.503412  3757 consensus_queue.cc:1059] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:00:35.517339  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:35.518592  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:35.536482  3764 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.538666  3764 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:35.518373  1542 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:35.501679  3739 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:35.519008  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:35.539585  3739 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.540565  1539 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 4: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:35.541749  3739 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:35.542387  3741 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.546164  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:35.546739  1619 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.547025  3541 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.549021  3541 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:35.553007  3335 consensus_queue.cc:260] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.519505  3692 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:35.507026  3827 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:35.494576  3729 raft_consensus.cc:2764] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:00:35.518349  3841 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.495819  3688 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.581444  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.582058  1613 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:35.582177  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:35.582867  1692 raft_consensus.cc:2393] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:35.527782  1696 raft_consensus.cc:2393] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:35.486691  3626 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:00:35.526906  2209 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:35.583827  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:35.584172  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 57367.4us
I20260709 13:00:35.584527  2242 raft_consensus.cc:2368] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:35.585289  2211 leader_election.cc:400] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6.
I20260709 13:00:35.495693  3696 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:35.529237  1585 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:35.585601  2211 leader_election.cc:403] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:00:35.531376  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:35.525769  1545 raft_consensus.cc:2955] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:00:35.567819  1694 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:35.568397  1620 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:00:35.584455  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 87008us
I20260709 13:00:35.598703  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:35.599445  1620 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:35.603323  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:35.604574  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:35.605175  1687 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:00:35.606778  3850 log.cc:927] Time spent T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:00:35.606953  1660 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:35.607930  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:35.609014  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:35.609921  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:35.611070  2211 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:35.498175  3561 consensus_queue.cc:237] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.568507  1691 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:35.569810  1617 raft_consensus.cc:2410] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:35.571695  1619 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:35.576435  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:35.478823  3817 consensus_queue.cc:1059] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:00:35.585968  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:35.586954  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.622829  2243 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:35.570708  3573 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:35.624315  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:35.624882  1691 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:35.625067  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 95892.5us
I20260709 13:00:35.625409  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.626091  1621 raft_consensus.cc:2368] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:35.626613  3712 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:35.626981  1615 raft_consensus.cc:2393] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:35.628144  1621 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:00:35.628441  1586 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:35.627581  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:35.629029  1613 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 4: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:35.629252  1616 raft_consensus.cc:2368] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:35.625023  2239 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:35.630308  2211 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:35.629320  1696 raft_consensus.cc:2393] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:35.627188  1585 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:35.673437  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:00:35.691835  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.654280  3032 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:35.679090  1691 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:35.695644  3032 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:35.690882  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:35.696218  3032 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.696352  1694 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:35.633231  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.671049  1660 leader_election.cc:400] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:35.680042  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:35.698076  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:00:35.701100  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 70856.6us
I20260709 13:00:35.697482  1617 raft_consensus.cc:2368] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:35.699947  1511 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:35.636222  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.697459  1660 leader_election.cc:403] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:35.704788  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.612025  3813 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.701890  1696 raft_consensus.cc:2393] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:35.633179  1620 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:35.628757  3826 raft_consensus.cc:2764] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:35.632716  3742 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:35.681137  3560 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.657294  3690 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.702462  3827 raft_consensus.cc:697] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:35.640321  3573 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.740084  2238 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:35.720157  3816 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.741364  3816 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.742079  3573 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:35.743343  3816 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:35.725359  3742 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.744541  3738 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6.
I20260709 13:00:35.744738  3742 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:35.707306  3764 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.669628  3734 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:35.764492  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 64637.2us
I20260709 13:00:35.767457  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.768222  1620 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:35.768759  1616 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:35.676599  3780 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.680022  3696 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.725353  3700 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:00:35.777561  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:35.762701  3832 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.760092  3620 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:00:35.774041  3522 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:35.769640  3759 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:35.786729  3032 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.791977  2239 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:35.799679  1694 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:35.778800  3817 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:35.781901  3816 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:35.833160  3032 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:35.801304  3591 consensus_meta.cc:287] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.584s	user 0.013s	sys 0.000s
I20260709 13:00:35.838706  1616 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:35.780840  3813 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:00:35.830591  3841 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:35.827718  3522 raft_consensus.cc:697] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:35.783682  3832 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.834263  3816 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.802524  3771 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:00:35.827955  3759 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:35.868708  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.858922  3816 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.837670  3817 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.862224  3591 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.878036  1616 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:35.839128  3827 consensus_queue.cc:237] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.854064  3854 consensus_queue.cc:1059] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
W20260709 13:00:35.883209  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 174994us
W20260709 13:00:35.878690  3593 consensus_meta.cc:287] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.004s
I20260709 13:00:35.886204  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:35.887156   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:35.896536  2210 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:35.878787  3682 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.931480  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42846 (request call id 8) took 17378 ms. Trace:
I20260709 13:00:35.932415  3682 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.927877  3826 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:35.934396  3837 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.935053  3826 raft_consensus.cc:697] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:00:35.935801  3855 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:00:35.935972  3826 consensus_queue.cc:237] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.939009  2237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 534) took 1406 ms. Trace:
I20260709 13:00:35.931980  1545 rpcz_store.cc:276] 0709 13:00:18.553340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.571349 (+ 18009us) service_pool.cc:224] Handling call
0709 13:00:18.638315 (+ 66966us) log.cc:844] Serialized 506 byte log entry
0709 13:00:18.747519 (+109204us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b1800243820. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e5b8c0a 00007fc497cf8219 00007fc48e640a40 00007fc48e63b4e4 00007fc48e63b455 00007fc491684b0b 00007fc491709b63 00007fc491731752 00007fc4966f1d29
0709 13:00:35.931300 (+17183781us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45796,"raft.queue_time_us":93888,"raft.run_cpu_time_us":1861,"raft.run_wall_time_us":121399,"spinlock_wait_cycles":14977920,"thread_start_us":238739,"threads_started":2,"wal-append.queue_time_us":109450,"wal-append.run_cpu_time_us":3348,"wal-append.run_wall_time_us":1170066}
I20260709 13:00:35.881742  3561 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.943140  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.950124  1613 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:35.939479  2237 rpcz_store.cc:276] 0709 13:00:34.533001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.534925 (+  1924us) service_pool.cc:224] Handling call
0709 13:00:35.370079 (+835154us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b5800003998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:00:35.370284 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.370517 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:35.758898 (+388381us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.878077 (+119179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:35.880224 (+  2147us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:35.883276 (+  3052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.891142 (+  7866us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.927767 (+ 36625us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":4526848,"thread_start_us":105750,"threads_started":1}
I20260709 13:00:35.948212  3759 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:35.881418  3591 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.946595  3688 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:35.952406  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.954667  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.954923  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:35.952015  3832 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:35.897228  3692 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.898451  3700 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:35.952247  3856 log.cc:927] Time spent T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:00:35.959050  3759 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:35.952144  3865 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:00:35.966289  1687 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:35.966598  3591 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:35.927932  3522 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.946374  3742 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:35.972582  3386 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.899389  3593 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.954291  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:35.998607  1620 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 4: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:35.979461  3817 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:35.982465  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:36.002592  1619 raft_consensus.cc:2410] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:35.928125  3573 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:35.956398  3854 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.968091  3688 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:35.988476  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 57390.4us
I20260709 13:00:35.966495  3780 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.985064  3759 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.989331  3541 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:36.021526  3700 raft_consensus.cc:697] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:36.022562  3700 consensus_queue.cc:237] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:35.956951  3561 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:36.030295  3816 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.027745  3386 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:36.028339  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.028739  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:36.039459  3560 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.039639  2238 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:36.040069  3560 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:36.040832  3561 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:36.041391  1660 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:36.032356  3837 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:36.018682  3759 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.042418  3560 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:36.034281  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:36.046594  1620 raft_consensus.cc:2393] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:36.026000  3688 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:36.047974  3688 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:36.018019  3573 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.051708  3722 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.053023  3573 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:36.053977  3573 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:36.054379  3573 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.054754  3573 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.007578  3588 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.055596  3588 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:36.057147  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:36.057626  3588 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:36.058696  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:36.059453  1547 raft_consensus.cc:2368] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6.
I20260709 13:00:36.059679  3832 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.060283  3832 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.060612  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:36.063402  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:36.063678  3593 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:36.064426  3593 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:36.065117  3593 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:36.067916  3688 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:36.068786  3832 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:36.069082  3688 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.069505  1512 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:36.079797  1512 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:36.062719  3759 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.087602  3593 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:36.088871  3868 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:36.089393  3759 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:36.091861  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:36.092164  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:36.092414  1620 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.092686  1613 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.094146  1512 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:36.024950  3854 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.108009  1512 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:36.078222  3561 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:36.119632  3868 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:36.120132  3868 raft_consensus.cc:697] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:36.121018  3868 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:36.122963  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.069706  3688 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:36.124073  3561 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.125813  1512 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:36.105759  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.102886  3759 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:00:36.108664  3756 consensus_queue.cc:1059] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:00:36.111157  3573 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:36.115520  1613 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:36.108652  3816 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:36.128778  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 87474.7us
I20260709 13:00:36.137429  1620 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:36.124626  3561 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:36.126796  3688 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:36.125356  3386 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:36.138782  1545 raft_consensus.cc:2955] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:36.127476  3865 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:36.141857  3573 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:36.145273  1547 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:36.146587  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:36.149286  1547 raft_consensus.cc:2393] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:36.149432  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:36.155900  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:36.156160  1542 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:36.158850  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:36.159577  1542 raft_consensus.cc:2368] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6.
I20260709 13:00:36.160305  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:36.160429  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:36.160969  1542 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.161046  1538 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:36.161357  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:36.161607  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:36.161947  1540 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:36.165665  1620 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:36.170198  1538 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:36.177290  1660 leader_election.cc:400] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:36.178316  1660 leader_election.cc:400] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:36.179888  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:36.183147  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:36.183727  1692 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.183979  1538 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:36.179371  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:36.190310  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:36.191059  1688 raft_consensus.cc:2393] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:36.192899  1660 leader_election.cc:400] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4.
I20260709 13:00:36.195860  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:36.203045  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:36.200512  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:36.203133  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:36.203819  1538 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:36.205175  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:36.205643  1543 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:36.206579  1691 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:00:36.207280  3032 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:36.207690  3032 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.210254  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:36.212268  3854 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:36.252382  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.213763  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:36.217130  3032 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:36.217869  3690 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:36.204845  3573 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:36.229710  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:36.255797  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:36.256291  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:36.256804  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:36.257308  1543 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.257634  1538 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:00:36.257944  1538 pending_rounds.cc:85] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 2
I20260709 13:00:36.258160  1538 pending_rounds.cc:107] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:00:36.258365  1538 raft_consensus.cc:2889] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:36.232230  3875 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:36.235352  1540 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:36.259475  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:36.259315  3875 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.259910  1541 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:36.260169  1691 raft_consensus.cc:2393] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:36.261324  3875 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:36.261597  1659 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:36.261840  3875 consensus_queue.cc:1059] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:36.262578  3873 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.262742  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:36.263675  3875 raft_consensus.cc:3055] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:36.264086  3875 raft_consensus.cc:740] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:36.264860  3875 consensus_queue.cc:260] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.265420  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:36.266175  1538 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.235584  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:36.237032  2209 leader_election.cc:400] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6.
I20260709 13:00:36.267267  1539 raft_consensus.cc:2393] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 4: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:36.237782  1585 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:36.223735  1542 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:36.270354  3690 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:36.241887  3561 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:36.254335  3593 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:36.271266  3593 raft_consensus.cc:697] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:36.271478  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:36.250334  1693 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:36.272109  3593 consensus_queue.cc:237] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.253091  1620 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:36.253528  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:36.254823  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:36.270262  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:36.275046  1691 raft_consensus.cc:2393] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 4: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:36.275993  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:36.276700  1688 raft_consensus.cc:2368] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6.
I20260709 13:00:36.276944  1538 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:36.278239  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:36.278806  1620 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:36.247757  1692 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:36.280622  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:36.281818  1659 leader_election.cc:400] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6.
I20260709 13:00:36.282119  1659 leader_election.cc:403] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:36.282235  1585 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:36.284679  1543 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:36.285166  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:36.285732  1617 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.286330  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:36.286480  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:36.287154  1692 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:36.288686  1613 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:00:36.289381  1621 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:36.290319  3335 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.290373  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:36.291404  1659 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:36.292213  3588 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.295513  3591 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:36.296058  3690 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:36.295985  3620 consensus_queue.cc:1059] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:36.296833  3837 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:36.297086  3620 raft_consensus.cc:3055] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:36.297468  3620 raft_consensus.cc:740] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:36.298269  3620 consensus_queue.cc:260] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:36.301455  3869 log.cc:927] Time spent T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 13:00:36.303627  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:36.306756  3732 consensus_queue.cc:260] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.307816  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:36.308040  3732 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:36.309566  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:36.310111  2242 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.309580  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:36.310901  3696 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.311573  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:36.313822  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:36.268525  3573 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:36.315785  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:36.317493  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:36.318049  1691 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:36.319916  1691 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:36.322439  3620 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.328583  3682 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:36.330932  3863 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:36.331482  3863 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:36.334707  3541 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:36.335650  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:36.337049  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:36.338871  1694 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:36.310910  1692 raft_consensus.cc:2393] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:36.341989  3742 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:36.342348  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:36.337715  1659 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:36.333781  3588 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6.
I20260709 13:00:36.345546  3742 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:36.346916  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:36.347674  2237 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:36.348527  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:36.348925  1659 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:36.349440  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:36.284083  1660 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:36.351907  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 67958.3us
I20260709 13:00:36.352852  1660 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:36.352852  1659 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:36.361124  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:36.361332  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:36.361891  2245 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:36.360396  1587 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:36.266220  3875 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.382493  1688 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:36.367600  1617 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:36.370962  2242 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:36.387620  2239 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:36.389410  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:36.392247  1512 leader_election.cc:400] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6.
I20260709 13:00:36.392686  1512 leader_election.cc:403] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:00:36.401294  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:36.412246  1512 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:36.413622  1512 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:36.415776  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:36.416630  2238 raft_consensus.cc:2368] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6.
I20260709 13:00:36.365758  3588 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:36.419386  3588 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:36.419559  3759 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:36.419842  3588 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.419965  3759 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.420377  3759 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.421398  3816 consensus_queue.cc:1059] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:36.422214  3816 raft_consensus.cc:3055] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:36.422523  3816 raft_consensus.cc:740] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:36.423250  3816 consensus_queue.cc:260] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.423694  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:36.424355  3816 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.424466  2237 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:36.419404  3722 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:36.427161  3722 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.427539  3722 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.431430  3522 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6.
I20260709 13:00:36.362447  3863 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:36.434651  3729 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.435174  3729 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.437497  3729 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:36.356366  3742 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.438606  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:36.439224  1693 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:36.440470  1587 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:36.440614  3682 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:36.442011  3729 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:36.442468  3729 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.442888  3729 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:36.444422  3860 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.419s	user 0.003s	sys 0.000s
W20260709 13:00:36.448323  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.454007  3734 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.467581  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:36.468291  2244 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:36.469501  1511 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:36.471809  1617 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:36.365702  3541 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:36.390810  3815 raft_consensus.cc:3055] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:36.485637  1586 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:36.487139  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:36.489634  1538 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:36.490039  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:36.491048  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:36.491679  1538 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:36.491107  1511 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:36.400321  3626 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:36.487766  1546 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:36.493144  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:36.493221  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:36.493916  2246 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.494973  1543 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:36.497363  3626 raft_consensus.cc:697] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:36.501487  1512 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:36.504091  3626 consensus_queue.cc:237] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.484007  3815 raft_consensus.cc:740] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:36.508075  3815 consensus_queue.cc:260] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.509099  2246 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:36.509335  3815 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.509791  1617 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:36.515018  1586 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:36.516002  3032 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:36.476125  3146 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:36.510322  3873 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:36.517750  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:00:36.517724  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 128370us
I20260709 13:00:36.521196  3032 raft_consensus.cc:697] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:36.528916  1660 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:36.412719  3561 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 13:00:36.499375  3776 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:36.546952  3032 consensus_queue.cc:237] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:36.498530  3827 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:36.549911  1511 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:36.547323  1689 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:36.550134  1660 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:36.512290  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:00:36.521606  3860 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.073s	user 0.003s	sys 0.000s
I20260709 13:00:36.516908  3696 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.491704  3588 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.558730  1511 leader_election.cc:400] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6.
I20260709 13:00:36.520720  3700 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:36.520969  3573 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:36.546854  3146 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:36.583985  3146 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:36.587564  1688 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:36.588944  1694 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:36.589572  1585 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:36.559075  3712 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.591483  3712 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.591200  2209 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:36.593700  3712 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:36.593890  3713 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:36.594811  3712 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:36.558252  3591 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:36.597337  3722 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:36.599525  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1005) took 1088 ms. Trace:
I20260709 13:00:36.599961  1545 rpcz_store.cc:276] 0709 13:00:35.510878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.511008 (+   130us) service_pool.cc:224] Handling call
0709 13:00:35.511489 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:35.511846 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:35.697779 (+185933us) log.cc:844] Serialized 14 byte log entry
0709 13:00:36.087170 (+389391us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b1800323e60. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63b455 00007fc4951233c7 00007fc4917359a7 00007fc4917450bf 00007fc491745038
0709 13:00:36.133146 (+ 45976us) log.cc:844] Serialized 14 byte log entry
0709 13:00:36.134199 (+  1053us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.138611 (+  4412us) log.cc:844] Serialized 564 byte log entry
0709 13:00:36.138703 (+    92us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:36.173239 (+ 34536us) log.cc:844] Serialized 14 byte log entry
0709 13:00:36.173451 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.189453 (+ 16002us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:36.443750 (+254297us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:36.599307 (+155557us) raft_consensus.cc:1685] finished
0709 13:00:36.599330 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.599462 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19962,"prepare.queue_time_us":255331,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":18701,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":37446,"spinlock_wait_cycles":15530112,"thread_start_us":221715,"threads_started":2,"wal-append.queue_time_us":291613}
I20260709 13:00:36.551928  3776 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.602464  3776 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.552114  3827 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:36.589481  3690 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:36.603498  3827 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.605149  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:36.605849  1689 raft_consensus.cc:2376] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6. Re-sending same reply.
I20260709 13:00:36.551702  3817 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:36.577824  3588 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:36.611563  1689 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:36.556619  3832 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:36.610010  3560 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:00:36.546552  3863 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:00:36.573154  3696 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:36.631042  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:36.570598  3874 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:36.570881  3522 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:36.608011  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:36.631986  1542 raft_consensus.cc:2410] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:00:36.553066  3873 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:00:36.609391  3712 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:36.624465  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:36.648123  1690 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.629129  1512 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:36.652302  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.671078  1659 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:36.570537  3759 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:36.627046  3817 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:36.676672  1659 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:36.634733  3722 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:36.665637  3712 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.728193  1690 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:36.733124  3573 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:00:36.735297  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 185212us
I20260709 13:00:36.666409  3874 raft_consensus.cc:697] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:36.667481  3832 raft_consensus.cc:697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:36.744343  1696 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:00:36.763480  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 83270.3us
I20260709 13:00:36.672417  3875 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:36.768641  1511 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:36.767168  1585 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:36.679951  3700 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:36.739554  3868 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:36.747771  3541 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:36.748181  3722 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.807121  3626 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:36.834178  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:36.835395  1543 raft_consensus.cc:2393] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 4: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:36.816694  3823 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:36.828687  3817 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.766660  3732 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:00:36.810580  2238 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:36.804513  3692 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:00:36.820717  3700 raft_consensus.cc:697] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:36.804757  3875 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:36.854676  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:36.867996  1622 raft_consensus.cc:2410] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:36.869015  1617 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
W20260709 13:00:36.872295  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.816901  3729 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.841032  3816 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.837782  3742 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:36.826968  3722 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.842483  3541 raft_consensus.cc:697] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:36.898731  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:36.934577  1617 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:36.936221  2210 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:36.860875  3626 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.891144  3573 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.847651  3776 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:36.973239  3900 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:00:36.953719  3341 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.885954  3874 consensus_queue.cc:237] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.892378  3832 consensus_queue.cc:237] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:36.975109  3696 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:37.081749  3885 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.409s	user 0.000s	sys 0.001s
W20260709 13:00:37.118481  3884 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
W20260709 13:00:37.119354  3890 log.cc:927] Time spent T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 13:00:37.119557  3863 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:37.120329  3899 log.cc:927] Time spent T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
W20260709 13:00:37.123728  3898 log.cc:927] Time spent T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:00:37.125742  3722 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:37.128296  3776 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:37.132102  3901 log.cc:927] Time spent T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:00:37.132591  3891 log.cc:927] Time spent T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.456s	user 0.001s	sys 0.000s
I20260709 13:00:37.039683  3573 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:36.952884  3827 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:36.941736  3626 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:37.116285  3815 consensus_meta.cc:287] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.607s	user 0.010s	sys 0.000s
I20260709 13:00:37.079141  3341 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.168069  3626 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:37.184165  3888 log.cc:927] Time spent T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.680s	user 0.011s	sys 0.009s
I20260709 13:00:37.169536  3729 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:37.043573  3700 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.153965  3759 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:37.168064  3827 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:37.153503  3863 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.283612  3863 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:37.233187  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2150) took 1084 ms. Trace:
I20260709 13:00:37.156589  3875 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:37.288084  3341 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:37.178725  3816 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:37.287411  1544 rpcz_store.cc:276] 0709 13:00:36.148375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.148791 (+   416us) service_pool.cc:224] Handling call
0709 13:00:36.149076 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.164476 (+ 15400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.164504 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.182078 (+ 17574us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.569385 (+387307us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:36.569443 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.569542 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.232627 (+663085us) raft_consensus.cc:1685] finished
0709 13:00:37.232659 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.232943 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15074,"raft.queue_time_us":15375,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":6224,"thread_start_us":362724,"threads_started":1,"wal-append.queue_time_us":469484}
I20260709 13:00:37.179911  3712 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.297435  3712 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:37.249562  1513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.000s	sys 0.004s
W20260709 13:00:37.255697  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 319404us
I20260709 13:00:37.301064  3911 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:37.255606  3591 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:37.302491  3591 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.303346  3911 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:37.260936  2243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45882 (request call id 533) took 1373 ms. Trace:
I20260709 13:00:37.154170  3541 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:37.259605  3573 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:37.305545  3591 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:37.259598  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 419283us
W20260709 13:00:37.306862  1513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.000s	sys 0.005s
I20260709 13:00:37.308775  3816 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:37.309719  3816 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:37.311592  3682 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:37.312016  3823 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:37.312774  3823 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:37.312501  3682 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:37.311151  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.005s	sys 0.002s
I20260709 13:00:37.305272  2243 rpcz_store.cc:276] 0709 13:00:35.887457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.887593 (+   136us) service_pool.cc:224] Handling call
0709 13:00:35.887937 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:35.888286 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:35.888312 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:35.895727 (+  7415us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.348079 (+452352us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b18001c20a0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb0d1 00007fc4916e6a0f
0709 13:00:36.571713 (+223634us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:36.571768 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.573943 (+  2175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.260195 (+686252us) raft_consensus.cc:1685] finished
0709 13:00:37.260232 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.260697 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1342,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":44963,"spinlock_wait_cycles":2696064,"thread_start_us":223428,"threads_started":1,"wal-append.queue_time_us":695593}
W20260709 13:00:37.320951  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.006s	sys 0.002s
I20260709 13:00:37.327200  3690 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.328584  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 559926us
I20260709 13:00:37.328289  3690 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.325768  3916 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.339053  3911 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:37.345813  3918 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:37.347092  3841 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.346827  3918 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:37.347811  3841 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.349687  3918 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:37.350698  1511 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:37.358713  3895 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:37.360059  3816 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:37.360929  3682 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:37.368003  3700 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:37.368876  3700 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.370002  3573 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.370827  3573 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.371872  1512 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:37.373309  3573 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:37.373889  3573 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.374648  3573 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:37.376379  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:37.378507  3690 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:37.379597  3573 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:37.364670  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:37.383687  3341 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:37.385442  3341 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.350373  3841 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:37.391213  3560 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:37.391924  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:37.392023  3560 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:37.393113  1696 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:37.394665  3560 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:37.400171  3341 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:37.401036  3682 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:37.402055  3682 raft_consensus.cc:697] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:37.403870  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:37.404248  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:37.406507  1689 raft_consensus.cc:3055] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:37.407078  1689 raft_consensus.cc:740] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:37.404889  2242 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:37.391062  1546 raft_consensus.cc:1275] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:37.403867  3682 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:37.420972  3146 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:37.421697  3146 raft_consensus.cc:697] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:37.423596  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:37.424551  2237 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:37.424548  1696 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:37.427683  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:37.429136  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:37.429874  1696 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.435814  3690 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.435989  1586 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:37.436579  3690 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.438244  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:37.442327  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 77825.3us
I20260709 13:00:37.443303  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:37.444180  1695 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:37.445592  1691 raft_consensus.cc:2393] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:37.446542  3700 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:37.446424  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:37.447598  1691 raft_consensus.cc:606] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:37.447714  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:37.448490  1695 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:37.450940  1691 raft_consensus.cc:1240] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:37.447609  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:00:37.451467  1622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2193) took 1853 ms (client timeout 1654 ms). Trace:
I20260709 13:00:37.452016  3729 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:37.452167  1692 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.452646  3729 raft_consensus.cc:697] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:00:37.452250  1622 rpcz_store.cc:269] 0709 13:00:35.598215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.607682 (+  9467us) service_pool.cc:224] Handling call
0709 13:00:37.450994 (+1843312us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54003200d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:37.451193 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2895222016}
I20260709 13:00:37.454052  3729 consensus_queue.cc:237] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:37.422986  3146 consensus_queue.cc:237] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.461248  1694 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:37.464026  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:37.464113  1694 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:37.464699  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:37.464869  1617 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:37.465412  2246 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:37.451538  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:37.408260  1689 consensus_queue.cc:260] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:37.452661  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:37.470059  2238 raft_consensus.cc:2393] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 4: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:37.469920  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:37.470507  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:37.471117  1620 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 7: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:37.471310  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:37.471536  1619 raft_consensus.cc:2393] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:37.467684  1695 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:37.473574  2237 raft_consensus.cc:1240] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:37.469851  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:37.475126  1616 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:37.474442  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 967) took 1298 ms. Trace:
I20260709 13:00:37.484603  1689 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:37.484369  1687 rpcz_store.cc:276] 0709 13:00:36.175747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.192065 (+ 16318us) service_pool.cc:224] Handling call
0709 13:00:36.216119 (+ 24054us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.264782 (+ 48663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.264825 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.451619 (+186794us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b2c00151d48. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc490024a11 00007fc490034372 00007fc491766a01 00007fc49172b43a 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2
0709 13:00:36.452112 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.528740 (+ 76628us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:36.559320 (+ 30580us) log.cc:844] Serialized 14 byte log entry
0709 13:00:36.576937 (+ 17617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.473859 (+896922us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b5400450e54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:37.473944 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.474012 (+    68us) raft_consensus.cc:1685] finished
0709 13:00:37.474032 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.474242 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7290,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":15594,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":186,"spinlock_wait_cycles":135720192,"thread_start_us":64734,"threads_started":1,"wal-append.queue_time_us":170466}
I20260709 13:00:37.495599  1692 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:37.496622  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:37.505070  1619 raft_consensus.cc:2368] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5.
I20260709 13:00:37.468182  3690 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:37.507740  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.508617  1622 raft_consensus.cc:1240] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:37.508955  1660 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:37.498241  1587 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:37.437951  3863 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:37.472452  3910 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.370s	user 0.001s	sys 0.003s
I20260709 13:00:37.500798  1511 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:37.518603  2242 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:37.503557  3823 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.512804  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:37.520206  1587 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:37.521800  1696 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:37.519529  3841 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:00:37.529342  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:37.530130  3620 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:37.530648  3620 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.531047  3620 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:37.467481  3916 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:37.528895  1689 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:00:37.534880  2243 raft_consensus.cc:2368] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6.
I20260709 13:00:37.534986  3032 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:37.535534  3032 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.535876  3032 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.536859  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:37.537670  1540 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:37.519618  3591 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:37.539394  3868 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:37.541348  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:37.532513  1689 pending_rounds.cc:85] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 5
I20260709 13:00:37.552235  1689 pending_rounds.cc:107] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:00:37.560228  1689 raft_consensus.cc:2889] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:37.542224  3591 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.532001  1687 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
W20260709 13:00:37.568506  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 70087.1us
I20260709 13:00:37.569391  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:37.579936  1693 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:37.580240  1587 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:37.580991  1586 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:37.582196  3918 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:37.582207  3626 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:37.582588  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:37.582887  3918 raft_consensus.cc:697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:37.583123  3626 raft_consensus.cc:697] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:37.584275  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:37.584123  3918 consensus_queue.cc:237] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:37.584726  3837 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:37.584889  1543 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:37.585347  3837 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.588301  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:37.552124  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:37.581043  1546 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:37.590054  3032 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.600327  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:37.563782  3591 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.602406  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:37.602437  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:37.610140  1544 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.612613  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:37.613256  1622 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:37.568804  3863 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:37.621588  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:37.616140  3386 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:37.623961  3823 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:37.624313  1692 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:37.648964  1544 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
W20260709 13:00:37.624845  1443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42122 (request call id 239) took 13193 ms (client timeout 15000 ms). Trace:
I20260709 13:00:37.627362  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:37.628782  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:37.629050  1660 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:37.647965  1696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
W20260709 13:00:37.648164  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 45178.2us
I20260709 13:00:37.648196  3032 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:37.587594  3837 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:37.620873  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:37.660723  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:37.662736  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:37.667402  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:37.667758  3386 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:37.670637  3386 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:37.662839  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:37.677150  1688 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:00:37.681635  1622 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:00:37.660199  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:37.649722  1443 rpcz_store.cc:269] 0709 13:00:24.430956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.444545 (+ 13589us) service_pool.cc:224] Handling call
0709 13:00:37.624574 (+13180029us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:35.370382 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:35.371042 (+   660us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:35.371081 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:00:35.371102 (+    21us) tablet.cc:662] Decoding operations
0709 13:00:35.388683 (+ 17581us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:35.388776 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:35.388810 (+    34us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:00:35.389284 (+   474us) tablet.cc:701] Row locks acquired
0709 13:00:35.389306 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:00:35.389466 (+   160us) write_op.cc:270] Start()
0709 13:00:35.389592 (+   126us) write_op.cc:276] Timestamp: P: 1783602035389421 usec, L: 0
0709 13:00:35.389628 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:00:35.390333 (+   705us) log.cc:844] Serialized 1706 byte log entry
0709 13:00:35.847941 (+457608us) op_driver.cc:464] REPLICATION: finished
0709 13:00:35.973920 (+125979us) write_op.cc:301] APPLY: starting
0709 13:00:35.974012 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:35.974170 (+   158us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:35.979581 (+  5411us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:35.986334 (+  6753us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:35.986526 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:00:35.986572 (+    46us) write_op.cc:312] APPLY: finished
0709 13:00:36.025137 (+ 38565us) log.cc:844] Serialized 41 byte log entry
0709 13:00:36.026296 (+  1159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:36.026402 (+   106us) write_op.cc:454] Released schema lock
0709 13:00:36.026444 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:36.026773 (+   329us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:36.026803 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1262059,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":125702,"apply.run_cpu_time_us":3271,"apply.run_wall_time_us":52846,"num_ops":4,"prepare.queue_time_us":80780,"prepare.run_cpu_time_us":42979,"prepare.run_wall_time_us":128605,"raft.queue_time_us":48336,"raft.run_cpu_time_us":7935,"raft.run_wall_time_us":84863,"replication_time_us":445519,"thread_start_us":234081,"threads_started":4,"wal-append.queue_time_us":285382,"wal-append.run_cpu_time_us":3187,"wal-append.run_wall_time_us":1346990}]]}
I20260709 13:00:37.684533  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:37.687423  1544 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:37.695322  1696 raft_consensus.cc:606] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:37.695796  1696 raft_consensus.cc:614] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:37.705572  1543 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:37.706646  1542 raft_consensus.cc:2393] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 3: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:37.708499  1587 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:37.710215  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:37.710983  1544 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.716496  2210 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:00:37.718564  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 120501us
I20260709 13:00:37.723946  1538 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:37.733337  1546 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:37.721336  3032 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:37.655689  3626 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.729727  1547 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:37.733219  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:37.738235  1543 raft_consensus.cc:1240] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:37.749032  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 120145us
I20260709 13:00:37.749513  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:37.750136  1695 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.749079  3923 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.733054  3863 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:37.756412  3863 raft_consensus.cc:697] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:37.755977  3923 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.757403  3863 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:37.727821  3841 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:37.711488  3690 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:00:37.751101  1660 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:37.777277  3874 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:37.777972  3874 raft_consensus.cc:697] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:37.781591  1695 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:37.787878  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:37.788853  2237 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:37.790055  1586 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:37.717388  3837 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:00:37.762534  3916 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:37.848407  3341 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:37.846839  3742 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:37.806880  3874 consensus_queue.cc:237] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.844492  3911 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.875988  3742 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:37.876295  3911 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:37.878588  3742 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:37.806352  3729 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:37.879071  3911 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:37.879492  3729 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.765545  3841 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:37.879993  3729 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.880038  3841 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.782498  3865 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 13:00:37.841730  3032 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.886454  3729 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:37.861234  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 110219us
I20260709 13:00:37.840474  3868 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:37.875051  3341 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.892681  1587 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:37.895807  3032 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:37.758895  3923 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:37.905970  3032 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:37.906863  3032 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:37.907907  3032 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.947968  1660 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:37.954071  3837 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.963910  1544 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:37.973978  3692 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:37.974126  3917 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.974466  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:37.974809  3917 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:37.974865  3692 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:37.977083  3917 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:37.973996  1445 catalog_manager.cc:5697] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 1 to 4, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:37.974057  3814 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:37.979753  3814 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.980134  3814 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:37.984509  3692 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:37.987605  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:37.998032  3573 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:37.958580  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:38.007447  2239 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:38.001307  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:38.010921  2238 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.954046  3868 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.000186  1445 catalog_manager.cc:5697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 1 to 2, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.018563  3868 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:38.030541  3938 log.cc:927] Time spent T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:00:38.028246  2237 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:38.035261  3914 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.035917  1688 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:00:38.035849  3914 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:37.964851  3837 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.038754  3837 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:38.043171  2238 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
W20260709 13:00:38.044629  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 49332.8us
I20260709 13:00:38.053164  1660 leader_election.cc:400] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5.
I20260709 13:00:38.053612  1660 leader_election.cc:403] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:38.003420  3541 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:38.056222  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 96109.5us
I20260709 13:00:38.050184  3868 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.067138  3341 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:38.067821  3823 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:38.068461  3823 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:38.070709  3823 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:38.072505  3729 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:38.073405  3875 raft_consensus.cc:993] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
W20260709 13:00:38.076273  3620 consensus_meta.cc:287] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.002s
I20260709 13:00:38.055351  3591 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:38.081936  3591 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:38.059475  3541 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.085417  3541 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:38.076938  3620 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.063647  1445 catalog_manager.cc:5697] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 3 to 4, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:38.091305  3918 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.091677  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:38.063715  3868 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.092278  1622 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:38.093323  3626 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:38.091856  3918 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.112082  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:38.113798  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:38.051105  3841 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.118886  1512 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:38.096447  3591 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.121523  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:38.129184  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:38.122032  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:38.134495  1543 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:38.136013  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:38.132498  2210 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:38.147688  1622 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:38.155661  3949 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.155927  3591 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.158151  3591 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:38.149245  1445 catalog_manager.cc:5697] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 2 to 5, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:38.161391  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 103518us
W20260709 13:00:38.170614  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 67617us
I20260709 13:00:38.173837  3951 raft_consensus.cc:1081] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:38.173619  1445 catalog_manager.cc:5697] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 2 to 3, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:38.175460  1445 catalog_manager.cc:5697] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 2 to 3, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.176553  2238 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:38.181664  3949 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5.
I20260709 13:00:38.183393  3713 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:38.183982  3713 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.184434  3713 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.159642  3560 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.121075  3626 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.160549  3923 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.218055  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:38.219360  2239 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.206058  1659 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:38.231490  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 178770us
I20260709 13:00:38.207086  2238 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:38.206344  3823 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:38.207633  3682 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.254215  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:38.254913  1688 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:38.257898  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:38.258989  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 200837us
I20260709 13:00:38.261336  2239 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:38.264047  1511 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:38.267943  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:38.269158  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:38.269740  1694 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:38.229132  3868 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:38.273784  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:38.245623  3823 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.218788  3560 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.280120  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:38.273342  2237 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:38.287040  1695 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:38.252914  3875 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:38.292342  1694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:38.294287  1689 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
W20260709 13:00:38.299649  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 55488.9us
I20260709 13:00:38.300951  1622 raft_consensus.cc:1275] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:38.302872  1616 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:38.308843  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:38.293059  1694 raft_consensus.cc:606] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:38.273597  3692 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:38.290614  3823 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.255519  3865 consensus_queue.cc:1059] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:00:38.324167  3032 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:38.293381  3620 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:38.331985  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 43986.4us
I20260709 13:00:38.333786  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:38.301187  3875 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:38.335942  1512 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:38.306453  3841 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:38.274219  3923 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.338119  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:38.324539  1585 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:38.283419  3682 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:38.348912  1585 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:38.354525  1622 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:38.358822  1587 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:38.350425  1616 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:00:38.361354  1616 pending_rounds.cc:85] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 3
I20260709 13:00:38.361742  1616 pending_rounds.cc:107] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:00:38.362084  1616 raft_consensus.cc:2889] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.292199  3816 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:00:38.364187  3032 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:38.349962  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 77396.5us
I20260709 13:00:38.339745  3875 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:38.350920  3918 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:38.374279  1660 leader_election.cc:400] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6.
I20260709 13:00:38.379396  1660 leader_election.cc:403] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:38.320803  3692 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:38.366757  3620 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:38.364775  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:38.391228  3682 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:38.391335  3776 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:38.392400  3776 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.392901  3776 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.389385  1587 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:38.352445  3386 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:00:38.425792  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:38.427382  2245 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:38.427512  3918 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:38.428527  3918 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:38.413682  3945 log.cc:927] Time spent T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.209s	user 0.001s	sys 0.001s
I20260709 13:00:38.432999  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:38.437700  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:38.442902  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:00:38.443918  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 97968.8us
I20260709 13:00:38.445372  1691 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:38.428995  3522 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:38.466010  3923 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:38.466624  3722 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:38.467149  3722 raft_consensus.cc:697] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:38.468096  3722 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:38.470858  3759 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.130s
I20260709 13:00:38.422118  3561 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:38.473856  3522 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:38.474845  3522 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:38.448194  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 58910.7us
W20260709 13:00:38.453033  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 84419.2us
I20260709 13:00:38.393321  3957 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:38.453678  3573 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6.
I20260709 13:00:38.485392  3742 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:38.456555  3776 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.487504  3957 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.414244  2237 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:38.487939  3956 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:38.487960  3776 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:38.463322  3712 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:38.476011  3966 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:38.490832  3712 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.458639  3837 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:38.492087  3837 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:38.492499  3837 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.493095  3712 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:38.463514  3626 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:38.490023  3957 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:38.491389  3966 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.485534  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:38.496083  1687 raft_consensus.cc:2393] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 4: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:38.496260  3966 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:38.497186  3814 consensus_meta.cc:287] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.517s	user 0.012s	sys 0.000s
I20260709 13:00:38.497681  3814 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.498800  1694 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:38.500454  3814 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:38.503639  2237 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:38.508713  3837 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.509251  3541 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.495995  3692 leader_election.cc:290] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:38.510228  3560 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:38.515133  3823 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.519213  3966 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:38.519666  1660 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:38.520390  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:38.521171  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:38.475711  3914 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:38.521253  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:38.522123  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:38.555560  1689 raft_consensus.cc:606] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
W20260709 13:00:38.555847  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 203723us
I20260709 13:00:38.556033  1689 raft_consensus.cc:614] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:38.525539  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:38.464624  3918 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:38.558123  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:38.558727  1694 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.564402  1586 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:38.573678  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:38.574542  1695 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:38.584592  1690 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:38.565598  3814 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:38.562337  1687 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:38.610301  2239 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:38.604602  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:38.586411  3560 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:38.605546  3742 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.579278  3816 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:00:38.617998  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:38.618680  1620 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:38.610140  3713 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:38.622537  3823 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:38.595441  3573 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.623708  3573 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:38.624919  3837 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:38.625893  3953 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.626142  3573 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:38.626590  3953 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:38.603385  3814 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.638757  1694 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
W20260709 13:00:38.640417  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 252513us
I20260709 13:00:38.609688  3874 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:38.618043  3742 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.658100  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:38.658713  3953 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:38.658870  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 322953us
I20260709 13:00:38.613446  3692 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.669296  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:38.670950  2237 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:38.643394  3814 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:38.640974  3560 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:38.691212  1621 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 13:00:38.687424  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 338554us
I20260709 13:00:38.699684  1615 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:38.743577  1585 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:38.744443  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:38.746031  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:38.753386  1585 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:38.707912  3541 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:38.707804  3742 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:38.761566  1585 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:38.762606  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:38.763610  2242 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:38.756012  1660 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:38.748199  1687 raft_consensus.cc:606] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:38.769351  1512 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:38.702731  3712 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:00:38.757990  3917 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:38.777581  1585 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:38.706017  3875 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.760632  3957 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:38.769667  3742 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:38.767627  3626 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:38.768266  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:38.749723  3692 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:38.746280  3874 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.791283  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:38.771608  1687 raft_consensus.cc:614] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:38.796146  3776 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:38.811594  3776 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:00:38.812060  3972 log.cc:927] Time spent T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:38.812158  3776 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.812526  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:38.813151  1618 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:38.814513  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:38.815141  1696 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:38.816148  3750 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.816274  2210 leader_election.cc:304] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:38.816670  3750 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.818766  3750 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:38.819585  1620 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:38.811590  3713 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:38.821098  1660 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:38.821492  3713 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:38.821938  3713 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:38.822299  3713 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.827553  3776 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:38.830962  3875 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:38.796671  3620 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:38.830775  3776 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:38.796624  1585 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:38.805263  3918 consensus_queue.cc:1059] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:00:38.836167  2246 raft_consensus.cc:2410] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:38.836577  3918 raft_consensus.cc:3055] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:38.837016  3918 raft_consensus.cc:740] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:38.837095  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:38.784708  3914 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:00:38.808422  3560 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:38.843119  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 46589.3us
I20260709 13:00:38.798596  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:38.846601  1694 raft_consensus.cc:2368] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6.
I20260709 13:00:38.783421  3722 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:38.790482  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:38.781695  3917 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:38.788076  3729 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:38.808580  1693 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:38.819307  3960 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:00:38.859150  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:38.860689  1694 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.846971  1587 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:38.781991  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 335898us
W20260709 13:00:38.849056  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 56005.4us
I20260709 13:00:38.871268  1692 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:38.808857  3742 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:38.855710  3722 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.878252  1693 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:38.807389  3626 raft_consensus.cc:697] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:38.871778  2209 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:38.875406  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:38.876575  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:38.855957  3917 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.881340  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:38.862291  3573 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:38.879730  3722 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.887638  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:38.888808  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:38.889945  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:38.892010  3969 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.891747  3742 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:38.892567  3969 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.892935   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:38.894713  3969 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:38.895768  3823 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:38.896344  3823 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.898357  3823 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:38.872749  3776 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:38.898980  3776 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.899379  3776 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:38.899750  3682 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:38.838132  3918 consensus_queue.cc:260] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.900585  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:38.900359  3682 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:38.859407  3841 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:38.902602  3983 log.cc:927] Time spent T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:38.902828  3682 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:38.888880  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:38.914903  3759 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:38.915566  1622 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:38.916607  3865 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:38.916651  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:38.917302  3865 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:38.918380  3914 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.918592  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:38.918972  3914 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:38.909691  1618 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:38.912956  1694 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:00:38.856084  3729 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.913684  3977 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:38.891014  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:38.904137  3146 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.935894  3146 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.859402  3814 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:38.923394  3987 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:00:38.943854  3895 raft_consensus.cc:3055] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:38.944545  3895 raft_consensus.cc:740] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:38.944919  3814 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:38.926766  3729 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:38.918041  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:00:38.913450  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 44880.1us
I20260709 13:00:38.891754  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:38.948200  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:38.965011  1622 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.934882  1621 raft_consensus.cc:2368] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6.
I20260709 13:00:38.946347  3992 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:38.949863  3960 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:38.950434  3951 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:38.974095  1587 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:39.010886  3032 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:39.011682  3032 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:39.031224  1587 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:39.034085  1587 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:39.034389  3146 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:39.036397  1587 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:38.945744  3895 consensus_queue.cc:260] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:39.039454  3032 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:39.040280  3032 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:39.040719  3032 raft_consensus.cc:697] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:00:39.042791  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 171074us
I20260709 13:00:39.043408  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:38.973476  3814 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:39.061389  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:39.061666  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:39.033041  3712 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:39.067852  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:39.070768  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:39.038683  3620 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:39.041792  3963 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:39.076455  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.077004  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:39.079672  1696 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:00:39.074328  3032 consensus_queue.cc:237] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.083010  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.083657  1546 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:39.070168  2211 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:39.085682  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:39.086828  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:39.089816  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:39.090380  1540 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.068940  3712 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.093206  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.087019  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.095399  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.095597  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:39.030354  3960 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:39.096011  1543 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:39.073951  3949 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:39.097891  1538 raft_consensus.cc:2410] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:39.107630  1622 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:00:39.079120  3963 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:39.139809  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:39.069360  3977 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:00:39.097685  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.069572  3814 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.083930  3620 raft_consensus.cc:697] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:39.146867  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.096624  3712 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.042155  3626 consensus_queue.cc:237] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.144060   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:39.152968  3776 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.098459  3949 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:39.153934  2240 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:00:39.154137  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:39.188249  1614 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.154366  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:39.154784  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.189332  2243 raft_consensus.cc:2368] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:39.155390  1543 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:00:39.156919  1622 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:39.158921  2241 raft_consensus.cc:1240] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:39.159616  3988 log.cc:927] Time spent T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:00:39.159497  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.160091  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:39.189239  1547 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:39.194125  1538 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.160517  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.162362  3814 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:39.099423  3914 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:39.160511  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.169104  3620 consensus_queue.cc:237] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.170606  3573 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:39.213421  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.215616  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.181293  3984 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:39.182267  3999 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:39.182727  3682 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:39.183262  3865 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:39.184019  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:39.032891  3951 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.144641  3963 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.145069  3522 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:39.155821  3895 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:39.218482  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:39.232681  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.220489  1618 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:38.977602  3992 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:39.193317  3949 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.160554  3991 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:39.229763  1540 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:39.232913  1622 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:39.224176  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:39.218369  3573 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.235954  3682 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.242106  3522 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.249289  3682 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:39.249410  3522 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:39.235230  3916 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:39.250218  3916 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.238602  3875 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:39.251674  3875 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:39.252224  3916 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:39.253950  3875 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:39.254931  1546 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:39.255470  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:39.256184  1543 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:39.256434  1542 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:39.256341  1546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39612
I20260709 13:00:39.257107  1546 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:39.257217  1543 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:39.257488  1546 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.262053  1539 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:39.227650  3984 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:39.259642  1547 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:39.267087  1538 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:39.269090  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.270052  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:39.277879  1538 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:00:39.281826  1538 pending_rounds.cc:85] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 3
I20260709 13:00:39.282673  1538 pending_rounds.cc:107] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:00:39.237787  3713 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:39.278998  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:39.285620  1618 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:39.239349  3729 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.285696  1622 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:39.282992  1538 raft_consensus.cc:2889] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:39.279021  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 214402us
I20260709 13:00:39.304601  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:39.317939  1615 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:00:39.321506  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.321900  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:39.323652  1616 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:39.321789  3951 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:39.329670  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:39.308691  3960 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:39.330432  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:39.334817  1538 raft_consensus.cc:2368] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8.
I20260709 13:00:39.316944  3991 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:39.337683  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:39.283043  3722 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:39.332031  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.332199  3974 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:00:39.308465  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:39.336017  1541 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:39.305686  3917 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.343693  3776 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:39.349134  1616 raft_consensus.cc:1240] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:39.349817  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.351828  3729 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:39.353163  3722 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:39.353675  1544 raft_consensus.cc:2368] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4.
I20260709 13:00:39.361855  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:39.364516  1538 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.368397  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:39.358556  1546 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:39.366083  3712 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.385430  1540 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:39.395112  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:39.399252  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.399758  1546 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:39.412250  1538 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:39.412789  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:39.399724  3951 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:39.416448  1618 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:39.419636  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.419746  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:39.395781  3992 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:39.414240  3984 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:39.421523  3951 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:39.421950  3713 leader_election.cc:290] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:39.420809  1538 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:39.435952  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.439733  3917 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:39.442461  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:39.451515  1614 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:39.455961  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:39.458328  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.460736  1541 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:00:39.472740  3951 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:39.466928  3814 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:39.466938  3957 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:39.473824  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:39.474480  3957 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.475526  1621 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:39.476797  3957 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:39.473848  3814 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.492161  3712 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:39.491848  3963 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.493048  1616 raft_consensus.cc:1240] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:39.493371  3814 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:39.476727  1621 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:39.478919  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:39.496309  3963 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:39.496541  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:39.480300  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:39.482985  4011 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:39.504487  1659 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:39.505115  1538 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:39.507027  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:39.507686  2243 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.510723  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:39.498659  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:39.512426  1539 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:39.513922  3999 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:39.513689  3722 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:39.515045  3969 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:39.515451  3969 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:39.516436  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:39.516291  3969 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:39.519052  3895 consensus_queue.cc:1059] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:39.520274  3816 raft_consensus.cc:3055] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:39.520643  3816 raft_consensus.cc:740] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:39.521492  3816 consensus_queue.cc:260] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:39.522217  1585 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:39.523523  3712 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:39.523121  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:39.525239  3692 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:39.526652  3816 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:39.527437  1512 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:39.528177  3868 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:39.530483  1512 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:39.531667  2245 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:39.531965  3969 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.536791  1585 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:39.537329  1512 leader_election.cc:400] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6.
I20260709 13:00:39.537685  1512 leader_election.cc:403] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:39.539565  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:39.540396  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:39.544134  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:39.499226  3951 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.557494  1512 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:39.556823  1659 leader_election.cc:400] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8.
I20260709 13:00:39.558252  1659 leader_election.cc:403] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:00:39.546326  1585 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:39.560289  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:39.561434  1585 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:39.555301  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:39.555918  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:39.566836  3146 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:39.556043  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:39.567380  3146 raft_consensus.cc:697] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:39.567693  1616 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.576655  1585 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:39.580619  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:39.581151  1585 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:39.588814  2209 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:39.590284  2209 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:39.593425  1687 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:39.597831  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:39.544073  3712 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:39.544854  3541 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:39.598886  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:39.602715  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:39.610162  1693 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:39.610862  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:39.604051  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:39.606626  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:39.608273  1546 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:39.544854  3868 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:39.602762  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:39.619072  1692 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.619463  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.620839  1540 raft_consensus.cc:3055] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:39.621297  1540 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:39.623929  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:39.624133  1585 leader_election.cc:400] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4.
I20260709 13:00:39.624552  1538 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.624641  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:39.622263  1540 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:39.570710  3954 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:39.626261  1540 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.579466  3690 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:39.566291  3522 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6.
I20260709 13:00:39.587620  3823 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:39.632644  3146 consensus_queue.cc:237] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.628715  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2224) took 1094 ms. Trace:
I20260709 13:00:39.581477  3963 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:39.553893  3875 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:00:39.591209  3837 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:39.556864  3957 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:00:39.580541  3814 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:00:39.571148  3682 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:00:39.580731  3951 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.599426  3620 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:00:39.618939  3341 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:39.669543  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:39.693830  1689 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.693964  1540 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:00:39.694402  1540 pending_rounds.cc:85] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 6
I20260709 13:00:39.652035  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:39.694651  1540 pending_rounds.cc:107] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:00:39.662679  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:39.651547  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.624284  3868 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.618595  3911 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:39.609861  3970 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:39.691411  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:39.665063  2210 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:39.697649  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:00:39.667920  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 111211us
I20260709 13:00:39.701066  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.706233  1540 raft_consensus.cc:2889] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:39.718182  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:39.657450  3960 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8.
I20260709 13:00:39.703545  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:39.633911  3954 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.732645  1692 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:39.662619  3874 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:39.692883  3837 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:39.650532  3690 raft_consensus.cc:697] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:00:39.741570  4018 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.074s	user 0.000s	sys 0.002s
I20260709 13:00:39.744768  3868 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.635375  1619 rpcz_store.cc:276] 0709 13:00:38.526169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.527392 (+  1223us) service_pool.cc:224] Handling call
0709 13:00:38.527717 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:38.527968 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:38.755160 (+227192us) log.cc:844] Serialized 14 byte log entry
0709 13:00:39.514740 (+759580us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b1800264fa0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc4912d34bc 00007fc48e62148b 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb23a
0709 13:00:39.595543 (+ 80803us) log.cc:844] Serialized 14 byte log entry
0709 13:00:39.595940 (+   397us) log.cc:844] Serialized 14 byte log entry
0709 13:00:39.599868 (+  3928us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:39.599923 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:39.599971 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.600032 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.620647 (+ 20615us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50450,"prepare.queue_time_us":430957,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":2461,"raft.queue_time_us":16655,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":7772,"spinlock_wait_cycles":11431680,"thread_start_us":293851,"threads_started":3,"wal-append.queue_time_us":144817}
I20260709 13:00:39.759192  1538 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:39.764060  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:39.764890  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:39.786159  1691 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:39.806960  1659 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:39.810271  1540 raft_consensus.cc:1240] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:39.818971  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:39.838307  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 257734us
I20260709 13:00:39.839754  1689 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
W20260709 13:00:39.819468  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 154505us
W20260709 13:00:39.809005  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 101443us
I20260709 13:00:39.845834  1586 leader_election.cc:400] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5.
I20260709 13:00:39.827502  1616 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:39.795907  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:39.848116  1659 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:39.842118  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 254189us
W20260709 13:00:39.806725  3949 consensus_meta.cc:287] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.562s	user 0.004s	sys 0.004s
W20260709 13:00:39.822134  4031 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:00:39.807390  3874 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:00:39.795773  3954 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.760989  3970 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:39.858155  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:39.800467  3837 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:39.805585  3951 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:39.859439  1691 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:39.855108  1688 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:39.851050  2210 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:39.823992  4000 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:39.838156  3911 raft_consensus.cc:697] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:39.867687  1690 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:39.860147  1511 leader_election.cc:400] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6.
I20260709 13:00:39.849094  3917 raft_consensus.cc:2764] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:00:39.881951  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:39.817817  3977 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:00:39.873303  3960 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:39.866550  3970 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.904345  1541 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:00:39.893324  2210 leader_election.cc:304] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:39.877113  1511 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:39.874521  3573 consensus_meta.cc:287] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.603s	user 0.004s	sys 0.007s
I20260709 13:00:39.910194  1541 pending_rounds.cc:85] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 5
I20260709 13:00:39.931147  1541 pending_rounds.cc:107] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:00:39.931565  1541 raft_consensus.cc:2889] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:39.911679  2243 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:39.912724  3960 raft_consensus.cc:697] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:39.933545  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:39.934198  1690 raft_consensus.cc:3055] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:39.934540  1690 raft_consensus.cc:740] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:39.913533  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:39.937155  1692 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:39.859632  3949 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.882797  3951 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:00:39.910132  3690 consensus_queue.cc:237] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:39.928386  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 51380us
I20260709 13:00:39.920464  3875 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:39.873929  3984 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:39.935643  1690 consensus_queue.cc:260] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:39.932128  3987 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:39.962227  1690 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:39.986958  4017 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.548s	user 0.003s	sys 0.000s
I20260709 13:00:39.941382  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:39.936556  3999 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:39.992200  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 50931.7us
I20260709 13:00:40.000082  3146 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:39.930747  3573 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.961285  3875 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:40.002451  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 142154us
I20260709 13:00:40.006204  1690 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
W20260709 13:00:40.008149  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 160190us
I20260709 13:00:40.007495  1511 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:40.033746  3960 consensus_queue.cc:237] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:40.022709  3875 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:40.019532  4021 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.355s	user 0.000s	sys 0.005s
I20260709 13:00:40.022828  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:40.072342  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 224294us
I20260709 13:00:40.036101  1587 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:40.092593  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 56552.3us
I20260709 13:00:40.034610  3816 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:40.014253  1692 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
W20260709 13:00:40.095861  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.047391  3522 consensus_queue.cc:1059] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:00:40.096696  3522 raft_consensus.cc:3055] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:40.097061  3522 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:40.097843  3522 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:40.098958  3522 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:40.100257  1587 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:40.101218  4044 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:40.101677  4044 raft_consensus.cc:697] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:40.102490  4044 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:39.992190  3911 consensus_queue.cc:237] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:40.113602  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 266629us
I20260709 13:00:40.032416  3682 consensus_queue.cc:1059] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:00:40.094761  3692 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:40.132893  3541 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.130822  1586 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:40.052359  3895 consensus_queue.cc:1059] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:00:40.069800  3865 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:00:40.104525  3963 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:40.034806  4033 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 13:00:40.111596  3999 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:40.154284  3999 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:40.126751  4006 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:40.142714  3692 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:40.153127  3573 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:40.185453  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 150755us
W20260709 13:00:40.188661  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 57933.5us
I20260709 13:00:40.193109  3999 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:40.194356  2243 raft_consensus.cc:1240] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:40.191890  3146 consensus_queue.cc:1059] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:40.218676  2243 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:40.222261  3146 raft_consensus.cc:3055] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:40.222644  3146 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:00:40.166030  3969 consensus_meta.cc:287] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.000s
I20260709 13:00:40.227586  1545 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:00:40.227993  1545 pending_rounds.cc:85] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 5
I20260709 13:00:40.191310  3729 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:40.228273  1545 pending_rounds.cc:107] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:00:40.164670  3949 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:40.172398  1587 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:40.167567  3918 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.169229  3814 raft_consensus.cc:993] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:40.174242  3341 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:40.459132  1545 raft_consensus.cc:2889] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:40.490927  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 318556us
I20260709 13:00:40.219429  4033 raft_consensus.cc:3055] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:40.181890  3692 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:40.458767  4041 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.364s	user 0.001s	sys 0.000s
W20260709 13:00:40.459373  3742 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.009s	sys 0.013s
W20260709 13:00:40.584633  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.495204  3146 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:40.587749  3146 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.165602  3963 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:40.488358  3865 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.170588  2237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 527) took 1107 ms. Trace:
I20260709 13:00:40.522641  3341 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.522506  3573 raft_consensus.cc:1081] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:40.494711  3874 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:40.189440  4006 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:40.572801  3729 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:40.605691  4043 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:40.195442  3970 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:40.570695  4033 raft_consensus.cc:740] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:40.167258  3875 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:40.615309  3963 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:40.576992  1511 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 1.675s (SENT) [suppressed 1 similar messages]
I20260709 13:00:40.664477  2238 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:40.618631  2237 rpcz_store.cc:276] 0709 13:00:39.063146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.071496 (+  8350us) service_pool.cc:224] Handling call
0709 13:00:39.144045 (+ 72549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.278821 (+134776us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.282724 (+  3903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:39.283841 (+  1117us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:39.286574 (+  2733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.170290 (+883716us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b540050f354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:40.170351 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.170519 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285041920}
W20260709 13:00:40.689422  3837 consensus_meta.cc:287] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.811s	user 0.009s	sys 0.000s
W20260709 13:00:40.692772  3954 consensus_meta.cc:287] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.814s	user 0.006s	sys 0.002s
I20260709 13:00:40.695005  4006 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:40.628651  3865 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:40.780881  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.029s	sys 0.064s
I20260709 13:00:40.658182  3729 raft_consensus.cc:697] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:00:40.832093  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.030s	sys 0.064s
W20260709 13:00:40.832617  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 615169us
I20260709 13:00:40.658618  4043 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:40.659348  3874 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:40.841532  3868 consensus_meta.cc:287] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.993s	user 0.007s	sys 0.004s
W20260709 13:00:40.850347  3911 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.063s	sys 0.080s
I20260709 13:00:40.857513  3729 consensus_queue.cc:237] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:40.862003  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2206) took 1290 ms. Trace:
I20260709 13:00:40.862426  1545 rpcz_store.cc:276] 0709 13:00:39.571981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.740146 (+168165us) service_pool.cc:224] Handling call
0709 13:00:39.815610 (+ 75464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.522829 (+707219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.861766 (+338937us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54000d1454. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:40.861945 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":946433408}
I20260709 13:00:40.869241  3865 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:40.870855  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2235) took 2050 ms (client timeout 1692 ms). Trace:
W20260709 13:00:40.871721  1617 rpcz_store.cc:269] 0709 13:00:38.819959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.836840 (+ 16881us) service_pool.cc:224] Handling call
0709 13:00:40.870540 (+2033700us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b5400400454. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:40.870720 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1762439936}
I20260709 13:00:40.872853  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
W20260709 13:00:40.856977  3911 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.063s	sys 0.080s
I20260709 13:00:40.816020  3837 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:40.831678  3954 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:40.891589  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:40.893363  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:40.900815  1660 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:40.885352  3522 consensus_meta.cc:287] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.786s	user 0.008s	sys 0.004s
I20260709 13:00:40.907814  4055 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:40.915987  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:40.914194  1660 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:40.875311  3868 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:40.936628  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:40.937368  1617 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:40.894711  4047 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.905414  4036 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.894912  4032 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:40.912977  3742 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:40.929493  3949 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.934926  4029 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:40.949091  1547 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:00:40.950505  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 373487us
I20260709 13:00:40.934888  3951 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:00:40.944379  4055 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:40.979161  4055 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:40.947721  3742 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:40.980139  4055 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:40.982216  3341 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:40.982445  1613 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:40.983908  3977 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.984378  3977 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:40.985442  3734 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:40.985867  3816 raft_consensus.cc:3055] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:40.986336  3816 raft_consensus.cc:740] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:40.882930  4033 consensus_queue.cc:260] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:40.958242  3875 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:40.959640  4053 log.cc:927] Time spent T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:00:40.971712  4052 log.cc:927] Time spent T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:00:40.971712  4048 log.cc:927] Time spent T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:00:40.948689  4032 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:40.987170  3816 consensus_queue.cc:260] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:40.996984  3816 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:40.997370  4032 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:40.997500  4006 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.997751  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1069) took 1428 ms. Trace:
I20260709 13:00:40.948529  4036 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:40.998108  4006 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:40.959227  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:40.999730  4036 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:40.976454  3970 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:40.951085  4029 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:41.000383  3970 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:40.987253  3874 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:41.000949  3970 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:40.947196  3911 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:41.001974  3996 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:40.988543  3868 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.002481  3911 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.003899  4003 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:41.004429  4003 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:40.980628  3742 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.985997  3734 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.000438  4029 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:40.977432  4043 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:41.001915  3954 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:40.975663  4009 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 1.590s	user 0.012s	sys 0.006s
I20260709 13:00:40.970376  3814 consensus_queue.cc:1059] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:40.998158  1541 rpcz_store.cc:276] 0709 13:00:39.569237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.569332 (+    95us) service_pool.cc:224] Handling call
0709 13:00:39.605305 (+ 35973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.936799 (+331494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.997476 (+1060677us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b5400069fd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:40.997672 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":638202112}
I20260709 13:00:40.999758  4056 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:00:41.027123  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 193762us
W20260709 13:00:41.028677  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 112856us
I20260709 13:00:40.991123  3541 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:41.013144  1616 raft_consensus.cc:2955] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:41.031533  1511 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:41.042395  3146 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:41.043574  3146 raft_consensus.cc:697] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:41.031916  4043 raft_consensus.cc:3055] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:41.065994  3146 consensus_queue.cc:237] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.054077  3954 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:40.948407  4047 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.078747  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:41.071676  3522 consensus_queue.cc:1059] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:00:41.082773  3522 raft_consensus.cc:3055] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:41.043466  3541 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.083781  3776 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:41.084323  3776 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:41.084388  3963 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:41.085553  3541 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:41.057269  4013 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:41.086454  4013 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.086900  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:41.095433  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:41.088505  1585 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:41.072137  3626 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:41.083176  3522 raft_consensus.cc:740] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:41.106194  3626 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.107071  3522 consensus_queue.cc:260] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.108604  3626 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:41.109256  3626 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:41.109740  3626 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.112645  1696 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:41.113297  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1037) took 1518 ms. Trace:
I20260709 13:00:41.113906  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:41.114791  1688 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:41.030241  4056 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.122524  4056 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.123024  3690 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:41.125252  3895 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:41.125944  3895 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.128123  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1854) took 2331 ms. Trace:
I20260709 13:00:41.128680  3690 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:41.128515  1695 rpcz_store.cc:276] 0709 13:00:38.796330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.796748 (+   418us) service_pool.cc:224] Handling call
0709 13:00:38.797117 (+   369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:38.797611 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:38.797653 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:38.802915 (+  5262us) log.cc:844] Serialized 52 byte log entry
0709 13:00:38.959202 (+156287us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b1800497200. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb0d1 00007fc4916e6a0f
0709 13:00:39.275337 (+316135us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:39.275377 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.275445 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.974978 (+1699533us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:41.127904 (+152926us) raft_consensus.cc:1685] finished
0709 13:00:41.127925 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.128047 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3432,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":3365,"spinlock_wait_cycles":45363200,"thread_start_us":315894,"threads_started":1,"wal-append.queue_time_us":515582}
I20260709 13:00:41.132261  3734 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:41.079026  3722 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:00:41.113819  1687 rpcz_store.cc:276] 0709 13:00:39.595008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.595188 (+   180us) service_pool.cc:224] Handling call
0709 13:00:39.595707 (+   519us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:39.847677 (+251970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.852153 (+  4476us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:39.870094 (+ 17941us) log.cc:844] Serialized 52 byte log entry
0709 13:00:40.138483 (+268389us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:40.138526 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.112745 (+974219us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54002242d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:41.112813 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.112880 (+    67us) raft_consensus.cc:1685] finished
0709 13:00:41.112904 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.113210 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6948,"raft.queue_time_us":267,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":12715,"spinlock_wait_cycles":389018368,"thread_start_us":212268,"threads_started":1,"wal-append.queue_time_us":328831}
I20260709 13:00:41.089131  3837 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.066310  4043 raft_consensus.cc:740] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:41.135794  4043 consensus_queue.cc:260] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:41.137286  3895 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:41.097003  3954 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.141286  3954 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:41.141782  3954 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:41.142853  3977 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.143364  3911 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.143620  4037 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:41.144147  4037 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.146329  4037 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:41.147406  1585 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:41.157649  1585 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:41.187613  4071 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:41.188390  4071 raft_consensus.cc:697] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:41.189468  4071 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:41.190752  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.192670  3816 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:41.193291  3816 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:41.196519  3868 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.196676  3996 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:41.197132  3895 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:41.197220  3868 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:41.197757  3895 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:41.198766  4047 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:41.199832  3895 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.203399  3911 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:41.203800  3626 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:41.203953  3911 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.206040  3911 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.167873  3729 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:41.207118  3911 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:41.156556  3970 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.207751  3911 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.147928  3541 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:41.148481  3341 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.217025  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:41.177700  4006 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:41.221328  1620 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:00:41.222190  1618 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:41.228956  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:41.223414  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:41.227685  1511 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:41.231387  1621 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 8: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:41.213174  4029 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.234529  3816 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.236385  3868 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.229197  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:41.239784  1618 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 9: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:41.213709  3837 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:41.248729  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 176721us
I20260709 13:00:41.255285  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:41.256197  1622 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:41.210285  4003 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.271440  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:41.275309  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:00:41.289021  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 229618us
I20260709 13:00:41.292055  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:41.293090  1689 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:41.294013  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:41.297325  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:41.298213  1695 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:41.299217  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:41.303155  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:41.306656  1690 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:41.230984  3970 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:41.197327  3996 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:41.253393  3895 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:41.289309  3816 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:41.311833  4003 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:41.221838  3541 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.316749  2245 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:41.227415  4066 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:00:41.313035  1696 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:41.293390  4029 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:41.336098  3146 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.344614  3146 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.289156  3722 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:00:41.268793  3837 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:41.343014  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:41.336263  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 327881us
W20260709 13:00:41.353992  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.289417  3868 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:00:41.348894  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:41.331327  1687 raft_consensus.cc:1240] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:41.332746  3816 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:41.337131  3895 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:41.349502  3146 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:41.350358  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:41.351452  4082 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.351543  3823 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:41.318894  3573 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:41.346906  1587 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:41.330574  4006 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:41.367446  1659 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:41.368495  3146 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:41.368814  2244 raft_consensus.cc:2393] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 4: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:41.369860  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:41.370954  1587 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:41.375272  3146 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:41.320550  3970 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.378301  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:41.369410  3816 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.401789  3911 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.383123  4006 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.335995  4003 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:41.377398  3918 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:41.390697  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.379696  4047 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:41.434006  3146 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:41.405471  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 464825us
I20260709 13:00:41.401260  3970 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.437273  1660 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:41.437886  4006 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:41.438403  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 67479.9us
I20260709 13:00:41.399734  3722 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:41.439616  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:41.441545  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:41.439925  1660 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:41.440240  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.387324  3954 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:41.440810  3146 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:41.376940  3895 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.377050  3573 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:41.380937  4029 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:00:41.370016  3742 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:41.433250  3918 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:41.443540  3146 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.385311  3823 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:41.453511  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.441699  3722 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:41.404995  3977 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 13:00:41.456985  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.446146  4055 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:41.458645  3146 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:41.461864  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:41.462646  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:41.462690  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:41.463001  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:41.454702  3918 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:41.463423  4096 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.443815  4093 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.443207  3954 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.492398  3954 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:41.493577  4084 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:00:41.493649  4073 consensus_queue.cc:1059] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:00:41.494890  4073 raft_consensus.cc:3055] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:41.447825  4037 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:41.474068  1688 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:41.463421  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:41.474462  3146 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:41.497383  4075 log.cc:927] Time spent T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:00:41.376858  4082 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:41.499907  4083 log.cc:927] Time spent T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:00:41.500669  4074 log.cc:927] Time spent T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:00:41.473649  3541 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:41.501581  4085 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.479586  3970 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.506688  4092 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.508070  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:41.472641  1615 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
W20260709 13:00:43.098295  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 1845) took 1636 ms (client timeout 1885 ms). Trace:
W20260709 13:00:43.098724  1615 rpcz_store.cc:269] 0709 13:00:41.461467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.461625 (+   158us) service_pool.cc:224] Handling call
0709 13:00:43.098207 (+1636582us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:41.489445  1545 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:41.505383  4064 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:00:41.540412  4085 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.207036  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1077) took 1731 ms. Trace:
I20260709 13:00:43.207481  1545 rpcz_store.cc:276] 0709 13:00:41.475975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.478470 (+  2495us) service_pool.cc:224] Handling call
0709 13:00:41.489206 (+ 10736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.206375 (+1717169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.206963 (+   588us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:43.208526  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1057) took 2710 ms. Trace:
I20260709 13:00:43.208941  4085 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.514873  4073 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:43.210263  4073 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:41.507491  4096 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.211418  4073 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:43.213069  4096 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:43.208981  1692 rpcz_store.cc:276] 0709 13:00:40.498224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.498328 (+   104us) service_pool.cc:224] Handling call
0709 13:00:40.498664 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:40.617955 (+119291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.617983 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:40.656912 (+ 38929us) log.cc:844] Serialized 52 byte log entry
0709 13:00:40.970028 (+313116us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b48002502d8. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc496654aa1 00007fc49664bb37 00007fc49664b9ca 00007fc49674326f 00007fc496742f37 00007fc49675755c 00007fc496757508 00007fc496757488 00007fc496757443 00007fc4967566ec 00007fc495680a96
0709 13:00:41.167935 (+197907us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:41.167996 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.168087 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.208187 (+2040100us) raft_consensus.cc:1685] finished
0709 13:00:43.208210 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.208446 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106717,"raft.queue_time_us":124232,"raft.run_cpu_time_us":35946,"raft.run_wall_time_us":341832,"spinlock_wait_cycles":26405120,"thread_start_us":346557,"threads_started":1,"wal-append.queue_time_us":507629}
I20260709 13:00:41.511437  4093 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.215935  4043 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:43.216504  4093 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:41.560847  4092 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.218775  4092 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:41.559429  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:41.538910  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.230882  1689 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
W20260709 13:00:43.231551  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 345) took 1695 ms (client timeout 1886 ms). Trace:
W20260709 13:00:43.231930  1689 rpcz_store.cc:269] 0709 13:00:41.536697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.536824 (+   127us) service_pool.cc:224] Handling call
0709 13:00:43.231457 (+1694633us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:41.555006  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:41.561635  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:41.516690  3146 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:41.562966  3573 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:43.246462  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1076) took 1770 ms. Trace:
I20260709 13:00:41.564185  3837 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.562041  3895 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:41.561587  3722 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:41.642258  3742 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:41.554307  3970 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.278765  3970 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.640688  4003 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:41.584156  4055 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:43.305742  4055 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:42.005900  4012 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.307526  4012 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.309916  4012 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:42.152467  3918 consensus_meta.cc:287] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.650s	user 0.013s	sys 0.000s
I20260709 13:00:43.310817  3918 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.313067  3918 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:42.187408  4098 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:42.562312  2242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.046s	sys 0.028s
W20260709 13:00:42.670608  1476 debug-util.cc:398] Leaking SignalData structure 0x7b0800067960 after lost signal to thread 431
W20260709 13:00:43.314134  1476 debug-util.cc:398] Leaking SignalData structure 0x7b0800067480 after lost signal to thread 434
W20260709 13:00:43.314311  2242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.730s	user 0.047s	sys 0.028s
I20260709 13:00:43.313989  4098 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:43.315192  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08000679a0 after lost signal to thread 1479
I20260709 13:00:43.315562  1614 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:43.316406  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08003cae20 after lost signal to thread 1571
W20260709 13:00:43.316695  1476 debug-util.cc:398] Leaking SignalData structure 0x7b0800248700 after lost signal to thread 1572
I20260709 13:00:42.686563  4082 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:43.317832  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:42.739193  3963 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:42.753125  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:42.755757  2241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 538) took 1445 ms. Trace:
I20260709 13:00:42.756146  4112 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.756731  4113 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:42.763564  3341 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:42.767998  4033 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.623799   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:42.783737  2211 connection.cc:256] RPC call timeout handler was delayed by -1.0982155599999714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
I20260709 13:00:42.794440  3953 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:42.801383  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 1807) took 3913 ms (client timeout 1675 ms). Trace:
W20260709 13:00:42.806217  3960 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.756s	user 0.037s	sys 0.046s
W20260709 13:00:43.337370  3960 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.287s	user 0.037s	sys 0.046s
W20260709 13:00:42.812970  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.363s	user 0.019s	sys 0.017s
I20260709 13:00:43.338121  1691 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:43.338292  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.888s	user 0.020s	sys 0.018s
W20260709 13:00:43.338639  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 1.89186e+06us
I20260709 13:00:43.340018  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1066) took 2066 ms. Trace:
I20260709 13:00:43.340309  4003 consensus_queue.cc:1059] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:43.340415  1691 rpcz_store.cc:276] 0709 13:00:41.273725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.274122 (+   397us) service_pool.cc:224] Handling call
0709 13:00:41.274422 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.338558 (+2064136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.339127 (+   569us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b54002c5e54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:43.339951 (+   824us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4745112320}
I20260709 13:00:43.341180  4003 consensus_queue.cc:1059] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:43.342756  4082 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.823550  4047 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.343004  3963 raft_consensus.cc:3055] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:43.343490  3963 raft_consensus.cc:740] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:43.343248  4082 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.345481  4082 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:42.843842  1546 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:42.852538  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.853044  3911 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.854252  4006 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:42.862425  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.407s	user 0.000s	sys 0.049s
I20260709 13:00:42.869573  1512 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:42.878449  2240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 596) took 1634 ms. Trace:
W20260709 13:00:43.354346  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.899s	user 0.001s	sys 0.050s
I20260709 13:00:42.898423  2246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 595) took 1657 ms. Trace:
W20260709 13:00:43.354895  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 485319us
I20260709 13:00:42.908713  3814 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:42.913547  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1074) took 1438 ms. Trace:
W20260709 13:00:42.916541  4035 log.cc:927] Time spent T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 2.861s	user 0.014s	sys 0.016s
W20260709 13:00:42.921193  2245 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.478s	user 0.009s	sys 0.008s
I20260709 13:00:42.936681  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1078) took 1460 ms. Trace:
I20260709 13:00:42.947449  2237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 592) took 1719 ms. Trace:
W20260709 13:00:42.950619  3816 consensus_meta.cc:287] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 1.514s	user 0.012s	sys 0.008s
I20260709 13:00:42.952993  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:42.956318  4039 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:42.970728  1617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.514s	user 0.020s	sys 0.030s
W20260709 13:00:42.986754  3954 consensus_meta.cc:287] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 1.494s	user 0.016s	sys 0.012s
I20260709 13:00:42.993892  4119 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:00:42.997659  1572 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:43923 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:43923 timed out after 15.000s (SENT)
I20260709 13:00:43.000782  4013 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:42.997637  3957 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:43.004595  4061 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.367314  4082 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:43.026906  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.027019  3823 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:43.030112  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.446255  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.059300  2239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 591) took 1831 ms. Trace:
I20260709 13:00:43.446980  2239 rpcz_store.cc:276] 0709 13:00:41.228049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.228280 (+   231us) service_pool.cc:224] Handling call
0709 13:00:43.058431 (+1830151us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b5800003998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:00:43.058659 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.058893 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.058923 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:43.058971 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:43.059006 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.059068 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.059206 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39836544}
I20260709 13:00:43.447907  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.448691  2244 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:43.390553  3816 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.449692  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.449728  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.450948  3816 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:43.074249  4046 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:43.451922  3918 raft_consensus.cc:3055] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:43.451695  4046 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.452318  3918 raft_consensus.cc:740] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:43.390550  4039 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.453284  1660 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:43.453154  3918 consensus_queue.cc:260] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.453832  4046 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:43.454306  3918 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:43.454408  4046 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:43.454707  4039 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:43.454909  4046 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:43.108382  3776 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:43.448894  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.109860  3729 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.457727  4046 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:43.457995  3729 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.459568  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:43.460247  3729 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:43.112442  4062 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 1.929s	user 0.008s	sys 0.006s
I20260709 13:00:43.118209  2243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 597) took 1864 ms. Trace:
I20260709 13:00:43.460686  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.461510  2243 rpcz_store.cc:276] 0709 13:00:41.253821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.253982 (+   161us) service_pool.cc:224] Handling call
0709 13:00:43.117330 (+1863348us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b5800003998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:00:43.117581 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.117811 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.117846 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:43.117898 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:43.117934 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.117999 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.118141 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35867392}
I20260709 13:00:43.462929  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.463291  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.464023  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.464286  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.119787  3522 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.464892  2239 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:43.465492  4046 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.465967  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.466693  2239 raft_consensus.cc:2410] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:43.121742  4091 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.126138  4037 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:43.467423  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:43.144017  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.144297  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.368409  4047 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.467761  4037 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.468245  1620 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:43.144836  3868 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.145146  4122 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:43.133366  4056 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.469319  4122 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.469681  4047 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:43.145607  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.469977  4056 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.376360  3911 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.471375  4122 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:43.472040  4056 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:43.148931  3692 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:43.472414  3911 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:43.472733  3692 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.474650  3692 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:43.150154  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.163408  4121 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:43.167557  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1075) took 1692 ms. Trace:
I20260709 13:00:43.475530  4121 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.475768  1538 rpcz_store.cc:276] 0709 13:00:41.475279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.477211 (+  1932us) service_pool.cc:224] Handling call
0709 13:00:41.477667 (+   456us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:41.478113 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.478155 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:41.493208 (+ 15053us) log.cc:844] Serialized 52 byte log entry
0709 13:00:43.149025 (+1655817us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b1800482aa0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb0d1 00007fc4916e6a0f
0709 13:00:43.165116 (+ 16091us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:43.165161 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.165234 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.166239 (+  1005us) raft_consensus.cc:1685] finished
0709 13:00:43.166258 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.167487 (+  1229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10810,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":98,"spinlock_wait_cycles":3804629888,"thread_start_us":15902,"threads_started":1,"wal-append.queue_time_us":1670751}
W20260709 13:00:43.477612  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1083) took 1994 ms (client timeout 1655 ms). Trace:
W20260709 13:00:43.477967  1538 rpcz_store.cc:269] 0709 13:00:41.483386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.477439 (+1994053us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:43.477554 (+   115us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:00:43.478804  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1092) took 1992 ms (client timeout 1695 ms). Trace:
I20260709 13:00:43.169976  4127 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:43.177610  3917 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.721s	user 0.009s	sys 0.043s
W20260709 13:00:43.479862  3917 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.028s	user 0.009s	sys 0.044s
I20260709 13:00:43.175828  4125 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.479591  4127 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.176435  4120 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:43.182627  4128 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:43.197945  3999 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:43.201762  3996 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:43.213828  4096 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.571035  4070 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.172s
W20260709 13:00:43.208590  1545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1084) took 1724 ms (client timeout 1609 ms). Trace:
W20260709 13:00:43.508482  1545 rpcz_store.cc:269] 0709 13:00:41.483705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.208410 (+1724705us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:43.208509 (+    99us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:43.234531  1696 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
W20260709 13:00:43.517541  1696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 347) took 1974 ms (client timeout 1561 ms). Trace:
I20260709 13:00:43.246881  1540 rpcz_store.cc:276] 0709 13:00:41.475643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.478369 (+  2726us) service_pool.cc:224] Handling call
0709 13:00:41.508127 (+ 29758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.245116 (+1736989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.245154 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:43.245203 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:43.245239 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.246230 (+   991us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54002f99d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:43.246273 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.246400 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3993770240}
W20260709 13:00:43.518582  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 59488.9us
W20260709 13:00:43.518900  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1094) took 2032 ms (client timeout 1896 ms). Trace:
W20260709 13:00:43.519331  1540 rpcz_store.cc:269] 0709 13:00:41.486602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.518736 (+2032134us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:43.518840 (+   104us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:00:43.520193  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1087) took 2035 ms (client timeout 1907 ms). Trace:
W20260709 13:00:43.520506  1540 rpcz_store.cc:269] 0709 13:00:41.484577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.520034 (+2035457us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:43.520142 (+   108us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:43.252784  3146 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:43.258536  2238 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:43.256713  4029 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.261572  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:43.295291  1445 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42114 (request call id 268) took 15683 ms (client timeout 15000 ms). Trace:
I20260709 13:00:43.296557  3722 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:43.295961  1443 catalog_manager.cc:5697] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 2 to 3, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:43.442276  3957 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:43.318459  1476 debug-util.cc:398] Leaking SignalData structure 0x7b080038cf40 after lost signal to thread 1646
I20260709 13:00:43.319173  4132 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:43.320438  4098 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:43.322232  4055 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:43.329095  1613 rpcz_store.cc:269] 0709 13:00:38.888337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.900231 (+ 11894us) service_pool.cc:224] Handling call
0709 13:00:42.800811 (+3900580us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b540033bb54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:42.801117 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4768552832}
I20260709 13:00:43.335350  3953 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.323627  4112 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.323210  1543 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:43.352896  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.355720  1512 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:43.544088  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 188411us
I20260709 13:00:43.544813  1512 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:43.354558  2240 rpcz_store.cc:276] 0709 13:00:41.243907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.244033 (+   126us) service_pool.cc:224] Handling call
0709 13:00:42.877618 (+1633585us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b5800003998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:00:42.877863 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.878086 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.878116 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.878162 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:42.878196 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.878258 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.878382 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12193664}
I20260709 13:00:43.545866  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.367488  1541 rpcz_store.cc:276] 0709 13:00:41.474857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.475050 (+   193us) service_pool.cc:224] Handling call
0709 13:00:42.913006 (+1437956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.913205 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.913236 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.913281 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:42.913314 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.913373 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.913485 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:43.375814  2245 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.933s	user 0.011s	sys 0.009s
I20260709 13:00:43.545871  1512 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:43.367911  1542 rpcz_store.cc:276] 0709 13:00:41.476295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.478678 (+  2383us) service_pool.cc:224] Handling call
0709 13:00:42.935758 (+1457080us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5800002d98. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:00:42.935996 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.936224 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.936261 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.936327 (+    66us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:42.936369 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.936442 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.936609 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3281884544}
I20260709 13:00:43.323433  2241 rpcz_store.cc:276] 0709 13:00:41.310447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.310779 (+   332us) service_pool.cc:224] Handling call
0709 13:00:41.327945 (+ 17166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.328156 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:41.366922 (+ 38766us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.651989 (+285067us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.652147 (+   158us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:41.652201 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.652306 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.755690 (+1103384us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":104320,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":4518,"raft.run_cpu_time_us":12765,"raft.run_wall_time_us":1477941,"thread_start_us":308161,"threads_started":2,"wal-append.queue_time_us":313115,"wal-append.run_cpu_time_us":1363,"wal-append.run_wall_time_us":1001637}
W20260709 13:00:43.387426  1617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.931s	user 0.022s	sys 0.031s
W20260709 13:00:43.009155  1618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.536s	user 0.014s	sys 0.032s
W20260709 13:00:43.394018  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 65727.4us
I20260709 13:00:43.445207  1546 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
W20260709 13:00:43.061236  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1067) took 3492 ms (client timeout 2176 ms). Trace:
I20260709 13:00:43.548347  2211 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:43.548450  1512 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:43.078296  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1878) took 1986 ms. Trace:
I20260709 13:00:43.456228  1695 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:43.324287  4113 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.376507  4006 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.456235  1691 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:00:43.379374  3742 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:43.469097  3868 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.472180  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.167785  3865 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:43.479115  1538 rpcz_store.cc:269] 0709 13:00:41.486033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.478669 (+1992636us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:43.478757 (+    88us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:43.324637  3341 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.488343  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.572548  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:43.489322  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:43.489403  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:43.489756  1621 raft_consensus.cc:3055] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:43.371934  4073 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.575527  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.499775  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:43.522567  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.480409  4125 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:43.518015  1696 rpcz_store.cc:269] 0709 13:00:41.543410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.543542 (+   132us) service_pool.cc:224] Handling call
0709 13:00:43.517438 (+1973896us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:43.517565  1545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1089) took 2032 ms (client timeout 1777 ms). Trace:
W20260709 13:00:43.577045  1545 rpcz_store.cc:269] 0709 13:00:41.485148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.517384 (+2032236us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:43.517508 (+   124us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:43.525599  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:42.692824  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1079) took 1216 ms. Trace:
I20260709 13:00:43.575567  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.346649  3963 consensus_queue.cc:260] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.469712  4037 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:43.530733  1476 debug-util.cc:398] Leaking SignalData structure 0x7b0800233160 after lost signal to thread 1720
I20260709 13:00:43.479137  4121 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:43.516492  3996 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.533488  1443 catalog_manager.cc:5697] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 4 to 5, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:00:43.585026  1476 debug-util.cc:398] Leaking SignalData structure 0x7b080024e000 after lost signal to thread 1721
W20260709 13:00:43.586189  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0820 after lost signal to thread 2270
I20260709 13:00:43.586072  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.585813  1443 catalog_manager.cc:5697] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 2 to 3, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:43.467372  4061 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.537767  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:43.535862  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:43.542848  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.587055  1693 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:43.355103  2246 rpcz_store.cc:276] 0709 13:00:41.241350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.243415 (+  2065us) service_pool.cc:224] Handling call
0709 13:00:42.897611 (+1654196us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b5800003998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:00:42.897837 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.898044 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.898075 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.898121 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:42.898159 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.898224 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.898357 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11895040}
W20260709 13:00:43.587218  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 51406.9us
I20260709 13:00:43.584632  2211 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:43.588904  1542 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:43.588675  2211 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:43.590214  1443 catalog_manager.cc:5697] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:43.591883  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.551108  1512 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:43.467481  4091 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.530179  3823 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:43.552196  1618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.079s	user 0.014s	sys 0.032s
I20260709 13:00:43.594647  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:43.594616  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:43.595450  1696 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:43.595536  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 1844) took 2153 ms. Trace:
I20260709 13:00:43.575598  3911 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:43.379552  3814 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:43.555789  1543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1082) took 2061 ms (client timeout 1755 ms). Trace:
I20260709 13:00:43.557075  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.549386  1694 rpcz_store.cc:276] 0709 13:00:41.091989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.092219 (+   230us) service_pool.cc:224] Handling call
0709 13:00:41.115965 (+ 23746us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:41.158950 (+ 42985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.158995 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.179375 (+ 20380us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.315090 (+135715us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:41.315152 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.077806 (+1762654us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b5400134cd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:43.077871 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.077927 (+    56us) raft_consensus.cc:1685] finished
0709 13:00:43.077941 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.078230 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6561,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":8218,"spinlock_wait_cycles":76516096,"thread_start_us":107002,"threads_started":1,"wal-append.queue_time_us":248937,"wal-append.run_cpu_time_us":1720,"wal-append.run_wall_time_us":1040412}
W20260709 13:00:43.557821  1546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1081) took 2070 ms (client timeout 1940 ms). Trace:
I20260709 13:00:43.563400  2245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 540) took 2241 ms. Trace:
I20260709 13:00:43.563057  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 1830) took 2549 ms. Trace:
W20260709 13:00:43.604789  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 53732.7us
W20260709 13:00:43.526297  1445 rpcz_store.cc:269] 0709 13:00:27.612384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.612665 (+   281us) service_pool.cc:224] Handling call
0709 13:00:43.295172 (+15682507us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:38.459171 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:38.460152 (+   981us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:38.460217 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:00:38.460247 (+    30us) tablet.cc:662] Decoding operations
0709 13:00:38.461544 (+  1297us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:38.461685 (+   141us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:38.461735 (+    50us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:00:38.463140 (+  1405us) tablet.cc:701] Row locks acquired
0709 13:00:38.463190 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:00:38.463409 (+   219us) write_op.cc:270] Start()
0709 13:00:38.463575 (+   166us) write_op.cc:276] Timestamp: P: 1783602038463342 usec, L: 0
0709 13:00:38.463617 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:00:38.535781 (+ 72164us) log.cc:844] Serialized 2472 byte log entry
0709 13:00:39.229667 (+693886us) op_driver.cc:464] REPLICATION: finished
0709 13:00:39.366432 (+136765us) write_op.cc:301] APPLY: starting
0709 13:00:39.372668 (+  6236us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:39.392571 (+ 19903us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:39.416863 (+ 24292us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:39.888865 (+472002us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b5c00136a0c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc49791d331 00007fc49791d221 00007fc497917f6c 00007fc49507830b 00007fc495077fd3 00007fc495176e34 00007fc49516297c 00007fc495166d61 00007fc495166d19 00007fc495166ca9 00007fc495166c71
0709 13:00:39.889983 (+  1118us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:39.890388 (+   405us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:00:39.890473 (+    85us) write_op.cc:312] APPLY: finished
0709 13:00:39.890873 (+   400us) log.cc:844] Serialized 53 byte log entry
0709 13:00:39.891078 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:39.891177 (+    99us) write_op.cc:454] Released schema lock
0709 13:00:39.896111 (+  4934us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:39.923510 (+ 27399us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:39.923546 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1260721,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":111868,"apply.run_cpu_time_us":7976,"apply.run_wall_time_us":575885,"num_ops":6,"prepare.queue_time_us":196408,"prepare.run_cpu_time_us":31067,"prepare.run_wall_time_us":395236,"raft.queue_time_us":242333,"raft.run_cpu_time_us":8997,"raft.run_wall_time_us":157074,"replication_time_us":733040,"spinlock_wait_cycles":3009408,"thread_start_us":593909,"threads_started":4,"wal-append.queue_time_us":309373,"wal-append.run_cpu_time_us":50860,"wal-append.run_wall_time_us":2060623}]]}
I20260709 13:00:43.444548  4119 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.516166  4128 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.516331  4096 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.566903  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.515831  3999 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.568130  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.592834  3996 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.571328  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:43.572435  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.508145  4120 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.573513  1621 raft_consensus.cc:740] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:43.221099  3541 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:43.551960  4122 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:43.577610  2239 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:43.578994  2240 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:43.552196  4106 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:43.552003  4115 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:43.582497  4073 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.581076  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:43.554332  4033 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:43.530874  4029 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.664827  4029 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:43.584297  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:43.586493  1476 debug-util.cc:398] Leaking SignalData structure 0x7b0800327520 after lost signal to thread 2271
W20260709 13:00:43.672422  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08002885c0 after lost signal to thread 3874
W20260709 13:00:43.672825  1476 debug-util.cc:398] Leaking SignalData structure 0x7b080035b540 after lost signal to thread 3875
I20260709 13:00:43.391152  3954 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.546384  3146 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:43.593358  2211 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:00:43.673938  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 84112.1us
W20260709 13:00:43.548691  1547 rpcz_store.cc:269] 0709 13:00:39.568611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.568719 (+   108us) service_pool.cc:224] Handling call
0709 13:00:43.060956 (+3492237us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540011fb54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:43.061136 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3079125888}
I20260709 13:00:43.592008  1443 catalog_manager.cc:5697] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 2 to 3, term changed from 1 to 4, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to <none>, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:43.570794  4046 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:43.576098  3865 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.679395  3953 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:43.598084  4145 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:43.559705  4093 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:00:43.600670  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.687318  1538 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:43.601274  3823 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.601890  4125 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:43.607020  1546 rpcz_store.cc:269] 0709 13:00:41.480488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.506192 (+ 25704us) service_pool.cc:224] Handling call
0709 13:00:43.551015 (+2044823us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46592}
W20260709 13:00:43.603773  1543 rpcz_store.cc:269] 0709 13:00:41.482812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.505692 (+ 22880us) service_pool.cc:224] Handling call
0709 13:00:42.752979 (+1247287us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5800002d98. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc4966f10a0 00007fc4966f0984 00007fc48fc6b6d4 00007fc48fc6b662
0709 13:00:43.543539 (+790560us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2437769472}
I20260709 13:00:43.609251  1512 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:43.570531  3742 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.596107  1618 rpcz_store.cc:276] 0709 13:00:41.442642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.442776 (+   134us) service_pool.cc:224] Handling call
0709 13:00:41.443090 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:41.447824 (+  4734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.447855 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:41.454483 (+  6628us) log.cc:844] Serialized 52 byte log entry
0709 13:00:43.595188 (+2140705us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:43.595229 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.595316 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.595356 (+    40us) raft_consensus.cc:1685] finished
0709 13:00:43.595366 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.595485 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7566,"raft.queue_time_us":7482,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":4826,"spinlock_wait_cycles":1792,"thread_start_us":2121844,"threads_started":1,"wal-append.queue_time_us":211978,"wal-append.run_cpu_time_us":1605,"wal-append.run_wall_time_us":1001733}
W20260709 13:00:43.689227  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 80042.5us
I20260709 13:00:43.689508  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:43.588179  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.639102  1614 raft_consensus.cc:2393] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 7: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:43.632334  1615 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:43.604965  2245 rpcz_store.cc:276] 0709 13:00:41.311186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.387037 (+ 75851us) service_pool.cc:224] Handling call
0709 13:00:41.387484 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:41.403812 (+ 16328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.403842 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.419512 (+ 15670us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.546815 (+2127303us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:43.546870 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.546969 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.547023 (+    54us) raft_consensus.cc:1685] finished
0709 13:00:43.547054 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.552453 (+  5399us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17079,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":13673,"thread_start_us":2103706,"threads_started":1,"wal-append.queue_time_us":244773,"wal-append.run_cpu_time_us":1814,"wal-append.run_wall_time_us":1004779}
I20260709 13:00:43.693480  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.598920  4085 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:43.644038  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.700075  1689 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:43.700304  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:43.701347  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.605155  1617 rpcz_store.cc:276] 0709 13:00:41.003122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.004337 (+  1215us) service_pool.cc:224] Handling call
0709 13:00:41.004718 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:41.005106 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:00:41.301929 (+296823us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.440357 (+138428us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:41.448066 (+  7709us) log.cc:844] Serialized 52 byte log entry
0709 13:00:41.448227 (+   161us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:41.450004 (+  1777us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.456090 (+  6086us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.547983 (+2091893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.548073 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.548109 (+    36us) raft_consensus.cc:1685] finished
0709 13:00:43.548121 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.552285 (+  4164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103246,"prepare.queue_time_us":374086,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":8420,"raft.queue_time_us":45575,"raft.run_cpu_time_us":499,"raft.run_wall_time_us":23371,"spinlock_wait_cycles":32384,"thread_start_us":2477880,"threads_started":3,"wal-append.queue_time_us":137781,"wal-append.run_cpu_time_us":2753,"wal-append.run_wall_time_us":1002774}
I20260709 13:00:43.638662  1621 consensus_queue.cc:260] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.701876  1614 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:43.702107  1621 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:43.647361  1692 raft_consensus.cc:2410] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:43.702430  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.648046  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.648169  4006 leader_election.cc:290] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:43.599083  4063 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:43.594609  4144 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:43.604215  3963 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.602990  3341 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:43.552506  3713 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:43.653174  2244 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:43.699635  4085 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:43.654767  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.658934  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.660719  1687 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:43.660857  4112 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:43.661512  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.744767  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.578176  1539 rpcz_store.cc:276] 0709 13:00:41.476622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.478771 (+  2149us) service_pool.cc:224] Handling call
0709 13:00:41.479128 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.480862 (+  1734us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:42.691323 (+1210461us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.692431 (+  1108us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.692497 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:42.692548 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.692623 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.692755 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1210174,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":176152,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":129,"thread_start_us":692,"threads_started":1,"wal-append.queue_time_us":1077}
I20260709 13:00:43.665621  4127 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:43.666484  3957 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:43.751456  2242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 598) took 2465 ms. Trace:
I20260709 13:00:43.652267  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.675105  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:43.675740  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08002eef80 after lost signal to thread 3962
I20260709 13:00:43.675894  1443 catalog_manager.cc:5697] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 2 to 3, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:00:43.752286  1476 debug-util.cc:398] Leaking SignalData structure 0x7b080038e360 after lost signal to thread 4000
I20260709 13:00:43.752619  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.712232  4125 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:43.681915  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.690476  1512 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:43.681741  4142 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:00:43.691926  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.692010  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.692660  1696 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
W20260709 13:00:43.760336  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 69916.9us
I20260709 13:00:43.760558  1546 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:43.694928  3999 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:43.696066  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.696781  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.764724  1542 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:00:43.697225  3742 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:43.697535  3865 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:43.699291  4140 log.cc:927] Time spent T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:00:43.371888  2237 rpcz_store.cc:276] 0709 13:00:41.228376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.230762 (+  2386us) service_pool.cc:224] Handling call
0709 13:00:41.290116 (+ 59354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.315954 (+ 25838us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:42.931540 (+1615586us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.947000 (+ 15460us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.947071 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:42.947121 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.947204 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.947382 (+   178us) inbound_call.cc:177] Queueing success response
0709 13:00:43.141019 (+193637us) spinlock_profiling.cc:243] Waited 99.3 ms on lock 0x7b48002508d8. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc496654aa1 00007fc49664bb37 00007fc49664b9ca 00007fc49674326f 00007fc496742f37 00007fc49675755c 00007fc496757508 00007fc496757488 00007fc496757443 00007fc4967566ec 00007fc495680a96
Metrics: {"mutex_wait_us":15250,"prepare.queue_time_us":120696,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2543,"raft.queue_time_us":92928,"raft.run_cpu_time_us":3232,"raft.run_wall_time_us":101223,"spinlock_wait_cycles":228430080,"thread_start_us":262095,"threads_started":2,"wal-append.queue_time_us":15433}
I20260709 13:00:43.776214  4096 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:43.776412  4127 consensus_queue.cc:1059] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:43.777464  4115 raft_consensus.cc:3055] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:43.777773  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.778421  2238 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:43.778956  3868 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:43.779314  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:43.780807  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.781584  4119 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:43.765872  4122 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:43.784205  4125 raft_consensus.cc:697] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:43.785113  4125 consensus_queue.cc:237] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.787213  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.702687  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.708318  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.708823  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.711499  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.711951  1693 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:43.653775  3541 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.681139  4056 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:43.716068  1511 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:43.679427  4091 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:43.719324  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.719894  4073 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:43.655664  4106 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.777796  4115 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:43.650928  1541 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:43.809650  1540 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:43.725687  1694 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:43.730723  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.731700  4113 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:43.735647  3814 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:43.740247  3996 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:43.745805  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:43.714250  4144 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:43.638262  3816 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:43.710120  3970 raft_consensus.cc:3055] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:43.752955  1443 catalog_manager.cc:5697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:43.826226  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.752136  1691 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:43.759079  1545 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:43.761374  1512 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:43.828294  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 66989.8us
I20260709 13:00:43.829149  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.827095  1543 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:43.709667  4063 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.745220  4085 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:43.840078  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:43.766698  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:43.751896  2242 rpcz_store.cc:276] 0709 13:00:41.286587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.309305 (+ 22718us) service_pool.cc:224] Handling call
0709 13:00:41.328943 (+ 19638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.329154 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:41.584160 (+255006us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.492160 (+1908000us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.664564 (+172404us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b180038c080. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e60c2a6 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e522 00007fc48e6407c1
0709 13:00:43.751118 (+ 86554us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:43.751174 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:43.751216 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.751295 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.751402 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25451,"prepare.queue_time_us":392788,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":71,"raft.queue_time_us":30190,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":4302,"spinlock_wait_cycles":35466240,"thread_start_us":2358966,"threads_started":5,"wal-append.queue_time_us":178450,"wal-append.run_cpu_time_us":1147,"wal-append.run_wall_time_us":1001172}
I20260709 13:00:43.767318  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.768147  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.841243  1538 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:43.841337  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 276) took 1009 ms. Trace:
I20260709 13:00:43.769111  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.837538  1443 catalog_manager.cc:5697] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:43.841799  1546 rpcz_store.cc:276] 0709 13:00:42.832402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.764919 (+932517us) service_pool.cc:224] Handling call
0709 13:00:43.841275 (+ 76356us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:43.842410  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.842692  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.842823  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:43.800639  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 84622.6us
I20260709 13:00:43.851269  1546 raft_consensus.cc:2410] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:43.800590  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.851738  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2213) took 1026 ms. Trace:
I20260709 13:00:43.795807  1696 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:43.803380  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.729889  3713 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.811086  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.853161  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.853845  1616 raft_consensus.cc:2393] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 7: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:43.853770  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.854769  1621 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:00:43.852249  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.855794  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.856451  1614 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:43.858562  2243 raft_consensus.cc:2410] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:00:43.821259  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.822795  1620 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:43.852106  1546 rpcz_store.cc:276] 0709 13:00:42.825626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.842573 (+1016947us) service_pool.cc:224] Handling call
0709 13:00:43.851678 (+  9105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:43.859974  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.860569  1546 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:43.861541  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.854789  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.823293  1688 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:43.680341  1544 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:43.862640  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.841580  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.843281  1622 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:43.773833  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:43.864020  1546 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:43.864269  2239 raft_consensus.cc:2410] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:43.865388  1696 raft_consensus.cc:1240] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:43.843667  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.807487  3954 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:43.863564  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2228) took 1034 ms. Trace:
I20260709 13:00:43.822393  3541 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:43.826659  3970 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:43.879259  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.879997  3970 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.881659  3970 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:43.846323  3816 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:43.883590  3816 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.885492  1617 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:00:43.886260  3816 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:43.842828  1443 catalog_manager.cc:5697] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 3 to 5, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 5 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:43.887910  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1086) took 2403 ms (client timeout 2181 ms). Trace:
I20260709 13:00:43.887923  1443 catalog_manager.cc:5697] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index -1 to 4, term changed from 1 to 3, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194), VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:43.836273  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2219) took 1008 ms. Trace:
I20260709 13:00:43.880010  1546 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:43.892717  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:43.893442  1546 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:43.895790  4061 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:43.898212  1614 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:43.898646  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 277) took 1066 ms. Trace:
I20260709 13:00:43.869066  1587 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:43.888438  1541 rpcz_store.cc:269] 0709 13:00:41.484272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.546563 (+2062291us) service_pool.cc:224] Handling call
0709 13:00:43.887710 (+341147us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b54001874d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:43.887829 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27636608}
I20260709 13:00:43.899154  1542 rpcz_store.cc:276] 0709 13:00:42.832644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.556827 (+724183us) service_pool.cc:224] Handling call
0709 13:00:43.898409 (+341582us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b54002e4854. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:43.898559 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36284672}
I20260709 13:00:43.886807  1617 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:43.902388  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.902524  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.868942  3341 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:00:43.807080  4120 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:43.874503  1659 leader_election.cc:336] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.288s (SENT)
I20260709 13:00:43.844039  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.914762  1538 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:43.878371  1543 rpcz_store.cc:276] 0709 13:00:42.829624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.841324 (+1011700us) service_pool.cc:224] Handling call
0709 13:00:43.863509 (+ 22185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:43.915755  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:43.899592  4128 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:43.840896  3996 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:43.904139  1622 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:43.923864  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2229) took 1085 ms. Trace:
I20260709 13:00:43.924569  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.925362  1659 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:43.926255  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 51789.9us
I20260709 13:00:43.927565  4133 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:43.865309  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2224) took 1036 ms. Trace:
I20260709 13:00:43.928121  3713 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:43.928315  1547 rpcz_store.cc:276] 0709 13:00:42.828651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.764920 (+936269us) service_pool.cc:224] Handling call
0709 13:00:43.865251 (+100331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:43.928954  2210 leader_election.cc:304] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:43.929344  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:43.929955  1547 raft_consensus.cc:2376] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8. Re-sending same reply.
I20260709 13:00:43.930225  4128 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:43.930646  4128 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.930979  4128 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:43.933529  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 433728us
I20260709 13:00:43.934320  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.935540  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.935734  1660 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:43.935932  3823 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:43.936534  3953 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:43.936643  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:43.937038  3953 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:43.937492  3953 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:43.937814  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1091) took 2452 ms (client timeout 2175 ms). Trace:
I20260709 13:00:43.900769  1691 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:00:43.938179  1540 rpcz_store.cc:269] 0709 13:00:41.485749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.521199 (+2035450us) service_pool.cc:224] Handling call
0709 13:00:43.937651 (+416452us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54000695d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:43.937751 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532008832}
I20260709 13:00:43.938947  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.939549  1691 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
W20260709 13:00:43.939754  1695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 348) took 2385 ms (client timeout 1850 ms). Trace:
W20260709 13:00:43.940114  1695 rpcz_store.cc:269] 0709 13:00:41.554582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.554733 (+   151us) service_pool.cc:224] Handling call
0709 13:00:43.939575 (+2384842us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400133b54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:43.939666 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":511849728}
I20260709 13:00:43.940441  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.852203  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:43.940987  1691 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:43.940665  4128 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.941917  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.942101  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.939172  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.943156  1540 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:43.943421  3742 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:43.943826  3742 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:43.944021  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.944206  3742 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.944252  3957 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:43.941097  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.946645  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.947480  1613 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:43.936167  1687 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:43.948297  1543 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:43.890758  1443 catalog_manager.cc:5697] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 2 to 4, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:43.800057  4056 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:43.953685  1443 catalog_manager.cc:5697] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:43.908416  1587 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:43.806398  3722 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:43.900831  4061 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:43.808858  4115 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:43.910003  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:43.910302  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.823060  4144 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.968501  1694 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:00:43.956867  4056 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:43.939428  4113 consensus_queue.cc:1059] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:43.872959  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.891396  1545 rpcz_store.cc:276] 0709 13:00:42.827460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.577902 (+750442us) service_pool.cc:224] Handling call
0709 13:00:43.836229 (+258327us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:43.969915  4079 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:43.970367  4079 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:43.970726  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.924336  1538 rpcz_store.cc:276] 0709 13:00:42.829852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.841841 (+1011989us) service_pool.cc:224] Handling call
0709 13:00:43.915192 (+ 73351us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:43.971400  4061 raft_consensus.cc:697] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:43.971556  4128 leader_election.cc:290] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:43.971800  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.972309  4061 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:43.973045  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.973429  1620 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:43.970752  4079 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:43.974157  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.973694  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:43.974790  1687 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:43.940789  3814 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:43.927145  1622 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:43.924345  1546 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:00:43.984022  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.984715  1546 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:43.952242  1544 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:43.942997  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:43.957046  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 48701.8us
I20260709 13:00:43.957733  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:43.958379  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:43.985957  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:43.986385  1543 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:43.960592  1443 catalog_manager.cc:5697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:43.986536  1587 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:43.987740  1587 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:43.962819  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:43.988538  1689 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:43.975142  1619 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:43.930881  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.990135  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2226) took 1161 ms. Trace:
I20260709 13:00:43.990584  1547 rpcz_store.cc:276] 0709 13:00:42.829127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.930641 (+1101514us) service_pool.cc:224] Handling call
0709 13:00:43.990063 (+ 59422us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:43.991808  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:43.992576  1546 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:43.973691  1538 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:43.986615  1541 raft_consensus.cc:2376] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6. Re-sending same reply.
I20260709 13:00:43.994284  1691 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:43.997073  3341 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:43.997524  3341 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.997949  3341 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:44.000206  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 346) took 2458 ms (client timeout 1883 ms). Trace:
W20260709 13:00:44.003418  1544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1080) took 2526 ms (client timeout 1891 ms). Trace:
W20260709 13:00:44.004089  1544 rpcz_store.cc:269] 0709 13:00:41.476952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.479975 (+  3023us) service_pool.cc:224] Handling call
0709 13:00:42.952800 (+1472825us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5800002d98. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc4966f10a0 00007fc4966f0984 00007fc48fc6b6d4 00007fc48fc6b662
0709 13:00:44.003121 (+1050321us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b5400186fd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:44.003311 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4012022912}
W20260709 13:00:44.000836  1688 rpcz_store.cc:269] 0709 13:00:41.542091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.542235 (+   144us) service_pool.cc:224] Handling call
0709 13:00:43.999904 (+2457669us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54002c6d54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:44.000096 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1364700032}
I20260709 13:00:44.009742  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.009948  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.010450  1545 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:44.010528  1543 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:44.009639  1443 catalog_manager.cc:5697] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 1 to 3, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:43.957103  3722 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:44.013269  1585 leader_election.cc:336] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.176s (SENT)
I20260709 13:00:44.012728  1443 catalog_manager.cc:5697] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:43.944907  3957 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:44.018213  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:44.018226  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:44.022563  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.022461  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.026834  1546 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:43.987314  3814 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.023931  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:44.021777  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1085) took 2537 ms. Trace:
I20260709 13:00:44.036700  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:44.030803  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:44.031133  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:44.031349  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.039691  1547 raft_consensus.cc:2410] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:44.031517  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:44.031594  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:44.032874  1687 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:44.033047  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:44.033154  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:44.035527  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:44.033182  1538 rpcz_store.cc:276] 0709 13:00:41.483979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.014414 (+2530435us) service_pool.cc:224] Handling call
0709 13:00:44.021129 (+  6715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.021349 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.021387 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.021443 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:44.021487 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.021570 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.021703 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:44.035298  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:44.036204  3970 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:00:44.053110  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:44.053869  1696 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:00:44.054806  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:44.053882  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:44.057288  1618 raft_consensus.cc:2410] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:00:44.058399  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:44.059207  2211 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:44.059847  1696 raft_consensus.cc:2393] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:44.059157  2245 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:44.061299  1538 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:44.062057  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1096) took 2574 ms. Trace:
I20260709 13:00:44.062529  1538 rpcz_store.cc:276] 0709 13:00:41.487164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.047282 (+2560118us) service_pool.cc:224] Handling call
0709 13:00:44.060883 (+ 13601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.061767 (+   884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.061991 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:44.017765  4047 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:44.073433  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:44.071543  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.075119  1538 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 2.
I20260709 13:00:44.009409  3918 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:44.080240  3918 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:44.069116  2211 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:44.024487  3722 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:44.081305  3918 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:44.009613  4073 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:44.083489  4073 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:44.066659  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:44.067672  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:44.086165  1689 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:44.087215  1546 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:00:44.087792  1689 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:00:44.088179  1689 pending_rounds.cc:85] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 3
I20260709 13:00:44.088400  1689 pending_rounds.cc:107] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:00:44.088645  1689 raft_consensus.cc:2889] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:44.087834  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2215) took 1261 ms. Trace:
I20260709 13:00:44.091640  1546 rpcz_store.cc:276] 0709 13:00:42.826171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.086592 (+1260421us) service_pool.cc:224] Handling call
0709 13:00:44.086963 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.087615 (+   652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.087784 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:44.093187  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:44.095078  4073 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:44.114760  1541 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:44.116885  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:44.097862  3722 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:44.079815  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 228620us
I20260709 13:00:44.108832  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:44.135866  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:44.112581  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:44.121737  1538 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:44.038012  3814 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:44.125761  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:44.152737  1691 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:00:44.031598  2238 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:44.030753  4115 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:44.123414  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:44.129096  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:44.130339  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 61335us
I20260709 13:00:44.132143  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:44.139302  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:44.073655  4146 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:44.107645  4047 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:44.136348  1622 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:44.156888  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:44.109985  3970 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:44.185113  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 53100.3us
I20260709 13:00:44.187677  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:44.195103  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:44.195605  1694 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:00:44.196537  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:44.197786  4112 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:44.199443  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:44.202183  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:44.198590  4112 consensus_queue.cc:1059] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:00:44.205561  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 48798.1us
W20260709 13:00:44.206223  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.143514  4148 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:44.200608  4047 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:44.225356  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.150893  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2214) took 1325 ms. Trace:
I20260709 13:00:44.253248  1538 rpcz_store.cc:276] 0709 13:00:42.825901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.108133 (+1282232us) service_pool.cc:224] Handling call
0709 13:00:44.121510 (+ 13377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.150535 (+ 29025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.150821 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:44.185554  4055 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:44.256870  1511 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:44.210264  3895 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:44.257144  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2216) took 1430 ms. Trace:
I20260709 13:00:44.290512  2211 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:44.289846  1546 rpcz_store.cc:276] 0709 13:00:42.826427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.092478 (+1266051us) service_pool.cc:224] Handling call
0709 13:00:44.092795 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.093042 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:44.093353 (+   311us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.227025 (+133672us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.227757 (+   732us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.227809 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:44.256647 (+ 28838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.256737 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.257088 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39499,"prepare.queue_time_us":16153,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":17147,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":37087,"thread_start_us":100434,"threads_started":1}
I20260709 13:00:44.149879  3341 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:44.291711  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.257781  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.192415  4146 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:44.255148  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:44.295598  1694 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:44.292968  1689 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:44.204679  3970 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:44.298151  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.293143  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:44.213100  4133 consensus_queue.cc:1059] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:00:44.150195  4106 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:44.305619  1540 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:44.306146  3341 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:44.281965  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.294236  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:44.291754  2211 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:44.310335  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.311879  2211 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:44.313874  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:00:44.322613  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 66303.5us
I20260709 13:00:44.323204  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.323570  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:44.228583  4046 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:00:44.228756  4029 consensus_queue.cc:1059] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:00:44.323884  1538 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
W20260709 13:00:44.335829  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.338686  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:44.299152  4146 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:44.304396  4145 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:44.353415  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1088) took 2868 ms. Trace:
I20260709 13:00:44.360069  1541 rpcz_store.cc:276] 0709 13:00:41.484901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.012153 (+2527252us) service_pool.cc:224] Handling call
0709 13:00:44.012448 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.115307 (+102859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.353139 (+237832us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54000d1954. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:44.353347 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234706304}
I20260709 13:00:44.361496  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.356400  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.350917  1546 raft_consensus.cc:2376] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7. Re-sending same reply.
I20260709 13:00:44.311013  4120 raft_consensus.cc:3055] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:44.307222  3970 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:44.357152  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.362864  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.319906  4148 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:44.324783  4096 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:44.373126  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:44.380897  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.377565  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:44.355291  4112 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:44.407919  4112 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:44.408375  4112 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:44.341378  4093 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:44.411433  4093 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.411841  4093 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:44.365631  4033 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:00:44.353883  3895 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:44.374471  4153 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:00:44.420145  4039 raft_consensus.cc:3055] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:44.420671  4039 raft_consensus.cc:740] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:44.421476  4039 consensus_queue.cc:260] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:44.421996  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1095) took 2935 ms. Trace:
W20260709 13:00:44.423293  4163 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:44.424360  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1090) took 2939 ms. Trace:
I20260709 13:00:44.387557  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:44.424706  1544 rpcz_store.cc:276] 0709 13:00:41.485448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.014671 (+2529223us) service_pool.cc:224] Handling call
0709 13:00:44.015072 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.025599 (+ 10527us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:00:44.025628 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.048143 (+ 22515us) log.cc:844] Serialized 26 byte log entry
0709 13:00:44.289900 (+241757us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:44.289940 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.290012 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.424147 (+134135us) raft_consensus.cc:1685] finished
0709 13:00:44.424179 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.424305 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9256,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":8069,"thread_start_us":136303,"threads_started":1,"wal-append.queue_time_us":240333}
I20260709 13:00:44.389210  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:44.389803  4150 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:00:44.390731  4149 log.cc:927] Time spent T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
W20260709 13:00:44.395120  4161 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:00:44.359721  4145 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:44.400512  3722 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:44.368319  4120 raft_consensus.cc:740] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:44.356680  3713 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:44.443032  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.445021  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.454464  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.478163  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1080) took 1132 ms. Trace:
W20260709 13:00:44.480204  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.480149  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:44.488065  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 187970us
I20260709 13:00:44.445535  3895 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:44.478693  1690 rpcz_store.cc:276] 0709 13:00:43.345812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.719115 (+373303us) service_pool.cc:224] Handling call
0709 13:00:43.947673 (+228558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.947880 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:43.948147 (+   267us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.011593 (+ 63446us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.011733 (+   140us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.011770 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:44.011809 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.011870 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.253135 (+241265us) spinlock_profiling.cc:243] Waited 7.47 ms on lock 0x7b18004967e0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:00:44.477954 (+224819us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54002c6850. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:44.478095 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38338,"prepare.queue_time_us":6455,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":95,"raft.queue_time_us":34020,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":15712,"spinlock_wait_cycles":653140352,"thread_start_us":47450,"threads_started":1,"wal-append.queue_time_us":85262}
I20260709 13:00:44.511437  4120 consensus_queue.cc:260] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:44.512969  4120 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:44.516201  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.517185  1544 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:44.463917  4145 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:44.524581  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2212) took 1699 ms. Trace:
W20260709 13:00:44.527055  4152 log.cc:927] Time spent T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 13:00:44.532846  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.489923  1511 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:44.545047  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.532651  1547 rpcz_store.cc:276] 0709 13:00:42.825314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.106758 (+1281444us) service_pool.cc:224] Handling call
0709 13:00:44.134151 (+ 27393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.134496 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.134534 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.186717 (+ 52183us) log.cc:844] Serialized 26 byte log entry
0709 13:00:44.309741 (+123024us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:44.309788 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.309851 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.524338 (+214487us) raft_consensus.cc:1685] finished
0709 13:00:44.524362 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.524518 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9816,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":20604,"thread_start_us":50851,"threads_started":1,"wal-append.queue_time_us":235023}
I20260709 13:00:44.553537  2246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 604) took 1173 ms. Trace:
W20260709 13:00:44.554210  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 64385.3us
I20260709 13:00:44.556427  4127 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:44.558751  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 69852.8us
I20260709 13:00:44.554111  2246 rpcz_store.cc:276] 0709 13:00:43.380376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.598588 (+218212us) service_pool.cc:224] Handling call
0709 13:00:43.598858 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:43.601363 (+  2505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.601395 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:43.601913 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:00:44.008610 (+406697us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:44.008661 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.008736 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.547993 (+539257us) raft_consensus.cc:1685] finished
0709 13:00:44.553275 (+  5282us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.553463 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19515,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"thread_start_us":386192,"threads_started":1,"wal-append.queue_time_us":509150}
I20260709 13:00:44.559540  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.488693  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.391083  3953 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:44.561439  1544 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
W20260709 13:00:44.562260  1619 consensus_meta.cc:287] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.553s	user 0.012s	sys 0.006s
I20260709 13:00:44.422362  1543 rpcz_store.cc:276] 0709 13:00:41.486890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.016312 (+2529422us) service_pool.cc:224] Handling call
0709 13:00:44.016614 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.024856 (+  8242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.024920 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.025365 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:00:44.187851 (+162486us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:44.209167 (+ 21316us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.212106 (+  2939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.212804 (+   698us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.421789 (+208985us) raft_consensus.cc:1685] finished
0709 13:00:44.421809 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.421928 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9095,"prepare.queue_time_us":21215,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":9576,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":182,"thread_start_us":135206,"threads_started":1,"wal-append.queue_time_us":277367}
I20260709 13:00:44.563205  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.566416  1619 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:44.569689  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:44.570643  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.451282  3742 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:44.573033  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.573365  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.573823  1547 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:00:44.574317  1544 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:44.576061  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.577710  1543 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:44.578382  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2218) took 1751 ms. Trace:
I20260709 13:00:44.578773  1543 rpcz_store.cc:276] 0709 13:00:42.827157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.577180 (+1750023us) service_pool.cc:224] Handling call
0709 13:00:44.577503 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.578133 (+   630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.578320 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:44.582214  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2221) took 1754 ms. Trace:
I20260709 13:00:44.582393  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:44.597213  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.586314  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2220) took 1758 ms. Trace:
I20260709 13:00:44.626111  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.630512  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:44.630774  1538 raft_consensus.cc:2410] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:00:44.631161  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 50782.5us
I20260709 13:00:44.618276  1540 rpcz_store.cc:276] 0709 13:00:42.827711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.580954 (+1753243us) service_pool.cc:224] Handling call
0709 13:00:44.585720 (+  4766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.585930 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.585966 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.586019 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:44.586068 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.586136 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.586249 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:44.631397  1696 raft_consensus.cc:1240] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:44.624184  1543 rpcz_store.cc:276] 0709 13:00:42.827937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.581105 (+1753168us) service_pool.cc:224] Handling call
0709 13:00:44.581430 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.581643 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.581680 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.581732 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:44.581804 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.581874 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.581990 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:44.522444  3895 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:44.630836  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.641531  1695 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:44.645509  3146 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.646234  3146 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:44.652233  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 340351us
I20260709 13:00:44.654541  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:44.638198  3868 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:44.588666  4127 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:44.638409  4143 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:00:44.663678  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:44.664512  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:44.639935  3996 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:44.643136  1540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39612
W20260709 13:00:44.648191  4157 log.cc:927] Time spent T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.394s	user 0.000s	sys 0.002s
I20260709 13:00:44.669092  1547 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 1.
I20260709 13:00:44.669768  2211 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:44.671547  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:44.676225  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:44.677103  2246 raft_consensus.cc:2393] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 7: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
W20260709 13:00:44.677531  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.678532  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:44.678589  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:44.679761  1620 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 13:00:44.661477  4085 consensus_meta.cc:287] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.730s	user 0.000s	sys 0.022s
I20260709 13:00:44.675704  1540 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:44.682307  1540 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:44.680335  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:44.668828  4061 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.010s	sys 0.016s
I20260709 13:00:44.701350  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.702688  1544 raft_consensus.cc:2410] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:44.681180  3999 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:44.707751  3999 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.708223  3999 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:44.710213  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:44.710886  1694 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:44.712899  1694 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:44.716624  4155 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.317s	user 0.000s	sys 0.014s
I20260709 13:00:44.718261  3146 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:44.719014  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:44.723405  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.723917  4159 log.cc:927] Time spent T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:00:44.725844  1585 leader_election.cc:336] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.609s (SENT)
I20260709 13:00:44.726326  1585 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:44.728369  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:44.729499  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:44.741104  3895 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:44.746769  4073 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.747350  4073 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:44.681699  3963 consensus_meta.cc:287] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.958s	user 0.003s	sys 0.021s
I20260709 13:00:44.749475  4073 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:44.750159  1621 raft_consensus.cc:2410] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:44.747679  4063 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:44.750778  3837 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:44.679174  4056 consensus_meta.cc:287] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.710s	user 0.011s	sys 0.010s
W20260709 13:00:44.828972  2209 leader_election.cc:336] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.545s (SENT)
W20260709 13:00:44.832890  1659 leader_election.cc:336] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.582s (SENT)
I20260709 13:00:44.715709  3999 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:44.853948  1691 consensus_meta.cc:287] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.689s	user 0.003s	sys 0.017s
I20260709 13:00:44.867408  1691 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:44.867274  2209 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:00:44.847534  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 121704us
W20260709 13:00:44.869751  1585 leader_election.cc:336] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.655s (SENT)
W20260709 13:00:44.870541  4079 consensus_meta.cc:287] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.896s	user 0.003s	sys 0.009s
I20260709 13:00:44.856634  3963 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:44.871011  4079 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:44.871814  1585 leader_election.cc:336] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.695s (SENT)
W20260709 13:00:44.872885  1585 leader_election.cc:336] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.755s (SENT)
I20260709 13:00:44.873294  1585 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:44.873355  4079 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:44.871857  3999 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:44.875506  3999 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:44.875385  4056 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:44.876852  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 47939.9us
I20260709 13:00:44.879666  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1093) took 3393 ms. Trace:
I20260709 13:00:44.880087  1545 rpcz_store.cc:276] 0709 13:00:41.486322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.016871 (+2530549us) service_pool.cc:224] Handling call
0709 13:00:44.053113 (+ 36242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.053624 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.053653 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.054218 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:00:44.090870 (+ 36652us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:44.090928 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.091007 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.879422 (+788415us) raft_consensus.cc:1685] finished
0709 13:00:44.879444 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.879583 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1057,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":106,"thread_start_us":36346,"threads_started":1,"wal-append.queue_time_us":103397}
I20260709 13:00:44.882052  1538 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:00:44.882799  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2227) took 2053 ms. Trace:
I20260709 13:00:44.883189  1538 rpcz_store.cc:276] 0709 13:00:42.829373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.835553 (+2006180us) service_pool.cc:224] Handling call
0709 13:00:44.881732 (+ 46179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.882548 (+   816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.882744 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:44.884505  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:44.905987  1545 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
W20260709 13:00:44.885962  1585 leader_election.cc:336] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.777s (SENT)
I20260709 13:00:44.907464  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:44.751434  3837 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:44.891709  2209 leader_election.cc:336] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.561s (SENT)
W20260709 13:00:44.902366  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.911224  2240 raft_consensus.cc:2393] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:44.677233  3996 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:44.903877  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 51193.9us
I20260709 13:00:44.841158  2210 leader_election.cc:304] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:00:44.914330  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 73276.3us
W20260709 13:00:44.939886  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.995823  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 77518.9us
I20260709 13:00:44.999680  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2223) took 2171 ms. Trace:
I20260709 13:00:45.000496  1543 rpcz_store.cc:276] 0709 13:00:42.828412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.633363 (+1804951us) service_pool.cc:224] Handling call
0709 13:00:44.647811 (+ 14448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.912176 (+264365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.912210 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.999116 (+ 86906us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:44.999199 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.999295 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.999475 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15710,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":256824,"threads_started":1}
I20260709 13:00:45.005254  1538 raft_consensus.cc:1240] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:44.701013  4085 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:45.003885  2209 leader_election.cc:336] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.668s (SENT)
I20260709 13:00:44.886229  3963 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:45.010725  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 273) took 2179 ms. Trace:
I20260709 13:00:45.015990  1545 rpcz_store.cc:276] 0709 13:00:42.831067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.906972 (+2075905us) service_pool.cc:224] Handling call
0709 13:00:45.010035 (+103063us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.010274 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.010326 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.010386 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:45.010434 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.010510 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.010652 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.012574  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 272) took 2181 ms. Trace:
I20260709 13:00:45.017539  1538 rpcz_store.cc:276] 0709 13:00:42.830827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.905855 (+2075028us) service_pool.cc:224] Handling call
0709 13:00:45.004989 (+ 99134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.012249 (+  7260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.012505 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.002368  3999 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:45.002583  4167 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:44.993913  3996 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:45.026504  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:45.027746  1542 raft_consensus.cc:2393] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:45.031536  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:45.032331  1691 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 7: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:45.029891  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:45.039152  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:45.047452  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 274) took 2216 ms. Trace:
I20260709 13:00:45.048285  1545 rpcz_store.cc:276] 0709 13:00:42.831836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.021039 (+2189203us) service_pool.cc:224] Handling call
0709 13:00:45.040323 (+ 19284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.047041 (+  6718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.047070 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.047121 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:45.047158 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.047263 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.047391 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:45.052577  4144 consensus_meta.cc:287] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 1.053s	user 0.025s	sys 0.008s
I20260709 13:00:45.054885  4055 raft_consensus.cc:3055] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:45.057469  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:45.058390  1543 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:45.035549  3999 raft_consensus.cc:697] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:45.067874  1540 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:45.076465  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 284) took 2215 ms. Trace:
I20260709 13:00:45.046465  3953 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:45.056581  3742 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:45.061942  4055 raft_consensus.cc:740] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:45.117758  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:45.118570  1688 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:45.129384  4115 consensus_meta.cc:287] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.944s	user 0.009s	sys 0.000s
I20260709 13:00:45.137123  1616 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:45.053059  4144 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:45.156664  4144 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:45.157881  2242 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:45.159834  4085 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:45.077235  1545 rpcz_store.cc:276] 0709 13:00:42.860771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.049226 (+2188455us) service_pool.cc:224] Handling call
0709 13:00:45.075766 (+ 26540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.076011 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.076052 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.076113 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:45.076167 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.076243 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.076386 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.162021  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:45.167614  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1103) took 1034 ms. Trace:
I20260709 13:00:45.168288  1689 rpcz_store.cc:276] 0709 13:00:44.133161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.297484 (+164323us) service_pool.cc:224] Handling call
0709 13:00:44.300554 (+  3070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.339281 (+ 38727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.339311 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.339352 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:44.339381 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.167229 (+827848us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b5400449154. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:45.167340 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.167524 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88560000}
I20260709 13:00:45.171339  4055 consensus_queue.cc:260] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:45.171654  3999 consensus_queue.cc:237] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:45.172390  4055 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.176112  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 396) took 1118 ms. Trace:
I20260709 13:00:45.176512  1615 rpcz_store.cc:276] 0709 13:00:44.057652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.150469 (+ 92817us) service_pool.cc:224] Handling call
0709 13:00:44.159135 (+  8666us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.463120 (+303985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.463151 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.495161 (+ 32010us) log.cc:844] Serialized 26 byte log entry
0709 13:00:45.020911 (+525750us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:45.020961 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.021033 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:45.175918 (+154885us) raft_consensus.cc:1685] finished
0709 13:00:45.175936 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.176058 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6289,"raft.queue_time_us":96432,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":7859,"thread_start_us":736827,"threads_started":2,"wal-append.queue_time_us":567115}
W20260709 13:00:45.177772  4093 consensus_meta.cc:287] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.766s	user 0.008s	sys 0.000s
I20260709 13:00:45.178215  4093 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:45.180581  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.181377  4145 consensus_meta.cc:287] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.001s
W20260709 13:00:45.182011  4112 consensus_meta.cc:287] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.773s	user 0.007s	sys 0.002s
I20260709 13:00:45.181782  4145 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:45.182401  4112 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:45.187510  4056 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:45.194347  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:45.201362  1689 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:00:45.202507  1545 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:00:45.202733  1543 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:45.198939  1688 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:45.209348  1545 pending_rounds.cc:85] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 2
I20260709 13:00:45.209805  1545 pending_rounds.cc:107] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:00:45.210058  1545 raft_consensus.cc:2889] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:45.210774  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1098) took 1363 ms. Trace:
I20260709 13:00:45.211166  1545 rpcz_store.cc:276] 0709 13:00:43.847389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.162932 (+1315543us) service_pool.cc:224] Handling call
0709 13:00:45.163229 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.210517 (+ 47288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.210709 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.230712  3341 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:45.232020  3341 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:45.239996  1543 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:45.240909  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1100) took 1393 ms. Trace:
I20260709 13:00:45.241393  1543 rpcz_store.cc:276] 0709 13:00:43.847869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.205838 (+1357969us) service_pool.cc:224] Handling call
0709 13:00:45.206118 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.240565 (+ 34447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.240827 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:45.187053  3814 consensus_meta.cc:287] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 1.001s	user 0.007s	sys 0.012s
W20260709 13:00:45.131745  4047 consensus_meta.cc:287] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.848s	user 0.010s	sys 0.000s
I20260709 13:00:45.247622  3341 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:45.202837  1689 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:45.256688  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1102) took 1408 ms. Trace:
W20260709 13:00:45.101817  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 186086us
I20260709 13:00:45.106561  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:45.257186  1545 rpcz_store.cc:276] 0709 13:00:43.848362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.212094 (+1363732us) service_pool.cc:224] Handling call
0709 13:00:45.256255 (+ 44161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.256407 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.256429 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.256470 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:45.256501 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.256549 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.256638 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.257910  1691 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:00:45.259624  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1112) took 1386 ms. Trace:
I20260709 13:00:45.261597  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:45.262537  1618 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:45.262446  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:45.262732  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:45.263324  1620 raft_consensus.cc:2376] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3. Re-sending same reply.
I20260709 13:00:45.266101  1541 raft_consensus.cc:2393] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:45.268489  1540 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:45.257946  1585 leader_election.cc:336] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.891s (SENT)
I20260709 13:00:45.270345  1585 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:45.271703  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:45.273151  3341 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:45.275018  1545 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:45.273458  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:45.273470  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:45.273727  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:45.282065  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1118) took 1317 ms. Trace:
I20260709 13:00:45.284264  1545 rpcz_store.cc:276] 0709 13:00:43.964498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.258221 (+1293723us) service_pool.cc:224] Handling call
0709 13:00:45.274581 (+ 16360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.281797 (+  7216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.282009 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.308501  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:45.272953  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:39612 (request call id 2222) took 2440 ms. Trace:
I20260709 13:00:45.317862  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:45.317674  1540 rpcz_store.cc:276] 0709 13:00:42.828190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.631866 (+1803676us) service_pool.cc:224] Handling call
0709 13:00:45.269014 (+637148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.304018  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:45.318564  1688 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:45.302268  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:45.315550  1539 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:45.319782  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:45.320389  1620 raft_consensus.cc:2376] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7. Re-sending same reply.
I20260709 13:00:45.286543  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:45.321204  1614 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:45.322489  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:00:45.328450  1585 leader_election.cc:336] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.940s (SENT)
W20260709 13:00:45.276774  4146 consensus_meta.cc:287] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.901s	user 0.014s	sys 0.008s
W20260709 13:00:45.274140  3970 consensus_meta.cc:287] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.844s	user 0.008s	sys 0.003s
I20260709 13:00:45.343688  4146 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:45.344388  3970 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:45.345300  2243 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:45.347999  4146 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:45.350528  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2274) took 1332 ms. Trace:
I20260709 13:00:45.351960  1617 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:00:45.352479  1617 pending_rounds.cc:85] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 2
I20260709 13:00:45.352800  1617 pending_rounds.cc:107] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:00:45.353137  1547 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:45.355093  2238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 614) took 1040 ms. Trace:
I20260709 13:00:45.355681  2238 rpcz_store.cc:276] 0709 13:00:44.315710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.316094 (+   384us) service_pool.cc:224] Handling call
0709 13:00:44.316564 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.418041 (+101477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.418073 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.418117 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:44.418146 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.354812 (+936666us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400631d54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:45.354876 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.355024 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232866048}
I20260709 13:00:45.357491  4093 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:45.359181  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1095) took 1308 ms. Trace:
I20260709 13:00:45.359549  4145 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:45.360704  2242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 554) took 1600 ms. Trace:
I20260709 13:00:45.361181  2242 rpcz_store.cc:276] 0709 13:00:43.760513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.849544 (+ 89031us) service_pool.cc:224] Handling call
0709 13:00:43.849827 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.158454 (+1308627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.360411 (+201957us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54007012d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:45.360634 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3007325440}
W20260709 13:00:45.361948  4120 consensus_meta.cc:287] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.848s	user 0.011s	sys 0.002s
I20260709 13:00:45.369213  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:45.369688  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.329556  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:45.353114  1617 raft_consensus.cc:2889] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:45.359553  1695 rpcz_store.cc:276] 0709 13:00:44.051172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.051302 (+   130us) service_pool.cc:224] Handling call
0709 13:00:44.051609 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.650040 (+598431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.358966 (+708926us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b5400133b54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:45.359116 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355906432}
I20260709 13:00:45.331743  1691 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
W20260709 13:00:45.373013  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.337206  1540 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:45.374217  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2247) took 1180 ms. Trace:
I20260709 13:00:45.374629  1540 rpcz_store.cc:276] 0709 13:00:44.193761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.330041 (+1136280us) service_pool.cc:224] Handling call
0709 13:00:45.337038 (+  6997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.373906 (+ 36868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.374152 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.322608  3868 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.274588  3541 raft_consensus.cc:3055] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:45.342803  3341 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:45.348325  2244 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:45.380172  1620 pending_rounds.cc:85] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 4
I20260709 13:00:45.380550  1620 pending_rounds.cc:107] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:00:45.380863  1620 raft_consensus.cc:2889] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:45.329106  1585 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:45.350936  1621 rpcz_store.cc:276] 0709 13:00:44.017835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.017982 (+   147us) service_pool.cc:224] Handling call
0709 13:00:45.350301 (+1332319us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b540042d954. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:45.350462 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665214336}
I20260709 13:00:45.253172  3814 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:45.253423  4047 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:45.366660  3996 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:45.371196  1587 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:45.384243  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.379113  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 57721.2us
I20260709 13:00:45.386924  1512 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.390887  3341 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:45.400686  1614 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:45.400961  3341 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.401407  3341 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:45.390383  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 47180.3us
I20260709 13:00:45.403999  1587 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:45.405507  1512 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:45.393270  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 64827.8us
I20260709 13:00:45.408015  1512 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:45.407991  1692 raft_consensus.cc:1240] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:45.409235  1690 raft_consensus.cc:1240] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:45.407867  3823 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:00:45.409953  4176 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:45.411144  3823 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:45.411547  3823 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:45.411895  3823 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.419775  1512 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.420956  1512 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:45.422147  1545 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:45.423177  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:45.378831  3541 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:45.424968  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:45.437522  4033 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:45.437973  4176 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:45.438529  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:45.409200  1587 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:45.438580  4033 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:45.390156  3895 consensus_queue.cc:1059] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:00:45.440786   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:45.440575  3541 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:45.403683  3957 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:45.383862  3868 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:45.400403  3954 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:45.445663  1542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1111) took 1572 ms (client timeout 1896 ms). Trace:
W20260709 13:00:45.479112  1542 rpcz_store.cc:269] 0709 13:00:43.873362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.902197 (+ 28835us) service_pool.cc:224] Handling call
0709 13:00:45.445434 (+1543237us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002e5254. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:45.445602 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2585049472}
I20260709 13:00:45.446578  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1098) took 1394 ms. Trace:
I20260709 13:00:45.400535  4178 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:45.449247  1538 raft_consensus.cc:1240] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:45.451624  3996 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:45.482245  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 452359us
I20260709 13:00:45.260031  1543 rpcz_store.cc:276] 0709 13:00:43.873637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.242327 (+1368690us) service_pool.cc:224] Handling call
0709 13:00:45.258906 (+ 16579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.259338 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.259365 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.259400 (+    35us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:45.259428 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.259478 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.259574 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98}
I20260709 13:00:45.453675  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2230) took 2623 ms. Trace:
I20260709 13:00:45.491201  1544 rpcz_store.cc:276] 0709 13:00:42.830095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.835623 (+2005528us) service_pool.cc:224] Handling call
0709 13:00:44.899222 (+ 63599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.900931 (+  1709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.900977 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.993608 (+ 92631us) log.cc:844] Serialized 26 byte log entry
0709 13:00:45.269641 (+276033us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:45.269877 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.269946 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:45.453431 (+183485us) raft_consensus.cc:1685] finished
0709 13:00:45.453452 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.453611 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":924,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":194422,"threads_started":1,"wal-append.queue_time_us":358183}
I20260709 13:00:45.453866  4047 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:45.455374  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 127748us
W20260709 13:00:45.455804  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 46716.4us
I20260709 13:00:45.459412  4106 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:45.424495  4112 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:45.510351  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:45.480499  1696 rpcz_store.cc:276] 0709 13:00:44.051969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.068319 (+ 16350us) service_pool.cc:224] Handling call
0709 13:00:44.068565 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.631818 (+563253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.446331 (+814513us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b54002c6354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:45.446511 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1293875072}
W20260709 13:00:45.479633  1659 leader_election.cc:336] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.676s (SENT)
I20260709 13:00:45.516288  1659 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.489948  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:45.517503  2242 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:45.482112  4191 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:45.464551  1585 leader_election.cc:336] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.896s (SENT)
I20260709 13:00:45.519637  1585 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:45.502229  3341 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:45.504688  3868 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:45.505132  3823 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:45.507360  3541 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:45.508055  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:45.508549  4029 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.508976  4012 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:45.509760  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:45.466226  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1091) took 1416 ms. Trace:
I20260709 13:00:45.514889  1587 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:45.520711  1659 leader_election.cc:336] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.725s (SENT)
I20260709 13:00:45.521281  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:45.513422  4106 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:45.525516  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 60990.2us
W20260709 13:00:45.544833  1585 leader_election.cc:336] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.907s (SENT)
I20260709 13:00:45.545073  3341 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:45.529127  2242 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:45.540735  1687 rpcz_store.cc:276] 0709 13:00:44.049966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.056915 (+  6949us) service_pool.cc:224] Handling call
0709 13:00:44.119388 (+ 62473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.119611 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:44.487754 (+368143us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.887601 (+399847us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.128660 (+241059us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b180015c640. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:00:45.465612 (+336952us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b180015c640. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e5b8c0a 00007fc497cf8219 00007fc48e640a40 00007fc48e63b4e4 00007fc48e63b455 00007fc491723060 00007fc491735716 00007fc491746287 00007fc491746208
0709 13:00:45.465786 (+   174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.465850 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:45.465911 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.465994 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.466156 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":482256,"prepare.queue_time_us":178251,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":81,"raft.queue_time_us":594913,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":38232,"spinlock_wait_cycles":57593856,"thread_start_us":725574,"threads_started":2,"wal-append.queue_time_us":544158}
W20260709 13:00:45.542876  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.546984  1585 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:45.547906  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.546679  1587 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:45.519415  4191 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:45.558223  1587 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:45.551357  1659 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.523571  3957 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:45.560943  3341 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:45.565222  3341 raft_consensus.cc:697] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:45.569340  1659 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:45.574045  1659 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.576640  4120 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:45.577111  4120 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:45.577474  4120 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:45.541501  3742 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:45.584035  1659 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.530576  4182 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:45.549876  4106 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.589744  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.553251  4047 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:45.549899  4070 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:45.596233  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 175320us
I20260709 13:00:45.600982  1512 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.602248  1512 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.602319  3341 consensus_queue.cc:237] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:45.604411  1512 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.568346  4169 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:45.606745  3868 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:45.589742  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:45.567209  4112 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:45.563267  4191 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:45.544622  4029 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:45.606657  1512 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.595351  4176 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:45.590320  4073 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:45.613044  4169 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:45.605572  3957 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:45.600322  4047 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.615164  3895 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:45.644428  1512 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:45.649309  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 102372us
I20260709 13:00:45.614603  3953 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:45.650138  1585 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:45.617386  3868 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:45.651281  1512 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.617103  4112 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:45.652491  4112 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.646854  3957 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:45.643381  4070 raft_consensus.cc:697] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:45.651978  1585 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:45.655133  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 97040.8us
I20260709 13:00:45.645548  4169 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.641889  4176 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:45.649574  4047 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.651259  4125 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:45.654325  3868 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:45.670354  2209 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.622s (SENT) [suppressed 51 similar messages]
I20260709 13:00:45.644104  4127 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:45.671697  4070 consensus_queue.cc:237] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:45.672710  4160 log.cc:927] Time spent T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 1.281s	user 0.011s	sys 0.007s
W20260709 13:00:45.674530  2240 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45882 (request call id 577) took 1657 ms (client timeout 1881 ms). Trace:
W20260709 13:00:45.694907  2240 rpcz_store.cc:269] 0709 13:00:44.017213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.017749 (+   536us) service_pool.cc:224] Handling call
0709 13:00:45.674298 (+1656549us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b540050f354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:45.674439 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1965242112}
I20260709 13:00:45.683943  4192 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:45.660712  3837 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:45.684293  3970 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:45.656926  3957 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.656765  4012 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:45.656371  4061 raft_consensus.cc:2764] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:45.693863  1587 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:45.665426  4176 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:45.662891  3895 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:45.704551  3823 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:45.705416  4029 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:45.706295  4197 log.cc:927] Time spent T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:00:45.707168  4194 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:00:45.738644  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:45.742287  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:45.700915  4192 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.743513  4192 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.711593  4200 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:45.686182  4125 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:45.715435  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 63505.6us
I20260709 13:00:45.693172  4127 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:45.717698  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 128013us
I20260709 13:00:45.751504  4127 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.752338  1659 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:45.753160  4029 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:45.753474  1659 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.754271  4029 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:45.754583  1659 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:45.727188  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:45.755892  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:45.756516  1659 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:45.756888  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:45.757345  1659 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.757893  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:45.758008  4046 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:45.758093  4055 consensus_meta.cc:287] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.002s
I20260709 13:00:45.758797  4046 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:45.759210  4046 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:45.716445  4012 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:45.760216  1659 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.760628  1622 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:45.696161  3918 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:00:45.754695  4029 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.719727  1660 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.730325  1618 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:45.739056  1613 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:45.765273  3823 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.771479  3823 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:45.778360  4106 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:45.779510  4061 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.780089  4061 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:45.781180  4203 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:45.782292  4061 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:45.783601  3814 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:45.748450  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:45.756285  4169 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:45.758920  4055 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:45.708073  4202 consensus_queue.cc:1059] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:00:45.733357  4167 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:45.785019  1659 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:45.786017  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 66442.1us
I20260709 13:00:45.794992  1660 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
W20260709 13:00:45.786345  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 114863us
I20260709 13:00:45.759644  4046 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.749475  4125 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.764835  4012 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:45.796211  2209 leader_election.cc:336] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.883s (SENT)
W20260709 13:00:45.799976  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 148807us
W20260709 13:00:45.829913  2209 leader_election.cc:336] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.886s (SENT)
I20260709 13:00:45.830284  1512 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:45.831094  2209 leader_election.cc:336] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.895s (SENT)
I20260709 13:00:45.803540  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:45.736734  4112 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:45.769480  4029 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:45.716311  4120 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:45.841888  4120 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:45.831722  2209 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.844094  3970 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:45.844717  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.847124  2209 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:45.852689  3970 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:45.853223  2209 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:00:45.855778  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 104796us
I20260709 13:00:45.747186  4191 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:45.793154  3814 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:45.863225  2209 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.735013  4162 consensus_queue.cc:1059] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:00:45.787523  4055 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:45.832334  4073 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:45.821187  3953 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:45.793790  3895 raft_consensus.cc:476] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 13:00:45.787634  4204 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:45.749025  4200 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:45.909660  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 78015.3us
I20260709 13:00:45.915844  1512 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:45.910897  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 51881.1us
W20260709 13:00:45.890734  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 70425.2us
W20260709 13:00:45.913041  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 109455us
I20260709 13:00:45.853192  3970 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:45.835168  4167 raft_consensus.cc:697] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:45.860898  4201 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:45.919106  1659 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.873413  4145 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:45.919222  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:45.892987  4055 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.900166  4169 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:45.928663  1512 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.901892  4191 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:45.898919  4106 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:45.921123  3970 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:45.937194  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:45.937594  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:45.938230  1614 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
W20260709 13:00:45.938750  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 60792us
I20260709 13:00:45.938902  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:45.939522  1613 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:45.941757  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:45.941982  4033 raft_consensus.cc:3055] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:45.942378  4033 raft_consensus.cc:740] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:45.946159  1659 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.937130  3823 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:45.920912  4073 raft_consensus.cc:697] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:45.890534  4056 consensus_queue.cc:1059] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:00:45.920692  3895 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:45.943127  3868 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:45.962502  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:45.936910  4204 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:45.953886  3999 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:45.961609  3953 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:45.978247  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 49666.1us
I20260709 13:00:45.960057  3814 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.960246  3541 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:45.980767  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:45.983194  1511 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:45.985301  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:45.985925  1543 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:45.988279  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:45.989862  4115 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:45.990327  4115 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.990180  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:00:45.991894  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2217) took 3165 ms (client timeout 2186 ms). Trace:
I20260709 13:00:45.989492  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:45.992597  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:45.992481  1539 rpcz_store.cc:269] 0709 13:00:42.826839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.839816 (+1012977us) service_pool.cc:224] Handling call
0709 13:00:45.991671 (+2151855us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54001603d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:45.991801 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2964776832}
I20260709 13:00:45.990938  4115 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.968827  4191 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:45.996978  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1890) took 2120 ms. Trace:
I20260709 13:00:46.000258  1692 rpcz_store.cc:276] 0709 13:00:43.876529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.943321 (+ 66792us) service_pool.cc:224] Handling call
0709 13:00:43.943575 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.408814 (+1465239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.996748 (+587934us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540014fd54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:45.996920 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3367080320}
I20260709 13:00:45.997319  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:46.002008  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:46.005494  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:45.998414  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:46.012311  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:45.953020  4033 consensus_queue.cc:260] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:45.982607  4167 consensus_queue.cc:237] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.015048  2244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 618) took 1636 ms. Trace:
W20260709 13:00:46.015468  4165 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 1.180s	user 0.006s	sys 0.005s
I20260709 13:00:46.016978  2243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 615) took 1699 ms. Trace:
I20260709 13:00:46.017419  2243 rpcz_store.cc:276] 0709 13:00:44.317770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.318134 (+   364us) service_pool.cc:224] Handling call
0709 13:00:44.318454 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.345706 (+1027252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.016750 (+671044us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54006c02d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:46.016921 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2360858496}
I20260709 13:00:46.023018  1546 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:46.015514  2244 rpcz_store.cc:276] 0709 13:00:44.378625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.378737 (+   112us) service_pool.cc:224] Handling call
0709 13:00:44.378972 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.384066 (+1005094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.014768 (+630702us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b54005f8554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:46.014973 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2228522752}
I20260709 13:00:46.026265  3953 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:46.026376  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1096) took 1974 ms. Trace:
I20260709 13:00:46.025794  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:46.027935  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:46.027074  1693 rpcz_store.cc:276] 0709 13:00:44.051479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.068227 (+ 16748us) service_pool.cc:224] Handling call
0709 13:00:44.077728 (+  9501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.078124 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.078151 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.119711 (+ 41560us) log.cc:844] Serialized 26 byte log entry
0709 13:00:44.476333 (+356622us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:44.476372 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.476437 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.014849 (+1538412us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:46.019357 (+  4508us) raft_consensus.cc:1685] finished
0709 13:00:46.019393 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.026312 (+  6919us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7574,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":48770176,"thread_start_us":317318,"threads_started":1,"wal-append.queue_time_us":484667}
I20260709 13:00:46.029085  3541 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:46.029445  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:46.030049  1539 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:46.030917  3953 raft_consensus.cc:697] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:46.032021  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:46.032297  3953 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.032886  1539 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:46.035810  4206 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:00:46.036473  4222 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:46.036978  4222 raft_consensus.cc:697] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:46.037801  4222 consensus_queue.cc:237] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.039572  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:00:46.040622  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.027357  1541 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:46.041905  1660 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:46.046489  1539 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:46.048055  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:00:45.996412  4209 log.cc:927] Time spent T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:00:46.053201  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:45.963332  4192 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:45.981532  4207 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:46.059141  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:46.070195  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:45.996596  4204 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:46.077221  1544 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:46.052256  4214 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:46.051656  3541 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:46.087513  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:45.997915  3814 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:45.995983  4047 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.090029  1541 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
W20260709 13:00:46.105567  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 122416us
I20260709 13:00:46.091856  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:46.132617  1585 leader_election.cc:336] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.988s (SENT)
I20260709 13:00:46.168915  1585 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:46.138520  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:46.112682  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:46.170142  1695 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:46.168151  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:46.181495  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:46.186062  1688 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 9: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:46.185006  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:46.187165  1693 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:46.191661  1689 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:46.191892  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:46.195888  1511 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:46.196554  1693 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
W20260709 13:00:46.197465  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 110023us
W20260709 13:00:46.198740  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 149508us
I20260709 13:00:46.199574  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:46.107640  4112 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:46.214210  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:46.202421  1693 raft_consensus.cc:606] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:46.203467  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:00:46.204911  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 341732us
I20260709 13:00:46.210565  1695 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:00:46.214856  1546 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:46.195631  4200 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:46.190938  4162 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:46.222462  2209 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:46.125710  4029 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.226171  2240 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:46.199909  4093 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:46.230154  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:46.230526  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:46.231979  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:46.233253  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:46.234112  1540 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 7: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:46.233928  4230 consensus_queue.cc:1059] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:46.235497  4207 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:46.235925  4207 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.236310  4207 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:46.236620  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:46.237552  2240 raft_consensus.cc:2393] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:46.243654  4061 raft_consensus.cc:3055] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:46.244135  4061 raft_consensus.cc:740] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:46.244977  4061 consensus_queue.cc:260] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.250272  4029 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:46.251089  1694 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:00:46.226380  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:46.200559  3953 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:46.252169  2244 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 1.
I20260709 13:00:46.236217  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:46.073436  4073 consensus_queue.cc:237] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.258858  3868 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:46.235056  4230 raft_consensus.cc:3055] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:46.255780  1587 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:46.208381  4146 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:46.198251  4201 consensus_queue.cc:1059] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:00:46.202339  3823 consensus_queue.cc:1059] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
W20260709 13:00:46.312665  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 56964.4us
I20260709 13:00:46.225984  4125 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.319629  1587 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:46.089013  4204 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.207420  3541 consensus_queue.cc:1059] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:00:46.326151  1511 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:46.320155  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 145765us
I20260709 13:00:46.267700  3953 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.335300  4220 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:46.336026  3953 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:46.338864  4046 consensus_meta.cc:287] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.000s
W20260709 13:00:46.340123  4228 log.cc:927] Time spent T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:00:46.340183  4046 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.341583  1691 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:46.342602  4046 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:46.343377  3895 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.343940  3895 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.346311  3895 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:46.340855  4127 consensus_meta.cc:287] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.589s	user 0.004s	sys 0.004s
I20260709 13:00:46.347617  4127 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.269466  4229 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:46.318639  4162 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:46.269615  4230 raft_consensus.cc:740] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:46.325186  4112 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.359771  1543 raft_consensus.cc:2393] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 7: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:46.315436  4146 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:46.354095  1511 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:46.264246  4176 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:46.370882  3957 consensus_meta.cc:287] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.000s
I20260709 13:00:46.362972  3823 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:46.359863  4220 raft_consensus.cc:697] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:46.370818  4146 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:46.374564  2237 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:46.381887  4093 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:46.417821  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 204939us
W20260709 13:00:46.419986  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.382091  4162 raft_consensus.cc:697] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:46.371778  4112 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.484362  1542 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:46.389546  3868 consensus_queue.cc:1059] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:00:46.393931  4166 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:46.394060  4225 consensus_queue.cc:1059] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:00:46.430838  4226 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:46.493296  4226 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.495573  4226 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:46.497134  4198 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.851s	user 0.003s	sys 0.001s
I20260709 13:00:46.404309  3957 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.392130  4207 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.501459  3957 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:46.502367  1687 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:46.503698  4207 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:46.463217  4230 consensus_queue.cc:260] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.509042  4230 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:46.512758  4204 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:46.418709  4210 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:46.513914  4210 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.503764  4215 raft_consensus.cc:3055] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:46.515811  4215 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:46.515951  4125 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:46.516268  4210 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:46.516654  4215 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.520138  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2233) took 2555 ms. Trace:
I20260709 13:00:46.520612  1545 rpcz_store.cc:276] 0709 13:00:43.965084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.285078 (+1319994us) service_pool.cc:224] Handling call
0709 13:00:45.299655 (+ 14577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.422685 (+123030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.519865 (+1097180us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540006a4d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:46.520073 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281110400}
I20260709 13:00:46.522274  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1110) took 1461 ms. Trace:
I20260709 13:00:46.522698  1690 rpcz_store.cc:276] 0709 13:00:45.060405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.176996 (+116591us) service_pool.cc:224] Handling call
0709 13:00:45.177435 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.409753 (+232318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.522021 (+1112268us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54001b7e54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:46.522214 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532445056}
I20260709 13:00:46.523983  4176 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:46.528162  4012 consensus_meta.cc:287] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.002s
I20260709 13:00:46.528631  4012 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.530747  4012 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:46.484257  4047 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:46.499105  4055 consensus_meta.cc:287] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.003s
I20260709 13:00:46.540966  4055 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.542956  1692 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:00:46.543519  4055 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:46.545506  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 1868) took 1880 ms. Trace:
I20260709 13:00:46.545910  1617 rpcz_store.cc:276] 0709 13:00:44.664700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.664816 (+   116us) service_pool.cc:224] Handling call
0709 13:00:45.351410 (+686594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.372654 (+ 21244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.545329 (+1172675us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b540042d950. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:46.545448 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1577822464}
I20260709 13:00:46.547782  3814 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:46.549041  4243 log.cc:927] Time spent T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:00:46.549805  4220 consensus_queue.cc:237] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.547879  4166 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.556043  4127 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:46.563687  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 185470us
I20260709 13:00:46.564745  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:46.566318  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:46.568854  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:46.569494  1617 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:46.571723  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:46.572795  1617 raft_consensus.cc:2393] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:46.575914  2241 raft_consensus.cc:1240] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:46.578663  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:46.578910  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:46.580737  1621 raft_consensus.cc:2368] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9.
I20260709 13:00:46.573537  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:46.581547  2240 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:46.582857  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:46.583990  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:46.584861  1615 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:46.534282  4115 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.588410  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:46.603519  1587 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:46.604235  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:46.607669  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:46.610761  3341 consensus_queue.cc:1059] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:46.611948  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:46.610963  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:46.613305  1622 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:46.614346  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:46.615182  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:46.618547  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:46.619164  1614 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:46.620795  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:46.622246  1621 raft_consensus.cc:1240] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:46.623313  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:46.579955  4127 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:46.653231  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:46.580107  4085 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:46.670981  1539 raft_consensus.cc:2393] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 7: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:46.587826  3823 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:46.651975  3970 consensus_meta.cc:287] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.693s	user 0.007s	sys 0.004s
I20260709 13:00:46.674497  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:46.676663  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.671864  1615 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:46.678592  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:46.682662  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 391) took 2968 ms. Trace:
I20260709 13:00:46.590541  4217 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:46.700340  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:46.683032  1618 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:46.557130  4162 consensus_queue.cc:237] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.736244  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:46.697294  1616 rpcz_store.cc:276] 0709 13:00:43.714618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.912794 (+198176us) service_pool.cc:224] Handling call
0709 13:00:43.913026 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.137738 (+1224712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.682447 (+1544709us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540033ac54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:46.682607 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2814359424}
I20260709 13:00:46.738104  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:46.766829  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:46.767742  1688 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:46.773953  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 99570.3us
I20260709 13:00:46.774761  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:46.624998  4070 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:46.776058  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:46.675392  4127 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:46.682826  4055 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:46.780927  1614 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:00:46.781538  4073 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:46.781702  4113 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:46.787070  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:46.684413  3823 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:46.626415  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:46.825595  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 171247us
I20260709 13:00:46.625249  3837 consensus_queue.cc:1059] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.160s
W20260709 13:00:46.829418  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 53397.5us
I20260709 13:00:46.778357  4070 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.786742  4127 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.832926  2211 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:46.833415  1688 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
W20260709 13:00:46.836071  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 53204.6us
I20260709 13:00:46.837451  1511 leader_election.cc:400] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9.
I20260709 13:00:46.837827  1511 leader_election.cc:403] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:46.669837  4251 consensus_queue.cc:1059] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.237s
I20260709 13:00:46.827426  3823 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:46.736290  3970 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.849128  2211 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:46.789541  4200 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:00:46.847915  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:46.834782  4070 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:46.833063  4235 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.832384  3957 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:46.850862  3999 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:46.859469  4234 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.859887  3999 raft_consensus.cc:697] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:46.860106  4234 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:46.860841  4246 log.cc:927] Time spent T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:00:46.861014  3999 consensus_queue.cc:237] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.862545  4234 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:46.834296  4073 raft_consensus.cc:697] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:46.846993  4113 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.871016  1511 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:46.851104  4207 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9.
I20260709 13:00:46.876027  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:46.877822  1617 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:46.871675  4085 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:46.844331  4210 consensus_queue.cc:1059] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:00:46.885627  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 58370.8us
I20260709 13:00:46.849933  4226 consensus_queue.cc:1059] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:00:46.868424  4166 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:46.890830  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 283) took 4030 ms. Trace:
I20260709 13:00:46.895345  1538 rpcz_store.cc:276] 0709 13:00:42.860432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.022511 (+2162079us) service_pool.cc:224] Handling call
0709 13:00:45.449047 (+426536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.482364 (+ 33317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.890681 (+1408317us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54002e5250. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:46.890786 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":959955712}
I20260709 13:00:46.884495  2237 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:46.879130  4112 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:46.869781  4235 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.888675  4085 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.903342  4248 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:46.904206  4250 log.cc:927] Time spent T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:00:46.904587  4247 log.cc:927] Time spent T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:00:46.904899  4252 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:46.909284  4252 raft_consensus.cc:697] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:46.875792  4113 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.913610  4113 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:46.888175  4146 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.917804  4127 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.918298  4073 consensus_queue.cc:237] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.901926  4226 consensus_queue.cc:1243] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:46.906836  4085 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.924620  4145 raft_consensus.cc:3055] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:46.925062  4145 raft_consensus.cc:740] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:46.925447  3970 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:46.894160  4115 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:46.926067  4145 consensus_queue.cc:260] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.927892  4223 raft_consensus.cc:3055] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:46.928269  4223 raft_consensus.cc:740] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:46.929078  4223 consensus_queue.cc:260] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.929996  4223 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.931289  4115 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.931813  4115 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.932446  4127 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:46.933452  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.933840  4039 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:46.933928  4115 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:46.910355  4252 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.935607  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:46.944140  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.947311  4012 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:46.949003  4012 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:46.950217  4192 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:46.922681  4182 consensus_queue.cc:1059] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:46.934911  4145 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.951987  4182 raft_consensus.cc:3055] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:46.952922  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:46.953548  1693 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:46.956825  4257 raft_consensus.cc:3055] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:46.957350  4257 raft_consensus.cc:740] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:46.962399  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5814bf31e900408885160ea0f89d6189"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40006
I20260709 13:00:46.963020  1616 raft_consensus.cc:606] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:00:46.953009  4182 raft_consensus.cc:740] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:46.964049  4224 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.964351  4182 consensus_queue.cc:260] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.965731  4182 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:46.964576  4224 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.967640  4210 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.968191  4210 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:46.969811  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:46.970388  1690 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:46.971756  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.972018  4211 raft_consensus.cc:3055] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:46.972453  4211 raft_consensus.cc:740] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:46.907968  1687 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:46.990540  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.994825  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5814bf31e900408885160ea0f89d6189"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40006
I20260709 13:00:46.995719  1616 raft_consensus.cc:606] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Received request to transfer leadership
W20260709 13:00:47.002934  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.922964  4235 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:47.001521  4230 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:00:47.011381  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:47.012250  1691 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:46.998780  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:47.016302  1687 raft_consensus.cc:2393] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:47.017055  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:47.017642  1687 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:00:47.018860  2243 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:46.958376  4257 consensus_queue.cc:260] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:46.970403  4210 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:47.024614  1690 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:47.028153  2211 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:47.028652  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:47.029450  1687 raft_consensus.cc:2393] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 7: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:47.039021  1585 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:47.040410  1585 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:47.037143  1693 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:47.041437  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:47.044793  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 169204us
I20260709 13:00:47.043177  1659 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:46.994395  4146 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:47.047062  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:47.048764  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:47.037716  4106 consensus_queue.cc:1059] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:00:47.068152  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:47.069836  1659 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:47.071647  1659 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:47.060273  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.058226  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:00:47.073076  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.052850  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:46.932461  3823 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.000607  4166 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:00:47.083500  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:47.046957  4230 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:47.084357  1691 raft_consensus.cc:2368] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9.
I20260709 13:00:47.049749  4220 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:47.085772  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:47.086851  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:47.088798  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "646909798f0047ef9e8073d28a784525"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:00:47.089300  1690 raft_consensus.cc:606] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:47.089602  1690 raft_consensus.cc:614] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:47.054385  3837 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:00:47.075299  4236 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:47.049914  4012 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:47.051381  4191 consensus_queue.cc:1059] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:00:47.063288  4070 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:47.076231  4039 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:47.103535  4039 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:47.104110  4039 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:47.075299  4223 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:47.061021  4203 raft_consensus.cc:3055] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:47.076352  4235 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:46.982095  4211 consensus_queue.cc:260] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.113693  1690 raft_consensus.cc:1240] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:47.113915  1691 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:47.119918  1690 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:47.121060  1690 raft_consensus.cc:1240] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:47.123792  1691 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:47.126142  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:47.104840  4230 raft_consensus.cc:697] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:47.131698  1690 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:47.132701  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:47.133941  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:47.135015  2243 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:47.134960  1691 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:00:47.136958  1695 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:47.115113  4203 raft_consensus.cc:740] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:47.129590  1693 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:47.140595  1693 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:47.127131  3868 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:47.141534  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:47.141867  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:47.142581  1512 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:47.122804  3999 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:47.143101  1690 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:47.146260  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:47.146631  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:47.151515  1546 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:47.151630  1547 raft_consensus.cc:2393] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:47.126783  4252 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:47.148200  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:47.126236  4221 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:47.149902  1512 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:47.150234  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1121) took 1162 ms. Trace:
I20260709 13:00:47.146737  3868 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.152608  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:47.140378  4070 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:47.117611  4201 consensus_queue.cc:1059] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:00:47.127549  4146 consensus_queue.cc:1059] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:00:47.139636  4211 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:47.201771  1543 rpcz_store.cc:276] 0709 13:00:45.987431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.987531 (+   100us) service_pool.cc:224] Handling call
0709 13:00:47.150051 (+1162520us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400128ed4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:47.150178 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796781824}
W20260709 13:00:47.198117  1430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 53582.4us
I20260709 13:00:47.151558  4093 consensus_queue.cc:1059] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:00:47.142908  4224 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:47.205605  1545 raft_consensus.cc:2376] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5. Re-sending same reply.
W20260709 13:00:47.161809  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.203322  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 53497.4us
I20260709 13:00:47.208680  4226 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:47.204521  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 156548us
I20260709 13:00:47.151690  4191 consensus_queue.cc:1059] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:00:47.233353  1585 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:47.235827  2209 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:47.236146  1585 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:47.155351  3999 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.214605  4201 consensus_queue.cc:1243] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:47.201722  4259 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:47.152719  4192 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:47.224517  1546 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:00:47.239444  1543 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:47.239215  2209 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:47.244872  4249 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:47.245620  4012 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:47.259855  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:47.260313  4012 raft_consensus.cc:697] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:47.261336  4012 consensus_queue.cc:237] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:47.246348  3999 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:47.247485  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:47.233196  4127 raft_consensus.cc:3055] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:47.252779  3823 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:47.253782  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.211823  4266 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.120s	user 0.001s	sys 0.009s
I20260709 13:00:47.198714  4252 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.262790  1690 raft_consensus.cc:2393] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 4: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:47.277289  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:47.225162  4221 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:47.281081  4221 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:47.282382  1690 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:47.284586  3999 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:47.293249  1615 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:47.240679  4270 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:47.295858  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.265019  4146 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.297557  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:47.300324  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:47.266147  4127 raft_consensus.cc:740] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:47.303725  1617 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:47.302856  2241 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:47.320976  1617 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:47.224360  4203 consensus_queue.cc:260] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:47.297556  4270 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.298400  4192 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:47.335707  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:47.336776  4270 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.254541  4230 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.346068  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:47.369328  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:47.370684  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:47.372906  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:47.347954  2238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 628) took 1089 ms. Trace:
I20260709 13:00:47.263414  4259 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.366387  4203 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:47.386260  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:47.387147  1545 raft_consensus.cc:2393] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 7: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:47.389395  4252 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:47.381328  4264 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.390298  4264 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:47.392190  4264 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:47.390900  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:47.346783  4192 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.397487  1545 raft_consensus.cc:3055] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:47.398137  1545 raft_consensus.cc:740] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:47.376380  4127 consensus_queue.cc:260] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.399044  4127 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:47.399044  1545 consensus_queue.cc:260] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:47.399946  4033 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:47.400116  1545 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:47.402462  4258 raft_consensus.cc:3055] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:47.402881  4248 raft_consensus.cc:3055] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:47.403152  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:47.413506  4256 log.cc:927] Time spent T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.524s	user 0.000s	sys 0.003s
I20260709 13:00:47.419499  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:47.420347  1617 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:00:47.402874  4258 raft_consensus.cc:740] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:47.412637  4248 raft_consensus.cc:740] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:47.435460  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:47.438386  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:47.439937  2242 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:47.443696  2244 raft_consensus.cc:2393] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 4: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
W20260709 13:00:47.437142  4267 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:00:47.441148  4146 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:47.455901  3895 raft_consensus.cc:3055] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:47.455683  4146 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.456293  3895 raft_consensus.cc:740] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:47.457116  3895 consensus_queue.cc:260] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:47.458020  3895 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:47.459283  4248 consensus_queue.cc:260] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.460342  4248 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:47.466897  3970 consensus_queue.cc:1059] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:00:47.444146  3999 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.460346  4210 raft_consensus.cc:993] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:47.478231  4210 raft_consensus.cc:1081] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:47.469720  4227 raft_consensus.cc:3055] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:47.480546  4227 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:47.481581  4227 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.487838  4047 raft_consensus.cc:3055] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:47.488406  4047 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:47.489599  4047 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:47.494609  4192 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:47.501372  4093 raft_consensus.cc:3055] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:47.501958  4093 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:47.512187  4202 raft_consensus.cc:3055] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:47.512799  4202 raft_consensus.cc:740] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:47.513785  4202 consensus_queue.cc:260] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.516386  4202 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.522166  4257 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.523516  3868 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:47.524952  4253 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.660s	user 0.003s	sys 0.000s
I20260709 13:00:47.526794  4215 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:47.503098  4093 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.528100  4061 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:47.529222  4265 log.cc:927] Time spent T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.301s	user 0.004s	sys 0.000s
I20260709 13:00:47.539526  4093 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:47.483135  4227 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:47.635488  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.636435  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.637168  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.644023  1541 raft_consensus.cc:1240] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:47.648476  1541 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:00:47.653962  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.655382  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.655915  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.657380  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2263) took 1519 ms (client timeout 1663 ms). Trace:
W20260709 13:00:47.658000  1539 rpcz_store.cc:269] 0709 13:00:46.137659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.138118 (+   459us) service_pool.cc:224] Handling call
0709 13:00:47.656850 (+1518732us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b54002fadd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:47.657152 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151487744}
I20260709 13:00:47.663888  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5814bf31e900408885160ea0f89d6189"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40006
I20260709 13:00:47.665369  1617 raft_consensus.cc:606] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Received request to transfer leadership
W20260709 13:00:47.667692  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.669548  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:47.670768  1543 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:47.671603  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:47.675493  1546 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:47.675319  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:47.676329  1539 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:47.676708  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:47.677909  1541 raft_consensus.cc:2393] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:47.679590  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:47.680732  1541 raft_consensus.cc:2393] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 7: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:00:47.681591  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.683300  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:00:47.686287  1493 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:00:47.686892  1493 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 5814bf31e900408885160ea0f89d6189 already in progress
I20260709 13:00:47.687031  1541 raft_consensus.cc:2393] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 7: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:00:47.687403  1493 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 5814bf31e900408885160ea0f89d6189 already in progress
I20260709 13:00:47.684199  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:47.684613  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.688895  1546 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:47.689692  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:47.691025  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:47.690850  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:47.691912  1617 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:47.691973  1618 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:47.695477  1541 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:47.696105  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.696595  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:47.709306  1538 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
W20260709 13:00:47.714031  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.714294  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:00:47.715014  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.717573  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:00:47.718786  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.719390  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:47.721747  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:47.723984  1619 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:47.724166  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:47.724679  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:47.725417  1696 raft_consensus.cc:2393] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:47.725605  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:47.723874  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:47.726305  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 366) took 1241 ms. Trace:
I20260709 13:00:47.726711  1696 rpcz_store.cc:276] 0709 13:00:46.485328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.720979 (+1235651us) service_pool.cc:224] Handling call
0709 13:00:47.726179 (+  5200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.726956  1617 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:00:47.712270  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:47.729686  1538 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:47.730171  2240 raft_consensus.cc:2393] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:47.380155  2238 rpcz_store.cc:276] 0709 13:00:46.253370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.259977 (+  6607us) service_pool.cc:224] Handling call
0709 13:00:47.058114 (+798137us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b5800003998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:00:47.058362 (+   248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.058654 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.058691 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:47.065511 (+  6820us) log.cc:844] Serialized 26 byte log entry
0709 13:00:47.229452 (+163941us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:47.233523 (+  4071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.244382 (+ 10859us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.320906 (+ 76524us) raft_consensus.cc:1685] finished
0709 13:00:47.324577 (+  3671us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.342814 (+ 18237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13632256,"thread_start_us":134112,"threads_started":1,"wal-append.queue_time_us":168867}
I20260709 13:00:47.703778  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:47.730942  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:47.745685  1545 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:47.754344  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:47.762519  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:47.795469  1539 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:47.795756  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:47.803737  3814 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.804898  3814 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:47.807420  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.807659  3999 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.809732  4259 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:47.810532  4176 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.811311  4176 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:47.813072  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 368) took 1311 ms. Trace:
I20260709 13:00:47.822621  1543 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
W20260709 13:00:47.823988  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.820464  1689 rpcz_store.cc:276] 0709 13:00:46.486622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.730376 (+1243754us) service_pool.cc:224] Handling call
0709 13:00:47.797945 (+ 67569us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.824775  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:47.827836  4207 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:00:47.828817  3814 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:47.830597  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:47.834510  4192 consensus_queue.cc:1059] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:47.836112  2246 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:47.836908  4222 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:47.838284  4270 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:47.836901  4252 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:47.840847  4252 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:47.843154  4252 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:47.836009  4221 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:47.843163  4270 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:47.846921  4252 raft_consensus.cc:3055] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:47.851101  1659 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:47.853096  3814 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:47.849535  4252 raft_consensus.cc:740] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:47.855722  1615 raft_consensus.cc:1240] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:47.854928  1545 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.858821  1538 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:47.866420  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:00:47.854074  4039 consensus_meta.cc:287] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.746s	user 0.021s	sys 0.001s
W20260709 13:00:47.807500  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 58913us
W20260709 13:00:47.869267  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 75852.5us
I20260709 13:00:47.880848  2245 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:47.880565  4252 consensus_queue.cc:260] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:47.892078  1546 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:00:47.895074  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 367) took 1404 ms. Trace:
I20260709 13:00:47.898414  1692 rpcz_store.cc:276] 0709 13:00:46.486262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.863340 (+1377078us) service_pool.cc:224] Handling call
0709 13:00:47.890148 (+ 26808us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.901072  3823 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.901791  3823 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:47.902415  1659 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:47.904650  3823 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:47.858544  4047 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:47.889917  4221 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.911942  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:47.908475  1543 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:47.911970  4205 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:47.925045  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 446525us
I20260709 13:00:47.909827  3814 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.896536  4222 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.939071  4222 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.928045  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:47.937956  4096 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:47.935708  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1117) took 1892 ms. Trace:
I20260709 13:00:47.942041  1694 rpcz_store.cc:276] 0709 13:00:46.042830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.042952 (+   122us) service_pool.cc:224] Handling call
0709 13:00:46.069082 (+ 26130us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.260464 (+191382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.911914 (+1651450us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400459554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:47.935531 (+ 23617us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417968512}
I20260709 13:00:47.898962  4039 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:47.905263  4249 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:00:47.940172  4225 raft_consensus.cc:3055] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:47.953871  4145 consensus_queue.cc:1059] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:00:47.956077  4205 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.960876  3970 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.961699  3970 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:47.968974  4287 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 13:00:47.970484  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.956067  4225 raft_consensus.cc:740] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:47.972404  4225 consensus_queue.cc:260] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.973906  4225 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:47.977380  4085 consensus_meta.cc:287] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 1.052s	user 0.020s	sys 0.008s
I20260709 13:00:47.946460  4146 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:47.982900  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.983026  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:47.984045  4176 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:47.968786  4211 consensus_meta.cc:287] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.710s	user 0.039s	sys 0.040s
I20260709 13:00:47.986600  3999 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:47.960038  3814 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.977906  4085 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:47.963023  4145 raft_consensus.cc:3055] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:48.001567  1546 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
W20260709 13:00:48.007447  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 174785us
I20260709 13:00:47.957906  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:48.007216  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:48.025906  1543 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:00:48.010511  4033 consensus_meta.cc:287] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.610s	user 0.018s	sys 0.003s
I20260709 13:00:48.034160  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:48.027493  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 121624us
I20260709 13:00:48.000923  3823 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.998538  4205 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:48.021705  4145 raft_consensus.cc:740] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:48.051771  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:47.953892  4221 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:48.082000  1541 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
W20260709 13:00:48.090117  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.093498  4248 consensus_meta.cc:287] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.633s	user 0.013s	sys 0.000s
W20260709 13:00:48.095782  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 113004us
W20260709 13:00:48.103406  4093 consensus_meta.cc:287] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.007s
I20260709 13:00:48.105322  4145 consensus_queue.cc:260] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.106911  4270 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.061820  3999 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.039140  4176 consensus_queue.cc:1059] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
W20260709 13:00:48.107600  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.099304  1544 raft_consensus.cc:1240] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 4. Ops: []
I20260709 13:00:48.137631  1545 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:48.091892  4258 consensus_queue.cc:260] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.114764  1538 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:48.120152  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:48.144439  1541 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
W20260709 13:00:48.103448  4202 consensus_meta.cc:287] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.586s	user 0.005s	sys 0.007s
I20260709 13:00:48.139509  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:00:48.149605  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.150619  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 72558.2us
W20260709 13:00:48.162655  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 130296us
W20260709 13:00:48.165483  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 56225.6us
I20260709 13:00:48.156831  3970 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:48.154538  4039 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:48.170790  3895 consensus_meta.cc:287] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.648s	user 0.006s	sys 0.011s
I20260709 13:00:48.173482  4297 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.154592  4146 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:48.174294  4297 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:48.175695  3814 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:48.176318  3814 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:48.177003  4297 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:48.177155  3814 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:48.177889  4257 consensus_meta.cc:287] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.585s	user 0.005s	sys 0.010s
I20260709 13:00:48.177783  3814 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:48.178511  4133 raft_consensus.cc:993] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:00:48.179039  4133 raft_consensus.cc:1081] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
W20260709 13:00:48.179366  4061 consensus_meta.cc:287] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.634s	user 0.018s	sys 0.005s
W20260709 13:00:48.179956  4203 consensus_meta.cc:287] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.778s	user 0.019s	sys 0.008s
W20260709 13:00:48.180869  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.181636  1546 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:00:48.181933  1616 raft_consensus.cc:2410] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:48.182458  4210 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.183097  4210 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.174834  4146 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.188951  3341 consensus_queue.cc:1059] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:48.189843  3341 consensus_queue.cc:1059] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:48.171060  4145 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.191418  4257 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:00:48.192943  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.193858  4257 raft_consensus.cc:3055] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:48.195169  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:48.194279  4257 raft_consensus.cc:740] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:48.196642  4257 consensus_queue.cc:260] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:48.198457  4257 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:48.199330  1615 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:48.199486  1586 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:48.200701  4146 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:48.201213  4259 raft_consensus.cc:3055] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:48.201679  4259 raft_consensus.cc:740] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:48.202155  3814 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:48.203822  3954 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:48.204201  3954 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:48.204617  3954 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:48.207850  4258 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:48.208488  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.214321  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 308) took 1079 ms. Trace:
W20260709 13:00:48.217343  4227 consensus_meta.cc:287] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.670s	user 0.005s	sys 0.005s
I20260709 13:00:48.169329  4270 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.219825  1546 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:00:48.220127  4270 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:48.221093  1546 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:48.221561  1541 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:00:48.173663  1545 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:00:48.171818  1539 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:00:48.194600  4286 log.cc:927] Time spent T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:00:48.214761  1544 rpcz_store.cc:276] 0709 13:00:47.135755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.136299 (+   544us) service_pool.cc:224] Handling call
0709 13:00:47.146527 (+ 10228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.154493 (+1007966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.213995 (+ 59502us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b5400321ed4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:48.214220 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2045440768}
I20260709 13:00:48.202627  4259 consensus_queue.cc:260] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:48.223093  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:48.177569  4297 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:48.241196  1545 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:48.220706  4222 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:48.250874  1546 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:48.264165  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.266286  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 94443.7us
I20260709 13:00:48.274072  1545 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:48.275853  2209 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:00:48.276412  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.280881  1544 raft_consensus.cc:1240] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.242103  4297 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:48.283812  1511 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:48.271515  4085 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:48.272857  4207 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:48.282697  4202 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.306615  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.307155  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.312153  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.316358  2243 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:48.309854  4202 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.318904  4202 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:48.320341  4259 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:48.321705  3868 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:48.324179  4210 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:48.325824  2237 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:48.326141  3954 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.334589  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:48.315300  1541 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:48.341599  2241 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:48.347677  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:48.351572  1542 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:48.339692  3868 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:48.365171  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 213734us
I20260709 13:00:48.348748  4096 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:48.359925  4085 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:48.368520  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 69562.6us
W20260709 13:00:48.369246  4215 consensus_meta.cc:287] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.742s	user 0.015s	sys 0.010s
I20260709 13:00:48.377907  1660 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:48.382208  1660 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:48.383415  4291 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:48.384526  4291 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:48.384999  4291 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.385397  4291 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.389405  3814 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:48.390915  3814 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:48.393828  3814 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:48.375358  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.397352  4303 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:00:48.399513  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 172932us
I20260709 13:00:48.401400  4303 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:48.403021  2245 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:48.405606  1545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5814bf31e900408885160ea0f89d6189"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39628
I20260709 13:00:48.406292  1545 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.406653  1545 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.406701  4303 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:48.407511  4299 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:48.409979  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.411319  3823 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.409058  1660 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:48.411880  3823 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.413458  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:48.414085  2240 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:48.414352  4096 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:48.419422  4297 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.420881  4297 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.425444  4252 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.426846  2243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 577) took 1203 ms. Trace:
I20260709 13:00:48.427413  2243 rpcz_store.cc:276] 0709 13:00:47.223596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.223832 (+   236us) service_pool.cc:224] Handling call
0709 13:00:47.224130 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.316844 (+1092714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.426512 (+109668us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54007012d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:48.426757 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2355986176}
W20260709 13:00:48.428902  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.428964  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 303) took 1303 ms. Trace:
I20260709 13:00:48.429425  1542 rpcz_store.cc:276] 0709 13:00:47.125107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.125892 (+   785us) service_pool.cc:224] Handling call
0709 13:00:48.428778 (+1302886us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b54000b5c54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:48.428915 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2118514048}
I20260709 13:00:48.353238  4192 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.431064  4192 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.432508  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 314) took 1290 ms. Trace:
I20260709 13:00:48.358529  4230 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:48.433522  4221 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:48.433955  4230 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:00:48.412657  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.435035  4230 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.436295  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:48.436677  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:48.437094  1542 raft_consensus.cc:2393] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:48.437361  1617 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:48.437714  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:48.438298  1546 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:48.439348  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:48.435047  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:48.441258  1541 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.415060  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:48.445418  2246 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:48.468041  1694 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:48.469736  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:48.470679  4039 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:48.471545  4167 raft_consensus.cc:3055] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:48.471853  1660 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:48.471992  4167 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:48.472008  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 1905) took 1150 ms. Trace:
I20260709 13:00:48.454056  1545 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.363289  3868 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:48.472424  4039 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.475135  1616 rpcz_store.cc:276] 0709 13:00:47.322103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.323049 (+   946us) service_pool.cc:224] Handling call
0709 13:00:48.471761 (+1148712us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b54001e7154. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:48.471933 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1942440320}
I20260709 13:00:48.480760  1542 raft_consensus.cc:1240] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:48.414525  3823 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:48.432916  1547 rpcz_store.cc:276] 0709 13:00:47.141600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.153209 (+ 11609us) service_pool.cc:224] Handling call
0709 13:00:47.153498 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.153848 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.153892 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:47.154366 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:00:47.663927 (+509561us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b1800241c00. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb0d1 00007fc4916e6a0f
0709 13:00:47.879182 (+215255us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:47.947398 (+ 68216us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.959048 (+ 11650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.000534 (+ 41486us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.193874 (+193340us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:48.366926 (+173052us) raft_consensus.cc:1685] finished
0709 13:00:48.366945 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.432307 (+ 65362us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":68501,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":25766,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":2713,"spinlock_wait_cycles":76893952,"thread_start_us":88938,"threads_started":1,"wal-append.queue_time_us":830073}
I20260709 13:00:48.477831  4221 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.494024  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:48.496071  1542 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:00:48.497442  1616 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:48.489923  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:48.501166  1619 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.498680  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:48.503991  1614 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:48.505179  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:48.505789  1614 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:48.506477  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:48.507099  1621 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:48.507752  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:48.508138  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:48.508790  1620 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:48.510594  4056 consensus_queue.cc:1059] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:48.511584  4056 raft_consensus.cc:3055] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:48.511925  4056 raft_consensus.cc:740] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:48.512930  4056 consensus_queue.cc:260] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.514348  4056 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.515673  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:48.505704  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.482438  4133 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:48.515992  1545 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:48.521498  1618 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
W20260709 13:00:48.527264  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.528345  1694 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:48.529656  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:48.525841  1442 catalog_manager.cc:5697] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 4 to 5, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:00:48.530350  1613 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:48.531070  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:48.531600  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:48.531873  2243 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.533893  1689 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:00:48.535403  1543 raft_consensus.cc:2410] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:48.535876  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:48.536649  2238 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:48.536360  4167 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:48.537715  4167 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:48.537819  2237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45882 (request call id 589) took 1101 ms. Trace:
I20260709 13:00:48.538313  2237 rpcz_store.cc:276] 0709 13:00:47.436768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.441264 (+  4496us) service_pool.cc:224] Handling call
0709 13:00:48.537616 (+1096352us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54006d01d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:48.537747 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1155104128}
I20260709 13:00:48.539551  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:48.542795  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:48.543421  2240 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.546729  1511 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:48.548089  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:48.549036  4096 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.549700  4096 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:48.551033  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:48.554538  4096 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:48.555410  4039 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.555972  4039 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.557031  4291 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.557894  4039 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:48.561060  2240 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:48.562503  2243 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:48.562844  1541 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:48.565070  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:00:48.566174  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.566825  4225 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:48.567430  4225 raft_consensus.cc:697] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:48.567641  4299 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.568331  4225 consensus_queue.cc:237] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:48.572275  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.574551  1619 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:48.489761  3954 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:48.577752  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:48.578359  1545 raft_consensus.cc:2376] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5. Re-sending same reply.
I20260709 13:00:48.583593  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:48.584362  1696 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.526077  4145 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:48.588852  4145 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.544474  1660 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:48.591739  4133 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:48.592197  4133 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.592578  4133 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.522032  4221 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:48.531137  1688 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:48.598158  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.595425  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 51132.7us
I20260709 13:00:48.605418  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:48.606336  2243 raft_consensus.cc:2368] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4.
I20260709 13:00:48.614450  1692 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:00:48.555002  4294 log.cc:927] Time spent T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.186s	user 0.003s	sys 0.000s
W20260709 13:00:48.617861  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.619679  1690 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:48.617925  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:48.625988  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:48.597882  4047 consensus_meta.cc:287] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.656s	user 0.001s	sys 0.009s
I20260709 13:00:48.627893  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:48.626765  2241 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:48.595201  4221 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:48.636430  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:48.632790  1690 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:48.635804  2210 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:48.643193  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:48.646130  4192 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:48.639588  3954 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:48.648363  4227 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:48.648840  4227 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.649204  4227 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:48.652940  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.629913  4215 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.655771  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:48.655824  1690 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:48.567025  3868 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:48.655038  1619 raft_consensus.cc:3055] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:48.666587  1619 raft_consensus.cc:740] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:48.667027  2210 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:48.668797  2241 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:48.670318  1511 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:00:48.673826  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.641937  4145 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:48.676427  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:48.676370  4215 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.677191  1620 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:48.678754  4215 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:48.648257  3954 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:48.679373  1659 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:48.681300  3954 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:48.681500  3895 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:48.681939  3895 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.682266  3895 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.687836  1586 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:48.688910  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:48.689715  2241 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:48.658926  4291 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:48.692526  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:48.696592  1442 catalog_manager.cc:5697] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 1 to 6, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:00:48.698283  4192 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:48.701354  1540 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:00:48.698827  4192 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.703002  1443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58806 (request call id 175) took 10551 ms. Trace:
I20260709 13:00:48.707410  4252 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:48.716004  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 51777.5us
I20260709 13:00:48.715197  4299 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:48.717850  4299 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.718293  1690 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:48.718578  1660 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:48.718860  4252 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.702138  4215 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:48.726341  1442 catalog_manager.cc:5697] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 4 to 6, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:00:48.707535  3954 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.732188  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.704753  1619 consensus_queue.cc:260] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:48.738891  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.712212  4145 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:48.747668  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 82915.1us
I20260709 13:00:48.747457  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:48.729167  1586 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:48.750594  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 305) took 1619 ms. Trace:
I20260709 13:00:48.749233  1619 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:48.751703  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.715507  4061 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:48.718318  4299 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.751021  1540 rpcz_store.cc:276] 0709 13:00:47.130864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.132182 (+  1318us) service_pool.cc:224] Handling call
0709 13:00:48.721007 (+1588825us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003223d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:48.750517 (+ 29510us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2960949632}
I20260709 13:00:48.719452  4096 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:48.755342  3341 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:48.756560  1442 catalog_manager.cc:5697] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 3 to 6, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:00:48.723497  4252 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.725023  4215 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.783221  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:48.783373  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:48.783177  3341 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.784636  3341 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.787652  4047 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.788270  4047 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:48.790792  4047 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:48.791532  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:48.791699  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:48.792500  1613 raft_consensus.cc:2393] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:48.793488  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:48.794251  1695 raft_consensus.cc:2393] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 3: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:48.795344  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:48.796790  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:48.797116  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:48.797323  1691 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:48.797686  1617 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:48.800170  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:48.800891  1693 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:48.801600  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:48.802316  1693 raft_consensus.cc:2410] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:48.795149  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:48.803540  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:48.716027  4291 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:00:48.808310  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:00:48.812994  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.809643  1585 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:48.810940  1695 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:48.810659  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:48.749855  4039 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 13:00:48.817325  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 176980us
I20260709 13:00:48.816871  1688 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:48.785601  4215 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:48.754920  4061 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:48.823556  2210 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:48.833647  4192 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:48.829927  4258 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.836494  4252 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.824992  4061 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.820938  4133 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:48.839200  4252 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:48.867002  4096 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.869875  4096 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:48.827360  1442 catalog_manager.cc:5697] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
W20260709 13:00:48.871443  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 237859us
I20260709 13:00:48.852852  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:48.858474  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:48.948679  2243 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.747069  3814 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:48.844933  4133 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:48.923043  4252 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:48.865322  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:48.846582  4145 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:48.934629  1688 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:00:48.847481  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 64023.6us
I20260709 13:00:48.856120  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:48.846385  2210 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:48.841557  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:48.965713  2241 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
W20260709 13:00:48.885458  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.940744  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.862785  1587 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:48.862653  4257 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:00:48.873099  3868 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:48.889278  1619 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:48.848008  1692 raft_consensus.cc:2393] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:48.900452  1691 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:00:48.959553  1696 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:48.754099  3954 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:48.966988  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.964766  1693 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:48.851400  4291 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.952019  3814 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.990753  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:48.971984  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:48.870882  4215 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.010408  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:48.984279  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.858326  4167 consensus_queue.cc:1059] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.117s
I20260709 13:00:49.010051  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:49.023765  1696 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
W20260709 13:00:49.015097  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 152372us
I20260709 13:00:49.024529  1585 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:49.009928  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:48.973466  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:48.848248  4039 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.857810  4227 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:48.864133  4299 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:48.843950  4300 consensus_queue.cc:1059] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.181s
I20260709 13:00:48.963608  4145 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:49.014628  1687 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:49.024050  1442 catalog_manager.cc:5697] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 3 to 7, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.969200  4047 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:49.030635  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:00:49.036567  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 327803us
I20260709 13:00:48.993427  4133 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.039377  1692 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.962286  4096 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:48.993057  4249 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:48.993546  3814 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:49.046000  1689 raft_consensus.cc:1240] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:00:49.028234  4259 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:48.710481  1443 rpcz_store.cc:276] 0709 13:00:38.147637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.152067 (+  4430us) service_pool.cc:224] Handling call
0709 13:00:38.223645 (+ 71578us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b540029ff90. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e607640 00007fc4974deb76 00007fc4975e8c3e 00007fc495aa92a4 00007fc495aa9232 00007fc495aa9161 00007fc495aa90dc 00007fc495aa8392 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:48.687056 (+10463411us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:44.583341 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:44.875220 (+291879us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:44.876921 (+  1701us) write_op.cc:435] Acquired schema lock
0709 13:00:44.878820 (+  1899us) tablet.cc:662] Decoding operations
0709 13:00:45.125585 (+246765us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:45.125671 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:45.125716 (+    45us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:00:45.256046 (+130330us) tablet.cc:701] Row locks acquired
0709 13:00:45.256066 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:00:45.256202 (+   136us) write_op.cc:270] Start()
0709 13:00:45.256310 (+   108us) write_op.cc:276] Timestamp: P: 1783602045256160 usec, L: 0
0709 13:00:45.256329 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:00:45.309347 (+ 53018us) log.cc:844] Serialized 5987 byte log entry
0709 13:00:45.698867 (+389520us) op_driver.cc:464] REPLICATION: finished
0709 13:00:45.998141 (+299274us) write_op.cc:301] APPLY: starting
0709 13:00:46.023082 (+ 24941us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:46.112489 (+ 89407us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:46.112655 (+   166us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:46.122401 (+  9746us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:46.122714 (+   313us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:00:46.122767 (+    53us) write_op.cc:312] APPLY: finished
0709 13:00:46.123162 (+   395us) log.cc:844] Serialized 107 byte log entry
0709 13:00:46.130850 (+  7688us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:46.131039 (+   189us) write_op.cc:454] Released schema lock
0709 13:00:46.131105 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:46.455770 (+324665us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b540016e4d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc491726e28 00007fc495161581 00007fc495160d58 00007fc4951659f1 00007fc4951659a9 00007fc495165939 00007fc495165901 00007fc495164b2d 000000000038f354 000000000038f199
0709 13:00:46.456042 (+   272us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:46.456078 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":139587,"reported_tablets":23,"spinlock_wait_cycles":5002240,"child_traces":[["op",{"apply.queue_time_us":272006,"apply.run_cpu_time_us":5394,"apply.run_wall_time_us":191173,"num_ops":15,"prepare.queue_time_us":484733,"prepare.run_cpu_time_us":37330,"prepare.run_wall_time_us":1892430,"raft.queue_time_us":224034,"raft.run_cpu_time_us":95634,"raft.run_wall_time_us":287275,"replication_time_us":398655,"spinlock_wait_cycles":28879104,"thread_start_us":428863,"threads_started":4,"wal-append.queue_time_us":102936,"wal-append.run_cpu_time_us":15839,"wal-append.run_wall_time_us":1713364}]]}
I20260709 13:00:49.014300  4056 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:49.038184  4308 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 13:00:49.092154  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.102037  2243 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:00:49.037938  4145 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:49.062736  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.056738  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.104061  1694 raft_consensus.cc:1240] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:49.041457  3868 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.099972  1688 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 7: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:49.100548  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:48.969097  4252 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:49.102064  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.046888  4301 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.107197  3895 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.033943  4039 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.139883  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:49.140501  1540 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:49.141206  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:49.107357  1442 catalog_manager.cc:5697] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 4 to 6, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:49.109428  3954 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:49.031777  4291 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.116242  4215 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:49.116492  4145 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.120668  1694 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:49.123417  1696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
W20260709 13:00:49.169718  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 435722us
I20260709 13:00:49.170122  1696 raft_consensus.cc:606] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:49.170506  1696 raft_consensus.cc:614] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:49.102196  4096 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.102483  4056 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:49.125581  4305 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:49.126391  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 73749.9us
I20260709 13:00:49.128031  4299 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:49.097716  3341 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:49.134100  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 160690us
I20260709 13:00:49.188508  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:49.091192  4259 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.202219  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:49.136186  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39612
I20260709 13:00:49.202988  1691 raft_consensus.cc:2393] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:00:49.137540  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 291183us
I20260709 13:00:49.203135  1541 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:49.148274  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:49.203614  1541 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.203971  1540 raft_consensus.cc:2376] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7. Re-sending same reply.
I20260709 13:00:49.204167  2210 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:49.048234  4133 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.149200  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:49.166875  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:49.135165  4297 raft_consensus.cc:3055] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:49.133263  4192 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.168491  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:49.211426  1547 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:49.136804  3823 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.173274  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:49.224968  1543 raft_consensus.cc:2410] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:00:49.177450  4252 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:49.179693  1512 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:49.180605  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:49.148906  4301 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.186632  1659 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:49.187465  1692 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:49.098848  4249 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.189159  1546 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.189917  1442 catalog_manager.cc:5697] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 2 to 6, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:49.201220  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.205199  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.235033  2209 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:49.206669  1545 raft_consensus.cc:2376] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7. Re-sending same reply.
I20260709 13:00:49.174448  3954 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.207623  4230 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:49.224598  3823 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.240702  4230 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:49.241292  4230 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:49.241864  4249 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:49.242775  4314 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:00:49.242909  3823 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:49.183488  4258 consensus_queue.cc:1059] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:00:49.207764  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:49.218523  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 248390us
W20260709 13:00:49.245425  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 65862.6us
I20260709 13:00:49.245941  1585 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:49.136747  3868 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.246284  1512 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:49.247850  4313 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:00:49.248165  3868 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:49.248754  3868 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:49.218928  1511 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:49.249315  1695 raft_consensus.cc:2410] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:49.219902  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:49.250100  1694 raft_consensus.cc:2393] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 4: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:49.214005  3341 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:49.219053  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:49.226169  1542 raft_consensus.cc:2410] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:49.143774  4221 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:49.252010  4221 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:49.252416  4221 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.252477  1694 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:49.254637  4300 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.224895  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:49.257309  2243 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:49.182969  3814 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.206590  4259 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:49.236061  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:49.268000  1692 raft_consensus.cc:2393] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:49.210564  4297 raft_consensus.cc:740] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:49.239903  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:49.269325  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:49.236122  4305 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.244702   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:00:49.208877  1620 raft_consensus.cc:2393] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:49.175730  4056 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.259222  1691 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:49.261767  1541 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.244067  3954 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.257089  4225 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:49.263459  4252 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:49.255177  4300 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.236513  4192 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.270992  1696 raft_consensus.cc:2393] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:49.271126  2246 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:49.270418  1695 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:49.275655  4299 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.292223  3341 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:00:49.320012  4299 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.292373  4326 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:00:49.322121  4299 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:49.322603  4326 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:49.292088  4249 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.298883  1693 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:00:49.310611  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 124043us
W20260709 13:00:49.307605  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 72667.6us
W20260709 13:00:49.294934  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 48767.6us
I20260709 13:00:49.322690  4299 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:49.313349  1541 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:49.283545  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.315519  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.329631  1546 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:49.330849  1442 catalog_manager.cc:5697] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.336118  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:49.340781  2246 raft_consensus.cc:2393] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 6: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:49.349879  2243 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:49.353745  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:49.354893  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:49.300599  4320 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:49.355860  2241 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.303090  4227 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:49.313112  4252 raft_consensus.cc:697] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:49.339313  4321 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:49.360610  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 114696us
I20260709 13:00:49.361347  1442 catalog_manager.cc:5697] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 2 to 3, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:49.363512  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:49.364059  2240 raft_consensus.cc:2376] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3. Re-sending same reply.
I20260709 13:00:49.366205  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:49.366760  1512 leader_election.cc:400] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9.
I20260709 13:00:49.367728  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:49.368592  2244 raft_consensus.cc:2393] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:49.347874  4318 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:49.371467  4318 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.371829  4318 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.372845  4145 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:49.341434  4249 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.375121  4249 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:49.378592  4257 raft_consensus.cc:3055] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:49.367799  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:49.384658  2238 raft_consensus.cc:2368] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8.
I20260709 13:00:49.310760  4322 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:00:49.388018  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:49.385630  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:49.389076  1619 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:00:49.385605  4326 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:49.391139  4326 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.385917  1442 catalog_manager.cc:5697] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 4 to 8, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.394297  4192 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:49.395854  4096 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:49.396124  3954 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:49.383730  4291 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:49.396939  4133 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:49.358271  4225 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.395705  1442 catalog_manager.cc:5697] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:49.397292  4252 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.397727  4225 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.383513  4297 consensus_queue.cc:260] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.399905  4225 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:49.400324  4297 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.401664  4039 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:49.388350  3895 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:49.299746  4305 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.403283  3814 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:49.404115  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:49.404899  1620 raft_consensus.cc:2393] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:49.404845  1659 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:49.379081  4257 raft_consensus.cc:740] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:49.399312  1442 catalog_manager.cc:5697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 3 to 4, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:00:49.407796  4257 consensus_queue.cc:260] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:49.408555  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.411818  1586 leader_election.cc:400] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4.
I20260709 13:00:49.412132  1586 leader_election.cc:403] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:00:49.409282  4145 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:00:49.412832  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.413290  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.413128  4145 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.413893  1511 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:49.424119  1442 catalog_manager.cc:5697] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 1 to 3, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:00:49.355504  4299 raft_consensus.cc:697] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:00:49.448553  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 87868.6us
W20260709 13:00:49.440070  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 54895.2us
I20260709 13:00:49.412863  1586 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:49.448052  2244 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:00:49.387111  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 171632us
W20260709 13:00:49.455173  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 59766.3us
W20260709 13:00:49.457934  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 45145.9us
W20260709 13:00:49.459200  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.463462  1616 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:49.457568  1587 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:49.460481  2210 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:49.455668  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:00:49.456187  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 71720.2us
I20260709 13:00:49.465924  2238 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.455771  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:49.455835  3895 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:49.386739  4321 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.467111  3895 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.459357  4329 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4.
I20260709 13:00:49.467994  1512 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:49.466493  2210 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:49.467537  3895 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.481768  1512 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:49.458675  3954 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:49.482613  3954 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.482999  3954 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.487452  4215 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:49.487725  2238 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:49.488284  4215 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:49.487507  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:49.488794  4327 consensus_queue.cc:1059] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:49.489114  2244 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.489192  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:49.489483  4333 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:49.489996  4333 raft_consensus.cc:697] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:49.490914  4333 consensus_queue.cc:237] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:49.496647  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.499786  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.501263  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 43813.5us
I20260709 13:00:49.501505  1442 catalog_manager.cc:5697] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 3 to 5, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:00:49.506754  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:49.501644  4329 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:49.460045  4257 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:49.477177  4061 consensus_meta.cc:287] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.638s	user 0.007s	sys 0.003s
I20260709 13:00:49.476688  4192 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:49.476933  4225 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.495692  4322 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:49.517607  4215 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:49.519296  4334 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.520031  4305 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:49.521087  1511 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:49.522601  4299 consensus_queue.cc:237] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.523762  4326 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:49.524008  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:49.559996  2239 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:49.524718  4332 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:49.502329  4318 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.501471  4227 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:49.515829  4331 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:00:49.533396  4145 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:49.533169  4056 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.577289  4227 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:49.577767  4227 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:49.557397  4225 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.580816  4318 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:49.572650  4221 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.560709  4334 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.538475  1512 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:49.545434  4324 consensus_queue.cc:1059] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:00:49.450083  3814 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:49.540344  1587 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:49.550591  4322 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:49.620335  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:49.620846  4322 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.622148  4322 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.623716  4335 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:49.624233  4335 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.624627  4335 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:49.626721  4215 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:49.575505  4327 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:49.627883  4327 raft_consensus.cc:697] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:49.545281  4061 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.629068  4327 consensus_queue.cc:237] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.563980  4167 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:00:49.634039  4167 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.566610  4301 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:49.635766  4301 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:49.558072  4192 raft_consensus.cc:697] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 7 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:49.638113  4192 consensus_queue.cc:237] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.560182  4329 raft_consensus.cc:697] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:49.641590  4329 consensus_queue.cc:237] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:49.644610  4337 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:00:49.545333  3868 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.546617  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:49.645431  3868 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.549508  1660 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:49.555008  2241 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:49.550102  4039 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:49.566069  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 60977.1us
I20260709 13:00:49.534258  4230 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.549558  3823 raft_consensus.cc:3055] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:49.570626  1586 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:00:49.685410  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 114886us
I20260709 13:00:49.581806  4321 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:49.450457  4336 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.155s
I20260709 13:00:49.535885  3895 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.619606  4324 raft_consensus.cc:3055] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:49.545728  4300 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:49.645699  2238 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:00:49.548216  2244 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
W20260709 13:00:49.549132  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 46428us
I20260709 13:00:49.634625  4167 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:49.585044  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 44764.7us
W20260709 13:00:49.690114  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.690275  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:49.695070  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 156648us
I20260709 13:00:49.696846  4061 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:49.697639  3868 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:49.686702  4039 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.699751  3895 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:49.700556  4039 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:49.684942  3823 raft_consensus.cc:740] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:49.701711  3823 consensus_queue.cc:260] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.702888  3823 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:49.704169  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 72392.3us
I20260709 13:00:49.705585  1585 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:49.688786  4221 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:49.707587  2209 leader_election.cc:336] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.748s (SENT)
I20260709 13:00:49.707824  4221 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.708087  2209 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:49.709741  4221 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.709988  4318 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:49.712406  4332 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:49.708643  4225 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:49.711437  3814 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:49.713967  3814 raft_consensus.cc:697] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:49.714399  4230 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:49.714813  2243 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
W20260709 13:00:49.715260  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 165789us
I20260709 13:00:49.648164  4320 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.717689  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:49.718228  1693 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:49.719138  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.676590  4331 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.723820  3341 raft_consensus.cc:3055] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:49.720618  1660 leader_election.cc:400] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8.
I20260709 13:00:49.724416  1660 leader_election.cc:403] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:49.724203  3341 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:49.732347  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:49.733297  3341 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.728953  1660 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:49.695060  4305 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:49.740974  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:49.692493  4324 raft_consensus.cc:740] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:49.743539  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:49.746038  1619 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:49.750416  1696 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:00:49.741454  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:49.755582  1692 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:49.757203  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:49.758050  1691 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:00:49.720177  4320 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.764146  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:49.764829  2243 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.766333  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:49.730518  4039 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.771590  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:49.714931  3814 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.770040  3341 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:49.741899  4326 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.772194  1694 raft_consensus.cc:2393] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 7: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:00:49.767940  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 246894us
I20260709 13:00:49.775336  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:49.767401  2210 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:49.750700  4133 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:49.750079  4305 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.724190  4301 consensus_queue.cc:1059] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:00:49.771713  4252 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:49.785692  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 80213.1us
I20260709 13:00:49.788089  2244 raft_consensus.cc:2368] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7.
I20260709 13:00:49.784765  4291 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.767282  4336 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:49.795812  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:49.797024  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:49.774999  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:49.804427  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:49.800738  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:49.807658  2246 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.799074  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:49.808175  1696 raft_consensus.cc:2393] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 4: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:49.808424  1615 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.800455  2243 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:49.774158  4056 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:49.794188  4340 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.232s	user 0.000s	sys 0.002s
I20260709 13:00:49.817085  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:49.807122  1694 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:49.816915  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:49.818184  1692 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:49.805032   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:49.811177  1511 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:49.795226  4333 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:49.827479  1586 leader_election.cc:400] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7.
I20260709 13:00:49.827867  1586 leader_election.cc:403] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:00:49.801040  4305 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.827901  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:49.833791  2238 raft_consensus.cc:2393] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:49.828701  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:49.828704  2211 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:49.835039  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:49.739778  4331 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.800184  4343 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:49.799121  3895 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.831717  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:49.828127  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:49.829589  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:49.844558  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:49.847108  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:49.847440  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:49.817310  4133 raft_consensus.cc:697] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:49.849027  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:49.850165  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:49.820045  1511 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:49.800427  4326 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.861593  1616 raft_consensus.cc:1240] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:49.837456  4334 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:49.823016  4215 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:00:49.845963  4056 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:49.846971  4096 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:49.865330  2246 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:00:49.816957  4291 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.844741  4333 raft_consensus.cc:697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:49.881636  1695 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:00:49.854254  4252 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:49.869011  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 44787.7us
I20260709 13:00:49.882902  4350 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:49.883967  4344 log.cc:927] Time spent T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:00:49.884824  4333 consensus_queue.cc:237] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.885847  4342 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:49.886646  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:49.848181  3895 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.872447  4056 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.866899  4221 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:49.894445  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:49.878129  4259 consensus_meta.cc:287] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.585s	user 0.015s	sys 0.005s
W20260709 13:00:49.895073  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 63191.4us
W20260709 13:00:49.907305  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 82439.5us
W20260709 13:00:49.888662  4346 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:00:49.914531  1694 raft_consensus.cc:2393] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 4: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:00:49.914930  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.835186  4324 consensus_queue.cc:260] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:49.920343  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.925866  2211 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:49.888365  1511 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:49.904150  4167 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:49.905649  4342 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.928694  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:49.903728  4096 raft_consensus.cc:697] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:49.912182  4258 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:49.908684  3868 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:00:49.932389  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 44112.5us
I20260709 13:00:49.896385  4252 raft_consensus.cc:697] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:49.913270  4056 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.917564  4230 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:49.892438  3954 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.939064  1694 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:49.957217  1622 raft_consensus.cc:2368] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6.
W20260709 13:00:49.941608  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.920300  4259 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.958540  3954 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:49.959350  4259 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:49.953601  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:49.959715  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:49.960341  1621 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 10: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:49.960382  2246 raft_consensus.cc:2393] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:49.942624  1512 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:49.962970  1512 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:49.964515  1512 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:49.931854  4221 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:49.928824  4321 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:49.967016  4225 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:49.967954  4225 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:49.968408  4225 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.968842  4225 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:49.973027  4221 raft_consensus.cc:697] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:49.867161  4343 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:50.013833  1659 leader_election.cc:336] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.525s (SENT)
I20260709 13:00:50.014636  1659 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:50.012921  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 57953.5us
I20260709 13:00:49.974417  4221 consensus_queue.cc:237] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.935842  4342 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.017890  1585 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:49.896076  4350 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:49.956139  4230 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.042202  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:50.062320  1693 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
W20260709 13:00:50.025501  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 61060.3us
I20260709 13:00:49.944433  4167 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:00:49.943413  3868 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:49.924232  4133 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.079972  1616 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:50.081234  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:00:50.082931  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 69133.1us
I20260709 13:00:49.936950  4349 consensus_queue.cc:1059] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.135s
I20260709 13:00:50.041349  4334 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.077060  4215 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:50.068647  4300 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:50.028184  3954 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:00:50.088573  4324 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:50.103606  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 92041.6us
I20260709 13:00:50.108214  4348 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.167s
I20260709 13:00:50.108701  4349 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.126655  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:50.127668  4355 log.cc:927] Time spent T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:00:50.131623  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:00:50.132165  4322 consensus_meta.cc:287] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.510s	user 0.014s	sys 0.002s
I20260709 13:00:50.132526  1614 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:50.133400  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:50.134562  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:50.139151  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:50.140745  4339 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:50.147523  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:50.148522  1694 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:50.147419  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:50.150560  2239 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:50.135154  1614 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:50.155882  1587 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:50.168848  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:50.196144  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:50.202698  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:50.198177  1587 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:50.204948  1587 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:50.213043  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:50.208941  1587 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:50.098608  4215 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.217074  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:50.260049  1614 raft_consensus.cc:2393] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:50.088421  4096 consensus_queue.cc:237] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.223124  1693 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:50.223227  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:50.239579  1615 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:50.196004  4348 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.194514  4326 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:50.255483  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:50.207108  4299 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.267997  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:50.271514  1614 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:50.269480  3341 raft_consensus.cc:3055] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:50.272480  3341 raft_consensus.cc:740] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:50.212795  4329 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:50.209509  4291 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:50.230613  3823 consensus_meta.cc:287] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.000s
W20260709 13:00:50.282102  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 137527us
I20260709 13:00:50.317739  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:50.277307  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:50.224810  4192 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:50.222966  4061 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:50.216591  4361 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:50.101140  4252 consensus_queue.cc:237] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.273819  3341 consensus_queue.cc:260] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:50.270466  4301 raft_consensus.cc:2764] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:50.278611  4329 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.325731  1619 raft_consensus.cc:2410] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:50.335932  4330 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.339804  4354 log.cc:927] Time spent T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:00:50.321151  3814 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:50.347278  1621 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:50.347848  3341 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.273114  4327 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:00:50.322863  4291 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:50.273135  4299 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.273236  4359 consensus_queue.cc:1059] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.301s
I20260709 13:00:50.335568  4061 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.325129  4361 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:50.334440  4329 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:50.396938  4353 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.369s	user 0.002s	sys 0.000s
I20260709 13:00:50.341964  4321 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.434134  4361 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.436959  4291 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.443764  4368 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.468099  4368 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.470012  4331 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:50.466861  4291 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:50.470889  4305 consensus_meta.cc:287] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.000s
I20260709 13:00:50.350162  4330 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:50.471691  3895 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:50.472421  4299 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:50.472983  4330 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:50.474287  4230 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:50.441689  4061 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.109344  4349 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.475582  4375 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.476375  4349 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:50.476109  4375 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.141379  4339 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.478438  4339 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:50.464890  4369 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.447932  4378 raft_consensus.cc:3055] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:50.479099  4378 raft_consensus.cc:740] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:50.479132  4369 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:50.473016  4342 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:50.450832  4362 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.136s	user 0.002s	sys 0.002s
W20260709 13:00:50.489919  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.490698  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:50.440338  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 223955us
I20260709 13:00:50.415807  3823 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 13:00:50.600212  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 61143.9us
W20260709 13:00:50.605546  1659 leader_election.cc:336] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.868s (SENT)
I20260709 13:00:50.606182  1659 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:50.607131  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 405813us
I20260709 13:00:50.608186  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:50.609798  4379 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:50.610244  4379 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.606484  1587 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:50.610463  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:50.457196  4350 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:50.610584  4379 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.615200  1587 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:50.398743  3814 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:50.625391  1512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.040s	sys 0.093s
W20260709 13:00:50.625840  1512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.040s	sys 0.093s
W20260709 13:00:50.626152  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 556194us
I20260709 13:00:50.626926  1512 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:50.628235  1512 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:50.615720  4367 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.157s	user 0.004s	sys 0.000s
I20260709 13:00:50.637149  3341 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:50.637333  1587 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:50.480234  4378 consensus_queue.cc:260] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.642409  4334 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:50.685283  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 74897.2us
I20260709 13:00:50.644769  4215 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:50.651454  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:50.621719  4369 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:50.672683  4385 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:50.673202  3895 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:50.602443  4305 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.600332  4321 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.633548  4348 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:50.652696  4350 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:50.692937  3895 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:50.694962  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 66860.4us
I20260709 13:00:50.651568  4343 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:50.697804  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 92364us
W20260709 13:00:50.701069  4227 consensus_meta.cc:287] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 1.123s	user 0.014s	sys 0.015s
I20260709 13:00:50.726799  1620 raft_consensus.cc:2393] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:50.719015  2241 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 5: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
W20260709 13:00:50.682878  1585 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.743s (SENT) [suppressed 25 similar messages]
I20260709 13:00:50.711313  4380 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.694406  4221 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.694355  1511 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:50.728348  2239 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
W20260709 13:00:50.701493  4357 log.cc:927] Time spent T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.374s	user 0.001s	sys 0.000s
W20260709 13:00:50.747022  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.701447  4334 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.706818  4352 log.cc:927] Time spent T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.808s	user 0.000s	sys 0.009s
W20260709 13:00:50.710135  4335 consensus_meta.cc:287] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 1.085s	user 0.013s	sys 0.004s
W20260709 13:00:50.707535  4257 consensus_meta.cc:287] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 1.162s	user 0.017s	sys 0.009s
I20260709 13:00:50.711813  4350 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.694144  4061 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:50.696439  4385 raft_consensus.cc:697] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:00:50.756562  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 62311.9us
W20260709 13:00:50.707186  4056 consensus_meta.cc:287] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.685s	user 0.006s	sys 0.003s
W20260709 13:00:50.726279  4039 consensus_meta.cc:287] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.949s	user 0.010s	sys 0.007s
I20260709 13:00:50.706120  4342 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:50.707391  3814 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:50.727564  3895 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:50.749550  4320 consensus_meta.cc:287] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.974s	user 0.004s	sys 0.008s
I20260709 13:00:50.757933  4320 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.759586  4342 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:50.759974  4342 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.760299  4342 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.764086  4385 consensus_queue.cc:237] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.767556  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1171) took 1046 ms. Trace:
I20260709 13:00:50.768026  1687 rpcz_store.cc:276] 0709 13:00:49.721365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.721487 (+   122us) service_pool.cc:224] Handling call
0709 13:00:49.753050 (+ 31563us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.753301 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.753327 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:49.772085 (+ 18758us) log.cc:844] Serialized 26 byte log entry
0709 13:00:50.075150 (+303065us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:50.075183 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.079437 (+  4254us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:50.767311 (+687874us) raft_consensus.cc:1685] finished
0709 13:00:50.767333 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.767492 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":273205,"threads_started":1,"wal-append.queue_time_us":392488}
I20260709 13:00:50.776175  4215 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:50.753261  4380 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.782675  4380 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:50.785807  4333 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:50.787688  4061 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:50.787967  4339 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:50.788211  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 61647.1us
I20260709 13:00:50.788591  4339 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.789927  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50552 (request call id 428) took 1034 ms. Trace:
I20260709 13:00:50.790117  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:50.790616  4339 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:50.790349  1622 rpcz_store.cc:276] 0709 13:00:49.755326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.755448 (+   122us) service_pool.cc:224] Handling call
0709 13:00:50.789697 (+1034249us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400086954. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:50.789834 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424870272}
I20260709 13:00:50.792661  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:50.793279  1687 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:50.794274  4331 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.794781  4331 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.796511  2241 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:50.798553  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:50.755956  4350 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.800230  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:50.804257  2210 leader_election.cc:400] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6.
I20260709 13:00:50.804960  2210 leader_election.cc:403] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:00:50.725508  4348 raft_consensus.cc:697] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:50.802377  4305 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:50.794799  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2336) took 1021 ms. Trace:
I20260709 13:00:50.818799  2246 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:50.812883  1659 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:50.814390  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:50.816890  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:50.755847  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 110115us
I20260709 13:00:50.821910  1659 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:50.823596  3814 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:50.818475  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:50.833554  1695 raft_consensus.cc:3055] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:50.834012  1695 raft_consensus.cc:740] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:50.834384  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:50.835201  1688 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:50.825573  1659 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:50.827103  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:50.818943  1617 rpcz_store.cc:276] 0709 13:00:49.773215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.773329 (+   114us) service_pool.cc:224] Handling call
0709 13:00:49.776915 (+  3586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:50.142323 (+365408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:50.142362 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:50.142872 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:00:50.258843 (+115971us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:50.258909 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.794411 (+535502us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54001e8554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:50.794464 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:50.794514 (+    50us) raft_consensus.cc:1685] finished
0709 13:00:50.794529 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.794741 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1659,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":839240960,"thread_start_us":115481,"threads_started":1,"wal-append.queue_time_us":204125}
I20260709 13:00:50.828706  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:50.837872  1690 raft_consensus.cc:2393] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:50.838227  2246 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:50.730225  4227 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.830106  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:50.817291  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:50.839780  1691 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:50.840883  1541 raft_consensus.cc:1275] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:50.834486  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:50.828560  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:50.754667  4334 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.864787  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:50.865399  1545 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:50.865697  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:50.756489  4133 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:50.836431  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:50.835065  1695 consensus_queue.cc:260] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.811319  3954 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.844210  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:50.848325  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:50.839891  1694 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:50.864814  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:50.867084  1695 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.867910  2241 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:50.817301  4333 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6.
I20260709 13:00:50.825493  4039 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8.
I20260709 13:00:50.894882  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:50.892383  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:50.898388  1539 raft_consensus.cc:2393] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:50.873600  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:50.891831  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:50.896670  2246 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.896013  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:50.900821  1694 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:50.874504  1615 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:50.901613  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:50.827865  4376 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:50.902315  1694 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:50.900648  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:50.904014  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:50.904603  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:50.907629  1547 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
W20260709 13:00:50.905517  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 222656us
I20260709 13:00:50.897864  1545 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:50.908502  1616 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:00:50.908828  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:50.908854  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:50.909237  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:50.909384  1543 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:50.909632  1693 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:50.909889  1545 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 10: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:00:50.871199  4225 consensus_meta.cc:287] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.902s	user 0.015s	sys 0.000s
I20260709 13:00:50.862036  4380 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:50.911670  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:50.812079  4056 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.837244  3814 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:50.912683  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:50.861965  4327 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.754230  4335 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.872735  4221 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:50.920288  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:50.910454  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:50.915642  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:50.839030  4061 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:50.917315  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:50.902906  4258 consensus_meta.cc:287] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.963s	user 0.004s	sys 0.008s
I20260709 13:00:50.866205  4215 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.922519  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:50.930524  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:50.932716  1542 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:50.922545  1660 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:50.931449  1688 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:50.947855  1693 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 5: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:50.948029  1660 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:50.912817  4331 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:50.954326  1621 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:50.842273  4329 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:50.899127  4133 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.920990  3814 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:50.919700  4096 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:50.958120  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:50.955756  1542 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
W20260709 13:00:50.960107  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.964066  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.957114  4369 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:50.907842  3954 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.970943  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:50.946208  4258 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7.
I20260709 13:00:50.923416  4334 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:50.952801  4039 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:50.950217  4376 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:50.945353  4061 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:50.983561  2246 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:50.918336  4225 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:50.976050  4096 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.981587  4369 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.945960  4221 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.028151  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:50.946738  4327 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.005913  1618 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:50.957338  4342 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:51.012410  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 116780us
I20260709 13:00:50.951269  4215 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:50.989750  1695 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:51.052021  1543 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:51.002033  4321 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:51.055579  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:51.059269  1693 raft_consensus.cc:2410] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:51.029464  4096 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:51.058204  1547 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:51.009346  4047 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.041849  4369 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.069948  1539 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:51.070708  1540 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:51.050401  4388 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:51.074735  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 247198us
I20260709 13:00:51.098965  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:51.099365  2243 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:51.099417  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:51.100255  2238 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:51.101009  2246 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:51.102201  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:51.105432  4358 log.cc:927] Time spent T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.780s	user 0.000s	sys 0.010s
I20260709 13:00:51.108368  4388 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:51.108911  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:51.110255  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.110858  4388 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:51.116385  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:51.117200  1688 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:51.118251  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:51.118850  1688 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:00:51.121501  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:51.122835  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:51.114705  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:51.123857  1622 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:00:51.146672  1622 pending_rounds.cc:85] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 3
W20260709 13:00:51.124341  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50552 (request call id 425) took 1548 ms (client timeout 1705 ms). Trace:
I20260709 13:00:51.124744  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:51.129760  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 393) took 1367 ms. Trace:
I20260709 13:00:51.132200  4259 raft_consensus.cc:3055] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:51.134997  1586 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:51.155910  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1176) took 1433 ms. Trace:
I20260709 13:00:51.156304  1692 rpcz_store.cc:276] 0709 13:00:49.722639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.883702 (+161063us) service_pool.cc:224] Handling call
0709 13:00:49.884060 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.884442 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.884473 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:49.884983 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:00:50.015291 (+130308us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:50.015328 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.015394 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:51.104608 (+1089214us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:51.140874 (+ 36266us) raft_consensus.cc:1685] finished
0709 13:00:51.140901 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:51.155839 (+ 14938us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4437,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":21752,"spinlock_wait_cycles":6982400,"thread_start_us":129760,"threads_started":1,"wal-append.queue_time_us":332414}
I20260709 13:00:51.158615  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:51.135896  1542 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:51.112076  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:51.159644  1619 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:51.160871  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:51.162249  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:51.162719  4400 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:51.162794  2210 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:51.163475  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:51.164307  4400 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:51.164530  2239 raft_consensus.cc:2393] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:51.164731  4400 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.165367  4400 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:51.102197  2240 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:51.050972  4376 raft_consensus.cc:697] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:51.050652  4382 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.166998  2241 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:51.148188  1696 rpcz_store.cc:276] 0709 13:00:49.762066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.836573 (+ 74507us) service_pool.cc:224] Handling call
0709 13:00:51.129499 (+1292926us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b54002c6354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:51.129652 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2267405056}
I20260709 13:00:51.167593  4382 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:51.149096  1616 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:51.154984  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:00:51.147218  1620 rpcz_store.cc:269] 0709 13:00:49.575545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.575743 (+   198us) service_pool.cc:224] Handling call
0709 13:00:51.124092 (+1548349us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540024ead4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:51.124265 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2373901184}
I20260709 13:00:51.169788  4382 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:51.170029  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:51.170066  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:51.170779  1693 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:51.172053  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:51.172906  1620 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:51.174098  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:51.176174  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.177742  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.178718  1542 raft_consensus.cc:2393] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:51.178795  4400 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.179607  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:51.175058  1620 raft_consensus.cc:2393] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:51.181257  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:51.182713  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:51.182870  1616 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:51.183352  2246 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:51.189049  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:51.190615  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:51.191898  1692 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:51.146975  1622 pending_rounds.cc:107] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:00:51.195281  1622 raft_consensus.cc:2889] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:51.063812  3895 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:51.232304  4393 log.cc:927] Time spent T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
I20260709 13:00:51.248700  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:50.979949  4348 consensus_queue.cc:237] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.249568  1587 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:51.257831  1587 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:51.255913  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 141283us
I20260709 13:00:51.282235  1587 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:51.187850  4388 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:51.189860  4380 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:51.188442  4331 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:51.247493  4361 consensus_meta.cc:287] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.765s	user 0.010s	sys 0.000s
I20260709 13:00:51.155712  4259 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:51.303696  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:51.166869  4376 consensus_queue.cc:237] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:51.194206  4227 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:51.322517  1688 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.305415  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:51.330484  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.312495  4331 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.317441  4056 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:51.331746  4331 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:51.333228  4375 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:51.335426  4386 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:51.319588  4300 consensus_queue.cc:1059] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:00:51.335999  4404 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:51.336326  4300 raft_consensus.cc:3055] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:51.336506  4404 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:51.336943  4300 raft_consensus.cc:740] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:51.337965  4300 consensus_queue.cc:260] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.338542  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.339758  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:00:51.340505  4350 consensus_meta.cc:287] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.001s
I20260709 13:00:51.340782  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.181504  4047 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.311497  4396 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:51.320531  4230 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:51.305147  4133 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:51.319748  4321 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.301772  4343 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:51.337075  4404 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.301152  4388 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.348918  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.325376  4361 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:51.352969  4230 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.341372  1538 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:51.364638  1687 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:00:51.404789  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.340914  4350 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:51.347049  4324 consensus_meta.cc:287] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 1.176s	user 0.005s	sys 0.005s
I20260709 13:00:51.424219  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.427330  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:51.460433  1538 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:51.372256  4259 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:51.356115  4225 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:51.317096  4380 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:51.473357  4380 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:51.354584  4369 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:51.355904  4327 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:51.372911  3954 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:51.475961  4369 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:51.458576  4056 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.477013  4056 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.370182  4386 raft_consensus.cc:697] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:00:51.370090  4379 consensus_meta.cc:287] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.726s	user 0.000s	sys 0.009s
I20260709 13:00:51.448534  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.479720  1613 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:51.452595  4221 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:51.452782  4230 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:51.405647  4047 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:51.454088  4361 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:51.369330  4388 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:51.356437  4335 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:51.393721  3895 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:51.448483  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.351789  4385 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.146s
I20260709 13:00:51.523702  1539 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
W20260709 13:00:51.354801  4394 log.cc:927] Time spent T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 13:00:51.483012  4039 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:51.399286  4331 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.339226  4300 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:51.460750  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 200199us
I20260709 13:00:51.352506  4396 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.367895  4257 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:51.342105  4061 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:51.371877  4329 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:51.444967  4350 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:51.449482  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:00:51.493490  1510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.035s	sys 0.065s
I20260709 13:00:51.355914  4343 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.403157  4368 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:51.519778  4259 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:51.355373  4321 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:51.522188  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.368199  4215 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:51.459177  1688 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
W20260709 13:00:51.574034  3814 consensus_meta.cc:287] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.000s
W20260709 13:00:51.530087  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 341099us
I20260709 13:00:51.510667  4379 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.549408  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.601514  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:51.602451  4379 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:51.602700  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:51.575273  1510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.036s	sys 0.066s
I20260709 13:00:51.603269  1546 raft_consensus.cc:2393] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:51.560776  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:51.604368  1691 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.575680  1692 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:51.578312  4343 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:51.566134  4373 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 1.124s	user 0.002s	sys 0.000s
I20260709 13:00:51.564843  4400 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:51.563045  4366 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 1.239s	user 0.004s	sys 0.000s
I20260709 13:00:51.549003  4386 consensus_queue.cc:237] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.514655  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:51.532384  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.571345  4342 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:51.580005  1538 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:51.612814  1542 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 10: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:51.612865  1539 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:51.613272  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:51.613942  1538 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.540685  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:51.533128  4396 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.527170  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.597738  1587 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:51.586151  4364 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 1.152s	user 0.001s	sys 0.001s
I20260709 13:00:51.601684  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:51.525942  4096 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:51.620110  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 79485.5us
I20260709 13:00:51.534317  4056 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:51.622579  4350 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:51.557540  4331 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:51.608644  1688 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:51.609162  4215 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:51.609548  4425 consensus_queue.cc:1059] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:51.609685  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:51.569952  4404 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.626044  2211 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:51.626466  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.625445  1585 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:51.627162  1542 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 3.
I20260709 13:00:51.627868  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:51.630072  1585 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:51.630368  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:51.631268  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:51.632890  1692 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:51.610545  1512 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:51.610918  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.618292  1543 raft_consensus.cc:2376] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8. Re-sending same reply.
I20260709 13:00:51.621286  1511 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:51.623737  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.632992  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:51.634841  2211 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:51.645066  1544 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:51.646368  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.541105  4409 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:00:51.647312  1691 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:00:51.600328  3814 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:51.619688  4333 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.650655  2211 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:51.623202  4350 raft_consensus.cc:697] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:51.655074  1538 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:51.623490  4096 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:51.623422  4321 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:51.649606  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:51.657123  1620 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:51.658071  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.618232  4348 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.635162  4329 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:51.662004  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.662825  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:51.662745  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:51.635314  4061 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:51.632930  4349 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:51.675086  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:51.675449  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:51.680431  1539 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:51.659420  3823 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:51.660578  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 50108.6us
I20260709 13:00:51.701730  1512 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:51.701987  1545 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:00:51.693673  4401 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:51.676851  1544 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
W20260709 13:00:51.677542  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.652169  4331 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:51.729686  4331 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:51.730123  4331 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:51.730401  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.678828  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 390) took 1942 ms. Trace:
I20260709 13:00:51.678943  4329 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:51.681159  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:51.628216  4379 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:00:51.683467  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:51.676764  4056 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:51.737709  1620 raft_consensus.cc:2393] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:51.648088  4215 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:51.688206  4378 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.744576  2209 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:51.689054  4404 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:51.690623  1542 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:51.635663  4405 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:51.657447  4400 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:51.691134  4350 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:51.692540  4345 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.200s	user 0.008s	sys 0.009s
I20260709 13:00:51.632747  4426 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:00:51.693094  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:51.695062  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:51.695384  2238 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:51.695896  2243 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:51.696417  1691 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 7: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:51.700161  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 1920) took 1588 ms. Trace:
I20260709 13:00:51.702831  1512 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:51.777143  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 74367.5us
I20260709 13:00:51.778143  1512 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:51.779695  1512 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:51.677636  1538 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:51.673635  4385 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.707774  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:51.714951  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:51.716431  4388 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.679577  4425 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.679905  4348 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:51.717749  4401 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:51.718657  4430 log.cc:927] Time spent T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.055s	user 0.003s	sys 0.000s
I20260709 13:00:51.789359  2243 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:00:51.773252  4345 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.325s	user 0.009s	sys 0.009s
I20260709 13:00:51.719079  4417 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:51.720909  4381 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:51.722517  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:51.680138  4061 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:51.725654  4396 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:51.726218  2242 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:51.728538  3814 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:51.728709  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:00:51.732448  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.732241  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:51.800660  1694 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:51.720585  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:51.783193  4227 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:51.739818  1541 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:51.736378  2210 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:51.742309  1587 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:51.805351  1512 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:51.805815  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 63578.2us
I20260709 13:00:51.744753  2240 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:51.673293  4333 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.787002  4252 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:51.734490  1689 rpcz_store.cc:276] 0709 13:00:49.736101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.885200 (+149099us) service_pool.cc:224] Handling call
0709 13:00:49.885681 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.886129 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.886170 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:49.904678 (+ 18508us) log.cc:844] Serialized 26 byte log entry
0709 13:00:50.225093 (+320415us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:50.225132 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.225195 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:50.465166 (+239971us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b48002502d8. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc496654aa1 00007fc49664bb37 00007fc49664b9ca 00007fc49674326f 00007fc496742f37 00007fc49675755c 00007fc496757508 00007fc496757488 00007fc496757443 00007fc4967566ec 00007fc495680a96
0709 13:00:51.585455 (+1120289us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:51.678659 (+ 93204us) raft_consensus.cc:1685] finished
0709 13:00:51.678673 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:51.678784 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5593,"raft.run_cpu_time_us":12237,"raft.run_wall_time_us":570562,"spinlock_wait_cycles":83257984,"thread_start_us":293943,"threads_started":1,"wal-append.queue_time_us":390954}
I20260709 13:00:51.811892  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:51.731015  4096 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:51.736424  4320 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:51.732846  3823 raft_consensus.cc:697] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:51.819870  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:51.741698  4056 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:51.770177  4215 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:51.770539  1545 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:51.771456  1547 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:51.776419  1618 rpcz_store.cc:276] 0709 13:00:50.111610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.126379 (+ 14769us) service_pool.cc:224] Handling call
0709 13:00:51.700000 (+1573621us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b54002d3554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:51.700101 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2019993984}
I20260709 13:00:51.732601  4424 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:51.746488  4259 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.786002  2238 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:51.747126  4349 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.834733  3823 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.835750  4349 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:51.838490  4349 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:51.718518  4257 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:51.767225  4400 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.840109  4400 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:51.765945  4405 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:51.792982  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:51.843508  4405 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:51.843688  1616 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:00:51.771548  4300 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:51.797123  1619 raft_consensus.cc:2393] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:51.801620  1688 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:51.847124  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:51.730937  1511 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:51.815562  4417 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:51.787125  4342 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:51.788648  4379 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:51.810192  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:51.883038  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:51.897367  1694 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:51.897665  1615 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:51.743997  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:51.812559  1692 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:51.822341  4056 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:51.901448  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:51.814016  1512 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:51.815364  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:51.904616  1613 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 8: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:51.798372  4061 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:51.786863  4385 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:51.737480  4329 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.820463  1689 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.794466  4381 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:00:51.826525  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 81995.3us
I20260709 13:00:51.916693  2209 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:51.827571  2246 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:51.829986  1696 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:00:51.848996  4320 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:51.812280  4305 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:51.801436  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:51.859910  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:51.924060  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 110138us
I20260709 13:00:51.924223  1616 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:51.860498  4300 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:51.861578  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 130703us
W20260709 13:00:51.912770  4436 log.cc:927] Time spent T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:00:51.864060  3868 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:51.871641  4252 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:51.790645  4425 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.885320  4039 raft_consensus.cc:3055] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:51.890389  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:51.892058  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:51.894572  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1174) took 1054 ms. Trace:
I20260709 13:00:51.895279  1543 raft_consensus.cc:1240] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:51.812821  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 76481.5us
I20260709 13:00:51.918673  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:51.830080  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:51.920775  1587 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:51.924253  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 122885us
I20260709 13:00:51.925972  1512 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:51.847469  4259 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.862706   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:51.930850  2209 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:51.845053  4096 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:51.919131  4381 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:51.923507  4320 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:51.942669  2210 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:51.943025  1617 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:51.959663  1694 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:51.931505  1692 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:00:51.955942  1659 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:51.960678  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:51.961512  1617 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:51.944567  1512 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:51.940056  1546 rpcz_store.cc:276] 0709 13:00:50.840307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.865444 (+ 25137us) service_pool.cc:224] Handling call
0709 13:00:51.894309 (+1028865us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54000695d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:51.894502 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694327040}
I20260709 13:00:51.943651  1660 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:51.947522  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:51.967430  1512 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:51.967761  2238 raft_consensus.cc:2393] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:51.950031  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:51.951247  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:51.952085  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:51.962762  1587 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:51.972488  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:51.938486  4039 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:51.973278  1538 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:51.966187  4439 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:51.974370  1620 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:51.960533  4320 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:51.975082  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:51.975653  1545 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.969098  2243 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:51.931653  3814 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:51.953510  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:51.932202  4424 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:51.943125  1696 raft_consensus.cc:2393] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:51.932039  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:51.968509  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:00:51.985532  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 53551.9us
I20260709 13:00:51.955714  1688 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:51.953814  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:51.981133  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:51.988343  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:51.985757  1586 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:51.964936  3868 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:51.981329  1693 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:00:51.991022  1587 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:51.983399  1691 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:00:51.986344  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:51.976599  4252 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:51.976776  4417 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:51.955018  4167 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:51.932775  4438 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:51.994876  1511 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:51.957402  4376 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.935092  4305 raft_consensus.cc:697] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:51.998821  1545 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:00:51.989204  4439 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:52.000412  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:52.000623  1587 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:52.014053  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:51.992249  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:51.984889  3814 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.992616  4368 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:51.982662  4389 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:52.009078  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:52.012435  1693 raft_consensus.cc:1240] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:52.014755  1546 raft_consensus.cc:2376] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4. Re-sending same reply.
I20260709 13:00:52.015228  1691 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
W20260709 13:00:52.003407  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 110702us
I20260709 13:00:51.991025  4380 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:51.951972  4321 consensus_queue.cc:1059] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:00:51.993134  4257 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:51.997627  4252 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.995764  4348 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:52.048902  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:52.002811  4401 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:52.050132  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:52.050652  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:52.019199  3814 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.051321  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:52.051946  1614 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:52.053035  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:52.025031  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:52.006373  4167 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:52.023017  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:52.054587  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 45630.6us
I20260709 13:00:52.055836  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:52.056416  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 100472us
I20260709 13:00:51.997264  4215 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:52.079111  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:51.997444  4349 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:52.013646  3868 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:52.017771  4388 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:52.058965  1511 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:52.061467  1659 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:52.021435  4330 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:52.077848  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:52.018342  4439 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:51.997717  4221 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:00:52.012046  4396 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:52.025555  4434 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:00:52.053790  3823 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:52.019711  4426 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:52.082381  4361 consensus_queue.cc:1059] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:00:52.048431  4257 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.054548  4252 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:52.083248  1585 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:52.088514  1511 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:52.088781  1659 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:52.186055  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 97619.9us
I20260709 13:00:52.187448  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:52.020524  4368 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.054297  4389 raft_consensus.cc:697] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:52.094890  1692 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:52.095563  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:52.200784  1542 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:52.062121  4167 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:52.097381  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 153797us
I20260709 13:00:52.203045  1660 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:52.097609  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:52.203526  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.077533  4300 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:52.109411  1512 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:52.079192  4215 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:52.021517  4376 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:52.098052  4439 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:52.081126  4321 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:00:52.016543  4039 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.106988  4438 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.095328  4342 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:52.093407  4330 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.188640  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 1945) took 1377 ms. Trace:
I20260709 13:00:52.201598  4447 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:52.221692  1687 rpcz_store.cc:276] 0709 13:00:50.811628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.811775 (+   147us) service_pool.cc:224] Handling call
0709 13:00:52.188456 (+1376681us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b5400134cd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:52.188583 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43407744}
I20260709 13:00:52.189692  1690 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:52.189586  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:52.116078  4426 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:52.186105  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 102940us
W20260709 13:00:52.192782  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 104075us
I20260709 13:00:52.228144  1659 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:52.120110  4257 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.194726  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:52.147891  4385 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:52.156387  4425 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:52.167199  4380 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:52.235652  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:52.213487  4215 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:52.181741  4361 raft_consensus.cc:3055] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:00:52.207711  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 98365.8us
I20260709 13:00:52.237556  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:52.241055  1585 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:52.245709  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:52.247740  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.208087  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 192463us
I20260709 13:00:52.169013  4446 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:52.211439  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:52.209028  4396 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:52.212765  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:52.253079  4396 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.253564  4396 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.253830  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:52.254885  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:52.255919  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:52.230865  4330 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:52.199574  4368 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:52.199955  3868 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:52.212085  4424 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:52.105577  4305 consensus_queue.cc:237] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.225157  1689 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:00:52.210995  4047 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:52.206773  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 98640.7us
I20260709 13:00:52.237342  4221 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:52.249593  1687 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:00:52.236400  4343 consensus_meta.cc:287] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.001s
I20260709 13:00:52.222061  4342 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.249049  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:52.256736  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:52.256922  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:52.287034  1544 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:00:52.197196  3823 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:52.224821  4096 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:52.285869  4342 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:52.258560  1659 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:52.219507  4349 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:52.208480  4320 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.236799  4450 raft_consensus.cc:3055] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:52.236387  4426 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:52.327059  4450 raft_consensus.cc:740] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:00:52.331732  4444 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:00:52.332581  4450 consensus_queue.cc:260] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.333850  4450 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.334185  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:52.265774  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:52.335409  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:52.335719  1692 raft_consensus.cc:2410] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:00:52.336434  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:52.320897  4403 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.337380  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:52.218174  4259 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:52.268134  4443 log.cc:927] Time spent T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:00:52.242524  4361 raft_consensus.cc:740] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:52.243831  4333 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:52.250676  4300 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:52.221618  4438 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.291860  4424 consensus_queue.cc:1059] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:52.285390  4230 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:00:52.281703  4343 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:52.274755  4047 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.297919  4453 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:52.283959  4425 consensus_queue.cc:1059] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:00:52.288798  3823 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:52.272600  4447 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:52.278816  4440 log.cc:927] Time spent T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.290s	user 0.002s	sys 0.000s
I20260709 13:00:52.243170  4380 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:52.236931  4448 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:00:52.327433  1539 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:52.394680  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2310) took 1059 ms. Trace:
I20260709 13:00:52.395121  1539 rpcz_store.cc:276] 0709 13:00:51.334808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.701442 (+366634us) service_pool.cc:224] Handling call
0709 13:00:51.709297 (+  7855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.327179 (+617882us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b54002399a0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916a2dc0 00007fc49172d1c0 00007fc49172e231 00007fc49172ad8f 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c
0709 13:00:52.394390 (+ 67211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.394617 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73767808}
W20260709 13:00:52.326400  4441 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:00:52.327879  4096 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:52.329792  4320 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:52.337248  4403 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:52.424291  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:52.338145  1692 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:52.425168  1539 raft_consensus.cc:2393] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:52.426062  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:52.339512  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2354) took 1378 ms. Trace:
I20260709 13:00:52.426602  1539 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:52.426644  1619 rpcz_store.cc:276] 0709 13:00:50.961050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.160495 (+199445us) service_pool.cc:224] Handling call
0709 13:00:52.339284 (+1178789us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b54000ad7d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:52.339444 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1460133248}
I20260709 13:00:52.426888  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:52.271042  1587 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:52.340600  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.341992  1618 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
W20260709 13:00:52.358170  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.374619  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2352) took 1412 ms. Trace:
I20260709 13:00:52.429764  1622 rpcz_store.cc:276] 0709 13:00:50.958511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.958640 (+   129us) service_pool.cc:224] Handling call
0709 13:00:50.978843 (+ 20203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:51.274466 (+295623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.366213 (+1091747us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400087354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:52.370381 (+  4168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332507520}
I20260709 13:00:52.370149  4221 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:52.376627  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:52.435449  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 164426us
I20260709 13:00:52.437188  1587 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:52.326670  4349 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:52.342051  4301 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:52.390473  3823 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:52.440021  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 181471us
I20260709 13:00:52.443086  1585 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:52.444283  1659 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:52.286768  4389 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:52.393396  4453 raft_consensus.cc:697] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:52.383509  4047 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:52.445461  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:52.448393  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 403) took 1344 ms. Trace:
I20260709 13:00:52.448647  1659 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:52.449141  1545 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 7: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:00:52.450448  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 111038us
I20260709 13:00:52.450891  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:52.451395  1511 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:52.453553  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:52.455914  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 205848us
W20260709 13:00:52.457989  4405 consensus_meta.cc:287] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.614s	user 0.005s	sys 0.009s
I20260709 13:00:52.457569  4460 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:52.458469  2209 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:52.459707  4460 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:52.465423  4452 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:52.466647  4329 consensus_meta.cc:287] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.535s	user 0.008s	sys 0.002s
I20260709 13:00:52.466799  4452 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.474165  4452 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:52.458444  4405 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.477533  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:52.478557  2241 raft_consensus.cc:2393] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 5: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:52.479734  4405 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:52.480203  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:52.449016  1691 rpcz_store.cc:276] 0709 13:00:51.103967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.051529 (+947562us) service_pool.cc:224] Handling call
0709 13:00:52.051772 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.051956 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:52.052255 (+   299us) log.cc:844] Serialized 14 byte log entry
0709 13:00:52.448092 (+395837us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:52.448140 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:52.448180 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.448237 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.448343 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12950,"prepare.queue_time_us":147,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":30,"raft.queue_time_us":15641,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":12831,"spinlock_wait_cycles":7792896,"thread_start_us":381798,"threads_started":2,"wal-append.queue_time_us":193859}
W20260709 13:00:52.482631  1694 consensus_meta.cc:287] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.506s	user 0.005s	sys 0.010s
I20260709 13:00:52.483204  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:52.483615  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:52.363631  4056 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.487696  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:52.492182  2246 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:52.488071  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:52.396517  4379 raft_consensus.cc:476] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 13:00:52.417460  4096 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.492962  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:52.512940  1546 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:52.520298  1618 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 8: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:52.513103  1694 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:52.455049  1511 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:52.491820  1617 consensus_meta.cc:287] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.004s
I20260709 13:00:52.525168  1617 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:00:52.526695  2210 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:52.528169  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:52.530252  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:52.531581  1617 raft_consensus.cc:2393] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:52.516232  1659 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:52.491816  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:52.532595  1622 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:52.535168  1659 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:52.538481  1539 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
W20260709 13:00:52.540690  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 292199us
I20260709 13:00:52.544390  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:52.545957  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:52.546672  1545 raft_consensus.cc:2393] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:52.489696  4447 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:52.510587  4334 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:52.553333  2240 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:52.555171  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:52.489570  4448 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:52.539587  4441 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:00:52.489363  4386 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:52.571403  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:00:52.571739  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 116780us
I20260709 13:00:52.447201  4456 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:52.488278  4424 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:52.565009  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:52.539891  4096 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:52.446806  4221 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:52.488566  4322 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:00:52.557029  1586 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:52.540421  4458 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:52.481819  4301 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:52.573946  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 136810us
I20260709 13:00:52.448427  4361 consensus_queue.cc:260] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:52.487267  4329 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:52.614410  4329 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:52.615038  4454 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:52.621959  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:52.556761  4452 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:52.581290  4456 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.589274  4388 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:52.627477  1619 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:52.593685  1546 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:00:52.583845  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:52.559304  4334 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:52.567189  4448 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.568464  4376 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:52.612365  4056 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:52.592444  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:52.622648  4378 consensus_meta.cc:287] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.856s	user 0.008s	sys 0.001s
I20260709 13:00:52.588896  4447 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:52.630362  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 73440us
I20260709 13:00:52.580071  4405 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:00:52.631505  2210 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:52.633709  4334 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:52.668860  4301 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:52.671547  4449 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:52.672168  4449 raft_consensus.cc:697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:00:52.672851  3814 consensus_meta.cc:287] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.621s	user 0.005s	sys 0.005s
I20260709 13:00:52.673081  4449 consensus_queue.cc:237] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.673326  3814 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:52.676962  4400 consensus_meta.cc:287] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.836s	user 0.012s	sys 0.000s
I20260709 13:00:52.677248  4425 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:52.677363  4400 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.677969  4425 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.678582  2239 raft_consensus.cc:1240] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:52.678450  4425 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.679350  4457 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:52.679955  4376 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:52.680368  4376 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.680711  4376 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:52.631610  4456 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:52.675019  4460 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.683673  4460 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:52.684319  4331 consensus_meta.cc:287] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.954s	user 0.011s	sys 0.000s
I20260709 13:00:52.684720  4331 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.685734  4460 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:52.686466  2245 raft_consensus.cc:2393] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 8: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:52.686765  4331 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:52.687402  4343 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:52.688750  4469 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:52.689152  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:52.689718  1545 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:52.665524  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:52.667052  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:52.624004  4438 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:52.664239  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1184) took 1821 ms (client timeout 1642 ms). Trace:
W20260709 13:00:52.692669  1540 rpcz_store.cc:269] 0709 13:00:50.844996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.903792 (+ 58796us) service_pool.cc:224] Handling call
0709 13:00:52.664015 (+1760223us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54002e9354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:52.664163 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":374783232}
I20260709 13:00:52.693773  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:52.694365  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:52.691344  1614 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 2.
I20260709 13:00:52.695118  1539 raft_consensus.cc:2393] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 2: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:52.627678  4453 consensus_queue.cc:237] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:52.633759  4403 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:52.660090  4448 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.695287  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:52.708186  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:52.708233  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 173147us
I20260709 13:00:52.709086  2241 raft_consensus.cc:2393] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 7: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:52.709829  1659 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:52.690114  4380 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:52.690351  4388 raft_consensus.cc:697] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:52.634313  4329 consensus_queue.cc:1059] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:00:52.690488  4452 raft_consensus.cc:697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:52.728369  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:52.696023  4324 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.730466  4380 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:52.731192  4470 consensus_queue.cc:1059] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:00:52.735023  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 291960us
I20260709 13:00:52.740104  1659 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:52.680729  4368 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.716966  4305 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:52.747531  1545 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:52.719565  4343 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.756218  3814 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:52.757573  4400 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:52.758078  4334 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:52.748682  4380 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.743947  4458 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:00:52.760458  4470 raft_consensus.cc:3055] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:52.761665  4061 consensus_meta.cc:287] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.836s	user 0.008s	sys 0.000s
I20260709 13:00:52.763813  4388 consensus_queue.cc:237] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:52.764842  4381 consensus_meta.cc:287] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.805s	user 0.009s	sys 0.000s
I20260709 13:00:52.722576  4447 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:52.766255  4459 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:52.766057  4452 consensus_queue.cc:237] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.738932  4457 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:52.769815  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:52.762723  3823 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:52.702843  4167 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:52.720882  4401 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:00:52.777719  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:52.781029  1546 raft_consensus.cc:2368] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6.
W20260709 13:00:52.776860  4439 consensus_meta.cc:287] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.006s
I20260709 13:00:52.789570  4329 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:52.745095  4324 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.789625  2245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45882 (request call id 622) took 1075 ms. Trace:
I20260709 13:00:52.795673  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:52.820814  1621 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.796458  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:52.779942  4405 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:52.802429  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:52.828312  1545 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:52.829090  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:52.830183  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:52.802773  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1195) took 1037 ms. Trace:
I20260709 13:00:52.807024  4334 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:52.812391  4221 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:52.812881  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 322) took 1918 ms. Trace:
I20260709 13:00:52.782850  4470 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:52.787110  4462 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.776547  4343 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.820065  2245 rpcz_store.cc:276] 0709 13:00:51.714558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.714679 (+   121us) service_pool.cc:224] Handling call
0709 13:00:52.789361 (+1074682us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54005da2d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:52.789536 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2081824640}
I20260709 13:00:52.822788  1613 raft_consensus.cc:2393] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 7: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:52.822937  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:52.823225  4396 consensus_meta.cc:287] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.569s	user 0.014s	sys 0.003s
I20260709 13:00:52.825464  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 1197) took 1059 ms. Trace:
I20260709 13:00:52.844556  1694 rpcz_store.cc:276] 0709 13:00:51.765486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.898382 (+132896us) service_pool.cc:224] Handling call
0709 13:00:52.825268 (+926886us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b5400133b54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:52.825382 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130556160}
I20260709 13:00:52.826109  1688 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:00:52.786942  4061 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:52.847509  1587 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:52.828702  4257 consensus_meta.cc:287] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.582s	user 0.013s	sys 0.014s
I20260709 13:00:52.838512  1543 rpcz_store.cc:276] 0709 13:00:50.894218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.658906 (+764688us) service_pool.cc:224] Handling call
0709 13:00:51.895036 (+236130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:51.940269 (+ 45233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.812693 (+872424us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54000695d0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:52.812826 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542417280}
I20260709 13:00:52.849237  1621 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:52.796890  4381 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:52.840725  4464 log.cc:927] Time spent T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:00:52.846995  4252 consensus_meta.cc:287] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.681s	user 0.010s	sys 0.007s
I20260709 13:00:52.834758  1692 rpcz_store.cc:276] 0709 13:00:51.765148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.425556 (+660408us) service_pool.cc:224] Handling call
0709 13:00:52.425900 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.426139 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:52.749690 (+323551us) log.cc:844] Serialized 14 byte log entry
0709 13:00:52.800413 (+ 50723us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:52.800475 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:52.800520 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.802558 (+  2038us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.802703 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12658,"prepare.queue_time_us":13321,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":3333,"raft.queue_time_us":110,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":86,"thread_start_us":372289,"threads_started":2,"wal-append.queue_time_us":50377}
I20260709 13:00:52.859617  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:52.861619  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:52.863152  4167 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:52.847627  4462 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:52.863682  4377 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:52.879688  4377 raft_consensus.cc:697] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:52.879647  4425 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:52.880630  4377 consensus_queue.cc:237] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.838136  4405 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:52.864754  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:52.888710  1694 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:52.858279  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:52.890931  1621 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:52.891745  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 1944) took 1170 ms. Trace:
I20260709 13:00:52.798184  4376 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.872242  1619 raft_consensus.cc:1240] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:52.872020  4252 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:52.874723  4478 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:52.876402  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2361) took 1242 ms. Trace:
I20260709 13:00:52.878098  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:52.851759  4215 consensus_meta.cc:287] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.007s
I20260709 13:00:52.817735  4439 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:52.887092  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 265168us
I20260709 13:00:53.024143  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:53.026302  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:53.006376  1659 leader_election.cc:336] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.775s (SENT)
I20260709 13:00:53.009817  1547 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.005299  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:53.028195  1659 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:53.028491  1692 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.013213  1545 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
W20260709 13:00:53.002651  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.029795  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:53.030594  1545 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:52.892143  1621 rpcz_store.cc:276] 0709 13:00:51.721163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.889960 (+1168797us) service_pool.cc:224] Handling call
0709 13:00:52.890378 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.891444 (+  1066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.891679 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:52.822137  4329 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:52.879634  4380 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:52.851169  4470 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:52.851976  4396 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:53.032377  4483 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:00:53.059937  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 53607.4us
I20260709 13:00:53.013731  4096 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:53.037258  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.037460  4439 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:53.037858  4459 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:53.038694  3814 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:53.039089  4215 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:53.040180  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:53.031615  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:53.069454  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:53.069883  1545 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:53.041386  1621 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:00:53.070715  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 1948) took 1343 ms. Trace:
I20260709 13:00:53.017580  1622 rpcz_store.cc:276] 0709 13:00:51.633656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.542601 (+908945us) service_pool.cc:224] Handling call
0709 13:00:52.542895 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.659402 (+116507us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:52.727205 (+ 67803us) log.cc:844] Serialized 14 byte log entry
0709 13:00:52.783033 (+ 55828us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:52.783117 (+    84us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:52.783181 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.876148 (+ 92967us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54000ae6d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:52.876197 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.876338 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33077,"prepare.queue_time_us":105369,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":32903,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":16482,"spinlock_wait_cycles":267234688,"thread_start_us":84401,"threads_started":2,"wal-append.queue_time_us":71174}
I20260709 13:00:53.071796  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:53.072458  2243 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:53.071019  1621 rpcz_store.cc:276] 0709 13:00:51.727366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.040694 (+1313328us) service_pool.cc:224] Handling call
0709 13:00:53.041111 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.070461 (+ 29350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.070666 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:53.074189  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:53.074586  1692 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:53.031703  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 1943) took 1295 ms. Trace:
I20260709 13:00:53.044395  4343 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:53.048064  2239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 615) took 1385 ms. Trace:
I20260709 13:00:53.075531  1619 rpcz_store.cc:276] 0709 13:00:51.720861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.871745 (+1150884us) service_pool.cc:224] Handling call
0709 13:00:52.872058 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.016369 (+144311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.016584 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:53.079982  1543 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:53.048153  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:53.080720  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2327) took 1048 ms. Trace:
W20260709 13:00:53.050767  4342 consensus_meta.cc:287] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.752s	user 0.009s	sys 0.000s
I20260709 13:00:53.032327  4061 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:53.006029  4405 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:53.084152  4482 log.cc:927] Time spent T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:00:53.086381  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1207) took 1085 ms. Trace:
I20260709 13:00:53.086722  1539 rpcz_store.cc:276] 0709 13:00:52.001126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.725434 (+724308us) service_pool.cc:224] Handling call
0709 13:00:52.725764 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.729877 (+  4113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.729908 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.749128 (+ 19220us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.784572 (+ 35444us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:53.005955 (+221383us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.006363 (+   408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.006455 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:53.086179 (+ 79724us) raft_consensus.cc:1685] finished
0709 13:00:53.086201 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.086326 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3509,"raft.queue_time_us":3855,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":33223,"thread_start_us":218494,"threads_started":2,"wal-append.queue_time_us":51943}
I20260709 13:00:53.051704  4478 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:53.089929  4457 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:53.091987  4478 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:53.092157  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1960) took 2193 ms. Trace:
I20260709 13:00:53.092527  1690 rpcz_store.cc:276] 0709 13:00:50.898530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.695116 (+796586us) service_pool.cc:224] Handling call
0709 13:00:52.189371 (+494255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.222738 (+ 33367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.091979 (+869241us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b5400134cd0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:53.092104 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135929728}
I20260709 13:00:53.094487  4342 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:53.095675  1542 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:53.096041  3823 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:53.097363  4342 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:53.098541  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1961) took 2182 ms. Trace:
I20260709 13:00:52.858269  4257 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:53.101012  4257 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:53.067421  1538 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:53.072628  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:53.098932  1696 rpcz_store.cc:276] 0709 13:00:50.916166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.991520 (+1075354us) service_pool.cc:224] Handling call
0709 13:00:52.004533 (+ 13013us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.075897 (+ 71364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.075926 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.080828 (+  4902us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.216324 (+135496us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:52.216538 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.091205 (+874667us) spinlock_profiling.cc:243] Waited 56.9 ms on lock 0x7b54000f2dd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:53.098201 (+  6996us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:53.098253 (+    52us) raft_consensus.cc:1685] finished
0709 13:00:53.098272 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.098483 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7088,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":8247,"spinlock_wait_cycles":130895104,"thread_start_us":96550,"threads_started":1,"wal-append.queue_time_us":181715}
I20260709 13:00:53.063005  4329 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:53.076663  2245 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:00:53.060972  4462 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:53.077134  4381 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:53.078176  4096 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:53.078429  3868 raft_consensus.cc:3055] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:53.025517  4456 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:53.079618  2239 rpcz_store.cc:276] 0709 13:00:51.662810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.674331 (+ 11521us) service_pool.cc:224] Handling call
0709 13:00:51.681915 (+  7584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.678948 (+997033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.047833 (+368885us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b540039dd54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:53.048010 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2291447168}
I20260709 13:00:52.851655  4047 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:53.047080  4361 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.080744  1694 raft_consensus.cc:2393] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 7: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:53.049645  1547 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:00:53.078929  4376 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:53.097414  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2329) took 1064 ms. Trace:
I20260709 13:00:53.124217  1542 rpcz_store.cc:276] 0709 13:00:52.032885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.256441 (+223556us) service_pool.cc:224] Handling call
0709 13:00:53.097223 (+840782us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b54000b6b54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:53.097359 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1859929472}
I20260709 13:00:53.128593  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 1936) took 1450 ms. Trace:
I20260709 13:00:53.129005  1617 rpcz_store.cc:276] 0709 13:00:51.678154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.549537 (+871383us) service_pool.cc:224] Handling call
0709 13:00:52.549943 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.623546 (+ 73603us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:52.746280 (+122734us) log.cc:844] Serialized 14 byte log entry
0709 13:00:52.817244 (+ 70964us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:52.817342 (+    98us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:52.822357 (+  5015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.128369 (+306012us) spinlock_profiling.cc:243] Waited 73.4 ms on lock 0x7b5400380ed4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:53.128416 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.128526 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51,"prepare.queue_time_us":140998,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":377,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2956,"spinlock_wait_cycles":168726784,"thread_start_us":154313,"threads_started":2,"wal-append.queue_time_us":113221}
I20260709 13:00:53.133201  4252 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:53.138661  4426 consensus_meta.cc:287] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.808s	user 0.011s	sys 0.012s
I20260709 13:00:53.063882  4458 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:53.060359  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:53.055895  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:53.144063  2246 raft_consensus.cc:2393] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:53.120204  4448 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:53.145603  1691 raft_consensus.cc:2368] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4.
I20260709 13:00:53.104614  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:53.147482  1619 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.105034  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:53.105839  1540 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:53.104375  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 446) took 1163 ms. Trace:
I20260709 13:00:53.051417  4447 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:53.156464  1622 rpcz_store.cc:276] 0709 13:00:51.941512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.103402 (+1161890us) service_pool.cc:224] Handling call
0709 13:00:53.103751 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.103987 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.104024 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:53.104076 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:53.104119 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.104190 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.104309 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:53.158362  1622 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:53.060124  4369 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:53.078615  1687 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 8. Ops: []
I20260709 13:00:53.109724  4396 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:53.110211  3868 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:53.110615  1696 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:53.183099  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1204) took 1393 ms. Trace:
I20260709 13:00:53.183486  1696 rpcz_store.cc:276] 0709 13:00:51.789438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.103375 (+1313937us) service_pool.cc:224] Handling call
0709 13:00:53.110437 (+  7062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.182816 (+ 72379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.183036 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:53.081174  1543 rpcz_store.cc:276] 0709 13:00:52.032286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.079553 (+1047267us) service_pool.cc:224] Handling call
0709 13:00:53.079827 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.080508 (+   681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.080672 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:53.123081  1694 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:53.131179  1617 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:53.185779  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1970) took 1183 ms. Trace:
I20260709 13:00:53.186285  1694 rpcz_store.cc:276] 0709 13:00:52.002543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.121387 (+1118844us) service_pool.cc:224] Handling call
0709 13:00:53.122813 (+  1426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.185551 (+ 62738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.185721 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:53.141028  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 266864us
I20260709 13:00:53.128618  4047 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:53.147719  4448 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:53.293905  1690 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:53.120736  4039 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.166111  1621 raft_consensus.cc:2393] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
W20260709 13:00:53.054477  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.186829  1617 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:53.214926  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 141349us
W20260709 13:00:53.295192  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.295912  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.296830  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:53.298276  1660 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:53.156018  4405 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:53.310784  2246 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:53.185779  1619 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:00:53.310901  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:53.312239  2210 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:53.312870  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:53.313462  1619 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:53.320513  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:53.321389  2246 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:53.322083  1694 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:53.324930  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1973) took 1302 ms. Trace:
I20260709 13:00:53.325340  1694 rpcz_store.cc:276] 0709 13:00:52.022253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.187179 (+1164926us) service_pool.cc:224] Handling call
0709 13:00:53.321730 (+134551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.324626 (+  2896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.324864 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:53.328425  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:53.328763  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1202) took 1553 ms. Trace:
I20260709 13:00:53.329734  1692 rpcz_store.cc:276] 0709 13:00:51.775621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.075107 (+1299486us) service_pool.cc:224] Handling call
0709 13:00:53.075395 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.075632 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:53.092409 (+ 16777us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.328315 (+235906us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:53.328388 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:53.328454 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.328543 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.328693 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11310,"prepare.queue_time_us":7464,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"thread_start_us":222437,"threads_started":1}
I20260709 13:00:53.332780  1692 raft_consensus.cc:1240] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:53.333724  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1976) took 1229 ms. Trace:
I20260709 13:00:53.334180  1692 rpcz_store.cc:276] 0709 13:00:52.107653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.332222 (+1224569us) service_pool.cc:224] Handling call
0709 13:00:53.332518 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.333407 (+   889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.333655 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:53.202361  4257 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:53.295133  4324 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:53.139123  4426 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:53.293720  4348 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.323068  4376 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:53.307476  4458 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:53.362363  4456 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:53.306643  4465 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.315491  4300 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.346453  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 448) took 1070 ms. Trace:
I20260709 13:00:53.345350  4472 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:53.320812  4047 consensus_queue.cc:1059] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:00:53.412573  2240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 669) took 1464 ms. Trace:
I20260709 13:00:53.364300  4376 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.373975  1615 rpcz_store.cc:276] 0709 13:00:52.275873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.132350 (+856477us) service_pool.cc:224] Handling call
0709 13:00:53.132664 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.132860 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:53.133156 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.346083 (+212927us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:53.346169 (+    86us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:53.346231 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.346298 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.346402 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32926,"prepare.queue_time_us":542,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":41119,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6636,"thread_start_us":171570,"threads_started":1}
I20260709 13:00:53.332726  4439 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:53.342170  1619 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:53.339079  4369 consensus_queue.cc:1059] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:00:53.383842  4405 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:53.384793  4449 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:53.385667  4426 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:53.379127  4465 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:53.406665  4479 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.392s	user 0.002s	sys 0.000s
W20260709 13:00:53.407598  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50552 (request call id 442) took 1676 ms (client timeout 1615 ms). Trace:
W20260709 13:00:53.460988  1620 rpcz_store.cc:269] 0709 13:00:51.731298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.743625 (+ 12327us) service_pool.cc:224] Handling call
0709 13:00:53.407333 (+1663708us) spinlock_profiling.cc:243] Waited 75.5 ms on lock 0x7b540042cf54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:53.407484 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173572992}
I20260709 13:00:53.408601  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1205) took 1408 ms. Trace:
W20260709 13:00:53.409123  4330 consensus_meta.cc:287] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 1.134s	user 0.011s	sys 0.003s
I20260709 13:00:53.409763  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:53.337321  4096 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:00:53.413028  2240 rpcz_store.cc:276] 0709 13:00:51.947876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.948013 (+   137us) service_pool.cc:224] Handling call
0709 13:00:51.948503 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.561089 (+612586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.412331 (+851242us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b54006211d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:53.412511 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1390281600}
I20260709 13:00:53.368330  2246 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:53.354597  4257 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:53.363859  4348 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:53.422377  4376 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.462595  1540 rpcz_store.cc:276] 0709 13:00:52.000520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.703731 (+703211us) service_pool.cc:224] Handling call
0709 13:00:52.704031 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.155745 (+451714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.408320 (+252575us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b54003c41d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:53.408537 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923576576}
I20260709 13:00:53.467785  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:53.460062  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:53.473315  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:53.474095  1540 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:53.381386  4300 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:53.476642  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:53.477142  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:53.478859  1615 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.364701  3868 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:53.458009  4439 raft_consensus.cc:697] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:53.477824  1620 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:53.482779  1540 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.484642  1621 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.483278  1619 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.474617  4215 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:53.479791  4369 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:53.512511  4369 raft_consensus.cc:697] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:53.493199  1692 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:53.514853  1621 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:53.516551  1540 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:53.516892  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:53.517763  2241 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:53.517861  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:53.518608  1540 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:53.501684  1615 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:53.508026  4439 consensus_queue.cc:237] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:53.462514  4449 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:53.522338  4449 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:53.543084  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:53.513597  4369 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:53.567329  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.567835  1615 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:53.581451  1619 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:53.587347  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:53.588312  1540 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.591817  4404 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.592561  4404 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:53.596544  4404 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:53.598307  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 398) took 2523 ms. Trace:
I20260709 13:00:53.598821  1688 rpcz_store.cc:276] 0709 13:00:51.074516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.987282 (+912766us) service_pool.cc:224] Handling call
0709 13:00:52.825828 (+838546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.846061 (+ 20233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.598039 (+751978us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b5400133b50. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:53.598235 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1923903872}
I20260709 13:00:53.601015  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:53.601368  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1194) took 1629 ms. Trace:
I20260709 13:00:53.601821  1541 rpcz_store.cc:276] 0709 13:00:51.971593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.971731 (+   138us) service_pool.cc:224] Handling call
0709 13:00:52.382200 (+410469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.382392 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.382418 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:52.382463 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:52.382498 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.382553 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.601194 (+1218641us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b54002fa3d0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:53.601312 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":903331072}
I20260709 13:00:53.602578  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:53.603137  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:53.603865  1541 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:53.603996  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1196) took 1626 ms. Trace:
I20260709 13:00:53.604586  1538 rpcz_store.cc:276] 0709 13:00:51.977485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.977621 (+   136us) service_pool.cc:224] Handling call
0709 13:00:51.987643 (+ 10022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.102447 (+1114804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.603701 (+501254us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000d1954. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:53.603928 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2482441984}
I20260709 13:00:53.606335  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:53.496459  3868 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:53.466784  4330 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:53.609946  4330 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:53.611192  1693 raft_consensus.cc:2393] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:53.606875  4470 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.613041  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1192) took 1848 ms. Trace:
I20260709 13:00:53.607949  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1190) took 1844 ms. Trace:
I20260709 13:00:53.613530  1687 rpcz_store.cc:276] 0709 13:00:51.764525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.321391 (+556866us) service_pool.cc:224] Handling call
0709 13:00:52.359109 (+ 37718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.170524 (+811415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.612806 (+442282us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b540044b954. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:53.612980 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654105472}
I20260709 13:00:53.509297  4300 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:53.616979  1540 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:53.617460  4047 raft_consensus.cc:3055] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:53.620216  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:53.614876  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:53.614236  1689 rpcz_store.cc:276] 0709 13:00:51.763957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.278563 (+514606us) service_pool.cc:224] Handling call
0709 13:00:52.297554 (+ 18991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.393128 (+ 95574us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:52.393437 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 13:00:52.704205 (+310768us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:52.704253 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:52.704296 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.607692 (+903396us) spinlock_profiling.cc:243] Waited 95.3 ms on lock 0x7b54001b6f54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:53.607750 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.607889 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17163,"prepare.queue_time_us":22222,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":111214,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":18604,"spinlock_wait_cycles":219255168,"thread_start_us":293194,"threads_started":2,"wal-append.queue_time_us":208524}
I20260709 13:00:53.622265  1688 raft_consensus.cc:2393] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:53.641091  1616 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:53.626467  1541 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:00:53.641808  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:53.640170  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2363) took 1991 ms. Trace:
I20260709 13:00:53.621609  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:53.643430  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:53.633195  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:53.645593  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:53.646865  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:53.657639  1688 raft_consensus.cc:2393] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:00:53.647972  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.648998  2211 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:53.650499  1538 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:53.649765  1613 rpcz_store.cc:276] 0709 13:00:51.648872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.161808 (+512936us) service_pool.cc:224] Handling call
0709 13:00:53.640008 (+1478200us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b54000e6354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:53.640125 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362593024}
I20260709 13:00:53.639650  4047 raft_consensus.cc:740] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:53.653924  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:53.655005  1544 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:53.677510  1544 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 13:00:53.670846  4449 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.674955  2211 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:53.677754  1540 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:53.685274  1687 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:53.687171  2211 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:53.691316  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:53.656751  4300 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:53.696918  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.703855  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 1941) took 1983 ms. Trace:
I20260709 13:00:53.704272  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 1211) took 1081 ms. Trace:
I20260709 13:00:53.704691  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 341) took 1102 ms. Trace:
I20260709 13:00:53.704694  1691 rpcz_store.cc:276] 0709 13:00:52.623223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.694995 (+ 71772us) service_pool.cc:224] Handling call
0709 13:00:53.704111 (+1009116us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b540014f354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:53.704220 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011370752}
I20260709 13:00:53.705313  1546 rpcz_store.cc:276] 0709 13:00:52.602031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.638238 (+ 36207us) service_pool.cc:224] Handling call
0709 13:00:53.704448 (+1066210us) spinlock_profiling.cc:243] Waited 89.7 ms on lock 0x7b5400069fd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:53.704617 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206272896}
I20260709 13:00:53.704243  1614 rpcz_store.cc:276] 0709 13:00:51.720282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.052815 (+332533us) service_pool.cc:224] Handling call
0709 13:00:53.703696 (+1650881us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b54002030d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:53.703797 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1466538752}
I20260709 13:00:53.692822  4452 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:53.714898  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:53.713798  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:53.683828  2237 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:53.715845  1620 raft_consensus.cc:2393] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 8: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:53.699842  4300 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.717707  1540 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:00:53.711663  4334 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.720903  1538 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:00:53.760092  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:53.761127  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:53.715513  4452 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.774830  4452 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.729866  2246 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:53.775331  4334 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:53.714895  4047 consensus_queue.cc:260] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:53.778060  4334 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:53.779099  1659 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:53.781808  1659 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:53.782572  4447 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:53.783160  4447 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:53.718782  4330 consensus_queue.cc:1059] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:00:53.784397  1585 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:53.784893  4330 raft_consensus.cc:3055] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:53.785240  4330 raft_consensus.cc:740] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:53.785652  4259 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.786074  4330 consensus_queue.cc:260] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:53.786697  1585 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:53.732025  1587 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:53.735194  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:53.736065  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:53.736943  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:53.737772  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:53.747776  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1216) took 1284 ms. Trace:
I20260709 13:00:53.789759  2238 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.734412  2239 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:53.749017  4215 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.718652  3814 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:53.751858  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:53.752781  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 1949) took 2025 ms. Trace:
I20260709 13:00:53.797399  1616 rpcz_store.cc:276] 0709 13:00:51.727663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.090581 (+1362918us) service_pool.cc:224] Handling call
0709 13:00:53.640532 (+549951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.641544 (+  1012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.752546 (+111002us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54000e6350. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:53.752712 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263923456}
W20260709 13:00:53.739023  1693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 1209) took 1684 ms (client timeout 2139 ms). Trace:
I20260709 13:00:53.799607  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:53.756938  1546 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:53.757628  1540 pending_rounds.cc:85] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 5
I20260709 13:00:53.801991  1540 pending_rounds.cc:107] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:00:53.802317  1540 raft_consensus.cc:2889] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:53.758492  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1203) took 1974 ms. Trace:
I20260709 13:00:53.713330  4348 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:53.692698  4449 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:53.728606  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.805085  1614 raft_consensus.cc:2368] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9.
I20260709 13:00:53.756821  4257 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:53.798779  1693 rpcz_store.cc:269] 0709 13:00:52.055067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.057043 (+  1976us) service_pool.cc:224] Handling call
0709 13:00:53.738776 (+1681733us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400459a54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:53.738951 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3520809728}
I20260709 13:00:53.807649  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:53.809782  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:53.761641  1538 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.800208  2239 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 1.
W20260709 13:00:53.750926  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.770406  1689 raft_consensus.cc:2410] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:53.759253  4300 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.773950  4376 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:53.786156  4259 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:53.833237  4447 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.838728  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:53.788157  1585 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:53.789674  1539 rpcz_store.cc:276] 0709 13:00:52.462896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.088172 (+625276us) service_pool.cc:224] Handling call
0709 13:00:53.088490 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.088687 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:53.305851 (+217164us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.747439 (+441588us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:53.747492 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:53.747531 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.747595 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.747716 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":342045,"prepare.queue_time_us":54771,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":328996,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":8836992,"thread_start_us":302222,"threads_started":2,"wal-append.queue_time_us":330092}
I20260709 13:00:53.748600  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1214) took 1406 ms. Trace:
I20260709 13:00:53.791379  1659 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:53.842069  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 50764.6us
I20260709 13:00:53.842973  1659 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:53.793237  2209 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:00:53.795053  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 63102us
I20260709 13:00:53.802877  1690 rpcz_store.cc:276] 0709 13:00:51.784181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.093395 (+1309214us) service_pool.cc:224] Handling call
0709 13:00:53.093612 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.301752 (+208140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.758210 (+456458us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400450e54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:53.758424 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239961984}
I20260709 13:00:53.844316  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:53.816804  2238 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:53.855491  1694 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:53.853930  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 343) took 1251 ms. Trace:
I20260709 13:00:53.853721  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:53.845211  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:53.858170  1587 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:53.840371  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:53.860035  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:53.860540  1539 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:53.853606  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.831477  4334 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.798501  4466 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:53.762877  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 340) took 1162 ms. Trace:
I20260709 13:00:53.856345  1543 rpcz_store.cc:276] 0709 13:00:52.602671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.300305 (+697634us) service_pool.cc:224] Handling call
0709 13:00:53.300996 (+   691us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.321334 (+ 20338us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:53.350577 (+ 29243us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.751889 (+401312us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.752370 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.752495 (+   125us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:53.752527 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.752591 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:53.853731 (+101140us) raft_consensus.cc:1685] finished
0709 13:00:53.853755 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.853874 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134204,"prepare.queue_time_us":40666,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":558414,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":204,"thread_start_us":250668,"threads_started":1,"wal-append.queue_time_us":479544}
I20260709 13:00:53.834100  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:53.865401  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:53.865957  1687 raft_consensus.cc:2393] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:53.811514  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:53.836817  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:53.817502  1538 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:53.796617  4305 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:53.863464  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:53.804239  4350 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:53.805378  4330 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.840513  1545 rpcz_store.cc:276] 0709 13:00:52.342121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.070494 (+728373us) service_pool.cc:224] Handling call
0709 13:00:53.070756 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.070939 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:53.332182 (+261243us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.748298 (+416116us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:53.748344 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:53.748383 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.748442 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.748543 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":280659,"prepare.queue_time_us":72323,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":283497,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":64,"thread_start_us":361380,"threads_started":2,"wal-append.queue_time_us":505379}
I20260709 13:00:53.893703  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:53.896800  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:53.864610  1542 rpcz_store.cc:276] 0709 13:00:52.601635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.125208 (+523573us) service_pool.cc:224] Handling call
0709 13:00:53.125511 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.125852 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.125881 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.126359 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.304544 (+178185us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:53.317052 (+ 12508us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.742985 (+425933us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b18003adaa0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e5b8c0a 00007fc497cf8219 00007fc48e640a40 00007fc48e63b4e4 00007fc48e63b455 00007fc491723060 00007fc491735716 00007fc491746287 00007fc491746208
0709 13:00:53.743194 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.758776 (+ 15582us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:53.758838 (+    62us) raft_consensus.cc:1685] finished
0709 13:00:53.762664 (+  3826us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.762814 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10083,"prepare.queue_time_us":16446,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":433591,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":158,"spinlock_wait_cycles":25944960,"thread_start_us":177750,"threads_started":1,"wal-append.queue_time_us":435117}
I20260709 13:00:53.898129  1545 raft_consensus.cc:2393] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 8: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:53.898974  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:53.899751  1616 raft_consensus.cc:2368] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7.
I20260709 13:00:53.899634  1545 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:53.901671  1545 raft_consensus.cc:1240] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:53.893046  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1210) took 1622 ms. Trace:
I20260709 13:00:53.902469  1692 rpcz_store.cc:276] 0709 13:00:52.270239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.335543 (+1065304us) service_pool.cc:224] Handling call
0709 13:00:53.335936 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.514831 (+178895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.892799 (+377968us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54002675d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:53.892988 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360852864}
I20260709 13:00:53.865969  1543 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.903730  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:53.870414  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 82307.2us
I20260709 13:00:53.904531  1692 raft_consensus.cc:2393] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:53.871356  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:53.907660  1687 raft_consensus.cc:2393] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:53.908766  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:53.854147  4404 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:53.837472  3814 raft_consensus.cc:697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:53.990321  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:53.991391  1619 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:53.992379  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:53.993074  1619 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:53.910895  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:53.913074  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:53.855052  4449 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:53.913345  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 69136.2us
I20260709 13:00:53.971128  4453 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.869978  1659 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:53.853019  4504 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:53.953362  1539 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:53.804347  4215 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:53.911921  4361 consensus_queue.cc:1059] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:00:53.839545  4381 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:00:53.869737  4334 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:53.838923  4447 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:53.977873  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2372) took 1230 ms. Trace:
I20260709 13:00:54.022585  1622 rpcz_store.cc:276] 0709 13:00:52.747737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.160964 (+413227us) service_pool.cc:224] Handling call
0709 13:00:53.161347 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.161706 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.161737 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.166510 (+  4773us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.633195 (+466685us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:53.633257 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.633350 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:53.977631 (+344281us) raft_consensus.cc:1685] finished
0709 13:00:53.977653 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.977809 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30790,"raft.queue_time_us":453,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":13061,"thread_start_us":289943,"threads_started":1,"wal-append.queue_time_us":659913}
W20260709 13:00:54.024891  1618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.029s	sys 0.045s
W20260709 13:00:54.025223  1618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.029s	sys 0.045s
I20260709 13:00:53.972114  1691 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:00:53.845544  4259 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:53.983515  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:53.869393  4039 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:53.892494  4425 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:53.846181  4376 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:53.986912  1687 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:53.855558  4221 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 13:00:53.996805  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:54.002221  1613 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:54.009002  4404 raft_consensus.cc:697] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:53.971987  4458 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:53.988360  4439 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:54.086843  4465 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:54.016115  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 146240us
I20260709 13:00:54.089184  1659 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:53.921387  4426 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:00:54.093253  4426 raft_consensus.cc:3055] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:54.093775  4426 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:54.095453  4039 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:53.921634  4456 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:00:54.028879  1542 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:53.870481  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:54.099565  1538 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:54.034232  1619 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:54.039251  1543 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:54.104334  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1974) took 2043 ms. Trace:
I20260709 13:00:54.104781  1694 rpcz_store.cc:276] 0709 13:00:52.061062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.326271 (+1265209us) service_pool.cc:224] Handling call
0709 13:00:53.349212 (+ 22941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.855910 (+506698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.104048 (+248138us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b540014f854. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:54.104269 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1163774720}
I20260709 13:00:54.023967  4369 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:54.021104  4504 raft_consensus.cc:697] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:00:54.116703  4503 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.224s	user 0.000s	sys 0.000s
I20260709 13:00:54.118100  4404 consensus_queue.cc:237] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:54.028046  4329 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:54.107067  1659 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:54.079999  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:54.127183  4361 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:54.129781  4039 consensus_queue.cc:1059] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:54.130038  4361 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:54.130739  4425 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:54.132223  4361 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:54.135164  4504 consensus_queue.cc:237] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:54.134135  4447 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:54.115278  4369 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:54.152420  4368 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:54.149695  4446 raft_consensus.cc:3055] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:00:54.143535  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 334) took 2109 ms (client timeout 2192 ms). Trace:
W20260709 13:00:54.181788  1547 rpcz_store.cc:269] 0709 13:00:52.034258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.428517 (+394259us) service_pool.cc:224] Handling call
0709 13:00:54.143316 (+1714799us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54001874d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:54.143460 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":876058496}
I20260709 13:00:54.131285  3814 consensus_queue.cc:237] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:54.133565  4215 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:54.142459  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:00:54.114231  4491 log.cc:927] Time spent T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 13:00:54.140089  4498 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.503s	user 0.000s	sys 0.014s
I20260709 13:00:54.134104  4376 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:54.147743  4452 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:54.180573  4369 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:54.166610  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 373380us
I20260709 13:00:54.166863  1659 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:54.172740  1695 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:54.173780  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:54.173347  1687 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:00:54.201817  2209 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:54.175094  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 487949us
I20260709 13:00:54.114621  4458 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:54.193856  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:54.181574  4446 raft_consensus.cc:740] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:00:54.202879  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 73608.3us
I20260709 13:00:54.094911  4426 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:54.191332  4447 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:54.214428  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 453944us
I20260709 13:00:54.193162  4376 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.195119  4466 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:54.206315  1687 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:54.213055  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:54.203862  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:54.217409  1691 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:54.221179  1687 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:54.239707  1687 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:00:54.226341  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 227663us
I20260709 13:00:54.204267  4405 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:54.208801  4305 raft_consensus.cc:697] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:54.256575  1587 leader_election.cc:400] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4.
I20260709 13:00:54.257465  1587 leader_election.cc:403] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:00:54.259204  1622 raft_consensus.cc:1240] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:54.218514  4376 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:54.263909  4446 consensus_queue.cc:260] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:54.265523  4446 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:54.272954  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2376) took 1202 ms. Trace:
I20260709 13:00:54.273420  1617 rpcz_store.cc:276] 0709 13:00:53.070862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.295454 (+224592us) service_pool.cc:224] Handling call
0709 13:00:53.295757 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.483794 (+188037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.483834 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:53.483891 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:53.483935 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.272704 (+788769us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54001e8554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:54.272746 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.272892 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431922048}
I20260709 13:00:54.283042  4368 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.259160  4359 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4.
I20260709 13:00:54.283660  4368 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:54.284554  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.284977  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.285101  4446 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.285274  4458 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:54.285701  4368 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:54.285806  4458 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:54.286442  4368 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.286533  4458 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:54.286973  4368 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:54.287904  4499 log.cc:927] Time spent T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.652s	user 0.004s	sys 0.000s
W20260709 13:00:54.288546  4507 log.cc:927] Time spent T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:00:54.223459  4401 consensus_queue.cc:1175] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "822e08445eae4a33b2f2fe92060192c6" responder_term: 8 status { last_received { term: 7 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:54.257006  4305 consensus_queue.cc:237] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:54.293051  4465 raft_consensus.cc:3055] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:54.308475  4465 raft_consensus.cc:740] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:54.293453  4452 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:54.309186  4259 consensus_queue.cc:1059] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:54.309762  4452 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:54.310365  4452 raft_consensus.cc:697] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:54.311651  4452 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:54.253135  4334 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:54.316666  4259 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:00:54.328861  1541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.001s	sys 0.024s
I20260709 13:00:54.297560  1696 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:54.257531  4426 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:54.356947  1690 raft_consensus.cc:2410] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:00:54.254001  4230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.015s	sys 0.013s
W20260709 13:00:54.303768  1695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 1952) took 3478 ms (client timeout 2079 ms). Trace:
I20260709 13:00:54.220043  4447 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:54.364781  4230 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.368230  4369 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:54.370808  4369 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:54.330142  1541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.001s	sys 0.024s
W20260709 13:00:54.333801  4508 log.cc:927] Time spent T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.190s	user 0.002s	sys 0.000s
I20260709 13:00:54.340507  4465 consensus_queue.cc:260] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:54.348908  4368 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:54.350986  4330 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:54.353487  4047 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:54.354429  4300 consensus_meta.cc:287] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.000s
I20260709 13:00:54.261592  4348 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:00:54.357970  1687 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:00:54.408305  1687 pending_rounds.cc:85] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 5
I20260709 13:00:54.408599  1687 pending_rounds.cc:107] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:00:54.371126  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:54.409081  1687 raft_consensus.cc:2889] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:54.409435  1689 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:54.285645  4446 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:54.360075  1695 rpcz_store.cc:269] 0709 13:00:50.819105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.059693 (+240588us) service_pool.cc:224] Handling call
0709 13:00:52.796272 (+1736579us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b58001c3598. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc4966f10a0 00007fc4966f0984 00007fc48fc6b6d4 00007fc48fc6b662
0709 13:00:54.297074 (+1500802us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400033c54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:54.297178 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3097231616}
W20260709 13:00:54.383612  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.007s	sys 0.019s
W20260709 13:00:54.412506  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.007s	sys 0.020s
I20260709 13:00:54.390923  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1972) took 2383 ms. Trace:
W20260709 13:00:54.412914  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 579638us
I20260709 13:00:54.412953  1696 rpcz_store.cc:276] 0709 13:00:52.007874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.184299 (+1176425us) service_pool.cc:224] Handling call
0709 13:00:54.297273 (+1112974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.329554 (+ 32281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.390641 (+ 61087us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b5400033c50. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:54.390843 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2256757504}
I20260709 13:00:54.401875  1660 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:54.404604  1690 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:00:54.419526  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.422170  1660 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:54.425755  4405 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.426410  4405 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:54.429196  4405 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:54.429853  4096 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:54.430526  4096 raft_consensus.cc:697] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:54.431591  4096 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:54.400141  4330 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:54.372709  4439 consensus_queue.cc:1059] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:00:54.447324  4215 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:00:54.452479  1510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.011s	sys 0.059s
W20260709 13:00:54.408524  4514 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.184s	user 0.001s	sys 0.004s
W20260709 13:00:54.454214  1510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.011s	sys 0.059s
I20260709 13:00:54.447660  4439 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:54.458598  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.458696  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:54.463709  1689 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:54.453886  4369 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:54.469043  1512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.039s	sys 0.034s
W20260709 13:00:54.469431  1512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.039s	sys 0.034s
I20260709 13:00:54.411410  4300 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:54.472226  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 487998us
W20260709 13:00:54.471042  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 637085us
I20260709 13:00:54.451370  4368 consensus_queue.cc:1059] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:00:54.375118  4376 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:54.473958  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:54.481532  1617 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:54.462410  4330 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:54.461433  4465 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:54.492187  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:54.493909  1622 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:54.472793  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:54.497433  1692 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:54.501906  1694 raft_consensus.cc:2393] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:54.512755  1587 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:54.476612  4350 raft_consensus.cc:697] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:54.462209  4439 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:54.520539  1689 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:54.521334  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:54.487284  4369 raft_consensus.cc:697] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:00:54.500085  4377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.002s	sys 0.025s
I20260709 13:00:54.526427  1587 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:54.529076  1585 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:54.530592  4377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.002s	sys 0.025s
I20260709 13:00:54.519753  4401 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:54.547430  1691 raft_consensus.cc:1240] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:54.521047  4515 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:54.549607  1585 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:54.556015  1585 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:54.530786  4525 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:54.530997  4405 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:00:54.577764  1585 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:54.564623  1587 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:54.533880  4259 consensus_queue.cc:1059] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:00:54.558135  4329 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:54.558290  4527 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:54.559592  4401 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:54.561736  4525 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:54.619684  1585 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:00:54.698185  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 489905us
I20260709 13:00:54.704326  2209 leader_election.cc:400] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6.
W20260709 13:00:54.586037  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.562636  4515 raft_consensus.cc:697] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:54.555064  4039 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:00:54.557269  4350 consensus_queue.cc:237] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:54.696738  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 477097us
I20260709 13:00:54.566267  4517 raft_consensus.cc:3055] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:54.565994  4466 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:54.619306  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 415454us
I20260709 13:00:54.721551  1586 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:54.619006  4446 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:54.621333  4527 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.733094  2210 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:54.578405  4359 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 13:00:54.714844  4525 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:54.565884  4454 consensus_queue.cc:1059] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.161s
I20260709 13:00:54.579000  4456 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.155s
I20260709 13:00:54.752571  1586 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:54.741644  2211 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:54.575739  4361 consensus_queue.cc:1059] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.161s
W20260709 13:00:54.739094  4404 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.010s	sys 0.015s
I20260709 13:00:54.737243  4517 raft_consensus.cc:740] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:54.743366  4466 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:54.767967  1586 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:54.743405  4426 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:54.768365  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 295647us
I20260709 13:00:54.620754  4369 consensus_queue.cc:237] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:54.754675  4527 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:54.760624  4300 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:54.762403  4348 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:54.743125  4518 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:00:54.764520  4404 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.010s	sys 0.015s
W20260709 13:00:54.761701  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 233527us
I20260709 13:00:54.766738  4405 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.783690  4305 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:54.768692  4425 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:54.771832  4466 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:54.776983  4453 consensus_meta.cc:287] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.764s	user 0.012s	sys 0.000s
I20260709 13:00:54.781745  4504 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:54.842926  4449 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:00:54.781240  4439 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:54.771529  4376 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:54.798130  4519 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:54.789512  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 315211us
W20260709 13:00:54.795897  4520 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
W20260709 13:00:54.790303  4506 log.cc:927] Time spent T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:00:54.858395  4425 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:54.769186  4523 consensus_queue.cc:1059] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:00:54.796039  4377 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:54.814038  4348 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.812526  4336 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:54.796275  4522 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:54.831665  4426 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.818401  4458 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:54.838058  1693 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
W20260709 13:00:54.871177  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 251523us
I20260709 13:00:54.803761  4447 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:54.775405  4533 consensus_queue.cc:1059] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
W20260709 13:00:54.853513  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.769325  4454 consensus_queue.cc:1243] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:54.857393  4230 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:54.845734  4526 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:54.845572  4530 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:54.781384  4385 consensus_queue.cc:1059] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
W20260709 13:00:54.886466  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 118474us
I20260709 13:00:54.921455  4368 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:54.944921  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1214) took 2175 ms. Trace:
I20260709 13:00:54.945533  1688 rpcz_store.cc:276] 0709 13:00:52.769466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.673708 (+904242us) service_pool.cc:224] Handling call
0709 13:00:53.679051 (+  5343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.679505 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.679535 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.693785 (+ 14250us) log.cc:844] Serialized 26 byte log entry
0709 13:00:54.218751 (+524966us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:54.218805 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.218896 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.944686 (+725790us) raft_consensus.cc:1685] finished
0709 13:00:54.944708 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.944845 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8008,"raft.queue_time_us":99,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":11492,"thread_start_us":457447,"threads_started":1,"wal-append.queue_time_us":815739}
W20260709 13:00:54.891846  4516 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.172s	user 0.002s	sys 0.000s
I20260709 13:00:54.947250  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:54.892131  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 327409us
I20260709 13:00:54.949193  1587 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:54.949653  4536 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:00:54.950471  4257 raft_consensus.cc:3055] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:00:54.895453  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 172127us
I20260709 13:00:54.951588  4379 raft_consensus.cc:3055] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:54.951653  4549 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:54.952124  4379 raft_consensus.cc:740] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:54.870208  4453 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:54.953589  4385 raft_consensus.cc:3055] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:54.953702  4453 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:54.954038  4385 raft_consensus.cc:740] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:54.955086  4453 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:54.954905  4385 consensus_queue.cc:260] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:54.955502  4453 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:54.955897  4453 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.955924  4259 raft_consensus.cc:3055] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:54.956176  4385 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:54.956480  4259 raft_consensus.cc:740] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:54.950942  4257 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:54.926993  4426 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:54.957324  4259 consensus_queue.cc:260] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:54.958467  4259 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:54.958123  4257 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:54.959283  4426 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:54.960464  4257 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:54.932009  4300 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.961357  4300 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:54.961925  4426 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:54.963375  4300 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:54.900730  4329 raft_consensus.cc:697] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:54.892076  4401 raft_consensus.cc:697] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:54.964738  4401 consensus_queue.cc:237] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:54.965523  4425 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:54.906821  4541 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:54.967506  4541 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:54.969798  4541 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:54.971354  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 345) took 2368 ms. Trace:
I20260709 13:00:54.789933  4515 consensus_queue.cc:237] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:54.887188  4381 consensus_queue.cc:1059] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:00:54.798880  4517 consensus_queue.cc:260] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:54.854928  4542 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:54.942667  1617 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:54.938959  4452 raft_consensus.cc:3055] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:55.073508  1617 raft_consensus.cc:1240] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:54.934092  4458 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.944833  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:54.855623  4405 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:54.934341  4377 raft_consensus.cc:697] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:54.972316  2241 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:00:54.944335  4526 raft_consensus.cc:697] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:54.973567  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:55.096057  2239 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:54.975993  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:54.971894  1541 rpcz_store.cc:276] 0709 13:00:52.603321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.642501 (+1039180us) service_pool.cc:224] Handling call
0709 13:00:53.642879 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.752794 (+109915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.752823 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.753226 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:00:54.401216 (+647990us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:54.454807 (+ 53591us) log.cc:844] Serialized 14 byte log entry
0709 13:00:54.455173 (+   366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.455314 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.858970 (+403656us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b180037c2a0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:00:54.891141 (+ 32171us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:54.971057 (+ 79916us) raft_consensus.cc:1685] finished
0709 13:00:54.971089 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.971278 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123024,"prepare.queue_time_us":52916,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":1813,"raft.queue_time_us":111209,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":168,"spinlock_wait_cycles":32188672,"thread_start_us":647605,"threads_started":1,"wal-append.queue_time_us":808860}
W20260709 13:00:54.922046  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 149934us
I20260709 13:00:54.971452  4527 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:55.064769  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.942550  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:55.100311  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 157822us
W20260709 13:00:55.068634  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 131159us
I20260709 13:00:55.072281  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:55.072731  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 173930us
I20260709 13:00:55.103139  1585 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:55.103356  1512 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:54.888636  4519 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:55.066018  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:54.921762  4522 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:55.076313  1693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 1220) took 1269 ms (client timeout 1619 ms). Trace:
W20260709 13:00:55.106380  1693 rpcz_store.cc:269] 0709 13:00:53.806438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.817934 (+ 11496us) service_pool.cc:224] Handling call
0709 13:00:55.076054 (+1258120us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b54002670d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:55.076228 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2208441728}
W20260709 13:00:55.079324  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.077273  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:54.913341  4348 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:55.092779  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:55.111599  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:55.103374  2243 raft_consensus.cc:2410] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:55.104818  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:54.931752  4545 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.154s
I20260709 13:00:55.109791  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:55.073932  4452 raft_consensus.cc:740] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:54.939735  4523 consensus_queue.cc:1059] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.142s
I20260709 13:00:55.111605  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:55.164952  1545 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:55.114645  1659 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:55.121300  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:55.122186  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:55.107618  2242 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:00:55.169379  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:55.171453  1660 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:54.989579  3868 consensus_queue.cc:1059] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.129s
I20260709 13:00:55.123805  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:55.174499  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:55.175087  2244 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:55.155973  1547 raft_consensus.cc:2393] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:55.110239  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:55.176195  1541 raft_consensus.cc:2393] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:55.126094  1511 leader_election.cc:400] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9.
I20260709 13:00:55.176546  1511 leader_election.cc:403] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:54.990422  4368 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:55.160393  1544 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:55.130575  2245 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:55.163167  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:55.122913  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:55.171458  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 1937) took 3457 ms. Trace:
I20260709 13:00:55.125757  2241 pending_rounds.cc:85] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: Aborting all ops after (but not including) 6
I20260709 13:00:55.186510  2241 pending_rounds.cc:107] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:00:55.186806  2241 raft_consensus.cc:2889] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:55.069239  4557 consensus_queue.cc:1059] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:00:55.071821  4465 consensus_queue.cc:1059] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 13:00:55.123492  4039 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:55.193717  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 79143.3us
W20260709 13:00:55.214637  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.184501  1618 rpcz_store.cc:276] 0709 13:00:51.698180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.552688 (+854508us) service_pool.cc:224] Handling call
0709 13:00:53.412968 (+860280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.413382 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.413422 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.419908 (+  6486us) log.cc:844] Serialized 26 byte log entry
0709 13:00:54.025569 (+605661us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:54.025615 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.025727 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.943452 (+917725us) raft_consensus.cc:1685] finished
0709 13:00:54.943479 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.109119 (+165640us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b540042cf50. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:55.155034 (+ 45915us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1908,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9166,"spinlock_wait_cycles":1942120320,"thread_start_us":553499,"threads_started":1,"wal-append.queue_time_us":1036017}
I20260709 13:00:55.197023  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:00:55.090130  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 348533us
I20260709 13:00:55.200855  2239 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:55.202901  1660 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:55.205097  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:55.123692  4522 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:55.088776  4426 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:00:55.087070  4544 consensus_queue.cc:1059] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 13:00:55.089644  4458 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:55.179723  4552 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:55.277721  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 62479.8us
I20260709 13:00:55.280524  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:55.296648  1693 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:55.284727  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:55.082015  4542 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:55.252928  2211 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:00:55.277856  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 75063.4us
I20260709 13:00:55.296770  1659 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:55.226117  4039 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.179764  4521 consensus_queue.cc:1059] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:00:55.218710  4047 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:55.302608  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:55.179908  4221 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
W20260709 13:00:55.099550  4532 consensus_queue.cc:1175] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" responder_term: 6 status { last_received { term: 5 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:55.179975  4518 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:00:55.295956  4376 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.299901  4550 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:55.294634  4538 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.425s	user 0.001s	sys 0.000s
I20260709 13:00:55.303262  4566 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.342314  4447 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:55.257441  4523 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.276913  4558 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:55.294759  3814 consensus_queue.cc:1059] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:00:55.301285  4369 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.355508  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:55.350668  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 47334.7us
I20260709 13:00:55.343678  1692 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:55.342612  4039 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:55.299306  4534 log.cc:927] Time spent T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.416s	user 0.000s	sys 0.001s
W20260709 13:00:55.349766  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 132339us
W20260709 13:00:55.344221  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 241164us
I20260709 13:00:55.417011  1693 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:00:55.432972  2211 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:55.439399  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:55.371635  4548 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.441s	user 0.000s	sys 0.001s
I20260709 13:00:55.440279  1690 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:00:55.445178  2211 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:55.446406  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:55.447486  4521 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:55.448122  4521 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:55.190279  4329 consensus_queue.cc:237] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:55.452984  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:55.379447  4401 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:55.371569  4558 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.356256  4550 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:55.435698  4047 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.284409  4377 consensus_queue.cc:237] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:55.414677  4554 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:55.371798  4512 consensus_queue.cc:1059] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:00:55.364888  4504 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:55.449705  4530 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:55.438092  4369 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:55.475102  4221 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.465147  4558 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:55.364593  4376 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:55.470391  4550 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:55.508487  2240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 678) took 1778 ms. Trace:
I20260709 13:00:55.518906  2240 rpcz_store.cc:276] 0709 13:00:53.729591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.732710 (+  3119us) service_pool.cc:224] Handling call
0709 13:00:53.733071 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.218614 (+485543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.218644 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.258758 (+ 40114us) log.cc:844] Serialized 26 byte log entry
0709 13:00:54.716344 (+457586us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:54.716618 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.716927 (+   309us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.508272 (+791345us) raft_consensus.cc:1685] finished
0709 13:00:55.508295 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.508430 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":352384,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":106,"thread_start_us":932766,"threads_started":2,"wal-append.queue_time_us":526740}
I20260709 13:00:55.437562  4523 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:55.348315  4526 consensus_queue.cc:237] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:55.513999  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1243) took 1004 ms. Trace:
I20260709 13:00:55.525156  4330 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:00:55.525413  4466 consensus_meta.cc:287] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.645s	user 0.005s	sys 0.003s
W20260709 13:00:55.527424  4570 log.cc:927] Time spent T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.182s	user 0.002s	sys 0.000s
I20260709 13:00:55.479468  4047 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:55.528144  4447 raft_consensus.cc:3055] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:55.528952  4257 consensus_meta.cc:287] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.568s	user 0.008s	sys 0.000s
I20260709 13:00:55.539816  1696 rpcz_store.cc:276] 0709 13:00:54.509258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.509408 (+   150us) service_pool.cc:224] Handling call
0709 13:00:54.524113 (+ 14705us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.526474 (+  2361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.526510 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.538418 (+ 11908us) log.cc:844] Serialized 26 byte log entry
0709 13:00:54.782931 (+244513us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:54.828106 (+ 45175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.828212 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.513804 (+685592us) raft_consensus.cc:1685] finished
0709 13:00:55.513825 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.513944 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1983,"raft.queue_time_us":4364,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5712,"thread_start_us":220083,"threads_started":1,"wal-append.queue_time_us":328657}
I20260709 13:00:55.497953  4568 raft_consensus.cc:3055] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:55.527966  4519 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:55.511669  4527 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:55.542868  4330 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:00:55.592533  4572 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.122s	user 0.002s	sys 0.000s
I20260709 13:00:55.556880  4368 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:55.529525  4405 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:55.654320  4466 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:55.514520  4221 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:55.372974  4566 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:55.727676  1659 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.757s (SENT) [suppressed 12 similar messages]
I20260709 13:00:55.559168  4557 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.531296  4567 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9.
I20260709 13:00:55.743253  4447 raft_consensus.cc:740] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:55.762403  4568 raft_consensus.cc:740] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:55.767419  1614 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
W20260709 13:00:55.786900  4576 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.197s	user 0.006s	sys 0.004s
I20260709 13:00:55.804893  4552 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:55.790493  4381 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:55.785377  4257 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:00:55.805881  4221 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:55.811617  4560 raft_consensus.cc:3055] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:55.729410  4426 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.818948  1616 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:55.808161  4368 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:55.809461  4542 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:55.889938  4570 log.cc:927] Time spent T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:00:55.881826  4405 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:55.938381  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.021s	sys 0.027s
W20260709 13:00:55.939435  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.021s	sys 0.027s
W20260709 13:00:55.940109  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 840753us
I20260709 13:00:55.941246  1511 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:55.920944  4560 raft_consensus.cc:740] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:55.935166  4466 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:55.893338  4381 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:55.987094  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50552 (request call id 464) took 1042 ms. Trace:
I20260709 13:00:55.991994  1614 rpcz_store.cc:276] 0709 13:00:54.944360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.944536 (+   176us) service_pool.cc:224] Handling call
0709 13:00:55.961440 (+1016904us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b540042ca54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:55.987032 (+ 25592us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586201344}
I20260709 13:00:55.813695  4557 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:56.002908  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 61768.6us
I20260709 13:00:56.003386  2210 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:56.004130  1511 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:55.931692  4368 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.013866  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1248) took 1039 ms. Trace:
I20260709 13:00:56.016345  4569 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:55.938629  4330 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.014448  1695 rpcz_store.cc:276] 0709 13:00:54.974736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.976214 (+  1478us) service_pool.cc:224] Handling call
0709 13:00:54.976585 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:54.977013 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.977055 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:54.977713 (+   658us) log.cc:844] Serialized 52 byte log entry
0709 13:00:55.358255 (+380542us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:55.358295 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.358374 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.013572 (+655198us) raft_consensus.cc:1685] finished
0709 13:00:56.013601 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.013791 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92122,"spinlock_wait_cycles":27960192,"thread_start_us":252224,"threads_started":1,"wal-append.queue_time_us":417492}
I20260709 13:00:55.921108  4426 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:55.943800  4405 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:56.026130  4540 log.cc:927] Time spent T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:00:56.024418  1511 leader_election.cc:400] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7.
I20260709 13:00:56.035506  1511 leader_election.cc:403] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:00:56.038820  4560 consensus_queue.cc:260] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.039634  4566 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:56.034606  4465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.049s	sys 0.062s
W20260709 13:00:56.040308  4465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.049s	sys 0.062s
I20260709 13:00:56.040601  4465 consensus_queue.cc:1243] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer 822e08445eae4a33b2f2fe92060192c6 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:56.042528  4569 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7.
I20260709 13:00:56.016360  4523 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:56.037674  1511 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:56.055823  4558 consensus_meta.cc:287] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.002s
I20260709 13:00:56.056505  4571 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.056406  4558 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.057279  4571 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.018085  4519 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:56.017997  4530 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:56.059578  4558 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:56.059993  4530 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:56.056354  4523 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:56.060472  4530 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:56.061723  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:00:56.071696  1620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.022s	sys 0.061s
W20260709 13:00:56.071714  1689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.007s	sys 0.036s
W20260709 13:00:56.072398  1689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.007s	sys 0.036s
I20260709 13:00:55.946630  4447 consensus_queue.cc:260] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:56.067046  4401 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.012s	sys 0.030s
W20260709 13:00:56.073258  2241 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.019s	sys 0.017s
W20260709 13:00:56.072177  1620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.022s	sys 0.061s
W20260709 13:00:56.080279  4525 consensus_meta.cc:287] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 1.314s	user 0.015s	sys 0.005s
W20260709 13:00:56.090178  1512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.003s	sys 0.035s
W20260709 13:00:56.081694  2241 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.020s	sys 0.018s
W20260709 13:00:56.082021  1510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.016s	sys 0.021s
W20260709 13:00:56.072175  4385 consensus_meta.cc:287] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 1.115s	user 0.012s	sys 0.007s
W20260709 13:00:56.081507  4401 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.012s	sys 0.031s
W20260709 13:00:56.072695  4550 consensus_meta.cc:287] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.003s
I20260709 13:00:56.121676  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:56.122375  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:56.122928  1614 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:00:56.111797  4525 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.123028  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:56.089002  4348 consensus_meta.cc:287] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.911s	user 0.014s	sys 0.003s
I20260709 13:00:56.123371  1618 raft_consensus.cc:1240] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:00:56.123937  4348 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.125404  4525 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:56.125775  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:55.945588  4568 consensus_queue.cc:260] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:56.090534  1512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.003s	sys 0.035s
W20260709 13:00:56.156476  1587 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.013s	sys 0.027s
W20260709 13:00:56.175427  1587 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.013s	sys 0.030s
W20260709 13:00:56.175272  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 447548us
W20260709 13:00:56.175712  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 959303us
W20260709 13:00:56.176491  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.118571  1661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.000s	sys 0.040s
I20260709 13:00:56.121330  4401 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:00:56.173717  1690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.000s	sys 0.012s
W20260709 13:00:56.173220  4586 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
W20260709 13:00:56.153995  2211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.005s	sys 0.020s
W20260709 13:00:56.153779  1619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.016s	sys 0.009s
W20260709 13:00:56.172281  1510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.016s	sys 0.026s
W20260709 13:00:56.159771  4535 log.cc:927] Time spent T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
W20260709 13:00:56.111665  4305 consensus_meta.cc:287] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 1.254s	user 0.009s	sys 0.005s
W20260709 13:00:56.177117  1691 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.053s	user 0.017s	sys 0.021s
W20260709 13:00:56.089008  4453 consensus_meta.cc:287] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 1.124s	user 0.010s	sys 0.010s
W20260709 13:00:56.089825  4259 consensus_meta.cc:287] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 1.131s	user 0.013s	sys 0.004s
W20260709 13:00:56.183208  1690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.000s	sys 0.014s
I20260709 13:00:56.193987  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:56.186975  2211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.006s	sys 0.020s
W20260709 13:00:56.186990  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.187916  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:56.188576  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:56.189358  1545 raft_consensus.cc:3055] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:56.190080  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:56.219643  1541 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:56.223305  1538 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:56.090407  4571 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:56.190654  1691 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.084s	user 0.019s	sys 0.022s
W20260709 13:00:56.182410  1661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.000s	sys 0.044s
I20260709 13:00:56.191032  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:00:56.187441  4039 consensus_meta.cc:287] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.744s	user 0.010s	sys 0.005s
W20260709 13:00:56.165850  4556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.009s	sys 0.018s
W20260709 13:00:56.156366  4350 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.186s	user 0.012s	sys 0.037s
I20260709 13:00:56.121892  4550 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:56.287884  4350 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.318s	user 0.015s	sys 0.039s
I20260709 13:00:56.214190  4453 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.283996  4401 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.290414  1617 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 4: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:56.181370  4368 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:56.293167  4522 consensus_meta.cc:287] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 1.002s	user 0.010s	sys 0.000s
I20260709 13:00:56.293730  4522 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:56.294891  4556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.009s	sys 0.019s
I20260709 13:00:56.192301  1540 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:56.295879  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:56.296821  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:56.297606  1540 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:00:56.298599  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:56.192451  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:56.301290  1540 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:56.171335  4557 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:56.193090  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:56.171833  4376 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:56.193553  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:56.186743  1619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.017s	sys 0.010s
I20260709 13:00:56.218554  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:56.310205  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:56.137845  4447 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:56.125929  4348 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:56.090535  4523 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:56.130923  4587 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.219424  4381 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:56.311656  4595 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.314335  4426 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:56.137877  4047 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:56.131121  4561 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:56.187944  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:56.357564  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:56.358029  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:56.358173  1544 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:56.358958  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:56.359632  1544 raft_consensus.cc:2393] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 3: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:56.317641  1622 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:56.302302  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:56.240664  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 794171us
I20260709 13:00:56.360750  1539 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:56.360997  2211 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:56.361512  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:56.307436  1512 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:56.316922  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:56.317135  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2400) took 1194 ms. Trace:
W20260709 13:00:56.362875  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 55564.8us
I20260709 13:00:56.360347  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:56.365048  1544 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:56.366089  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:56.308596  4368 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.194959  4519 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:56.224077  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:56.371424  1547 raft_consensus.cc:2376] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7. Re-sending same reply.
I20260709 13:00:56.362409  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:56.363735  1512 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:56.372579  1539 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.372757  4588 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:56.372943  1512 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:56.373247  4588 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.373647  4588 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:56.367480  1614 raft_consensus.cc:2410] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:56.362887  1613 rpcz_store.cc:276] 0709 13:00:55.130612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.167799 (+ 37187us) service_pool.cc:224] Handling call
0709 13:00:55.168219 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.197878 (+ 29659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.197927 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.211506 (+ 13579us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.474218 (+262712us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:55.474270 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.474349 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.316937 (+842588us) raft_consensus.cc:1685] finished
0709 13:00:56.316960 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.317085 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11553,"raft.queue_time_us":125552,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":37675,"thread_start_us":129442,"threads_started":1,"wal-append.queue_time_us":513601}
I20260709 13:00:56.225461  4566 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.369071  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:56.204784  4568 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:56.315811  4376 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.219847  4305 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:56.326683  4523 raft_consensus.cc:697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:56.356423  4405 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:56.214478  4597 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:00:56.223421  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.354743  1545 raft_consensus.cc:740] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:56.394515  2240 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:56.392702  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 111134us
I20260709 13:00:56.391404  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:56.388002  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:56.225185  4583 log.cc:927] Time spent T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:00:56.367590  4571 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:56.400306  1539 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:56.393860  4566 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.410312  1615 raft_consensus.cc:1240] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:56.405000  1545 consensus_queue.cc:260] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.357313  4039 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.313830  4595 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.438006  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:56.501883  2239 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:56.502948  2239 raft_consensus.cc:1240] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:56.381629  4593 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:56.440507  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:56.313360  4452 consensus_queue.cc:260] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.443641  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:56.312999  4587 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.376590  4368 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.445907  4405 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:56.382818  4519 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.452517  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:56.455365  4300 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:56.517386  1622 raft_consensus.cc:2393] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:56.517241  4300 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:56.518555  4581 log.cc:927] Time spent T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.499s	user 0.001s	sys 0.001s
I20260709 13:00:56.463626  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:56.519363  4523 consensus_queue.cc:237] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.465372  2246 raft_consensus.cc:1240] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:56.469096  4546 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:56.521003  4546 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.521243  4379 consensus_queue.cc:260] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.469679  4560 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:56.524366  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2399) took 1402 ms. Trace:
I20260709 13:00:56.524741  1616 rpcz_store.cc:276] 0709 13:00:55.122152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.122608 (+   456us) service_pool.cc:224] Handling call
0709 13:00:55.122939 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.909922 (+786983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.524155 (+614233us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b54000adcd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:56.524310 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1599909120}
I20260709 13:00:56.491389  4334 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:56.525990  4587 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:56.526154  4334 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.528324  4334 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:56.528709  4039 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:56.529592  2242 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:56.529728  4452 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.533799  4595 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:56.506668  4593 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.410101  4597 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.534780  4593 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:56.475481  4596 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:56.475945  4589 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:56.446987  4047 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:56.540944  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:56.516469  4530 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.375973  4561 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.491979  1545 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:56.478084  4369 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:56.493635  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:56.546316  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:56.546927  1687 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:56.500042  1546 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:56.405678  4376 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.509725  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:56.511121  4368 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:56.422847  4601 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:00:56.512619  4550 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:56.519867  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1246) took 1545 ms. Trace:
I20260709 13:00:56.562455  1691 rpcz_store.cc:276] 0709 13:00:54.974055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.975332 (+  1277us) service_pool.cc:224] Handling call
0709 13:00:54.975703 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.064392 (+ 88689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.064425 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.064980 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.306011 (+1241031us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:56.306068 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.306158 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.519661 (+213503us) raft_consensus.cc:1685] finished
0709 13:00:56.519680 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.519797 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92939,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":22975,"thread_start_us":1199367,"threads_started":1,"wal-append.queue_time_us":1324412}
I20260709 13:00:56.564810  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:56.464386  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:56.522984  4546 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:56.514729  4405 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.477089  1688 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:56.552479  1546 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:00:56.554490  1547 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:56.508585  2237 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:56.555146  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:56.528751  4334 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:56.519375  4300 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:56.557273  2244 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:56.576156  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:56.569182  1545 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:56.565542  1691 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:00:56.572281  2242 raft_consensus.cc:1240] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:00:56.579514  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:56.544667  4596 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:56.574672  1687 raft_consensus.cc:2410] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:56.524389  4588 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.581687  1545 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:56.583040  1547 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:56.583964  1546 raft_consensus.cc:1240] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:56.586072  1691 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:56.587960  1687 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:56.589161  1687 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:56.561673  4454 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.590790  4454 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.592994  4454 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:56.551465  4589 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.570361  4336 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.586957  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:56.598568  1691 raft_consensus.cc:2410] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:56.544410  4047 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.602145  1693 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:56.606868  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:56.612183  1688 raft_consensus.cc:2410] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:56.617883  1546 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:00:56.583465  4596 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:56.628820  4564 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:56.629387  4564 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:56.630522  4600 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:00:56.631992  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 466) took 1459 ms. Trace:
I20260709 13:00:56.632321  1619 rpcz_store.cc:276] 0709 13:00:55.172194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.174890 (+  2696us) service_pool.cc:224] Handling call
0709 13:00:55.175156 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.344315 (+169159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.344350 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.423925 (+ 79575us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.309555 (+885630us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:56.309612 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.309702 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.629954 (+320252us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:56.631705 (+  1751us) raft_consensus.cc:1685] finished
0709 13:00:56.631727 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.631936 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5010,"raft.queue_time_us":188792,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":46397,"spinlock_wait_cycles":100830976,"thread_start_us":1031940,"threads_started":2,"wal-append.queue_time_us":928535}
I20260709 13:00:56.635376  1542 raft_consensus.cc:2410] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:00:56.593701  4336 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.616088  4566 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:56.585033  4334 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.641024  4559 raft_consensus.cc:3055] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:56.641425  4559 raft_consensus.cc:740] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:00:56.691622  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.625325  4597 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:56.782665  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.785000  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.756361  4560 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.795904  1512 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:56.796912  1512 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:00:56.800557  4607 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:00:56.800904  4377 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:56.802762  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.803606  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:56.804260  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:56.804803  1695 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:56.812316  1622 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:00:56.822722  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.801493  4377 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.826359  4377 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:56.849572  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.642581  4593 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:56.792071  4587 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.642194  4559 consensus_queue.cc:260] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.794003  4329 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.869709  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:56.884275  1544 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:56.853260  4566 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:56.861281  4545 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:56.892225  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:56.894465  1696 raft_consensus.cc:2376] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7. Re-sending same reply.
I20260709 13:00:56.801558  4564 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:56.797575  4560 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.864481  3868 consensus_queue.cc:1059] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:00:56.864305  4597 consensus_queue.cc:1059] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:00:56.882694  4047 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:56.873083  4589 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:56.895402  4566 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:56.894078  4545 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:56.871019  4587 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.915740  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:00:56.925990  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.888052  4329 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:56.913467  4530 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:56.918927  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:56.913414  4334 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:56.921487  4368 raft_consensus.cc:3055] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:56.908555  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 462) took 1967 ms. Trace:
I20260709 13:00:56.951607  1695 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:00:56.957683  1615 rpcz_store.cc:276] 0709 13:00:54.941362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.941919 (+   557us) service_pool.cc:224] Handling call
0709 13:00:54.947163 (+  5244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.492424 (+1545261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.908240 (+415816us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54000aebd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:56.908480 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3364188416}
I20260709 13:00:56.924108  4545 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.899060  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:56.920639  4566 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:56.958685  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:56.964722  1695 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:56.912012  4561 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:56.966675  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:56.927376  4588 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:56.972532  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:56.976883  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:56.981334  1695 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
W20260709 13:00:56.967628  4624 log.cc:927] Time spent T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.137s	user 0.003s	sys 0.000s
I20260709 13:00:56.957559  4368 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:56.985486  4524 raft_consensus.cc:3055] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:56.970652  4376 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:57.008267  1692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 1250) took 2026 ms (client timeout 1817 ms). Trace:
I20260709 13:00:57.262087  1695 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:57.266060  1696 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
W20260709 13:00:57.226780  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.296499  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.296842  1696 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:00:57.297041  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.085999  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 213728us
W20260709 13:00:57.031361  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.079042  1616 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
W20260709 13:00:57.297842  1692 rpcz_store.cc:269] 0709 13:00:54.981488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.065670 (+ 84182us) service_pool.cc:224] Handling call
0709 13:00:57.001966 (+1936296us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400385754. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:57.008171 (+  6205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550437760}
I20260709 13:00:57.304113  4096 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:57.304656  4096 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.305338  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:57.306260  1545 raft_consensus.cc:2393] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:57.306761  4096 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:57.155795  4452 consensus_meta.cc:287] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.000s
W20260709 13:00:57.281118  4523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.004s	sys 0.015s
W20260709 13:00:57.308362  4523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.005s	sys 0.016s
W20260709 13:00:57.219965  4596 consensus_meta.cc:287] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.575s	user 0.006s	sys 0.003s
W20260709 13:00:57.156641  4590 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.842s	user 0.004s	sys 0.000s
I20260709 13:00:57.315347  1693 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:00:57.316228  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1988) took 2036 ms. Trace:
I20260709 13:00:57.316728  1693 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:57.317595  1547 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:57.316589  1689 rpcz_store.cc:276] 0709 13:00:55.279536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.279651 (+   115us) service_pool.cc:224] Handling call
0709 13:00:55.302707 (+ 23056us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.463558 (+160851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.463608 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.477871 (+ 14263us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.072804 (+594933us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:56.408451 (+335647us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.408740 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.408809 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.156102 (+747293us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:57.315973 (+159871us) raft_consensus.cc:1685] finished
0709 13:00:57.316070 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.316172 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":436388,"raft.queue_time_us":36156,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":17731,"spinlock_wait_cycles":469579392,"thread_start_us":1055254,"threads_started":3,"wal-append.queue_time_us":734803}
I20260709 13:00:57.318235  1693 raft_consensus.cc:1240] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:57.318696  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:57.043334  4619 log.cc:927] Time spent T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:00:57.295964  4524 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:00:57.311633  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.313443  4597 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.320353  4597 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:57.322443  4597 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:57.032399  4627 log.cc:927] Time spent T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:00:57.319367  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:57.323797  1546 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:57.311167  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:57.325428  1545 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:00:57.325721  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2393) took 2205 ms (client timeout 1998 ms). Trace:
I20260709 13:00:57.326192  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:57.305306  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:57.327994  1621 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:57.326107  1617 rpcz_store.cc:269] 0709 13:00:55.120183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.122580 (+  2397us) service_pool.cc:224] Handling call
0709 13:00:57.325507 (+2202927us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400380ed4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:57.325631 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2543117952}
I20260709 13:00:57.324764  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:57.327087  1545 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
W20260709 13:00:57.329977  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.329457  1546 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:57.339560  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:57.340441  1540 raft_consensus.cc:2393] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:57.341439  1547 raft_consensus.cc:2393] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:57.349840  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:57.350730  1545 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:57.139451  4632 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 13:00:57.154564  4606 log.cc:927] Time spent T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.702s	user 0.001s	sys 0.000s
W20260709 13:00:57.358471  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.232462  4563 raft_consensus.cc:3055] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:57.339085  4612 log.cc:927] Time spent T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.887s	user 0.003s	sys 0.000s
I20260709 13:00:57.380782  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:57.380882  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.147105  4560 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:57.000703  4336 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:57.391037  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:57.398926  1546 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:57.400025  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:57.341497  4569 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.025074  4593 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:57.151464  4361 raft_consensus.cc:3055] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:57.148442  4519 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:57.309136  4588 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.396880  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1252) took 2413 ms. Trace:
I20260709 13:00:57.401144  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:57.259377  4453 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:57.402004  1545 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:00:57.439181  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:57.151062  4566 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:57.399761  2209 connection.cc:256] RPC call timeout handler was delayed by -1.244426719000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
I20260709 13:00:57.442158  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:57.388835  4377 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:57.444823  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.445688  2240 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:00:57.388584  4556 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:57.256603  4545 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:57.391927  4563 raft_consensus.cc:740] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:57.414451  1694 rpcz_store.cc:276] 0709 13:00:54.983492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.983641 (+   149us) service_pool.cc:224] Handling call
0709 13:00:55.079127 (+ 95486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.092854 (+ 13727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.092905 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.102647 (+  9742us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.314662 (+1212015us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b18004486c0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb0d1 00007fc4916e6a0f
0709 13:00:56.439612 (+124950us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:56.439674 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.439759 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.327274 (+887515us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:57.396652 (+ 69378us) raft_consensus.cc:1685] finished
0709 13:00:57.396673 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.396800 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56983,"raft.queue_time_us":13721,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":72958,"spinlock_wait_cycles":30529152,"thread_start_us":124718,"threads_started":1,"wal-append.queue_time_us":1325695}
I20260709 13:00:57.437842  1546 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:00:57.352090  4596 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.400482  4533 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:57.457371  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2353) took 1266 ms. Trace:
I20260709 13:00:57.484706  1542 rpcz_store.cc:276] 0709 13:00:56.190715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.190834 (+   119us) service_pool.cc:224] Handling call
0709 13:00:57.449208 (+1258374us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400193054. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:57.457265 (+  8057us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757475584}
I20260709 13:00:57.410694  4515 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:57.486331  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.487095  2238 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:57.488435  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:57.489199  2245 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:57.490012  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:57.137362  4368 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.451650  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.412653  4361 raft_consensus.cc:740] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:00:57.493682  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 111910us
W20260709 13:00:57.483784  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.496678  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.502378  1538 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:57.507082  1616 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:57.512670  4630 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.513319  4630 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.516177  4532 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.516696  4532 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.517673  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.518623  4532 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:57.519109  4532 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.510637  4458 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:57.519845  4368 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:57.519577  4532 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:57.524013  4636 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:57.524443  4532 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:57.528393  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:57.529356  1541 raft_consensus.cc:2410] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:57.530140  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:57.530820  1541 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:57.534783  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 1974) took 1126 ms. Trace:
I20260709 13:00:57.543738  1614 rpcz_store.cc:276] 0709 13:00:56.408525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.408653 (+   128us) service_pool.cc:224] Handling call
0709 13:00:56.408911 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.574690 (+165779us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:56.758440 (+183750us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.872194 (+113754us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.872245 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:56.874019 (+  1774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.532852 (+658833us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b180043e7c0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e60c2a6 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419
0709 13:00:57.534533 (+  1681us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540042cf54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:57.534584 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.534722 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7967,"prepare.queue_time_us":252400,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":9671,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":10735,"spinlock_wait_cycles":396714624,"thread_start_us":247252,"threads_started":2,"wal-append.queue_time_us":144580}
I20260709 13:00:57.555546  4566 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:57.556782  4563 consensus_queue.cc:260] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:57.558220  4563 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:57.494493  4533 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.561822  4533 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:57.413192  4569 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:57.542721  4330 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.564371  4569 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:57.565109  1542 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:00:57.542578  4633 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:00:57.548913  4596 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:57.482820  4556 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.448583  4588 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:57.483417  4377 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:57.566706  1541 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:57.501452  4515 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.508816  1546 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:57.545368  4587 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:57.568892  2245 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3.
I20260709 13:00:57.551640  4361 consensus_queue.cc:260] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.575328  1587 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:57.540867  4545 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:57.576448  4569 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.595607  1545 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:00:57.597704  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 91529.1us
I20260709 13:00:57.600451  2210 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:57.600579  1587 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:57.600890  4361 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:57.605604  4515 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:57.607501  4640 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:57.608045  4640 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:57.608911  4640 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.612475  1539 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:57.612869  4544 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.613363  4544 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:57.613742  1539 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:00:57.614955  4603 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 1.172s	user 0.003s	sys 0.001s
I20260709 13:00:57.650089  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 1991) took 2357 ms. Trace:
I20260709 13:00:57.615494  4544 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:57.650484  1690 rpcz_store.cc:276] 0709 13:00:55.292717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.444728 (+152011us) service_pool.cc:224] Handling call
0709 13:00:55.445133 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.453478 (+  8345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.453508 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.458796 (+  5288us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.194152 (+735356us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:56.194191 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.194254 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.614412 (+1420158us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:57.649791 (+ 35379us) raft_consensus.cc:1685] finished
0709 13:00:57.649811 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.650027 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7885,"raft.queue_time_us":24177,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8764,"spinlock_wait_cycles":81385856,"thread_start_us":699353,"threads_started":1,"wal-append.queue_time_us":899622}
W20260709 13:00:57.652908  4608 log.cc:927] Time spent T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 1.077s	user 0.002s	sys 0.005s
I20260709 13:00:57.653985  1547 raft_consensus.cc:1240] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:57.600440  4587 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:57.655535  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:57.615851  4336 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:57.656417  4336 raft_consensus.cc:697] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:57.657420  4336 consensus_queue.cc:237] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:57.616570  4634 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
I20260709 13:00:57.660300  4544 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.661378  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1253) took 1080 ms. Trace:
I20260709 13:00:57.661755  1687 rpcz_store.cc:276] 0709 13:00:56.581479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.589780 (+  8301us) service_pool.cc:224] Handling call
0709 13:00:57.309379 (+719599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.309585 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.309619 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.309663 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:57.309698 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.309760 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.661217 (+351457us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b54002242d0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:57.661323 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654161152}
W20260709 13:00:57.662907  1442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42132 (request call id 239) took 18848 ms (client timeout 15000 ms). Trace:
I20260709 13:00:57.624899  4259 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:57.664455  4584 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.617682  4377 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:57.626024  4426 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:57.626482  4401 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:55.238372   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:57.628074  4517 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:57.630230  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:57.614985  1539 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:57.634497  2209 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:57.685647  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 51217.6us
I20260709 13:00:57.638402  4522 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:57.639225  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1254) took 1056 ms. Trace:
I20260709 13:00:57.691309  1691 rpcz_store.cc:276] 0709 13:00:56.582666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.607992 (+ 25326us) service_pool.cc:224] Handling call
0709 13:00:56.608305 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.618419 (+ 10114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.618446 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.618485 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:56.618514 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.639030 (+1020516us) spinlock_profiling.cc:243] Waited 9.91 ms on lock 0x7b54001b6f54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:57.639069 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.639170 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22797568}
I20260709 13:00:57.639719  4588 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:57.640913  4556 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:57.601367  4569 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:57.645159  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:57.645313  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.696100  2238 raft_consensus.cc:2393] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:57.645200  4405 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:57.646340  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:57.646384  3868 raft_consensus.cc:3055] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:57.647840  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:57.648520  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:57.700857  1619 raft_consensus.cc:1275] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:57.701694  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:57.702757  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.660962  4544 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:57.663105  4447 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.619159  2244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45866 (request call id 632) took 1157 ms. Trace:
I20260709 13:00:57.683167  4401 consensus_queue.cc:1243] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:57.625578  4515 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:57.731616  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:57.667456  1511 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:57.690225  1546 raft_consensus.cc:2410] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:00:57.732707  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:57.733287  1616 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
W20260709 13:00:57.733687  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 66316.5us
I20260709 13:00:57.698904  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.689348  4579 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:00:57.664891  1442 rpcz_store.cc:269] 0709 13:00:38.814126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.814875 (+   749us) service_pool.cc:224] Handling call
0709 13:00:57.662807 (+18847932us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:49.838603 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:49.856770 (+ 18167us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:49.856819 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:00:49.856837 (+    18us) tablet.cc:662] Decoding operations
0709 13:00:49.858345 (+  1508us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:49.858457 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:49.858491 (+    34us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:00:50.055517 (+197026us) tablet.cc:701] Row locks acquired
0709 13:00:50.082169 (+ 26652us) write_op.cc:260] PREPARE: finished
0709 13:00:50.101528 (+ 19359us) write_op.cc:270] Start()
0709 13:00:50.191255 (+ 89727us) write_op.cc:276] Timestamp: P: 1783602050093643 usec, L: 0
0709 13:00:50.208635 (+ 17380us) op_driver.cc:348] REPLICATION: starting
0709 13:00:50.415683 (+207048us) log.cc:844] Serialized 5959 byte log entry
0709 13:00:51.455833 (+1040150us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc48e6210ac 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b
0709 13:00:51.834466 (+378633us) op_driver.cc:464] REPLICATION: finished
0709 13:00:52.052771 (+218305us) write_op.cc:301] APPLY: starting
0709 13:00:52.052864 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:52.053166 (+   302us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:52.053203 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:52.174941 (+121738us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:52.175482 (+   541us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:00:52.175580 (+    98us) write_op.cc:312] APPLY: finished
0709 13:00:52.176210 (+   630us) log.cc:844] Serialized 107 byte log entry
0709 13:00:52.176494 (+   284us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:52.176720 (+   226us) write_op.cc:454] Released schema lock
0709 13:00:52.176813 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:52.177307 (+   494us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:52.177359 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":234018,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":187240,"apply.run_cpu_time_us":5991,"apply.run_wall_time_us":124490,"num_ops":15,"prepare.queue_time_us":216299,"prepare.run_cpu_time_us":29034,"prepare.run_wall_time_us":2006780,"raft.queue_time_us":104372,"raft.run_cpu_time_us":21741,"raft.run_wall_time_us":126691,"replication_time_us":1625632,"spinlock_wait_cycles":6405632,"thread_start_us":1646755,"threads_started":4,"wal-append.queue_time_us":1233663,"wal-append.run_cpu_time_us":23901,"wal-append.run_wall_time_us":1496268}]]}
I20260709 13:00:57.704634  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:57.705339  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:57.739583  1622 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:57.693608  4630 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:57.706791  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:57.708256  1615 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:00:57.743281  4544 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:57.691088  4512 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:57.695681  4584 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.737818  4552 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:57.734385  4447 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:57.745894  4447 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:57.689167  4567 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.743323  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.700860  3868 raft_consensus.cc:740] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:57.746219  4584 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:57.747753  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.748342  2246 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:00:57.748052  3868 consensus_queue.cc:260] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.749082  3868 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:57.749156  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:57.749722  2246 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:57.716255  4592 log.cc:927] Time spent T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 1.415s	user 0.000s	sys 0.008s
I20260709 13:00:57.719339  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2369) took 1427 ms. Trace:
I20260709 13:00:57.751509  1544 rpcz_store.cc:276] 0709 13:00:56.291955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.387737 (+ 95782us) service_pool.cc:224] Handling call
0709 13:00:57.719059 (+1331322us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54003d90d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:57.719264 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102411520}
I20260709 13:00:57.723865  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 1968) took 1537 ms. Trace:
I20260709 13:00:57.752393  2241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 689) took 2627 ms. Trace:
I20260709 13:00:57.752458  1621 rpcz_store.cc:276] 0709 13:00:56.186360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.186495 (+   135us) service_pool.cc:224] Handling call
0709 13:00:57.327825 (+1141330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.328376 (+   551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.723611 (+395235us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400380ed0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:57.723788 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2623703424}
I20260709 13:00:57.700839  4639 consensus_queue.cc:1059] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:00:57.754055  4639 raft_consensus.cc:3055] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:57.752911  2241 rpcz_store.cc:276] 0709 13:00:55.124661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.125321 (+   660us) service_pool.cc:224] Handling call
0709 13:00:55.125597 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.187365 (+ 61768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.187399 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.187829 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.040968 (+1853139us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b18003977e0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc4912d34bc 00007fc48e62148b 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb0d1
0709 13:00:57.054152 (+ 13184us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:57.054210 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.054307 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.715668 (+661361us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:00:57.752160 (+ 36492us) raft_consensus.cc:1685] finished
0709 13:00:57.752184 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.752314 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467166848,"thread_start_us":987094,"threads_started":1,"wal-append.queue_time_us":986542}
I20260709 13:00:57.754396  4639 raft_consensus.cc:740] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:57.755105  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.755748  2241 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:57.726059  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:57.756944  1619 raft_consensus.cc:2410] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:57.727981  4524 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:57.728438  4569 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:57.729578  1547 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:00:57.730206  1617 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:00:57.774420  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:57.776252  1616 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:00:57.777454  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.778250  2241 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:57.779335  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.706336  2244 rpcz_store.cc:276] 0709 13:00:56.461328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.463322 (+  1994us) service_pool.cc:224] Handling call
0709 13:00:57.618985 (+1155663us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b54002aeed4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:57.619107 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85910400}
I20260709 13:00:57.697949  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.785143  2238 raft_consensus.cc:2410] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:57.785107  2241 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
W20260709 13:00:57.734928  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.734867  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.785895  2242 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:57.737039  1511 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:57.741294  4379 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:57.741509  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:57.743603  1613 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:57.746739  4567 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:57.704825  4504 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:57.759346  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.793869  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.758809  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:57.794373  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:57.730576  1586 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:00:57.795148  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 64641.3us
I20260709 13:00:57.795794  1586 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:57.795998  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:57.699685  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:57.797143  1614 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:57.693857  4533 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:00:57.799325  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:57.798418  2246 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:57.800179  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:57.802459  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:57.787210  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 50272.1us
I20260709 13:00:57.788414  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.803643  2242 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:57.789044  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.789547  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:57.703774  4452 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:00:57.788199  4569 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:57.850358  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:57.795535  4601 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.807142  1511 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:57.801808  4426 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:57.795495  4524 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:57.822144  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.822858  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 156208us
I20260709 13:00:57.755316  4639 consensus_queue.cc:260] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:57.855629  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 48541.2us
W20260709 13:00:57.857758  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.859404  1660 connection.cc:256] RPC call timeout handler was delayed by -1.0999167300000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 13:00:57.859671  1660 connection.cc:256] RPC call timeout handler was delayed by -1.0366842199999837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
W20260709 13:00:57.859831  1660 connection.cc:256] RPC call timeout handler was delayed by -1.0036167299999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
I20260709 13:00:57.860672  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:57.861351  1688 raft_consensus.cc:2393] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:57.861598  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:57.801851  4401 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:57.775998  4579 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.862474  1614 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:57.806360  4533 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:57.857076  4552 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:57.865309  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:57.866360  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.869782  1691 raft_consensus.cc:2410] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:00:57.871929  1691 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:57.870574  1511 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:57.874996  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:57.877626  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 356) took 1688 ms. Trace:
I20260709 13:00:57.878000  1543 rpcz_store.cc:276] 0709 13:00:56.189304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.189472 (+   168us) service_pool.cc:224] Handling call
0709 13:00:56.189721 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.535670 (+345949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.535707 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.535748 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:56.535781 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.877426 (+1341645us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54003c46d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:57.877469 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.877577 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795078912}
W20260709 13:00:57.878707  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.879770  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:57.857743  4426 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:57.803838  4504 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.863302  4584 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.866474  4401 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:57.888304  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 262618us
I20260709 13:00:57.865082  4533 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:57.883934  4368 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:57.889508  1691 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:00:57.882498  4569 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:57.858946  4601 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.927009  1691 pending_rounds.cc:85] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 8
I20260709 13:00:57.936769  1691 pending_rounds.cc:107] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:00:57.882161  4517 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:57.885083  4639 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:57.942977  1659 connection.cc:256] RPC call timeout handler was delayed by -1.7621532169999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
W20260709 13:00:57.950717  1659 connection.cc:256] RPC call timeout handler was delayed by -1.6775532170000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
I20260709 13:00:57.925508  4523 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.937033  1688 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:57.938324  2239 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:57.924908  1585 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:57.938794  1691 raft_consensus.cc:2889] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:57.952085  1544 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:57.958505  1659 connection.cc:256] RPC call timeout handler was delayed by -1.5501896620000366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
W20260709 13:00:57.958878  1659 connection.cc:256] RPC call timeout handler was delayed by -1.5497532169999886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
W20260709 13:00:57.959156  1659 connection.cc:256] RPC call timeout handler was delayed by -1.4142804929999784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23070000000000002s for a response
I20260709 13:00:57.949369  1511 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:57.956578  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:00:57.959856  1659 connection.cc:256] RPC call timeout handler was delayed by -1.3724035980000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 13:00:57.960377  1659 connection.cc:256] RPC call timeout handler was delayed by -1.2761035979999633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
I20260709 13:00:57.891465  4426 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:57.960829  1659 connection.cc:256] RPC call timeout handler was delayed by -1.1561084439999831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2859s for a response
I20260709 13:00:57.926070  4401 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:57.978163  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:57.978067  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:57.978579  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:57.981875  1659 connection.cc:256] RPC call timeout handler was delayed by -1.0277035979999596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
I20260709 13:00:57.982122  1543 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:57.979422  1545 raft_consensus.cc:1275] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:57.983392  1546 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:00:57.949810  4447 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:57.986166  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 61305.5us
I20260709 13:00:57.964704  4551 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.986720  4563 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:57.951763  4517 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.987152  4446 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.987986  1659 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:57.991425  4330 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:00:58.011125  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.995445  4401 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:58.003976  4646 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:00:58.005811  4579 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:58.006191  1539 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
W20260709 13:00:58.025238  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 44757.5us
I20260709 13:00:57.951676  4405 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.030251  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:58.033566  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:58.011312  4515 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:58.027693  4551 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:57.984326  4544 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:58.025058  1585 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:57.981312  2237 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:58.036384  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:57.926277  4584 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.955965  4368 consensus_queue.cc:1059] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:00:57.978223  4523 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:57.985643  4533 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.084493  4368 raft_consensus.cc:3055] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:58.084957  4368 raft_consensus.cc:740] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:58.041857  4515 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.085815  4368 consensus_queue.cc:260] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.087419  4515 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:58.089031  4517 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:58.028074  4446 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.089133  4504 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:58.028074  4447 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.092175  4447 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:58.092734  4551 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:58.087144  4368 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.095652  4551 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:58.096040  4551 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:58.096390  4551 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.094281  4426 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.031292  4643 consensus_queue.cc:1059] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:00:58.102103  4643 raft_consensus.cc:3055] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:58.102602  4643 raft_consensus.cc:740] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:58.103564  4584 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:58.034405  4569 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:58.035841  4385 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:58.153815  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 118338us
I20260709 13:00:58.232055  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:58.041610  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:58.158504  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:58.162282  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:58.170172  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:58.172902  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:58.174968  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:58.040764  1585 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:58.178129  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:58.179076  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 190955us
W20260709 13:00:58.179939  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.181622  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:58.234642  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.235661  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 54393.2us
I20260709 13:00:58.236411  1659 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:00:58.184382  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.238574  4584 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:58.213299  4551 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.239545  4584 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:58.239781  4453 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:58.240339  4453 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.240630  1547 raft_consensus.cc:2393] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:58.240825  4453 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.242102  4551 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:58.107100  4426 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:58.242983  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:58.244385  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:58.245468  1617 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
W20260709 13:00:58.235671  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 194825us
I20260709 13:00:58.248452  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:58.184592  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 468) took 1828 ms. Trace:
I20260709 13:00:58.185748  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:58.186426  1687 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:58.040795  1690 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:58.186936  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:58.187891  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:58.192018  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:58.035801  4454 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:00:58.256645  4454 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.257802  1541 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:00:58.259029  1539 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:00:58.119112  4446 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:58.073668  4640 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:58.271898  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:58.272852  4640 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.258971  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:58.274492  2245 raft_consensus.cc:2376] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 3. Re-sending same reply.
I20260709 13:00:58.103645  4643 consensus_queue.cc:260] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:58.209923  4656 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:00:58.277002  4643 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.278455  1696 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:00:58.269012  1543 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:00:58.279970  1691 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:00:58.252290  1620 rpcz_store.cc:276] 0709 13:00:56.355804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.356880 (+  1076us) service_pool.cc:224] Handling call
0709 13:00:56.357193 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:56.357546 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.357574 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:57.852119 (+1494545us) spinlock_profiling.cc:243] Waited 6.91 ms on lock 0x7b2c000653e8. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc490024a11 00007fc490034372 00007fc491766a01 00007fc49172b43a 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2
0709 13:00:57.859416 (+  7297us) log.cc:844] Serialized 52 byte log entry
0709 13:00:58.034625 (+175209us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:58.034662 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.034723 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.183541 (+148818us) raft_consensus.cc:1685] finished
0709 13:00:58.183635 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.184274 (+   639us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6811,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":5591,"spinlock_wait_cycles":15888256,"thread_start_us":110604,"threads_started":1,"wal-append.queue_time_us":235144}
I20260709 13:00:58.034988  4405 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.215487  4655 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:58.229187  4569 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.184315  1688 raft_consensus.cc:1240] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:58.239683  1546 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:00:58.041469  4579 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:58.272400  1692 raft_consensus.cc:2393] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 7: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:58.271920  1694 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:00:58.296298  4579 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.296844  4579 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.296854  4329 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:58.297272  4446 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:58.299737  4446 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:58.300252  4405 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:58.300880  4569 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.301649  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:58.303081  1620 raft_consensus.cc:2410] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:58.304075  4385 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:58.304553  4385 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:58.304955  4385 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.309773  1660 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:58.311523  4655 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:58.312120  4655 raft_consensus.cc:697] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:58.313634  4655 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.316100  1545 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:58.316423  4640 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:58.280987  4404 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.281531  1542 raft_consensus.cc:2393] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:00:58.281769  4594 log.cc:927] Time spent T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 1.803s	user 0.015s	sys 0.001s
W20260709 13:00:58.282985  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.209664  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:58.212584  4523 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:58.273588  1621 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:00:58.284312  1659 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:58.311087  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:58.307207  1587 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:58.321900  4368 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.322669  4368 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.323143  4454 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:58.325379  4368 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:58.300304  4446 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.328842  1613 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:58.314327  1443 catalog_manager.cc:5697] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
W20260709 13:00:58.340166  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 68961.4us
W20260709 13:00:58.343295  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 92491.1us
I20260709 13:00:58.341671  4457 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:58.346170  4404 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.346635  4457 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.348186  4457 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.354597  4404 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:58.345000  4454 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:58.364754  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.364599  4559 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.364130  4567 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:58.371877  4601 leader_election.cc:290] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:58.374688  4401 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:58.377610  2210 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:58.377912  4571 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:58.367149  4533 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.379673  4638 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:58.380119  4638 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.380470  4638 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:58.380609  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.381296  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.383812  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 144634us
I20260709 13:00:58.387378  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:58.390105  1659 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:58.391321  1613 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:00:58.391426  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:00:58.392904  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.403977  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 96870.1us
I20260709 13:00:58.389096  4405 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:58.405409  4405 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:58.409065  4405 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.409879  1659 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:00:58.410583  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.411372  4551 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:58.420708  1659 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:58.421897  4551 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:00:58.426223  4379 consensus_meta.cc:287] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.606s	user 0.011s	sys 0.004s
I20260709 13:00:58.428923  1540 raft_consensus.cc:2410] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:00:58.423614  1585 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:58.432157  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1255) took 1130 ms. Trace:
I20260709 13:00:58.432078  4381 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.433473  1540 rpcz_store.cc:276] 0709 13:00:57.300829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.380531 (+ 79702us) service_pool.cc:224] Handling call
0709 13:00:58.431083 (+1050552us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002f99d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:58.431427 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2381489920}
I20260709 13:00:58.434592  4330 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:58.434389  4381 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.435310  4330 raft_consensus.cc:697] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:58.436791  4330 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.425657  4551 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.438377  4381 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:58.442358  1586 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:58.440251  4404 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:58.443397  4404 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:58.443938  4404 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.447464  2210 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:58.448808  2210 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:00:58.449883  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 61887.2us
I20260709 13:00:58.450814  4601 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:58.451165  4401 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:58.451452  4601 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.449648  4640 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:58.454783  2210 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:00:58.456678  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 59956.3us
I20260709 13:00:58.453577  4640 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:58.457973  4640 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.460472  4401 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:58.460955  4401 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.461308  4401 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.452072  4601 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.463610  4447 consensus_queue.cc:1059] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:58.464680  4584 raft_consensus.cc:3055] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:58.465106  4584 raft_consensus.cc:740] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:58.466324  4584 consensus_queue.cc:260] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.469540  1443 catalog_manager.cc:5697] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 3 to 5, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 5 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:58.471565  1587 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:58.471976  4584 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.479497  4454 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:58.479347  4446 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.480224  4454 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.480712  4454 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.482388  4446 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:58.432078  4569 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:58.487715  4452 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:58.498286  1443 catalog_manager.cc:5697] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 5 to 7, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
W20260709 13:00:58.501175  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 59593.2us
W20260709 13:00:58.513411  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 88100us
I20260709 13:00:58.517573  1585 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:00:58.525437  1660 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:58.518517  1443 catalog_manager.cc:5697] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 6 to 7, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:00:58.533751  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:58.534538  2243 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
W20260709 13:00:58.548144  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 136948us
I20260709 13:00:58.513268  4452 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:58.554760  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:58.558434  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:58.560913  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:58.576938  4556 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:58.577478  4556 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.577845  4556 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:58.579383  4446 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:58.581398  4638 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.584224  4379 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:58.585003  4379 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.585594  4569 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.586197  4405 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.586295  4569 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.596020  2243 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.547640  4447 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:00:58.557574  4452 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:58.601092  1586 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:58.587456  4379 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:58.605888  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 80513.3us
I20260709 13:00:58.607805  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:58.595760  4381 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.613798  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:58.614523  1616 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.619364  4336 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
W20260709 13:00:58.622982  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 108159us
I20260709 13:00:58.632647  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:58.592451  4601 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.637601  1616 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:00:58.644097  4527 raft_consensus.cc:2764] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:58.646636  4350 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:58.648319  1659 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:58.649953  1585 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:58.652966  4336 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:58.600271  4551 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.657188  4551 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:58.657917  4551 consensus_queue.cc:1048] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:58.658679  4557 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:58.655647  4350 consensus_queue.cc:1059] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:00:58.661702  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:58.638164  4404 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.664158  4329 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:58.665237  4447 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:58.665829  4404 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:58.666134  4447 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:58.666690  4447 raft_consensus.cc:697] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:58.612843  4454 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.667609  4381 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.631537  4457 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.668234  4350 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:58.671016  4457 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:58.661430  2240 raft_consensus.cc:2410] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:58.661391  4379 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.673291  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:58.673638  4379 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.673844  4579 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.674847  4329 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:58.675407  4530 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.676088  4579 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:58.675943  4530 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.683678  2243 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
W20260709 13:00:58.685815  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 46853.8us
I20260709 13:00:58.683977  2241 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:58.688983  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:58.671674  1443 catalog_manager.cc:5697] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 7 to 9, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.689601  2245 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:58.675431  4329 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:00:58.696422  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:58.686244  4638 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:58.711496  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:58.712232  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:58.708815  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:58.714618  1546 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:00:58.707757  1443 catalog_manager.cc:5697] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 2 to 3, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.715602  4569 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:58.716873  1443 catalog_manager.cc:5697] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.719172  1443 catalog_manager.cc:5697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 3 to 5, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:00:58.720794  1443 catalog_manager.cc:5697] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 2 to 5, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:00:58.721383  4405 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:58.676426  4426 consensus_queue.cc:1059] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:00:58.727838  4336 raft_consensus.cc:3055] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:58.728298  4336 raft_consensus.cc:740] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:58.728343  1586 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:58.729487  4336 consensus_queue.cc:260] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.730234  1586 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:58.730302  4557 raft_consensus.cc:3055] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:58.730993  4336 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:58.732582  4379 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:58.732210  4631 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:58.731024  4557 raft_consensus.cc:740] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:58.733485  4385 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.734510  4557 consensus_queue.cc:260] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.701380  4329 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.735550  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:58.736068  4557 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.736270  1617 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.738371  1620 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:58.700505  4401 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.732127  4524 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:58.740619  4524 raft_consensus.cc:697] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:58.736928  1586 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:58.711436  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:58.746260  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.748015  2245 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:58.707197  4454 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:58.749619  1660 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:58.732378  4601 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:58.759002  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:58.708240  4404 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:00:58.767339  4404 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.768240  1511 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:58.769487  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:00:58.769791  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.769783  4404 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:58.770258  2246 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:58.748878  4401 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:58.771186  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:58.773312  2245 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.776928  2241 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.781072  1617 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
W20260709 13:00:58.782043  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 133813us
I20260709 13:00:58.774081  4379 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:58.785742  4379 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.786130  4379 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.788691  4530 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:58.790324  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:58.791105  1539 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:00:58.770992  4579 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:58.795300  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:58.794970  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:58.794752  1512 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:58.772711  4524 consensus_queue.cc:237] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.810751  1616 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:00:58.813177  4452 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.814647  2239 raft_consensus.cc:1240] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:58.815690  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:58.816408  1694 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:00:58.795078  4655 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:58.817072  4655 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.817500  4655 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.818809  4452 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:58.819389  4404 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:58.796646  4401 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.820535  4401 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:58.821345  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 58748.2us
I20260709 13:00:58.822713  4401 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:58.823939  4569 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:58.824361  4569 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:58.824738  4569 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.825209  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:58.825757  1616 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:58.828177  4660 log.cc:927] Time spent T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:00:58.828850  4664 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.829458  4664 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:58.836040  4659 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:58.836617  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:58.836079  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:00:58.837723  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.841043  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 64486.8us
I20260709 13:00:58.774783  4640 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.842132  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:58.796427  4381 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:58.845139  1694 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.803562  4579 raft_consensus.cc:697] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:58.755991  4447 consensus_queue.cc:237] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.854431  2209 leader_election.cc:304] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:58.858747  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:58.860759  1688 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:58.861459  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:58.864679  4405 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:58.865147  4405 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.865469  1696 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:58.862725  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:58.870141  4452 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:58.870601  4452 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.870915  4452 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.872947  2210 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:58.874331  2210 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:58.875350  4571 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:58.875880  4571 raft_consensus.cc:697] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:58.876170  1544 pending_rounds.cc:85] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 4
I20260709 13:00:58.876510  1544 pending_rounds.cc:107] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:00:58.876577  4601 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:58.876888  1544 raft_consensus.cc:2889] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:58.876983  4571 consensus_queue.cc:237] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.871083  4568 consensus_queue.cc:1059] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:00:58.878984  4568 raft_consensus.cc:3055] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:58.879019  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:58.879565  4568 raft_consensus.cc:740] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:58.879827  1690 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:58.880649  4568 consensus_queue.cc:260] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.882002  4568 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:58.875792  4533 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:58.858176  4584 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:00:58.884411  4446 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:58.875109  2210 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:58.884987  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:00:58.886008  4453 consensus_meta.cc:287] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.644s	user 0.015s	sys 0.003s
I20260709 13:00:58.864703  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:58.865509  4405 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.886107  4530 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:58.888175  4530 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.888512  4530 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.877156  4601 raft_consensus.cc:697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:00:58.890969  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.893965  1616 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:00:58.908767  2210 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:58.916306  1694 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:00:58.917042  2241 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:00:58.924326  1694 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:58.859295  4664 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:00:58.925741  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.886893  4453 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:58.931006  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 76415.7us
I20260709 13:00:58.933284  1539 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:58.934785  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:58.921367  4551 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:58.933105  1541 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 2.
I20260709 13:00:58.859521  4404 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
W20260709 13:00:58.939689  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.924196  4533 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:58.939447  1690 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:58.947557  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:58.938506  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:58.948369  1511 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:58.948721  1688 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:58.940150  1586 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:00:58.938889  4669 log.cc:927] Time spent T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:00:58.908147  4329 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:58.950898  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:58.962487  1621 raft_consensus.cc:2393] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 7: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:58.965513  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:58.966274  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:58.969025  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:58.960235  1687 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:58.973022  1690 raft_consensus.cc:2410] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:58.951788  4523 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:58.976512  4523 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.977097  4523 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.890781  4601 consensus_queue.cc:237] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:58.929122  4655 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:58.963474  2240 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45886 (request call id 692) took 1503 ms (client timeout 1532 ms). Trace:
I20260709 13:00:58.985113  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:58.980793  1694 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
W20260709 13:00:58.984127  2240 rpcz_store.cc:269] 0709 13:00:57.451151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.451395 (+   244us) service_pool.cc:224] Handling call
0709 13:00:58.943829 (+1492434us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400621e54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:58.954054 (+ 10225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2510258560}
I20260709 13:00:58.970028  4638 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:00:58.990240  4655 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:58.991429  1691 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 11: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:58.994839  4552 consensus_queue.cc:1059] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:00:58.995752  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:58.996191  4552 raft_consensus.cc:3055] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:58.996646  4552 raft_consensus.cc:740] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:58.996806  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:58.996973  4673 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:58.997453  1545 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:58.997633  4673 raft_consensus.cc:697] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:58.963896  4533 raft_consensus.cc:697] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:58.965448  4385 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:00:59.006812  4666 log.cc:927] Time spent T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.183s	user 0.003s	sys 0.000s
I20260709 13:00:59.006214  4673 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.006240  1547 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:59.011412  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:59.011971  1547 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.006844  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:00:59.018678  4640 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:00:59.028513  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.028680  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.029335  1690 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
W20260709 13:00:59.035122  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.034946  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 51216.2us
I20260709 13:00:59.037617  1659 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:59.039536  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.040426  1688 raft_consensus.cc:2410] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 10 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:00:59.041724  4551 consensus_queue.cc:1048] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:59.042052  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.042685  1690 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:59.043063  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.044307  1547 raft_consensus.cc:2410] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:00:59.054316  1695 raft_consensus.cc:2410] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:00:59.055619  1660 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:00:59.063024  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:59.072629  1539 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:59.055042  4655 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:59.056370  4643 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.073859  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.075549  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:58.986452  4579 consensus_queue.cc:237] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.077772  1621 raft_consensus.cc:2393] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 7: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:59.078325  1544 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:00:58.997658  4552 consensus_queue.cc:260] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:59.079494  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 95996.4us
I20260709 13:00:59.071728  4404 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:59.084502  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.085696  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.080791  1660 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:59.071179  4336 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.086387  1695 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:59.092394  1659 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:59.076053  4655 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:59.099076  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.099076  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:00:59.099947  1539 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:59.101863  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.103686  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.074478  4556 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:59.109326  4556 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:59.084149  4404 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:59.110116  4404 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.114696  2245 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
W20260709 13:00:59.106045  4668 log.cc:927] Time spent T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:00:59.117306  4379 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.106899  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:59.119638  4379 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:59.104519  1688 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:59.119788  4453 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:59.117321  4404 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:59.121455  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.122015  1690 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:59.122315  4404 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:59.132400  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.133136  1691 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:00:59.099905  4655 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.139693  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:59.140342  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.140448  2240 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:59.139777  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.143700  4404 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:59.144268  4404 raft_consensus.cc:697] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:00:59.145551  4404 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.142401  1687 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:59.147918  1621 raft_consensus.cc:1240] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 6. Ops: [4.5-4.5]
I20260709 13:00:59.148447  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.151626  1691 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:59.147779  4329 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:59.157512  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.102151  4643 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:59.162389  1696 raft_consensus.cc:2393] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 9: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:59.103485  4336 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:59.167357  1691 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:59.161557  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 67668.3us
I20260709 13:00:59.170228  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:00:59.180864  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.193938  1659 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:59.153208  4447 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:59.196360  1613 raft_consensus.cc:2410] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:00:59.199047  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 92256.9us
I20260709 13:00:59.200596  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:59.102479  4533 consensus_queue.cc:237] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.208881  1688 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:59.204914  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:59.210892  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:59.218313  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.255131  1621 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 11: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:59.256331  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:59.258257  4690 log.cc:927] Time spent T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 13:00:59.267148  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 73350.1us
I20260709 13:00:59.270619  1616 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
W20260709 13:00:59.272866  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 68161.6us
I20260709 13:00:59.276363  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:59.277177  1696 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:59.279328  4692 log.cc:927] Time spent T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:00:59.274799  4405 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:59.282436  4405 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:59.291693  1689 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:00:59.292259  1689 pending_rounds.cc:85] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 3
I20260709 13:00:59.292554  1689 pending_rounds.cc:107] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:00:59.292945  1689 raft_consensus.cc:2889] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:59.294412  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:59.266454  4664 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:59.316510  1659 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:59.259505  4330 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:59.324688  1693 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:00:59.325054  1693 pending_rounds.cc:85] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 6
I20260709 13:00:59.325276  1693 pending_rounds.cc:107] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:00:59.325515  1693 raft_consensus.cc:2889] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:59.317576  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:59.318331  1689 raft_consensus.cc:2368] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9.
I20260709 13:00:59.319543  1620 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:00:59.328824  4643 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:59.329438  1659 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:59.331522  4447 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:59.332016  4447 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:59.340245  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:59.342942  1659 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:59.344302  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.333454  4664 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:59.360621  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 62506.9us
I20260709 13:00:59.367707  1620 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:00:59.367770  1621 raft_consensus.cc:2410] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:59.346788  4447 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.323393  4452 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.399379  1659 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:59.402527  2240 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:00:59.361860  4664 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.406633  4639 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:59.407075  4452 leader_election.cc:290] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:59.359829  4405 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:59.360052  4551 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:59.417100  1696 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:59.425513  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.426170  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:59.396163  4446 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:59.429546  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 59709.9us
I20260709 13:00:59.426999  1696 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:59.413055  4691 log.cc:927] Time spent T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:00:59.427662  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.417678  1511 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:00:59.431879  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 136410us
I20260709 13:00:59.526232  1622 raft_consensus.cc:1240] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:59.506954  4568 consensus_meta.cc:287] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.625s	user 0.006s	sys 0.006s
I20260709 13:00:59.473788  4639 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.425091  4405 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.418745  4640 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.454614  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.458406  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.505810  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.466972  1615 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:00:59.467440  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.526903  4655 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:59.448312  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:00:59.543578  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.473237  4569 consensus_meta.cc:287] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.000s
W20260709 13:00:59.453963  4530 consensus_meta.cc:287] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.001s
I20260709 13:00:59.510280  1539 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:59.458343  4523 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.449729  4336 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:59.513332  1695 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:00:59.447938  4686 log.cc:927] Time spent T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:00:59.455459  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:00:59.459436  4584 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:59.521282  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.558175  1620 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 9: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:59.524552  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:59.559351  2240 raft_consensus.cc:2393] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 7: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:59.488368  4404 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:59.455922  1690 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:59.446905  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.429320  4446 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:59.536065  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:59.537757  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 132052us
I20260709 13:00:59.552234  1696 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:00:59.552546  2243 raft_consensus.cc:1275] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:00:59.553601  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.556408  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.564441  1693 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:00:59.566274  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.566704  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.573124  4655 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:59.556792  4569 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:59.574199  1692 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:59.575525  1614 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:00:59.580696  4664 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.576395  4523 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:59.582347  1687 raft_consensus.cc:2393] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:59.582756  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:59.556442  4530 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.583958  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:59.584550  1690 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:59.585875  4530 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:59.586933  2237 raft_consensus.cc:1240] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:59.556092  4681 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:59.578280  1587 leader_election.cc:400] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9.
I20260709 13:00:59.604957  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:59.616644  1587 leader_election.cc:403] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:59.616953  1693 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 11: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:59.578440  4350 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:00:59.617827  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.596233  4584 raft_consensus.cc:2764] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:59.618391  1693 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:00:59.603729  4523 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:59.619449  4523 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:59.619525  4556 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:59.577661  4336 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:00:59.585877  4639 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:59.621906  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:59.611811  2245 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:59.591156  1690 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:00:59.624233  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:59.614033  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:59.624928  2243 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.602784  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.625710  1693 raft_consensus.cc:2393] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 9: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:00:59.581292  1619 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
W20260709 13:00:59.595952  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 140527us
I20260709 13:00:59.577462  1543 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:59.625183  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 80853.9us
I20260709 13:00:59.542047  4405 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.607105  4446 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:59.596516  4688 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.330s	user 0.006s	sys 0.004s
I20260709 13:00:59.637401  1693 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:59.638695  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:59.614880  4552 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.643332  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.630594  2210 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:59.562489  4404 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.578495  4569 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:59.615398  2237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 651) took 1034 ms. Trace:
I20260709 13:00:59.646435  1688 raft_consensus.cc:2376] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7. Re-sending same reply.
I20260709 13:00:59.649009  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.605671  4568 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.656068  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.657356  1613 raft_consensus.cc:2410] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:59.577392  4454 consensus_queue.cc:1059] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:00:59.632172  4681 raft_consensus.cc:697] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:59.555563  4640 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.591056  4447 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:59.663803  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.664371  1621 raft_consensus.cc:2393] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:59.664527  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:59.672384  1614 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:59.673076  1620 raft_consensus.cc:2393] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 7: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:00:59.577306  4673 consensus_queue.cc:1059] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:00:59.674324  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:59.676806  1615 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:59.648900  4404 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:59.677119  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.656517  4556 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.687947  1512 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:59.649425  4664 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:59.649011  4350 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.690570  2243 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:00:59.693292  1687 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:59.692839  1511 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:59.670432  4530 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:59.647168  4579 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:00:59.695075  1613 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:59.695137  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.703339  1621 raft_consensus.cc:2393] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 7: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 13:00:59.703589  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 125507us
I20260709 13:00:59.706404  2240 raft_consensus.cc:1240] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:59.714491  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:59.720773  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:59.721657  2243 raft_consensus.cc:2368] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8.
I20260709 13:00:59.699400  4379 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:59.723109  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.674701  4568 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:59.700040  4569 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:59.724851  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.691887  4667 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:59.694363  4639 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:00:59.728089  1587 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:59.734624  4523 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:59.717790  4454 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.693338  4556 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:00:59.780678  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 52701.3us
I20260709 13:00:59.809578  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.654166  2237 rpcz_store.cc:276] 0709 13:00:58.556380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.557684 (+  1304us) service_pool.cc:224] Handling call
0709 13:00:58.962118 (+404434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.587485 (+625367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.589897 (+  2412us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b5400621e54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:00:59.590994 (+  1097us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b5400621e50. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:00:59.591168 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2272009216}
I20260709 13:00:59.810854  4556 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:59.810926  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.811638  4556 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:59.812146  4447 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:00:59.803617  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:59.813134  4708 consensus_queue.cc:1059] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:59.813417  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.813954  4708 consensus_queue.cc:1243] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer e8a64798e5f94de8909707bcbd11804a log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:59.814072  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.814513  4708 raft_consensus.cc:3055] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:59.814553  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.796660  4673 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:59.816584  4673 raft_consensus.cc:697] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:59.816797  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:59.817685  1618 raft_consensus.cc:2410] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:59.716148  4530 raft_consensus.cc:697] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:59.801607  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:00:59.819486  1622 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:00:59.819317  4530 consensus_queue.cc:237] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.815060  4708 raft_consensus.cc:740] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:59.820874  4708 consensus_queue.cc:260] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.822184  4708 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:59.817696  4673 consensus_queue.cc:237] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:59.827790  1510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.034s	sys 0.027s
W20260709 13:00:59.828157  1510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.034s	sys 0.027s
I20260709 13:00:59.836580  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:59.837898  4523 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:59.842015  4702 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.842655  4702 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:00:59.843667  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 62210.2us
I20260709 13:00:59.844498  1512 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:59.844583  4705 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.845753  4702 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:59.845454  4705 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.846378  4702 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:59.846928  4702 raft_consensus.cc:697] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:59.752199  4379 raft_consensus.cc:697] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:59.813453  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:00:59.848706  4640 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:59.849238  4350 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9.
I20260709 13:00:59.750443  4569 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:00:59.846029  1512 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:59.867339  1615 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
W20260709 13:00:59.884758  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 74788us
I20260709 13:00:59.894418  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:59.850381  4568 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:59.871208  4638 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.900105  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:00:59.902493  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 66033.2us
I20260709 13:00:59.735131  4681 consensus_queue.cc:237] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.882287  4569 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.895764  4381 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:59.918032  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:59.876863  4639 consensus_queue.cc:1059] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:00:59.872494  4454 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:59.917366  1512 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:59.922696  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:00:59.925172  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.925585  1585 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:59.926903  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:59.921154  4557 raft_consensus.cc:3055] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:59.931710  4705 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:00:59.933059  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.935480  4379 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.937259  4454 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:59.938112  1621 raft_consensus.cc:2410] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:59.938365  4639 raft_consensus.cc:3055] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:59.938576  4336 raft_consensus.cc:3055] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:59.938798  4639 raft_consensus.cc:740] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:00:59.939131  4336 raft_consensus.cc:740] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:59.939445  4697 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:59.928990  4557 raft_consensus.cc:740] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:00:59.939888  4697 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.940486  4697 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:59.940169  4336 consensus_queue.cc:260] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:59.940862  4557 consensus_queue.cc:260] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:59.942322  4557 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.943306  4381 raft_consensus.cc:697] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:00:59.940939  2241 raft_consensus.cc:2393] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 7: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:00:59.944309  4381 consensus_queue.cc:237] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:59.941627  4336 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.921717  4643 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.958307  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:00:59.960213  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:00:59.968763  1585 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:59.906919  4638 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.968870  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:59.973466  1696 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:59.913959  4571 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:00:59.972772  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:59.974982  1691 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:59.958721  2210 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:00:59.978338  1587 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:00:59.983695  1512 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:00:59.986544  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:00:59.987205  1693 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.966002  4329 raft_consensus.cc:2804] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:59.977622  4512 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:00:59.981448  4452 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:00.000918  4638 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:00:59.959959  4702 consensus_queue.cc:237] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.001912  4718 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:59.939881  4639 consensus_queue.cc:260] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:00.002581  1696 raft_consensus.cc:2410] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:00.003494  1512 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:00.003507  4523 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:59.967305  4530 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:01:00.008190  2211 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:00.008883  1511 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:00:59.996342  4673 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:59.972725  4643 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:00:59.968350  4454 consensus_queue.cc:1059] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:00:59.994522  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:00.014333  4404 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.014767  1587 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:00.016558  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:00.022135  4350 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:00.010841  4405 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:00:59.994797  4379 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:00.040199  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:00.054977  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 68853.4us
I20260709 13:01:00.026078  4329 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:00.060469  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 52358.7us
W20260709 13:01:00.060508  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 57205.4us
I20260709 13:01:00.058900  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:00.059304  1585 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:00.062930  1695 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:00.047173  4664 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.047855  4452 raft_consensus.cc:697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:01:00.067325  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 58541us
I20260709 13:01:00.049285  4673 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:01:00.069933  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 93730.3us
I20260709 13:01:00.070915  2245 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:00.074066  2239 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:01:00.055516  4559 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:00.060096  4552 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:00.060091  4379 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:00.077194  2211 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:00.078778  1511 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:00.063140  4523 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:00.064605  4329 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:00.084611  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.070363  4673 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.084242  1691 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:01:00.088510  1512 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:00.090425  1689 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:00.087352  4381 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:00.078737  4379 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:00.077723  4559 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:00.105890  4559 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.108062  4452 consensus_queue.cc:237] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:00.092283  4512 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:00.093531  2211 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:00.079856  4533 consensus_queue.cc:1059] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:01:00.097043  4639 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.070391  4664 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:00.100373  4405 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:00.141219  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 52783.8us
I20260709 13:01:00.101701  4643 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:00.103708  4404 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:00.119477  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.140377  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 125630us
I20260709 13:01:00.145695  1587 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:00.149164  1512 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:00.152251  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 73535us
I20260709 13:01:00.115005  4673 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:00.161304  4718 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:00.164397  1687 raft_consensus.cc:2393] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 7: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:00.164222  1512 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:00.142848  4732 raft_consensus.cc:3055] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:00.168073  1511 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:00.165863  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 71822.7us
I20260709 13:01:00.089448  4446 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.167711  1512 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:00.191045  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 45039.3us
I20260709 13:01:00.164822  4681 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:00.161459  4708 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:00.143249  4731 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:00.188886  1660 leader_election.cc:400] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8.
I20260709 13:01:00.205895  1660 leader_election.cc:403] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:01:00.204624  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 59267.6us
I20260709 13:01:00.167212  4523 raft_consensus.cc:2764] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:01:00.221506  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:00.220009  1511 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:00.223842  1692 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:00.172821  4732 raft_consensus.cc:740] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:00.153913  4697 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.205621  4708 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.245493  4708 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.245535  4732 consensus_queue.cc:260] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:00.247131  4732 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.249388  4330 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.249902  4330 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.252099  4330 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:00.229751  4405 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8.
I20260709 13:01:00.252734  4568 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:00.254098  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:00.229651  4571 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:00.233572  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:00.204075  4705 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:00.259294  4705 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.259514  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:00.260237  1542 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:01:00.227748  4552 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.233976  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:00.260831  4552 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:00.261624  1543 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:00.262454  4405 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:00.221815  4381 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:00.263437  4381 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:00.263849  4381 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.264246  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:00.265431  1540 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:00.259402  4551 consensus_queue.cc:1059] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:00.270874  4551 raft_consensus.cc:3055] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:00.271260  4551 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:00.272114  4551 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:00.273236  4551 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:00.263013  4552 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:00.275408  1693 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:01:00.276233  1690 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:00.278908  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:00.221961  4719 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:00.280217  4719 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.236045  4731 raft_consensus.cc:697] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:00.280793  4719 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.281127  4640 raft_consensus.cc:3055] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:00.281499  4640 raft_consensus.cc:740] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:00.282341  4640 consensus_queue.cc:260] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:00.284622  4697 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:00.285382  1693 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:00.285499  4718 consensus_queue.cc:1059] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:00.286295  4336 consensus_queue.cc:1059] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:00.286963  4336 consensus_queue.cc:1243] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:00.244428  4446 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:00.269557  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:00.280174  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:00.259919  4705 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:00.237273  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:00.298791  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:00.299393  1693 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:00.217877  4404 consensus_queue.cc:1059] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:01:00.307283  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:00.311683  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:00.314455  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:00.296067  4579 raft_consensus.cc:3055] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:01:00.319768  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 226248us
I20260709 13:01:00.323458  1687 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:01:00.325397  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:00.297176  4454 raft_consensus.cc:3055] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:00.321270  1542 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:01:00.326653  1696 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:00.328454  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:00.319501  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 154724us
I20260709 13:01:00.330538  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:00.315436  4697 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.331801  4697 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.336651  4718 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:00.336450  4379 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.339375  1538 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.331228  1688 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:00.313766  4640 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:00.342026  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.295640  4733 consensus_queue.cc:1059] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:01:00.281512  4731 consensus_queue.cc:237] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.348425  2211 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:00.298266  4559 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:00.339053  4379 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:00.325022  4579 raft_consensus.cc:740] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:00.297401  4735 consensus_queue.cc:1059] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 13:01:00.389894  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 91457.6us
W20260709 13:01:00.390926  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.370038  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:00.393529  1687 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:00.369737  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:00.370965  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:00.395313  1542 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:01:00.329141  4454 raft_consensus.cc:740] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:00.346896  4740 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:00.346568  4569 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.385080  2237 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:00.386284  4730 log.cc:927] Time spent T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:01:00.387972  4552 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:00.388826  4733 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.400189  1695 raft_consensus.cc:3055] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:00.410085  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:00.411106  2241 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:00.413434  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:00.414613  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:00.422676  4697 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:00.422951  4381 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.425037  4381 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:00.428669  4552 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.430971  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:00.420055  1695 raft_consensus.cc:740] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:00.431710  1540 raft_consensus.cc:2368] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7.
W20260709 13:01:00.432711  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 88817.2us
I20260709 13:01:00.435890  2211 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:00.431733  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:00.439103  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:00.432368  4705 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:00.442631  1544 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.432554  4579 consensus_queue.cc:260] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:00.444154  4579 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.446370  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:00.447438  4452 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:00.447708  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:00.449040  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:00.449353  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:00.449772  1540 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.451007  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:00.451525  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:00.452222  1545 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:00.452991  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:00.453612  1545 raft_consensus.cc:2393] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:00.455614  4746 raft_consensus.cc:3055] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:00.456005  4746 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:00.456852  4746 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.457962  4746 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:00.461223  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:00.461736  4747 raft_consensus.cc:3055] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:00.461651  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:00.462189  1620 raft_consensus.cc:2410] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:00.416149  4664 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:00.465763  1620 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:01:00.467937  4569 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:00.469409  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:00.470530  4673 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:00.470970  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:00.471377  4673 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:00.471748  1617 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:00.475080  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:00.436405  4733 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.477167  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:00.478818  4559 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:00.454584  1545 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:00.479202  1614 raft_consensus.cc:1240] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:00.480361  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:00.481581  4350 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:00.481830  1695 consensus_queue.cc:260] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:00.482553  4329 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:00.482967  1695 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.484607  4329 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:00.484977  1538 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:01:00.486013  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:00.469468  4708 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.521292  4708 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:00.521387  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1299) took 1050 ms. Trace:
I20260709 13:01:00.522071  1539 raft_consensus.cc:2393] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:00.522015  1692 rpcz_store.cc:276] 0709 13:00:59.470882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.622812 (+151930us) service_pool.cc:224] Handling call
0709 13:00:59.655845 (+ 33033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.224292 (+568447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.521076 (+296784us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b54001b6f54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:00.521307 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1305693440}
I20260709 13:01:00.522910  1620 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:01:00.523751  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:00.524356  1539 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:00.524909  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:00.525081  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:00.525750  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:00.431226  4552 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:00.527870  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:00.528539  1696 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:01:00.486524  1615 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:00.488009  1616 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:00.489319  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:00.491725  1618 raft_consensus.cc:1240] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:00.531785  1587 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:00.462242  4747 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:00.494814  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:00.551856  1619 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 11: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:00.495002  4664 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:00.499078  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:00.477312  4733 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:00.601269  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 364036us
I20260709 13:01:00.493857  4719 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.531556  1622 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:01:00.603138  1544 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:00.536273  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:00.544467  4732 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:00.544641  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:00.545904  4557 consensus_queue.cc:1059] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:00.546686  1587 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:00.636616  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 89997.2us
I20260709 13:01:00.529695  4381 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:00.548480  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 112671us
W20260709 13:01:00.550740  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.554543  1614 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:00.559796  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:00.641572  1538 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:00.642647  4705 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:00.643452  4705 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:00.646919  4705 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:00.598016  1540 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:00.507368  1690 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:00.653522  1540 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:00.655534  1540 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:01:00.601811  1695 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:00.604547  1545 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:00.615854  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:00.615857  1544 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:00.614967  1539 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:01:00.547322  4454 consensus_queue.cc:260] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:00.660605  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.664814  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:00.666020  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 167014us
I20260709 13:01:00.665905  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:00.659435  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:00.669544  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:00.661948  1538 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
W20260709 13:01:00.659332  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 53902us
I20260709 13:01:00.681600  1621 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 13:01:00.685930  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 48534.7us
I20260709 13:01:00.686985  1587 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:00.614157  4735 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:00.686013  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:00.689669  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:00.636018  4404 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:00.699544  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:00.636493  4697 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:00.668223  4733 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:00.711650  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:00.721740  1539 raft_consensus.cc:2410] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:01:00.717975  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:00.722788  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:00.687278  4446 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:01:00.718773  4767 consensus_queue.cc:1059] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:00.692907  4551 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:00.729079  1546 raft_consensus.cc:2393] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:00.729727  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:00.730542  1615 raft_consensus.cc:2410] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:00.604699  4664 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:00.732420  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 299182us
W20260709 13:01:00.732805  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 67638.2us
I20260709 13:01:00.737412  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:00.700096  4329 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:00.701720  4379 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:00.721279  4733 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.754395  2209 leader_election.cc:304] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:00.742180  2211 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:00.743191  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:00.745132  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:00.668449  4381 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.749377  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:00.738147  1541 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:00.725760  4454 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.725572  4452 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:00.686931  4667 consensus_queue.cc:1059] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:01:00.695446  4330 consensus_queue.cc:1059] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:01:00.769937  1616 raft_consensus.cc:2393] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 7: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:00.701812  4557 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:01:00.772360  2209 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:00.767055  1539 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
W20260709 13:01:00.770956  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 45104.1us
I20260709 13:01:00.746688  4569 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.788130  4569 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:00.741145  4329 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.791210  4329 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.784230  4551 raft_consensus.cc:3055] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:00.797354  4551 raft_consensus.cc:740] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:00.733445  4697 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.798723  4551 consensus_queue.cc:260] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.800406  4551 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:00.719854  4747 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.801761  4747 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.803941  4719 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:00.806299  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:00.807404  1539 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:01:00.785415  4664 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:00.808936  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:00.809701  1687 raft_consensus.cc:2393] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:00.811084  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:00.813232  1617 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:00.814148  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:00.814908  1546 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:00.781772  4638 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:00.815541  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:00.775857  4745 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.816262  1694 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:00.816959  1616 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:00.817317  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:00.797400  2237 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:00.767204  4733 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.786415  1620 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:00.842491  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:00.783280  1587 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:00.843842  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:00.845291  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:00.847450  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:00.849342  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:00.850657  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:00.766018  4379 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.851540  1695 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:00.852797  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:00.853515  1695 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:01:00.853881  1585 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:00.854641  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:00.855567  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:00.856413  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:00.816298  4745 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.859529  4739 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:00.860035  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 125681us
I20260709 13:01:00.861232  4745 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:00.861604  4739 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:00.862428  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:00.862991  4559 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:00.863590  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:00.787370  4330 raft_consensus.cc:3055] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:00.775369  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:00.820737  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.823634  1545 raft_consensus.cc:2410] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:01:00.865027  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 92724.7us
I20260709 13:01:00.866946  1693 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:00.867125  1512 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:00.875197  4708 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:00.875487  1694 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:00.875716  4708 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.876238  4708 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.879889  1512 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:00.846669  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:00.887899  1688 raft_consensus.cc:2393] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 9: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:00.855176  1695 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.894683  1695 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:00.872444  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:00.896744  1546 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:00.873838  1540 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:00.869925  1622 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:00.900888  4552 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:00.901381  4552 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.901796  4552 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:00.910569  1546 raft_consensus.cc:1275] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:00.918480  4552 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:00.929422  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 234497us
I20260709 13:01:00.929940  1545 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:01:00.865478  1511 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 1.957s (SENT) [suppressed 37 similar messages]
W20260709 13:01:00.931886  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 148664us
I20260709 13:01:00.969053  1660 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:00.969563  1587 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:00.969991  4766 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:00.970597  4766 raft_consensus.cc:697] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:00.971671  4336 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:01:00.933449  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 79643.5us
I20260709 13:01:00.971558  4766 consensus_queue.cc:237] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:00.972388  4336 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:01:00.939127  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 64511.8us
I20260709 13:01:00.970002  1660 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:00.872108  4330 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:00.870896  4569 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:00.864414  4559 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:01:00.871702  4601 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.951165  4741 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.954744  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:01.004053  1620 raft_consensus.cc:1240] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:01.004326  2241 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
W20260709 13:01:00.975878  4746 consensus_meta.cc:287] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.000s
I20260709 13:01:00.958366  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:00.959444  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:01.010612  2243 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:01:00.960320  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:00.960963  2244 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:00.961668  2242 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:00.965327  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:00.965806  4708 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:00.975669  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:01.016234  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:01.016940  1660 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:00.976648  2209 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:00.942173  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:00.977833  1622 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:00.920375  4638 raft_consensus.cc:697] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:00.979449  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:00.974174  4336 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:00.955889  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:00.936041  4731 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:00.938723  4673 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:01.008665  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:01.022655  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:01.024631  1547 raft_consensus.cc:2393] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 7: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:00.977571  4667 raft_consensus.cc:2764] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:01:01.021986  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:01.031438  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.032120  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.035844  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:01.049243  1545 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:01:01.051147  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.026870  4446 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:01.008618  4552 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:01.053224  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:01.056830  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:01.057830  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:01.005139  4452 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:01:01.029269  4673 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.066854  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:01.072142  1541 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:01.073201  1546 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:01.028079  4664 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:01.082062  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:01.082895  1544 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:01.005314  4749 consensus_queue.cc:1059] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:01:01.136870  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:01.136857  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:01.138312  1538 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:01.138389  1616 raft_consensus.cc:2376] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5. Re-sending same reply.
I20260709 13:01:01.135928  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:01.139340  1617 raft_consensus.cc:2376] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8. Re-sending same reply.
I20260709 13:01:01.056875  4640 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:01.156287  1545 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:01.080519  1619 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:01:01.089941  1541 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:01.094724  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 47182.5us
W20260709 13:01:01.158579  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 181965us
I20260709 13:01:01.163224  2209 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:01.144078  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 278568us
I20260709 13:01:01.168200  1659 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:01.169013  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:01.064098  4765 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:01.141911  4716 log.cc:927] Time spent T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:01:01.085175  4673 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.152486  4640 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.034467  4741 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:01.135783  4446 raft_consensus.cc:697] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:01.193320  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:01.084896  4667 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:01.188288  1544 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:01:01.197098  4765 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:01.187578  4559 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:01.233461  1544 pending_rounds.cc:85] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 4
I20260709 13:01:01.236102  1544 pending_rounds.cc:107] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:01:01.236446  1544 raft_consensus.cc:2889] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:01.235880  1511 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:01.080479  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5814bf31e900408885160ea0f89d6189"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:01.253573  1622 raft_consensus.cc:606] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:01.083856  4330 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:01.202430  4640 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:01.230643  4336 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:01.249640  4559 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:01.273313  1511 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:01.255824  4749 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.197271  4638 consensus_queue.cc:237] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:01.295756  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:01.262364  4552 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.263270  4569 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:01.270582  4731 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.301090  1544 raft_consensus.cc:1240] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:01.274950  4559 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.305025  1541 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:01.290572  4664 raft_consensus.cc:697] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:01:01.315191  4454 consensus_meta.cc:287] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.540s	user 0.007s	sys 0.000s
I20260709 13:01:01.311360  4446 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:01.306241  4731 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:01.334533  4731 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:01.303537  4766 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:01.307476  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:01.335625  4697 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:01.335934  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:01.324250  4664 consensus_queue.cc:237] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:01.325392  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1312) took 1026 ms. Trace:
I20260709 13:01:01.305712  4756 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:01.321875  4329 consensus_meta.cc:287] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.000s
I20260709 13:01:01.336588  1622 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:01:01.347369  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:01.291811  4330 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:01.327555  1541 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:01.262842  4336 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:01.343875  4735 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:01:01.318854  4551 consensus_meta.cc:287] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.518s	user 0.003s	sys 0.005s
I20260709 13:01:01.350378  1622 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 9: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:01.305980  4708 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:01.355036  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:01.357723  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:01.350087  4329 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:01.340723  4756 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:01.362006  1690 raft_consensus.cc:2410] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:01.363615  1622 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 9: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:01:01.364428  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.392817  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.403609  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:01.298750  4749 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:01.410993  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 242836us
I20260709 13:01:01.404577  1541 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:01.411725  1613 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:01:01.411777  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:01.353034  4735 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:01.406813  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:01.304972  4733 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:01.415345  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:01.416091  1622 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:01.417132  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:01.418337  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:01.419126  1622 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 9: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:01.422930  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:01.320358  4673 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:01.424482  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:01.426436  1620 raft_consensus.cc:2368] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 7. Current term is 8.
I20260709 13:01:01.426470  1618 raft_consensus.cc:2393] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 13:01:01.426920  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 404986us
W20260709 13:01:01.407927  4769 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 13:01:01.339447  1689 rpcz_store.cc:276] 0709 13:01:00.298751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.298894 (+   143us) service_pool.cc:224] Handling call
0709 13:01:00.299172 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:00.316324 (+ 17152us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:00.552306 (+235982us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b180040f9c0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63b455 00007fc4951233c7 00007fc4917359a7 00007fc4917450bf 00007fc491745038
0709 13:01:00.989088 (+436782us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.269444 (+280356us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.270062 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.296404 (+ 26342us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:01.296461 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.296566 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.325093 (+ 28527us) raft_consensus.cc:1685] finished
0709 13:01:01.325195 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.325331 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43545,"prepare.queue_time_us":386813,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":17574,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":2403,"spinlock_wait_cycles":26566016,"thread_start_us":658687,"threads_started":3,"wal-append.queue_time_us":234215}
I20260709 13:01:01.436576  1659 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:01.439592  4775 log.cc:927] Time spent T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:01:01.440629  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:01.443746  1622 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:01.444975  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:01.445945  1692 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:01:01.449970  1689 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:01:01.455364  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 182073us
I20260709 13:01:01.456408  1511 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:01.457669  1511 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:01.458850  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:01.459391  1692 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:01.461357  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:01.463162  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:01.465262  1696 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:01:01.468865  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 489990us
W20260709 13:01:01.471725  4772 log.cc:927] Time spent T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:01:01.471334  4734 raft_consensus.cc:3055] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:01.470995  4782 raft_consensus.cc:2764] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:01:01.467553  4786 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.451589  4788 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:01.488428  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2403) took 1058 ms. Trace:
I20260709 13:01:01.484472  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:01.489705  1618 raft_consensus.cc:2410] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:01:01.459331  4569 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:01.466337  4765 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:01.461304  4708 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:01.472165  4783 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:01.491919  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:01.470237  4741 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:01.502238  4756 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:01.504827  4673 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:01.505396  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 68949.4us
I20260709 13:01:01.485553  4734 raft_consensus.cc:740] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:01.506718  4778 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:01.507833  4336 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:01.510859  4785 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:01.516299  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:01.520705  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:01.569486  2244 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:01.488899  1542 rpcz_store.cc:276] 0709 13:01:00.427457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.439995 (+ 12538us) service_pool.cc:224] Handling call
0709 13:01:00.508833 (+ 68838us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:00.605482 (+ 96649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:00.605534 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:00.659754 (+ 54220us) log.cc:844] Serialized 52 byte log entry
0709 13:01:00.738184 (+ 78430us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:00.738222 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.738289 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.485785 (+747496us) raft_consensus.cc:1685] finished
0709 13:01:01.485807 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.485952 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2320,"raft.queue_time_us":35991,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":23817,"thread_start_us":13330,"threads_started":1,"wal-append.queue_time_us":36623}
I20260709 13:01:01.531888  4329 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:01.540313  1659 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:01.505923  4780 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:01.543433  4601 consensus_meta.cc:287] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.006s
I20260709 13:01:01.484164  4638 consensus_queue.cc:1059] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:01:01.548933  4556 raft_consensus.cc:3055] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:01.548615  4640 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:01.543457  4782 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:01.552232  4405 raft_consensus.cc:3055] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:01.552598  4796 consensus_queue.cc:1059] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:01:01.557297  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 69866.8us
I20260709 13:01:01.488796  4788 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.492230  4452 consensus_queue.cc:1059] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:01:01.574635  1659 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:01.577484  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:01.590035  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:01.591068  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:01.546900  4559 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:01.598925  1659 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:01.609539  1511 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:01.610617  4708 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:01.611019  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:01.612226  4708 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:01.612622  4708 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.612376  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:01.612982  4708 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.614260  1511 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:01.615130  4783 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:01.615525  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:01.616465  1511 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:01.577785  4780 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:01.577353  4765 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:01.589792  4405 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:01.623914  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2426) took 1152 ms. Trace:
I20260709 13:01:01.624461  2242 raft_consensus.cc:2368] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:01.577175  4556 raft_consensus.cc:740] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:01.637564  4556 consensus_queue.cc:260] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:01.638835  4556 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:01.596156  4639 consensus_queue.cc:1059] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:01:01.639595  1542 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:01.639768  4667 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:01.493062  4786 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:01.596870  4788 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:01.594424  4601 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:01.652927  4640 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:01.625768  4569 raft_consensus.cc:2764] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:01:01.634631  1621 rpcz_store.cc:276] 0709 13:01:00.446003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.446119 (+   116us) service_pool.cc:224] Handling call
0709 13:01:01.598541 (+1152422us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b540024efd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:01.598669 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":507408128}
I20260709 13:01:01.597833  4404 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:01.634131  4796 raft_consensus.cc:3055] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:01.633476  2245 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:01.647778  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:01.654438  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 140498us
I20260709 13:01:01.665863  2211 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:01.666594  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 44627.1us
W20260709 13:01:01.636595  4787 log.cc:927] Time spent T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:01:01.656183  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:01.670552  1621 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:01.671491  1615 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:01:01.623493  1659 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:01.630755  4733 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:01.626617  4794 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:01.631435  4780 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:01.667984  1511 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:01.672946  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 49698us
I20260709 13:01:01.693887  1621 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:01.624949  4793 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:01.600250  4735 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:01.661375  4782 raft_consensus.cc:697] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:01.742897  4782 consensus_queue.cc:237] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:01.738554  1659 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:01.694227  4785 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:01.752081  4800 raft_consensus.cc:3055] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:01.752770  4800 raft_consensus.cc:740] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:01.665179  4796 raft_consensus.cc:740] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:01.672264  4778 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:01:01.764626  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 96714.8us
I20260709 13:01:01.770548  1618 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:01.757923  4740 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.004s	sys 0.023s
I20260709 13:01:01.771276  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:01.762499  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 163041us
I20260709 13:01:01.776170  1659 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:01.777690  1659 leader_election.cc:400] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7.
I20260709 13:01:01.778192  1659 leader_election.cc:403] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:01:01.772859  4740 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.004s	sys 0.024s
I20260709 13:01:01.774677  4404 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:01.780848  4404 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.781237  4404 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:01.783371  4793 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:01.696638  4640 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:01:01.795014  4786 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:01.795394  4796 consensus_queue.cc:260] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:01.766749  4794 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:01.766459  4767 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.804006  4794 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:01.803987  4767 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:01.805408  1659 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:01.805632  4794 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:01.806169  4785 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7.
I20260709 13:01:01.806773  4785 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:01.807394  4796 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:01.807273  4800 consensus_queue.cc:260] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:01.808318  4785 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:01.808485  4800 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.804417  1511 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:01.813099  4381 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:01.813621  4793 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:01.813997  4793 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.814311  4793 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:01.817134  4749 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:01.818646  1659 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:01.820714  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:01.821373  1542 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:01.823592  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:01.824218  1546 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.768873  4405 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:01.826635  4405 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:01.831651  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 383) took 1371 ms. Trace:
I20260709 13:01:01.832067  1540 rpcz_store.cc:276] 0709 13:01:00.460684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.658496 (+197812us) service_pool.cc:224] Handling call
0709 13:01:00.873616 (+215120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.899452 (+ 25836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.831476 (+932024us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54002e4850. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:01.831596 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493863296}
I20260709 13:01:01.833851  4381 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.834324  4381 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:01.835618  4802 log.cc:927] Time spent T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:01.836845  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2436) took 1362 ms. Trace:
I20260709 13:01:01.837234  4381 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:01.837242  1613 rpcz_store.cc:276] 0709 13:01:00.474717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.474831 (+   114us) service_pool.cc:224] Handling call
0709 13:01:01.836700 (+1361869us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b5400201cd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:01.836792 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2003105024}
I20260709 13:01:01.838284  4735 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:01.838913  4330 raft_consensus.cc:2764] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:01:01.826834  1586 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:01.840173  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.811786  4559 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:01.848852  1546 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:01:01.841871  1659 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:01.843127  1542 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:01.843763  1618 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:01.845172  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:01.850903  1688 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:01:01.847570  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:01.852113  1695 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:01:01.852881  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:01.853500  2243 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:01.847599  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:01.856901  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:01.858009  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:01.856038  1659 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:01.871030  1695 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:01.860198  1659 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:01.878139  1659 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:01.848274  4785 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:01.859211  4329 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:01.855271  4794 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:01.893810  2243 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:01.864462  4786 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:01.877812  4330 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:01.915750  4330 raft_consensus.cc:697] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:01.916998  4330 consensus_queue.cc:237] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:01.901849  4797 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:01.923446  4789 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:01:01.924294  4786 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.924767  4786 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:01.925814  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1316) took 1615 ms. Trace:
I20260709 13:01:01.888674  4667 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:01.907524  4794 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:01.945958  4794 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:01.883700  4664 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:01.891558  4329 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:01.901978  4551 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
W20260709 13:01:01.941013  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.884753  4767 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:01.926221  1691 rpcz_store.cc:276] 0709 13:01:00.310967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.311440 (+   473us) service_pool.cc:224] Handling call
0709 13:01:00.312086 (+   646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.312531 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:00.690601 (+378070us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.925306 (+1234705us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b180040f900. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc4912d34bc 00007fc48e62148b 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63b455 00007fc491723060 00007fc491735716 00007fc491746287
0709 13:01:01.925413 (+   107us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.925466 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:01.925513 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.925593 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.925727 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1244,"prepare.queue_time_us":397977,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":39111,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":8595,"spinlock_wait_cycles":2585984,"thread_start_us":426561,"threads_started":3,"wal-append.queue_time_us":20473,"wal-append.run_cpu_time_us":1417,"wal-append.run_wall_time_us":1025542}
I20260709 13:01:01.954206  2211 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:01.911047  4783 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:01.957973  4805 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.276s	user 0.001s	sys 0.012s
I20260709 13:01:01.966931  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:01.969286  2211 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:01.986501  1619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2449) took 1489 ms (client timeout 1648 ms). Trace:
I20260709 13:01:01.984007  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 2038) took 1174 ms. Trace:
I20260709 13:01:01.985958  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2444) took 1490 ms. Trace:
I20260709 13:01:01.961432  4329 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:02.010129  1619 rpcz_store.cc:269] 0709 13:01:00.497242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.601626 (+104384us) service_pool.cc:224] Handling call
0709 13:01:01.986321 (+1384695us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b540033b654. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:01.986439 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":814042368}
I20260709 13:01:02.011831  1690 rpcz_store.cc:276] 0709 13:01:00.809831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.855293 (+ 45462us) service_pool.cc:224] Handling call
0709 13:01:01.983670 (+1128377us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b540014f354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:01.983879 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1162299648}
I20260709 13:01:02.014330  1614 rpcz_store.cc:276] 0709 13:01:00.495827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.753511 (+257684us) service_pool.cc:224] Handling call
0709 13:01:00.778978 (+ 25467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:00.863765 (+ 84787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:00.863810 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:00.864279 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.337192 (+472913us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:01.337245 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.985470 (+648225us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b540033c554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:01.985532 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.985596 (+    64us) raft_consensus.cc:1685] finished
0709 13:01:01.985612 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.985882 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":194181504,"thread_start_us":472538,"threads_started":1,"wal-append.queue_time_us":587355}
I20260709 13:01:01.972131  4785 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:01:02.380833  1542 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:01.977447  4664 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.995390  4530 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:02.021486  4800 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:02.019965  4796 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.979758  4638 raft_consensus.cc:3055] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:02.278888  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:02.287674  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2029) took 1099 ms. Trace:
W20260709 13:01:02.378178  4708 consensus_meta.cc:287] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.752s	user 0.019s	sys 0.001s
I20260709 13:01:02.278350  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:02.417395  2243 raft_consensus.cc:2410] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:01:02.330293  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.290715  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.311949  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2022) took 1241 ms. Trace:
I20260709 13:01:02.305183  1616 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:02.300573  1613 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:02.304433  1617 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:01:02.308266  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.305955  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2019) took 1236 ms (client timeout 1500 ms). Trace:
W20260709 13:01:02.275976  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.277346  4446 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:02.178177  4379 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:02.290345  4719 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:02.296413  4799 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.674s	user 0.000s	sys 0.003s
I20260709 13:01:02.372823  2209 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:02.373678  4639 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:01:02.458039  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 85228.9us
I20260709 13:01:02.395505  4530 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.417915  4638 raft_consensus.cc:740] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:01:02.164250  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 273751us
W20260709 13:01:02.177992  4810 log.cc:927] Time spent T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:01:02.285070  4556 consensus_meta.cc:287] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.009s
I20260709 13:01:02.161360  4667 raft_consensus.cc:697] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:01:02.409843  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 130743us
I20260709 13:01:02.412825  1622 rpcz_store.cc:276] 0709 13:01:01.187779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.424152 (+236373us) service_pool.cc:224] Handling call
0709 13:01:02.287228 (+863076us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5400380ed4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:02.287410 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41766144}
I20260709 13:01:02.329722  4792 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.296643  1615 raft_consensus.cc:1240] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:02.276286  4767 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:02.449085  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.438441  1620 rpcz_store.cc:269] 0709 13:01:01.069544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.159773 (+ 90229us) service_pool.cc:224] Handling call
0709 13:01:02.305491 (+1145718us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54000adcd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:02.305875 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448113536}
I20260709 13:01:02.443351  1618 rpcz_store.cc:276] 0709 13:01:01.070207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.635451 (+565244us) service_pool.cc:224] Handling call
0709 13:01:02.311777 (+676326us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400400454. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:02.311890 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241365248}
I20260709 13:01:02.421900  4708 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:02.497172  4792 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:02.501998  4708 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:02.495692  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:02.471153  4530 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.467216  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:02.538383  1622 raft_consensus.cc:2376] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9. Re-sending same reply.
I20260709 13:01:02.542336  1614 raft_consensus.cc:2376] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6. Re-sending same reply.
I20260709 13:01:02.404552  4785 consensus_queue.cc:1243] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:02.280733  4793 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:02.476675  1512 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:02.548430  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 71853.1us
I20260709 13:01:02.548461  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:02.485669  4742 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:02.478482  4379 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:01:02.489542  4729 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.460526  4719 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:02.492045  4667 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:02.415853  4796 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:02.408594  4664 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:02.168821  4797 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:02.573568  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:02.326100  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.605690  4664 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:02.604897  4734 consensus_queue.cc:260] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:02.540719  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:02.496093  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:02.543991  1622 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:02.628804  1615 raft_consensus.cc:2376] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7. Re-sending same reply.
I20260709 13:01:02.481184  4741 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:02.165738  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 152721us
I20260709 13:01:02.405638  4601 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:01:02.391163  4801 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:01:02.566759  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:02.558135  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:02.634577  1546 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:02.454089  4446 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:02.571995  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 107211us
W20260709 13:01:02.632184  1511 leader_election.cc:336] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 2.160s (SENT)
I20260709 13:01:02.502959  4792 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:02.558975  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:02.558588  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:02.639351  1547 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.542281  4789 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.581753  1660 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:02.507382  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.554909  4379 consensus_queue.cc:1243] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer 822e08445eae4a33b2f2fe92060192c6 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:02.473237  4639 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:02.503072  4767 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:02.565951  4729 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:02.571756  4708 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.571174  4705 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:02.566466  4817 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:02.595141  1443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42114 (request call id 269) took 13353 ms (client timeout 15000 ms). Trace:
W20260709 13:01:02.604072  4812 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:01:02.604373  4404 consensus_meta.cc:287] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.823s	user 0.015s	sys 0.000s
I20260709 13:01:02.617133  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 523) took 1121 ms. Trace:
W20260709 13:01:02.609248  4780 consensus_meta.cc:287] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.860s	user 0.006s	sys 0.012s
I20260709 13:01:02.616524  4797 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:02.619577  4788 consensus_meta.cc:287] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.957s	user 0.014s	sys 0.004s
W20260709 13:01:02.620112  4786 consensus_meta.cc:287] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.695s	user 0.014s	sys 0.003s
I20260709 13:01:02.538776  1659 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:02.627790  4329 consensus_meta.cc:287] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.588s	user 0.016s	sys 0.000s
I20260709 13:01:02.635672  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:02.635797  4741 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:02.678145  4820 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.768321  4512 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:01:02.796226  4719 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:02.635977  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:02.646404  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:02.639323  4734 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:02.797746  1694 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:02.676752  4664 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:02.798324  4329 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:02.648530  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:02.675612  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:02.797746  2243 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:02.678687  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:02.801216  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:02.802008  1691 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:02.634063  4601 consensus_queue.cc:1243] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:01:02.643162  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 61550.2us
I20260709 13:01:02.804642  1547 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:02.805553  1694 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:01:02.799427  1696 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.799368  1621 rpcz_store.cc:276] 0709 13:01:01.491966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.742816 (+250850us) service_pool.cc:224] Handling call
0709 13:01:01.743210 (+   394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:01.743923 (+   713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.743958 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:01.744564 (+   606us) log.cc:844] Serialized 52 byte log entry
0709 13:01:01.768817 (+ 24253us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:01.768861 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.768933 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.613225 (+844292us) raft_consensus.cc:1685] finished
0709 13:01:02.613249 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.613404 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":23731,"threads_started":1,"wal-append.queue_time_us":211913}
I20260709 13:01:02.798341  4793 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:02.694288  4818 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.811306  4404 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:02.811743  4329 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:02.677078  4789 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:02.812614  4786 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:02.794283  1443 rpcz_store.cc:269] 0709 13:00:49.242170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.273942 (+ 31772us) service_pool.cc:224] Handling call
0709 13:01:02.594995 (+13321053us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:59.157091 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:59.394749 (+237658us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:59.399468 (+  4719us) write_op.cc:435] Acquired schema lock
0709 13:00:59.411446 (+ 11978us) tablet.cc:662] Decoding operations
0709 13:00:59.412570 (+  1124us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:59.412666 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:59.412700 (+    34us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:00:59.460799 (+ 48099us) tablet.cc:701] Row locks acquired
0709 13:00:59.460859 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:00:59.461072 (+   213us) write_op.cc:270] Start()
0709 13:00:59.461248 (+   176us) write_op.cc:276] Timestamp: P: 1783602059461000 usec, L: 0
0709 13:00:59.461294 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:00:59.462171 (+   877us) log.cc:844] Serialized 3631 byte log entry
0709 13:00:59.935793 (+473622us) op_driver.cc:464] REPLICATION: finished
0709 13:01:00.084575 (+148782us) write_op.cc:301] APPLY: starting
0709 13:01:00.084696 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:00.084944 (+   248us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:00.085088 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:00.094718 (+  9630us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:00.095043 (+   325us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:01:00.095104 (+    61us) write_op.cc:312] APPLY: finished
0709 13:01:00.095471 (+   367us) log.cc:844] Serialized 71 byte log entry
0709 13:01:00.146923 (+ 51452us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:00.161979 (+ 15056us) write_op.cc:454] Released schema lock
0709 13:01:00.172781 (+ 10802us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:00.233888 (+ 61107us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:00.250943 (+ 17055us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6518,"reported_tablets":46,"spinlock_wait_cycles":7552,"child_traces":[["op",{"apply.queue_time_us":126571,"apply.run_cpu_time_us":4370,"apply.run_wall_time_us":145810,"num_ops":9,"prepare.queue_time_us":390502,"prepare.run_cpu_time_us":62463,"prepare.run_wall_time_us":537811,"raft.queue_time_us":193373,"raft.run_cpu_time_us":36937,"raft.run_wall_time_us":121244,"replication_time_us":474319,"thread_start_us":780929,"threads_started":4,"wal-append.queue_time_us":228773,"wal-append.run_cpu_time_us":108733,"wal-append.run_wall_time_us":1442492}]]}
I20260709 13:01:02.814757  4789 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:02.692950  1693 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:01:02.711362  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 79209.1us
I20260709 13:01:02.816391  1620 raft_consensus.cc:2410] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:01:02.693991  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:02.817092  1690 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:02.693516  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:02.817682  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:02.818329  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:02.818799  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:02.819056  1694 raft_consensus.cc:2393] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:02.642333  4800 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:02.818056  1692 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:02.823053  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:02.814823  4786 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:02.825268  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 286519us
I20260709 13:01:02.842164  4664 raft_consensus.cc:697] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:02.842347  4786 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:02.842947  4786 raft_consensus.cc:697] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:02.841900  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:02.677282  4792 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:02.771314  4814 log.cc:927] Time spent T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:01:02.845114  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:02.770247  4446 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:02.794178  4820 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:02.888653  1540 raft_consensus.cc:1240] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:02.891769  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:02.857082  1693 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:02.895221  2243 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:02.856599  4800 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:02.856627  1659 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:02.858706  4793 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:02.859282  4789 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:02.858845  4786 consensus_queue.cc:237] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:02.815279  4788 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:02.694206  4816 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.843420  4664 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:02.825201  1687 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:02.871487  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:02.872179  1692 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:02.923977  1695 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.873095  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:02.784816  4767 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:02.808758  4379 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:02.889389  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:02.794224  4780 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:02.902436  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:02.931701  1547 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:01:02.903995  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:02.781239  4530 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:02.908468  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 64186us
I20260709 13:01:02.811780  4818 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:02.913602  1688 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:02.815768  4817 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:02.778028  4638 consensus_queue.cc:260] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:02.821600  1696 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:02.768476  4708 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:02.930686  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 420119us
I20260709 13:01:02.872032  4705 raft_consensus.cc:697] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:02.883903  4792 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:03.050105  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:02.990350  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.934614  1691 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 9: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:02.934134  1693 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:01:02.982223  1547 pending_rounds.cc:85] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 6
I20260709 13:01:03.053145  1547 pending_rounds.cc:107] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:01:03.053568  1547 raft_consensus.cc:2889] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:03.024631  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 43681.8us
I20260709 13:01:03.051095  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:03.055959  1696 raft_consensus.cc:2368] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9.
I20260709 13:01:02.982223  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:03.058049  1545 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:03.060612  1585 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:02.912765  4446 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:03.064647  4785 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:02.991313  1586 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:03.065105  1543 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.987741  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:03.067163  1545 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
W20260709 13:01:03.076419  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 85231.8us
I20260709 13:01:03.073151  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:03.039768  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.078397  1541 raft_consensus.cc:2368] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:03.078137  1692 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:03.078687  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:03.073149  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:03.079631  1544 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:01:03.083127  2244 raft_consensus.cc:1240] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:03.084125  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:03.062477  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:03.084978  1538 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
W20260709 13:01:03.085664  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.087540  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:03.088678  1545 raft_consensus.cc:2393] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:03.089488  1694 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:03.072902  4336 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:03.091887  1693 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:03.053805  4719 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.991523  4404 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:02.990540  4729 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:03.011626  4702 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:03.053630  4747 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.065079  4556 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.065414  4767 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:03.103223  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:01:03.085989  4829 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:03.109513  1692 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:03.078174  4638 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:03.133174  2210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.028s	sys 0.042s
W20260709 13:01:03.133837  2210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.029s	sys 0.042s
I20260709 13:01:03.112237  1445 catalog_manager.cc:5697] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:03.113976  4825 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:01:03.124711  1693 raft_consensus.cc:606] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:02.915342  4793 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:03.130389  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:02.926822  4816 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:03.158555  1693 raft_consensus.cc:614] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:03.160333  1445 catalog_manager.cc:5697] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:02.946374  4379 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:03.076128  4827 consensus_queue.cc:1059] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:01:03.172636  1692 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:01:03.129977  4729 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:03.131260  4829 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.086242  4785 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:02.946000  4742 raft_consensus.cc:697] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:03.192549  1546 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:01:03.107307  4719 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:03.196292  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:03.200523  1538 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:03.188301  1445 catalog_manager.cc:5697] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 5 to 7, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.222048  1695 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
W20260709 13:01:03.188818  4405 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.009s	sys 0.035s
W20260709 13:01:03.198443  4746 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.034s	sys 0.036s
I20260709 13:01:03.156565  4556 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:03.263435  4556 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:03.191318  4829 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:03.267828  4742 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:03.270133  4820 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:03.270961  4780 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:03.272161  4817 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:03.211905  4729 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:01:03.157248  4747 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:03.129828  4702 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:03.203739  4827 raft_consensus.cc:3055] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:03.251366  2243 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:03.282470  1694 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
W20260709 13:01:03.279563  4746 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.035s	sys 0.037s
I20260709 13:01:03.273799  1445 catalog_manager.cc:5697] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:03.249675  4405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.013s	sys 0.035s
I20260709 13:01:03.307261  4827 raft_consensus.cc:740] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:03.367563  1693 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:03.309607  4639 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:03.362211  1445 catalog_manager.cc:5697] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: leader changed from <none> to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:03.321837  4832 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:03.312398  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 508558us
I20260709 13:01:03.298496  1538 raft_consensus.cc:2410] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:03.319371  2242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45882 (request call id 678) took 1238 ms. Trace:
I20260709 13:01:03.196978  4705 consensus_queue.cc:237] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:03.321484  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.020s	sys 0.024s
W20260709 13:01:03.382761  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.020s	sys 0.024s
I20260709 13:01:03.383441  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:03.383802  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:03.384912  1695 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:03.384347  1688 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
W20260709 13:01:03.385588  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.386049  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 217026us
I20260709 13:01:03.305990  4833 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
W20260709 13:01:03.378492  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 300592us
I20260709 13:01:03.321264  4601 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:01:03.375787  1445 catalog_manager.cc:5697] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 2 to 5, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.388374  1660 leader_election.cc:400] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:03.399399  1660 leader_election.cc:403] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:03.389119  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:03.400398  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 306484us
I20260709 13:01:03.390163  4329 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.390759  4793 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:03.391079  1587 leader_election.cc:400] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9.
I20260709 13:01:03.411355  1587 leader_election.cc:403] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:01:03.410691  1445 catalog_manager.cc:5697] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 3 to 5, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 5 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:03.391630  4816 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:03.397769  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.413223  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.382201  4530 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:03.412863  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 221679us
I20260709 13:01:03.404517  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:03.404723  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:03.420094  1688 raft_consensus.cc:2410] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:03.410434  1543 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:03.378468  4708 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:03.301069  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:03.379447  2242 rpcz_store.cc:276] 0709 13:01:02.080933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.277162 (+196229us) service_pool.cc:224] Handling call
0709 13:01:02.277658 (+   496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:02.363014 (+ 85356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.363045 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:02.374710 (+ 11665us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.530178 (+155468us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:02.530289 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.530402 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.319104 (+788702us) raft_consensus.cc:1685] finished
0709 13:01:03.319133 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.319302 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90075,"raft.queue_time_us":89380,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":13633,"thread_start_us":139137,"threads_started":1,"wal-append.queue_time_us":492183}
W20260709 13:01:03.428292  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 127302us
I20260709 13:01:03.401446  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:03.417673  1445 catalog_manager.cc:5697] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 6 to 9, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.430837  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:03.433378  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:03.438863  1688 raft_consensus.cc:2393] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:03.409727  4405 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:03.457669  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:03.458662  2243 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:03.389453  1512 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:03.465808  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:03.410923  4786 consensus_queue.cc:1059] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:01:03.468739  1511 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:03.397464  4832 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:03.466984  4793 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:03.436057  4785 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:03.485560  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 96161.8us
I20260709 13:01:03.414288  4329 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:03.486310  1512 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:03.499325  1445 catalog_manager.cc:5697] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 3 to 5, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.432672  4708 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.463969  4841 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:03.474300  4379 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:03.524808  4719 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:03.518234  4800 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:03.521041  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:03.483532  4845 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:03.523190  4734 consensus_meta.cc:287] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.725s	user 0.008s	sys 0.004s
I20260709 13:01:03.517793  4792 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:03.520007  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 116835us
I20260709 13:01:03.553838  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:03.563890  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 95186.5us
I20260709 13:01:03.538513  4841 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:03.543442  4800 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:03.570761  4860 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:03.570979  4800 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:03.569625  4836 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9.
I20260709 13:01:03.537735  1445 catalog_manager.cc:5697] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.496723  4793 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:03.565493  1585 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:03.607683  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:03.607679  1585 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:03.609125  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 55406.5us
I20260709 13:01:03.527714  4852 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:03.519062  4708 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:03.610107  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:03.533391  4838 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:03.612545  1445 catalog_manager.cc:5697] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 3 to 6, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.615077  1585 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:03.532047  4702 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:03.618842  1659 leader_election.cc:400] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:03.532290  4379 consensus_queue.cc:1059] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:01:03.611505  4792 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:03.612645  4851 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.626873  1688 pending_rounds.cc:85] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 5
I20260709 13:01:03.557367  4846 consensus_queue.cc:1059] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:01:03.558754  4845 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:03.606861  4719 consensus_queue.cc:1059] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:01:03.610937  4841 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:03.738695  4835 log.cc:927] Time spent T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.319s	user 0.001s	sys 0.002s
I20260709 13:01:03.674134  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2051) took 1029 ms. Trace:
I20260709 13:01:03.680480  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:03.869438  1688 pending_rounds.cc:107] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 5.6
W20260709 13:01:03.822680  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 257093us
I20260709 13:01:03.676499  1445 catalog_manager.cc:5697] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 4 to 7, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.667201  1585 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:03.762830  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:03.882089  1688 raft_consensus.cc:2889] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:03.628198  4860 raft_consensus.cc:697] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:03.881634  1511 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:03.884400  1693 raft_consensus.cc:2393] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 7: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:03.886940  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:03.887948  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:03.888733  2243 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:01:03.891867  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:03.894352  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:03.895151  2243 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:01:03.879801  1687 rpcz_store.cc:276] 0709 13:01:02.644544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.676108 (+ 31564us) service_pool.cc:224] Handling call
0709 13:01:02.792711 (+116603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.923516 (+130805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.673858 (+750342us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b540014f854. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:03.674060 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55803648}
W20260709 13:01:03.626139  4843 log.cc:927] Time spent T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:01:03.757336  4638 consensus_meta.cc:287] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.000s
W20260709 13:01:03.750772  4858 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.073s	user 0.001s	sys 0.002s
I20260709 13:01:03.621217  4667 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:03.738579  4855 log.cc:927] Time spent T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.264s	user 0.001s	sys 0.001s
I20260709 13:01:03.738008  4789 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.624130  4836 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:03.739296  4849 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.110s	user 0.000s	sys 0.004s
W20260709 13:01:03.914566  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 247505us
I20260709 13:01:03.623801  4797 consensus_queue.cc:1059] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.297s
W20260709 13:01:03.841334  4859 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:01:03.790086  4865 log.cc:927] Time spent T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
I20260709 13:01:03.751371  4741 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:03.675756  4837 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
W20260709 13:01:03.840680  4864 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:01:03.749732  4844 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.318s	user 0.001s	sys 0.003s
I20260709 13:01:03.624686  4796 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:03.626684  4839 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:03.659219  4379 consensus_queue.cc:1243] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:03.732869  4664 raft_consensus.cc:3055] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:03.764627  4446 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.718212  4863 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:03.737829  4850 log.cc:927] Time spent T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.215s	user 0.001s	sys 0.001s
I20260709 13:01:03.940320  4719 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.672371  4729 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:03.661604  4746 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:03.981091  4638 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:03.751636  4329 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:03.661695  4747 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:03.927977  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.016s
W20260709 13:01:04.010699  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.001s	sys 0.016s
I20260709 13:01:03.844282  4793 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:03.764375  4816 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.669914  4862 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:01:03.933211  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.007s	sys 0.009s
W20260709 13:01:04.013813  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.007s	sys 0.009s
I20260709 13:01:03.932437  1445 catalog_manager.cc:5697] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 7 to 9, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.626035  4817 consensus_queue.cc:1059] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.303s
I20260709 13:01:03.916738  2211 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:03.937702  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 451370us
I20260709 13:01:03.997653  4664 raft_consensus.cc:740] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:03.917927  4336 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:03.941093  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 497350us
W20260709 13:01:04.017943  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 101303us
I20260709 13:01:03.884044  4851 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:03.925901  4601 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.945169  1585 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:03.939919  4829 consensus_meta.cc:287] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.675s	user 0.013s	sys 0.000s
I20260709 13:01:03.761137  4870 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.981395  4765 raft_consensus.cc:3055] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:04.005607  4874 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.935276  4789 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:03.757211  4708 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:03.994252  4702 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:04.011041  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 619986us
I20260709 13:01:04.089042  1587 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:03.998044  4839 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:04.017006  1512 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:03.918507  4734 raft_consensus.cc:3055] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:03.999629  4379 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:04.025491  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1332) took 1371 ms. Trace:
I20260709 13:01:04.031855  4705 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.032814  2244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 735) took 1573 ms. Trace:
I20260709 13:01:04.002575  4446 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.024521  4796 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:04.034071  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:04.038125  4842 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.570s	user 0.000s	sys 0.002s
I20260709 13:01:04.040370  4852 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:04.041451  4788 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:04.030967  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1325) took 1472 ms. Trace:
I20260709 13:01:04.047807  4741 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:04.048163  4801 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:04.049013  4818 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:04.056689  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:04.060122  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:04.060389  4838 raft_consensus.cc:3055] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:04.063796  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:04.066179  2245 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:04.085215  4601 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.074249  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:04.074542  2237 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:04.081565  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:04.127693  1618 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 7: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:04.105651  4879 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.084753  4829 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:04.086153  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 141047us
I20260709 13:01:04.091286  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1334) took 1436 ms. Trace:
I20260709 13:01:04.093595  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 402) took 1205 ms. Trace:
I20260709 13:01:04.147387  1542 rpcz_store.cc:276] 0709 13:01:02.887745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.887960 (+   215us) service_pool.cc:224] Handling call
0709 13:01:02.906934 (+ 18974us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:02.907431 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.907473 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:02.919199 (+ 11726us) log.cc:844] Serialized 52 byte log entry
0709 13:01:03.359570 (+440371us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:03.474281 (+114711us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.982454 (+508173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.982659 (+   205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.093378 (+110719us) raft_consensus.cc:1685] finished
0709 13:01:04.093402 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.093535 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55733,"prepare.queue_time_us":169250,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":8902,"raft.queue_time_us":62748,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":31183,"thread_start_us":959866,"threads_started":3,"wal-append.queue_time_us":440260}
W20260709 13:01:04.094487  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 77530.7us
I20260709 13:01:04.151039  1512 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:04.089931  4839 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:04.093600  1445 catalog_manager.cc:5697] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:04.096916  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:04.066924  4832 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:04.007164  4719 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.096487  1696 rpcz_store.cc:276] 0709 13:01:02.654123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.065261 (+411138us) service_pool.cc:224] Handling call
0709 13:01:03.065770 (+   509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.082460 (+ 16690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.082501 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.109051 (+ 26550us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.327551 (+218500us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:03.327607 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.327695 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.025259 (+697564us) raft_consensus.cc:1685] finished
0709 13:01:04.025284 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.025426 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5357,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":11904,"thread_start_us":218092,"threads_started":1,"wal-append.queue_time_us":422284}
I20260709 13:01:04.101423  1586 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:04.156646  1545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:34424
I20260709 13:01:04.102499  4747 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.099608  4664 consensus_queue.cc:260] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.016319  4638 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.017812  4816 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.099988  4708 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:04.099973  2244 rpcz_store.cc:276] 0709 13:01:02.459840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.459975 (+   135us) service_pool.cc:224] Handling call
0709 13:01:02.477470 (+ 17495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.083618 (+606148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.032559 (+948941us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b54006a0254. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:04.032715 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383408896}
I20260709 13:01:03.938042  4836 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.117033  4556 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 13:01:04.162279  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 54519us
I20260709 13:01:04.083693  4883 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.082955  4765 raft_consensus.cc:740] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:04.099893  4862 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:04.112988  1539 rpcz_store.cc:276] 0709 13:01:02.558634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.558737 (+   103us) service_pool.cc:224] Handling call
0709 13:01:04.030684 (+1471947us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003c3f54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:04.030882 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2970350848}
I20260709 13:01:04.090696  4702 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.093128  4734 raft_consensus.cc:740] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:04.002861  4863 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.120788  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:04.068437  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:04.123641  2243 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:04.085748  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:04.132421  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 104884us
I20260709 13:01:04.090875  4874 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.158167  4841 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:04.173847  1620 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:01:04.145316  1689 rpcz_store.cc:276] 0709 13:01:02.655139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.117015 (+461876us) service_pool.cc:224] Handling call
0709 13:01:03.117435 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.117893 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.117937 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.118501 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.380726 (+262225us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:03.380784 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.380878 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.090998 (+710120us) raft_consensus.cc:1685] finished
0709 13:01:04.091020 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.091173 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2044,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":29369,"thread_start_us":261717,"threads_started":1,"wal-append.queue_time_us":317508}
I20260709 13:01:04.153671  2210 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:04.157409  1545 raft_consensus.cc:606] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:04.178354  1545 raft_consensus.cc:614] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:04.104009  4705 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.015350  4860 consensus_queue.cc:237] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.168751  4664 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.123322  4838 raft_consensus.cc:740] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:04.155026  4851 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:04.128716  4845 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:04.087642  4870 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.120749  4741 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.172384  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1326) took 1521 ms. Trace:
W20260709 13:01:04.166069  4800 consensus_meta.cc:287] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.004s
I20260709 13:01:04.175038  2239 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:01:04.180035  1445 catalog_manager.cc:5697] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 2 to 6, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:04.164546  4747 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.161412  4879 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.160465  4329 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:01:04.160733  4336 consensus_queue.cc:1059] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:01:04.124361  4801 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.117566  4852 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.171751  4702 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:04.168740  4708 raft_consensus.cc:697] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:04.286167  4708 consensus_queue.cc:237] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.197827  2210 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:04.289587  4796 raft_consensus.cc:2804] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:04.290000  4796 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.290318  4796 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:04.289247  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 91512us
I20260709 13:01:04.293653  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:04.200053  2243 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:01:04.166167  4746 consensus_queue.cc:1059] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:01:04.220403  1690 rpcz_store.cc:276] 0709 13:01:02.650615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.874314 (+223699us) service_pool.cc:224] Handling call
0709 13:01:02.874701 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:02.875139 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.875180 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:02.895327 (+ 20147us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.369305 (+473978us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:03.635098 (+265793us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.635485 (+   387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.635581 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.037418 (+401837us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:04.167802 (+130384us) raft_consensus.cc:1685] finished
0709 13:01:04.172179 (+  4377us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.172307 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":197691,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":318,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":29649,"spinlock_wait_cycles":5776768,"thread_start_us":673647,"threads_started":2,"wal-append.queue_time_us":499060}
I20260709 13:01:04.105818  4379 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.225257  1660 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:04.296609  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 71428.5us
I20260709 13:01:04.297194  4379 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:04.226467  4827 consensus_queue.cc:260] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.298023  4797 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:04.298432  4827 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.300321  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:04.302621  1660 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:04.267894  4842 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:01:04.227449  4741 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:04.227226  4800 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.227861  4895 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:04.228277  4868 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.228375  4841 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.228873  4896 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:01:04.229743  4875 consensus_queue.cc:1059] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 13:01:04.230695  4894 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:01:04.231375  4873 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:01:04.231935  4871 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:01:04.202790  4785 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:04.232250  4881 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:04.232935  4889 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:04.233620  4836 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:04.171130  4883 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.202520  4833 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:04.236443  4638 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:04.237838  2240 raft_consensus.cc:2410] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:01:04.239992  4884 log.cc:927] Time spent T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:01:04.241627  4870 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:04.246081  4839 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.440152  4839 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:04.443957  4893 log.cc:927] Time spent T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:01:04.444972  4880 log.cc:927] Time spent T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:01:04.446174  4888 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.446727  4888 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:04.448021  4890 log.cc:927] Time spent T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:01:04.449291  4888 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:04.449627  4863 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:04.454821  4792 consensus_meta.cc:287] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.571s	user 0.008s	sys 0.000s
I20260709 13:01:04.456916  4800 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:04.274379  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 142452us
I20260709 13:01:04.272668  2238 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:04.236375  4789 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:04.181175  4793 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
W20260709 13:01:04.460101  1511 leader_election.cc:336] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 1.957s (SENT)
I20260709 13:01:04.222340  4878 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.460619  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:04.461146  4878 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:04.461748  1511 leader_election.cc:336] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 2.163s (SENT)
I20260709 13:01:04.462201  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:04.307578  2210 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:04.462891  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 155364us
I20260709 13:01:04.465843  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2427) took 1405 ms. Trace:
I20260709 13:01:04.303468  4797 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:04.310598  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:04.356303  2246 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:04.467929  1690 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:01:04.468024  1660 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:04.360564  4852 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:04.277500  4729 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:04.357513  4846 raft_consensus.cc:3055] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:04.361680  4705 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:04.308117  4845 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:01:04.357651  4887 log.cc:927] Time spent T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
W20260709 13:01:04.328197  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.311759  4895 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:04.405555  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 237242us
I20260709 13:01:04.529039  1587 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:04.529294  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.529827  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:04.512194  4719 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:04.530229  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:04.412760  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 311368us
I20260709 13:01:04.531504  1586 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:04.276084  4734 consensus_queue.cc:260] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.277909  4765 consensus_queue.cc:260] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.399437  4817 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:04.380486  4446 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:04.425555  4896 consensus_queue.cc:1243] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:04.460431  4879 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:04.305734  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 151821us
I20260709 13:01:04.412578  4832 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:04.531139  4816 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:04.466317  1538 rpcz_store.cc:276] 0709 13:01:03.060288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.392188 (+331900us) service_pool.cc:224] Handling call
0709 13:01:03.392493 (+   305us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:03.576983 (+184490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.577015 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:03.611834 (+ 34819us) log.cc:844] Serialized 52 byte log entry
0709 13:01:03.983597 (+371763us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:03.983650 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.983735 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.465595 (+481860us) raft_consensus.cc:1685] finished
0709 13:01:04.465615 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.465772 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1335,"raft.queue_time_us":92428,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":24374,"thread_start_us":532503,"threads_started":2,"wal-append.queue_time_us":470450}
I20260709 13:01:04.485774  1511 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:04.490813  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:04.555322  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 69614.1us
I20260709 13:01:04.349644  4868 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.468690  4792 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:04.494527  4873 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:04.483337  4829 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:04.488723  4638 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:04.506194  4881 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:04.483732  4789 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:04.492202  4836 raft_consensus.cc:3055] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:04.492926  4875 raft_consensus.cc:3055] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:04.487015  4863 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:04.488371  4793 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:04.462201  4874 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:04.522646  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 348025us
I20260709 13:01:04.590044  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:04.592948  1692 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:01:04.496251  4888 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:04.434964  4785 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.504765  4797 raft_consensus.cc:697] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:04.435719  4889 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.411460  4851 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:04.532253  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:04.597375  1696 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:01:04.573634  4336 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:04.532270  4895 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:04.545161  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2066) took 1140 ms. Trace:
I20260709 13:01:04.555365  4845 raft_consensus.cc:697] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:04.412132  4862 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:04.556113  1615 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 7: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:04.536962  4877 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.557196  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:04.556506  1586 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:04.532121  4846 raft_consensus.cc:740] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:04.531283  4801 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:04.620399  4838 consensus_queue.cc:260] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.621456  4838 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.621762  4846 consensus_queue.cc:260] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.622991  4846 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:04.623966  4862 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.608443  4853 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:04.607939  4898 consensus_queue.cc:1059] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:01:04.627996  4853 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.628696  4898 raft_consensus.cc:3055] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:04.629055  4898 raft_consensus.cc:740] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:04.629583  4601 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:04.629880  4898 consensus_queue.cc:260] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.632501  4785 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:04.634348  4889 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:04.634599  4883 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:04.569586  1695 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:04.560134  1585 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:01:04.583110  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 91443.3us
I20260709 13:01:04.579046  1587 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:04.608788  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 51670us
W20260709 13:01:04.636245  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 57273.8us
I20260709 13:01:04.636837  1511 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:04.582392  1690 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:01:04.426323  4841 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.560276  4734 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.545342  4878 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:04.601051  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:04.585954  4719 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:04.601739  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:04.602082  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:04.603801  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:04.664438  1541 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 4.
I20260709 13:01:04.664682  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:04.665491  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:04.604478  1543 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:04.604982  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:04.666841  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 61939.7us
I20260709 13:01:04.671854  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:04.672824  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:04.673125  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:04.673921  1694 raft_consensus.cc:2410] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:04.598326  1688 rpcz_store.cc:276] 0709 13:01:03.404714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.615476 (+210762us) service_pool.cc:224] Handling call
0709 13:01:03.626647 (+ 11171us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:03.882966 (+256319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.883010 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:03.913097 (+ 30087us) log.cc:844] Serialized 52 byte log entry
0709 13:01:04.058678 (+145581us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b180040ff60. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb0d1 00007fc4916e6a0f
0709 13:01:04.379728 (+321050us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:04.379777 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.379856 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.544861 (+165005us) raft_consensus.cc:1685] finished
0709 13:01:04.544883 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.545100 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1149,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4966,"spinlock_wait_cycles":2904832,"thread_start_us":320844,"threads_started":1,"wal-append.queue_time_us":549166}
I20260709 13:01:04.590541  4875 raft_consensus.cc:740] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:01:04.610369  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 53932.3us
I20260709 13:01:04.613871  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:04.676962  1546 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:04.614586  1544 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:04.615149  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:04.618125  4329 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:04.608950  4705 raft_consensus.cc:2804] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:04.681867  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:04.682488  1695 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:04.593643  4789 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.582965  4708 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:04.559599  4832 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:04.658806  1511 leader_election.cc:336] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 1.662s (SENT)
I20260709 13:01:04.662551  1540 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:04.587960  4836 raft_consensus.cc:740] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:01:04.642998  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 82935.9us
I20260709 13:01:04.671630  1541 raft_consensus.cc:2393] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 8: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:04.675374  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:04.696588  1511 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:04.702018  1547 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
W20260709 13:01:04.702308  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 43559.7us
I20260709 13:01:04.697461  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:04.697846  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:04.699056  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:04.704634  2242 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.705061  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:04.677801  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:04.631145  4898 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:04.630435  4853 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:04.690212  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:04.710527  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:04.690847  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:04.711727  1543 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:04.711876  1541 raft_consensus.cc:1275] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:04.713140  1541 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:04.691793  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:04.710547  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:04.693856  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:04.610200  4336 raft_consensus.cc:697] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:04.645282  4897 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:04.684341  2211 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:04.700240  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:04.705840  1690 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:01:04.662927  4883 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:04.663481  4719 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.604329  4851 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.708442  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:04.709760  1547 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:04.732285  1659 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:04.743610  1543 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:04.610252  4792 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:01:04.710588  1620 pending_rounds.cc:85] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 2
I20260709 13:01:04.669528  4896 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:04.717410  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:04.717548  1619 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:04.748874  1620 pending_rounds.cc:107] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:04.749229  1620 raft_consensus.cc:2889] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:04.718079  1618 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:04.718708  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:04.720817  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:04.751866  1540 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:01:04.707182  4852 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:04.745184  1659 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:04.607090  4911 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 13:01:04.681088  4329 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.683534  4379 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.608211  4877 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.713768  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:04.695562  4705 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:04.746670  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:04.725690   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:04.696321  4708 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:04.692027  4801 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:04.757056  1541 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:04.751793  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:04.633945  4895 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.750988  1616 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:01:04.759024  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:04.798576  1546 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:04.824261   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:04.877609  1543 raft_consensus.cc:1240] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:04.747771  4719 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:04.608393  4797 consensus_queue.cc:237] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.805068  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:04.814854  1547 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:01:04.815676  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:04.889256  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:04.817081  1587 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:04.607952  4845 consensus_queue.cc:237] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.747160  4785 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.741252  4816 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:04.751364  4897 raft_consensus.cc:697] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:04.758558  4780 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
W20260709 13:01:04.799011  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 97367.9us
I20260709 13:01:04.741714  4853 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:04.922286  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:04.752265  4885 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.751636  4446 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:04.889325  1619 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:01:04.812021  4705 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:04.755592  4896 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.889967  1546 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:01:04.759410  4664 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.145s
W20260709 13:01:04.820873  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 75722.4us
I20260709 13:01:04.741276  4870 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:04.893976  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:04.804159  4329 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:04.798512  4863 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.897749  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:04.901170  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:04.741532  4817 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
I20260709 13:01:04.813544  4883 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.904867  1544 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:04.880144  1618 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:01:04.919297  4827 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.918304  1585 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:04.824173  4801 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:04.922283  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 114908us
I20260709 13:01:04.745802  4876 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.926795  4889 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:04.933727  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:04.931063  1659 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:04.933404  4896 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.823360  4836 consensus_queue.cc:260] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.941437  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:04.942288  4877 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:04.944810  4664 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:04.981186  4801 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:04.993561  4664 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:01:04.929385  4702 consensus_meta.cc:287] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.000s
I20260709 13:01:04.994611  4702 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:04.813362  4379 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.962738  1543 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:04.986997  1615 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:04.822674  4708 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.928346  4446 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.977073  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:04.977175  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.008198  1542 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.008278  1619 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:04.978440  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:04.923043  4853 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:04.949712  4905 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 13:01:04.917941  4921 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:04.984817  1660 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:04.985571  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 54556us
I20260709 13:01:05.015831  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:04.991330  4889 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.991882  4916 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:04.803313  4875 consensus_queue.cc:260] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.907493  4785 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:04.964010  4739 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:04.912315  4816 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:05.004817  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 86638.9us
W20260709 13:01:04.996639  4909 log.cc:927] Time spent T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.394s	user 0.000s	sys 0.001s
I20260709 13:01:04.954629  4870 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.045634  1585 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:04.936983  4885 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:05.049247  1619 raft_consensus.cc:1275] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:05.001801  4841 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:04.997046  4868 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:04.930552  4336 consensus_queue.cc:237] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:05.012602  4446 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.018487  4921 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:05.051008  1618 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:04.981406  4883 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:05.095715  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 286476us
I20260709 13:01:05.055436  4702 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:05.056242  4889 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:05.014672  4853 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.970489  4863 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:05.060678  4789 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:04.982201  4827 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.018745  4916 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:05.096686  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.090385  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:05.044066  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 59325.7us
W20260709 13:01:05.123292  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.090219  4868 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.046537  4917 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:05.111056  2209 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:05.110462  1619 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:04.997548  4876 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:05.059191  2242 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:05.088351  4841 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:05.126019  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:05.119383  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.137413  1621 raft_consensus.cc:2410] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:01:05.128268  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.106534  1542 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:01:05.100111  4832 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:05.096405  4921 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.113649  4889 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:05.165287  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.179448  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.162468  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:05.182652  1543 raft_consensus.cc:2393] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:05.181686  1618 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:05.184206  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.186647  1618 raft_consensus.cc:2393] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:05.187783  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.193905  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.194834  1619 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:05.124985  4916 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.116096  4833 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:01:05.152727  4877 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:05.203076  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.214978  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.215647  1687 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:05.216341  4900 raft_consensus.cc:3055] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:05.216737  4900 raft_consensus.cc:740] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:05.217562  4900 consensus_queue.cc:260] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:05.218931  4900 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:05.205544  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:05.219501  1547 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:05.220400  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:05.220956  1547 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:05.221750  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:05.222242  1547 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:01:05.222734  4863 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:05.132336  4789 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:01:05.223327  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:05.149472  4868 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.207616  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:05.224049  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:05.224622  1543 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:05.224889  1542 raft_consensus.cc:2410] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:05.225365  4868 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:05.181878  4829 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:05.185932  4934 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.223999  2241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 688) took 1092 ms. Trace:
I20260709 13:01:05.248864  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.249821  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.223016  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:05.250610  1547 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:05.250614  1687 raft_consensus.cc:2410] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:05.223681  4885 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:05.233712  4924 log.cc:927] Time spent T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:01:05.234458  4925 log.cc:927] Time spent T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 13:01:05.235215  4927 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 13:01:05.235894  4914 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:01:05.236382  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 461) took 1011 ms. Trace:
I20260709 13:01:05.239904  4876 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:05.242743  4838 consensus_meta.cc:287] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.000s
W20260709 13:01:05.244915  4796 consensus_meta.cc:287] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.954s	user 0.010s	sys 0.002s
I20260709 13:01:05.045303  4897 consensus_queue.cc:237] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:05.246085  4883 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:05.246344  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:05.246731  4844 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:01:05.247887  4920 log.cc:927] Time spent T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:01:05.255795  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 239636us
I20260709 13:01:05.268904  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.223923  1541 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:05.183881  4741 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:01:05.150849  4841 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.249033  2241 rpcz_store.cc:276] 0709 13:01:04.131393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.131508 (+   115us) service_pool.cc:224] Handling call
0709 13:01:04.461812 (+330304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.462002 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:04.462309 (+   307us) log.cc:844] Serialized 14 byte log entry
0709 13:01:04.937321 (+475012us) log.cc:844] Serialized 14 byte log entry
0709 13:01:04.947961 (+ 10640us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:04.948011 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:04.948075 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.948138 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.223846 (+275708us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54002afb50. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:05.223947 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10404,"prepare.queue_time_us":31836,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":100,"raft.queue_time_us":27445,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":11394,"spinlock_wait_cycles":689341696,"thread_start_us":474236,"threads_started":1,"wal-append.queue_time_us":521628}
I20260709 13:01:05.276417  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.276556  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:05.316519  1542 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:05.202473  4816 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:05.282433  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.283083  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.282030  1689 rpcz_store.cc:276] 0709 13:01:04.224922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.225408 (+   486us) service_pool.cc:224] Handling call
0709 13:01:04.225787 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.634836 (+409049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.634869 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:04.634910 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:04.634938 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.236062 (+601124us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54001b7e54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:05.236128 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.236295 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":940146944}
I20260709 13:01:05.321013  1586 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:05.294541  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:05.321838  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.297840  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.322425  1659 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:05.322796  1690 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
W20260709 13:01:05.302383  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 138886us
W20260709 13:01:05.319082  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 502004us
I20260709 13:01:05.322184  1547 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:05.326937  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:05.313772  4846 consensus_meta.cc:287] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.690s	user 0.010s	sys 0.001s
I20260709 13:01:05.325804  1659 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:05.322445  1689 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:05.334038  1691 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:05.334600  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.347950  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.348421  1617 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:05.352958  4797 consensus_queue.cc:1059] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:05.353227  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.354477  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.355301  4922 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:05.355829  4922 raft_consensus.cc:697] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:05.356693  4922 consensus_queue.cc:237] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:05.359563  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.360958  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:05.361500  1694 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:05.327754  4889 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:01:05.327131  4734 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:05.367980  1689 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:05.369455  1689 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:01:05.369592  4708 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.317783  4841 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.371461  4816 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:05.361167  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.296566  4719 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.375598  1542 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:05.355082  1690 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:05.392334  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:05.377944  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:05.392504  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:05.393071  1542 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:01:05.378744  1688 raft_consensus.cc:2410] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:05.393329  1538 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:05.311550  4796 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.385803  1694 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:05.324402  4801 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.390105  4785 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:05.393294  1544 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:05.267765  4934 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:05.397433  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:05.393733  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.417205  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:05.417583  1545 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.418509  1542 pending_rounds.cc:85] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 2
I20260709 13:01:05.419881  1542 pending_rounds.cc:107] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:05.420186  1542 raft_consensus.cc:2889] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:05.379005  4816 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.419896  1616 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:01:05.377701  4734 raft_consensus.cc:697] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:05.389681  4877 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.425902  1544 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:05.430701  1691 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:01:05.425900  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 138940us
I20260709 13:01:05.426795  1690 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:05.433223  1660 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:05.435478  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.396744  4931 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:01:05.448375  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.376243  4932 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:01:05.418761  4883 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:05.425215  4816 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.455418  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.459508  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:05.454563  4852 consensus_meta.cc:287] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.000s
I20260709 13:01:05.469002  4852 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:05.471086  4708 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:05.473609  1545 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:01:05.474776  1539 raft_consensus.cc:2410] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:05.436338  4926 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:05.488516  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 51103us
I20260709 13:01:05.489576  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:05.490779  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:05.494859  1660 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:05.496826  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 161145us
I20260709 13:01:05.499286  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.499933  1621 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:05.500851  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.499176  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.501672  1621 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:05.502208  1691 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:05.502945  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:05.480367  4898 consensus_meta.cc:287] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.762s	user 0.010s	sys 0.001s
I20260709 13:01:05.436149  4877 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.507618  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.518137  1690 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:05.503532  1621 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:05.496619  4708 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.521198  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.472867  4883 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:05.498540  4446 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:05.532109  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.533497  1512 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:05.541198  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.543426  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.544255  1690 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:05.528788  4922 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:05.546309  4922 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:05.546691  4922 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.546957  4894 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:05.541887  4931 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:05.547703  4931 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.548101  4931 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:05.552745  4329 consensus_meta.cc:287] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.000s
I20260709 13:01:05.553197  4329 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:05.556895  4705 consensus_meta.cc:287] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.593s	user 0.006s	sys 0.002s
I20260709 13:01:05.557343  4705 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.558312  4719 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:05.558612  1540 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:01:05.559602  4796 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:05.560869  4739 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:05.561338  4739 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:05.557291  4922 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.526836  4708 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:05.564920  4935 log.cc:927] Time spent T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260709 13:01:05.565898  4446 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:05.518458  4734 consensus_queue.cc:237] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.500147  4926 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.557564  4841 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:05.542810  1512 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:05.577863  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.580013  1621 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:05.581670  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:05.581986  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.584318  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.579689  1512 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:05.588380  1620 raft_consensus.cc:2393] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 3: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:05.564894  4708 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:05.590871  1512 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:05.591432  1687 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:05.581715  4801 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:05.584916  4934 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:05.590610  4894 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:05.595499  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 100716us
I20260709 13:01:05.598503  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:05.582343  4852 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:05.601322  1512 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:05.596436  4705 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:05.578482  4947 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:05.602339  4889 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:05.602144  4446 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:05.602962  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.564894  4922 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:05.619807  4747 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:05.621425  4838 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:05.623312  4705 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:05.602108  4793 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:05.558748  4916 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.625356  4793 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.625808  4793 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.626302  4870 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:05.617516  4739 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.628876  1617 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:05.630326  1617 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:05.631973  4851 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:05.632380  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.633013  4836 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.633203  4739 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:05.636636  1618 raft_consensus.cc:2368] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 7. Current term is 8.
I20260709 13:01:05.639609  4729 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:05.640054  4729 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.640733  4926 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:05.613487  4946 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:01:05.644217  4841 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:05.645567  4883 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:05.646438  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.646749  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:05.647079  1696 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:05.646473  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:05.647881  2241 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:05.647982  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.649029  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:05.649499  1696 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:05.650760  4853 consensus_meta.cc:287] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.000s
I20260709 13:01:05.598313  4785 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:05.597570  4894 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.611150  1660 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:05.633143  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.616679  1512 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:05.595968  4719 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:05.656637  2242 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:05.656692  1512 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:05.655409  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 44367.5us
I20260709 13:01:05.657682  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:05.608170  4852 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.660142  1690 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.664323  1696 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:05.667919  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:05.669595  2243 raft_consensus.cc:2368] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4.
I20260709 13:01:05.669945  1696 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:05.670213  1512 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:05.672482  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:05.672885  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:05.652846  4742 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:05.675153  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:05.680299  2238 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:05.675328  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:05.614867  4708 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:05.676965  2241 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:05.677812  2211 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:05.598578  4885 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:01:05.658182  4883 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:05.656972  4894 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.686836  2240 raft_consensus.cc:2368] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7.
I20260709 13:01:05.692319  1695 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:05.687595  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:05.684983  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:05.668871  4852 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.656031  4800 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.690801  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:05.688562  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:05.669368  4329 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:05.668605  4780 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:05.651177  4853 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.687096  4796 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:05.692551  4896 consensus_meta.cc:287] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.000s
I20260709 13:01:05.687357  4883 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.712266  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:05.713534  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 215799us
I20260709 13:01:05.714762  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:05.689208  4741 raft_consensus.cc:2764] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:05.668897  4719 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.709117  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.709151  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:05.720536  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.721375  1687 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:05.722411  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:05.710548  1511 leader_election.cc:400] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4.
I20260709 13:01:05.724521  1511 leader_election.cc:403] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:01:05.715548  1542 raft_consensus.cc:2410] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:05.719424  1620 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:01:05.725865  2238 raft_consensus.cc:2393] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 8: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:05.616542  4947 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.725821  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:05.716221  1690 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:05.711279  1613 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:05.718436  2242 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:05.699293  4938 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:05.679325  4601 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:01:05.725708  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:05.728837  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:05.729640  1511 leader_election.cc:400] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7.
I20260709 13:01:05.687471  4742 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.703047  4708 raft_consensus.cc:697] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:05.733130  1511 leader_election.cc:403] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:01:05.716813  4883 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:05.739328  1511 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:05.742403  4734 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:05.746333  4734 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.748636  4734 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:05.749282  4888 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.749776  4888 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.751766  4888 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:05.742255  4838 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7.
I20260709 13:01:05.731705  4780 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:05.754503  4780 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.758522  4780 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:05.764788  4853 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:05.709358  4866 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:01:05.774293  1621 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:01:05.774649  4947 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:05.719506  4796 raft_consensus.cc:697] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:05.704725  4800 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.785127  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:05.733810  4938 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.790091  2244 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:01:05.788954  1511 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:05.730962  4446 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:05.735456  4868 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.792812  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:05.715673  4896 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:05.785300  4921 consensus_meta.cc:287] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.004s
I20260709 13:01:05.775703  4797 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:05.795328  4930 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:05.787685  4876 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:05.793962  4938 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:05.794174  4866 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:05.812667  1615 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:05.817361  4708 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.821022  4765 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.821812  4796 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:05.825819  4950 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:01:05.808559  4930 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:05.827620  4930 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.828596  4719 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:05.831215  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.814193  4866 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.800655  4446 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.805786  4921 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:05.842010  4793 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:05.849618  4937 log.cc:927] Time spent T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.370s	user 0.000s	sys 0.002s
I20260709 13:01:05.854351  4729 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.855306  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:05.856166  4951 log.cc:927] Time spent T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:01:05.856410  1613 raft_consensus.cc:2393] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 7: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:05.858453  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.859366  1613 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:05.860733  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.860826  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:05.862607  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:05.863708  1613 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:01:05.866566  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.868034  1620 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:05.871307  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:05.871901  1618 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:05.873342  4910 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 1.229s	user 0.001s	sys 0.002s
W20260709 13:01:05.878656  4954 log.cc:927] Time spent T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:01:05.846508  4866 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.879657  4785 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:05.880419  4785 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.870347  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:05.885804  1613 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.890380  1618 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:05.892416  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.963964  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.964428  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:05.965009  1620 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.965056  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:05.965699  1618 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.966288  4785 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:05.967253  4907 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:05.968084  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.967993  4907 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.969122  1619 raft_consensus.cc:2393] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 7: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:05.970125  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.892508  1696 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:05.971122  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:05.981331  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 144339us
I20260709 13:01:05.981575  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:05.982311  1511 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 1.884s (SENT) [suppressed 18 similar messages]
I20260709 13:01:05.982781  1619 raft_consensus.cc:2410] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:05.984371  1613 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:01:05.983106  1511 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:05.933266  4961 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:01:05.988309  1619 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:05.989846  1692 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:01:05.988977  4836 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:05.992033  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.992568  4836 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:05.993325  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:05.994853  1585 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:05.995793  4901 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:05.996065  1585 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:05.997330  1618 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:05.998185  4934 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:05.998462   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:05.998782  4934 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.998821  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:05.999540  1618 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.000336  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:06.000926  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.996203  4901 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.001696  4901 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.001755  1613 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
I20260709 13:01:06.002926  1620 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:01:06.003908  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:05.989212  4719 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:06.004628  1585 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:06.004992  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:06.005664  1620 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:06.006661  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:06.007191  1620 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:06.007900  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:06.008368  1620 raft_consensus.cc:2368] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4.
I20260709 13:01:06.009464  1585 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:06.010880  4734 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:05.993981  4785 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:05.999289  4934 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.989334  4742 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.012974  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:05.994897  4946 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.013875  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 406) took 1209 ms. Trace:
I20260709 13:01:06.014806  4734 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:06.012197  1618 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:06.023607  4734 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.012732  4800 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.019644  1540 rpcz_store.cc:276] 0709 13:01:04.804651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.804813 (+   162us) service_pool.cc:224] Handling call
0709 13:01:06.013728 (+1208915us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54003c46d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:06.013823 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1540425984}
I20260709 13:01:06.024125  4734 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.024156  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:06.024950  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:06.026165  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.027762  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:06.029060  4895 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.011806  4836 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:06.036293  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.022773  4946 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.023485  4729 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:06.016893  1585 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:06.027125  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.020478  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:06.038975  4851 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:06.011952  4556 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:06.044835  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 61806.9us
I20260709 13:01:06.045202  4556 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.045806  4556 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:06.045922  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:06.047981  1690 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:06.049494  1511 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:06.017839  4896 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.050536  4792 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:06.049489  1585 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:06.056106  1585 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:06.053934  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:06.013659  4719 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.067735  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:06.068527  1696 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 11: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:06.050992  4836 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:06.060222  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:06.056936  4929 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:06.060600  4866 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.061298  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:06.061980  4329 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:06.080090  4329 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.080487  4329 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.062718  4874 consensus_queue.cc:1059] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:06.083714  1619 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:06.064550  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.069468  1511 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:06.053638  4907 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:06.055274  4816 consensus_meta.cc:287] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.003s
I20260709 13:01:06.078038  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.119439  4816 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.120328  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:06.079097  1690 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.077529  4792 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:06.085127  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:01:06.067181  4965 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:01:06.091948  4838 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:06.092718  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:06.133494  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 48441.3us
I20260709 13:01:06.094296  4719 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:06.095875  4866 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.096446  1540 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 10: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:06.099056  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:06.100068  1622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2480) took 1402 ms (client timeout 1735 ms). Trace:
I20260709 13:01:06.101229  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2485) took 1296 ms. Trace:
I20260709 13:01:06.103331  1617 raft_consensus.cc:1240] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:06.140110  1622 rpcz_store.cc:269] 0709 13:01:04.697605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.746404 (+ 48799us) service_pool.cc:224] Handling call
0709 13:01:06.099864 (+1353460us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54000adcd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:06.100012 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1656898944}
I20260709 13:01:06.074133  4836 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.074604  4446 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:06.069496  4729 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:06.110970  1512 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:06.115370  4960 log.cc:927] Time spent T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:01:06.116912  1689 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:06.117942  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:06.152848  1696 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:06.153671  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:06.154234  1696 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:06.120494  1695 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:01:06.155390  4708 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:06.155828  4708 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.156181  4708 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.070228  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:06.121518  1587 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:06.058259  4734 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.134354  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:06.135805  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 72774.4us
I20260709 13:01:06.105296  4879 raft_consensus.cc:3055] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:06.141618  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:06.168022  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.168505  1622 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:06.142481  4877 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.140175  1615 rpcz_store.cc:276] 0709 13:01:04.804962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.997332 (+192370us) service_pool.cc:224] Handling call
0709 13:01:06.100915 (+1103583us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b540024f9d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:06.101159 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1830428544}
I20260709 13:01:06.143512  4885 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:06.131435  4816 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:06.147716  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.131951  4792 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.150399  1690 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:06.156082  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:06.159394  1613 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:06.123354  1619 raft_consensus.cc:2410] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:06.164855  1511 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:06.179711  4876 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:06.166927  1696 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:06.163872  1585 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:06.168690  1541 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:06.133080  4838 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:06.148473  4930 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.151487  4836 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.176636  1622 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:01:06.182233  1689 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:06.182875  1512 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:06.158876  4729 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:06.168310  4870 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:06.168154  4879 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:06.174944  4885 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.190238  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 2054) took 1037 ms. Trace:
I20260709 13:01:06.180989  4792 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.201694  1622 rpcz_store.cc:276] 0709 13:01:05.152453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.173351 (+1020898us) service_pool.cc:224] Handling call
0709 13:01:06.173775 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.189997 (+ 16222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.190180 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.185226  4907 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:06.188880  4838 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:06.200487  4729 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.212781  1511 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:06.203616  4885 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.211761  1622 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:06.209614  4866 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:06.218272  4866 raft_consensus.cc:697] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:06.214663  1511 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:06.219448  4982 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:06.219877  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:06.219512  4866 consensus_queue.cc:237] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.220890  4982 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:06.221288  4982 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:06.221302  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:06.221804  4982 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:06.222222  4870 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:06.222626  1511 leader_election.cc:400] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 3 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4.
I20260709 13:01:06.222842  4870 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:06.223407  4870 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:06.226774  2238 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:06.229194  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:06.211716  4929 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:01:06.232753  4930 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.234688  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:06.235862  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:06.236088  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:06.236920  1689 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:06.237149  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:06.212386  4966 log.cc:927] Time spent T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:01:06.199549  4860 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:01:06.237979  1622 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:06.210098  4719 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:06.252158  1622 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:06.215960  4876 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:06.228155  4747 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:06.306123  4982 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.316056  4747 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.317906  4982 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:06.317991  4747 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.319689  4877 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:06.320236  4877 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.324137  4877 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:06.326306  4883 consensus_meta.cc:287] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.002s
W20260709 13:01:06.328521  4931 consensus_meta.cc:287] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.780s	user 0.011s	sys 0.000s
I20260709 13:01:06.329756  4921 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:06.330615  4734 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.212574  4975 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
W20260709 13:01:06.340637  4972 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
W20260709 13:01:06.361976  4938 consensus_meta.cc:287] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.545s	user 0.006s	sys 0.003s
I20260709 13:01:06.362432  4938 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:06.364989  4894 consensus_meta.cc:287] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.665s	user 0.006s	sys 0.004s
I20260709 13:01:06.365509  4894 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.367884  1538 raft_consensus.cc:2368] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11.
I20260709 13:01:06.384114  1542 raft_consensus.cc:2368] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
W20260709 13:01:06.382937  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 132435us
I20260709 13:01:06.337486  4883 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.332113  4879 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.340008  4931 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.406456  1541 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:06.415285  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:06.417912  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 252170us
I20260709 13:01:06.421355  1587 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:06.408543  4978 log.cc:927] Time spent T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:01:06.350605  4934 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.348834  4556 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.365039  4329 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.430473  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:06.431185  1587 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:06.432415  1543 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:06.433717  1688 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:01:06.434775  4989 consensus_queue.cc:1059] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:01:06.430056  4845 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:06.436125  4734 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:01:06.437458  4918 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 1.317s	user 0.004s	sys 0.000s
I20260709 13:01:06.439375  4747 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:06.441475  2210 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:06.443565  4778 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:06.446349  1692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 469) took 1770 ms (client timeout 2177 ms). Trace:
W20260709 13:01:06.446878  1692 rpcz_store.cc:269] 0709 13:01:04.676313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.723659 (+ 47346us) service_pool.cc:224] Handling call
0709 13:01:06.446166 (+1722507us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400097754. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:06.446281 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2679016320}
I20260709 13:01:06.451809  4793 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.453527  4793 consensus_queue.cc:1059] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:06.455991  2210 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:06.457316  4833 raft_consensus.cc:2804] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:06.457988  4833 raft_consensus.cc:697] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:06.459093  4833 consensus_queue.cc:237] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.464967  4883 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.465854  4883 raft_consensus.cc:3055] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:06.466293  4883 raft_consensus.cc:740] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:06.467443  4778 consensus_queue.cc:1059] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:06.468933  4741 raft_consensus.cc:3055] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:06.469413  4741 raft_consensus.cc:740] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:06.470607  4741 consensus_queue.cc:260] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.473165  4741 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:06.476382  4894 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.478034  4792 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:06.480494  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.390556  4729 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.484148  4851 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:06.484232  4974 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:06.485594  4845 raft_consensus.cc:697] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:06.486335  4329 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.487076  4747 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:06.488052  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 56951.6us
I20260709 13:01:06.533099  1587 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:06.491709  4868 consensus_meta.cc:287] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.692s	user 0.000s	sys 0.010s
W20260709 13:01:06.492753  4852 consensus_meta.cc:287] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.788s	user 0.005s	sys 0.006s
I20260709 13:01:06.493245  4938 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.494808  4931 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:06.496306  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:06.501143  4934 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.501788  1620 raft_consensus.cc:2393] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 8: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:06.503351  4379 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.504680  4907 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.486943  4946 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:06.506042  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2086) took 1252 ms. Trace:
I20260709 13:01:06.507479  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:06.508172  1618 raft_consensus.cc:2393] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 7: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:06.508476  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.508651  1586 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:06.494863  4875 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.511042  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2432) took 1911 ms. Trace:
I20260709 13:01:06.513512  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 409) took 1707 ms. Trace:
W20260709 13:01:06.484052  4964 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:01:06.580945  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 72367.2us
I20260709 13:01:06.580967  1542 raft_consensus.cc:2393] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:06.422531  4876 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.458741  4838 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.539104  1622 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:01:06.585364  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.529310  4851 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.553404  1541 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:06.531915  4747 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:06.531330  4870 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.581168  1546 rpcz_store.cc:276] 0709 13:01:04.805717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.937474 (+131757us) service_pool.cc:224] Handling call
0709 13:01:04.945674 (+  8200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.061001 (+115327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.061034 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:05.061073 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:05.061103 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.513261 (+1452158us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54001874d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:06.513303 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.513442 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264746368}
I20260709 13:01:06.580206  1543 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.512676  2209 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:06.581404  1545 rpcz_store.cc:276] 0709 13:01:04.599578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.599701 (+   123us) service_pool.cc:224] Handling call
0709 13:01:06.510890 (+1911189us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54001879d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:06.510983 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1733258496}
W20260709 13:01:06.562479  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 150093us
I20260709 13:01:06.537757  4829 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 13:01:06.546619  4901 consensus_meta.cc:287] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.000s
I20260709 13:01:06.579906  1694 rpcz_store.cc:276] 0709 13:01:05.254015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.401314 (+147299us) service_pool.cc:224] Handling call
0709 13:01:05.401757 (+   443us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:05.651678 (+249921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.651710 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:05.652272 (+   562us) log.cc:844] Serialized 52 byte log entry
0709 13:01:05.686625 (+ 34353us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:05.699073 (+ 12448us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.701575 (+  2502us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.701774 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.829285 (+127511us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b18002dfb20. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:01:06.391333 (+562048us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b48002502d8. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc496654aa1 00007fc49664bb37 00007fc49664b9ca 00007fc49674326f 00007fc496742f37 00007fc49675755c 00007fc496757508 00007fc496757488 00007fc496757443 00007fc4967566ec 00007fc495680a96
0709 13:01:06.505716 (+114383us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b540014f854. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:06.505766 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.505812 (+    46us) raft_consensus.cc:1685] finished
0709 13:01:06.505827 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.505981 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9662,"prepare.queue_time_us":36695,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":62,"raft.queue_time_us":6171,"raft.run_cpu_time_us":3290,"raft.run_wall_time_us":713356,"spinlock_wait_cycles":589077376,"thread_start_us":33745,"threads_started":1,"wal-append.queue_time_us":57662}
I20260709 13:01:06.586905  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.544341  4868 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 3. Current term is 4.
I20260709 13:01:06.537839  4975 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:06.525046  4883 consensus_queue.cc:260] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.592082  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2051) took 1473 ms. Trace:
I20260709 13:01:06.595700  4792 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.586366  4336 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:06.603701  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:06.599220  1511 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:06.545874  4852 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:06.600416  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 87873.2us
I20260709 13:01:06.603189  1545 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:06.601522  1621 rpcz_store.cc:276] 0709 13:01:05.118974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.581677 (+462703us) service_pool.cc:224] Handling call
0709 13:01:06.591852 (+1010175us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b540042ca54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:06.592022 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434697472}
I20260709 13:01:06.555095  4556 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.562618  4907 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.606153  2244 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:06.605641  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:06.609925  1621 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.610387  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:06.555299  4836 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.611069  2238 raft_consensus.cc:2393] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 7: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:06.588282  4876 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.616335  1511 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:06.619331  4868 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:06.605144  4741 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:06.609616  4883 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:06.605485  4975 raft_consensus.cc:697] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:06.629841  1538 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:01:06.592724  4708 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.622162  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:06.621688  1541 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:06.603168  4901 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.634586  1543 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:06.618314  4838 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.634073  4747 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.631762  4741 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.647090  4741 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:06.636256  4993 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:06.651396  4852 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.630461  4879 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.656390  4885 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.658854  4885 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.658612  4741 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.663578  4729 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.660751  4708 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.664825  1585 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:06.661002  1544 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:01:06.668973  1585 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:06.673887  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:06.662097  4870 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:06.664191  1659 leader_election.cc:400] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:06.664605  4747 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.664880  4741 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:06.675604  1659 leader_election.cc:403] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:06.676332  1543 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:06.686862  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39608
I20260709 13:01:06.689335  1538 raft_consensus.cc:606] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Received request to transfer leadership
I20260709 13:01:06.689833  1538 raft_consensus.cc:614] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:06.693634  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.698392  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.636454  4792 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:06.606737  4845 consensus_queue.cc:237] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.705708  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.708509  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.664180  4901 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.710789  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:06.711031  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.712198  1539 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:06.692378  4708 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.685755  4729 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:06.692139  4829 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:06.704463  4868 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:06.724138  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.724857  1538 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:06.695715  4838 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:06.701996  4741 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.727970  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.726174  4746 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.703876  4988 consensus_queue.cc:1059] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:01:06.722028  4901 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.708330  4870 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:01:06.723487  4829 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:06.724545  4868 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:06.738499  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.729369  4729 raft_consensus.cc:697] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:06.750080  1621 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:06.751991  1511 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:06.753631  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:06.754511  1621 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.755714  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:06.754801  1538 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:01:06.758294  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2466) took 1023 ms. Trace:
I20260709 13:01:06.733290  4885 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:06.758839  2209 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:06.735993  4997 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:06.758677  1546 rpcz_store.cc:276] 0709 13:01:05.735077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.593451 (+858374us) service_pool.cc:224] Handling call
0709 13:01:06.604547 (+ 11096us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.608578 (+  4031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.608608 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.615109 (+  6501us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.730669 (+115560us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:06.730712 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.730778 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.758100 (+ 27322us) raft_consensus.cc:1685] finished
0709 13:01:06.758118 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.758243 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3666,"raft.queue_time_us":4985,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":5319,"thread_start_us":95059,"threads_started":1,"wal-append.queue_time_us":131471}
I20260709 13:01:06.724912  4708 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:06.764452  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 1.06571e+06us
I20260709 13:01:06.742151  4829 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:06.731662  4838 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.766558  4796 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:06.731081  4741 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.747551  4868 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:06.766894  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.735802  4746 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:06.769886  4995 log.cc:927] Time spent T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:01:06.769937  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.791630  1546 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.767477  4997 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.793265  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.778061  4708 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:06.779088  4994 log.cc:927] Time spent T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:01:06.741412  4901 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.779803  4729 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.759677  4860 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:06.765419  4885 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.783123  1543 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:01:06.785775  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:06.801901  2238 raft_consensus.cc:2410] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:01:06.788815  1621 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:06.734998  4975 consensus_queue.cc:237] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.804414  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:06.799817  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:06.806844  4885 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:06.807677  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:06.808236  4901 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.808903  4860 raft_consensus.cc:697] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:06.808697  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:06.809964  4860 consensus_queue.cc:237] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.811662  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:06.813374  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2501) took 1127 ms. Trace:
I20260709 13:01:06.813575  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:06.813817  1622 rpcz_store.cc:276] 0709 13:01:05.685858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.310609 (+624751us) service_pool.cc:224] Handling call
0709 13:01:06.311080 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.586043 (+274963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.813103 (+227060us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54001e8554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:06.813314 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523629440}
I20260709 13:01:06.815753  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2477) took 2118 ms. Trace:
I20260709 13:01:06.816203  1616 rpcz_store.cc:276] 0709 13:01:04.696904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.997703 (+300799us) service_pool.cc:224] Handling call
0709 13:01:05.033458 (+ 35755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.421315 (+387857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.815510 (+1394195us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b540024ead4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:06.815693 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872406912}
I20260709 13:01:06.817024  4997 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.817332  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:06.818109  1616 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 11: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:06.815032  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:06.819689  1622 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:06.820868  4851 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.824498  4827 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:06.825803  4851 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:06.793080  4836 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:06.828670  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1370) took 1203 ms. Trace:
I20260709 13:01:06.829172  1695 rpcz_store.cc:276] 0709 13:01:05.625549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.693123 (+ 67574us) service_pool.cc:224] Handling call
0709 13:01:05.701949 (+  8826us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.155422 (+453473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.828340 (+672918us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54002689d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:06.828594 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":961967488}
I20260709 13:01:06.830763  4916 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:06.809877  4838 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:06.831666  1621 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
W20260709 13:01:06.835381  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.797909  4796 raft_consensus.cc:697] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:06.843214  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:06.843899  1688 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.844030  4796 consensus_queue.cc:237] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.844792  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:06.845341  1694 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.845604  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:06.846688  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.847584  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:06.848147  1691 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.804504  1511 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:06.848716  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 44298.1us
I20260709 13:01:06.848903  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:06.849642  1619 raft_consensus.cc:2393] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:06.850459  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:06.850924  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:06.854236  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:06.856793  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:06.857297  1696 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.858100  1542 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:06.858559  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:06.858785  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:06.859344  1689 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.860715  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:06.861851  1693 raft_consensus.cc:2410] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:01:06.862643  4851 consensus_queue.cc:1059] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:06.862937  4877 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:06.863523  4877 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.863999  4851 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:06.864502  4851 raft_consensus.cc:697] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:06.865348  4851 consensus_queue.cc:237] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.866254  4877 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:06.867417  4997 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:06.867676  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:06.868058  4885 raft_consensus.cc:3055] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:06.867939  4997 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:06.868465  4885 raft_consensus.cc:740] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:06.869479  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 2037) took 1811 ms. Trace:
I20260709 13:01:06.869233  4885 consensus_queue.cc:260] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:06.869891  1617 rpcz_store.cc:276] 0709 13:01:05.058498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.630962 (+572464us) service_pool.cc:224] Handling call
0709 13:01:06.103124 (+472162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.143156 (+ 40032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.869271 (+726115us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b540024f9d0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:06.869420 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085177088}
I20260709 13:01:06.870417  4885 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.870842  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:06.872866  1692 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:06.871354  1688 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:06.871969  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:06.819767  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:06.878647  1687 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:06.879878  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:06.882876  1696 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
W20260709 13:01:06.884327  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 220270us
I20260709 13:01:06.885042  4785 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
W20260709 13:01:06.888628  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 104017us
I20260709 13:01:06.907968  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:06.908067  1660 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:06.888862  1539 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:06.889134  1691 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
W20260709 13:01:06.889583  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 130786us
I20260709 13:01:06.889778  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:06.911903  1538 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:06.912837  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:06.894975  1694 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:06.871188  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:06.899113  1687 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:06.899446  1689 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:06.906302  1659 leader_election.cc:400] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11.
I20260709 13:01:06.915632  1659 leader_election.cc:403] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:06.901296  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:06.890791  1546 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:06.917310  1546 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:06.918054  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:06.870529  4997 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:06.867677  4916 consensus_queue.cc:1059] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:01:06.925938  1538 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:07.497370  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:07.521903  2239 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:01:07.084587  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:06.901628  4883 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:06.949120  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:07.174494  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:07.564460  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:07.559844  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:06.929009  1622 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
W20260709 13:01:07.522727  1614 consensus_meta.cc:287] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.000s
I20260709 13:01:06.969976  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:07.566779  1614 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:07.328341  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:07.566286  1689 raft_consensus.cc:2393] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:06.955678  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:07.077888  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.096467  1691 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
W20260709 13:01:07.471412  1619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.006s	sys 0.013s
W20260709 13:01:07.573431  1619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.006s	sys 0.016s
I20260709 13:01:06.949867  1541 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:01:07.556977  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 648850us
I20260709 13:01:07.576395  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:07.575994  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:07.577904  1538 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 3.
I20260709 13:01:06.896692  4792 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:01:07.450964  4868 consensus_meta.cc:287] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.000s
I20260709 13:01:07.518576  4797 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11.
W20260709 13:01:07.449937  4907 consensus_meta.cc:287] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.833s	user 0.009s	sys 0.001s
I20260709 13:01:06.935909  4841 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:07.344844  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:07.359313  1512 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:07.068820  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:06.996266  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:07.590741  1622 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:01:07.591488  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2505) took 1894 ms. Trace:
I20260709 13:01:07.591987  1622 rpcz_store.cc:276] 0709 13:01:05.697592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.590138 (+1892546us) service_pool.cc:224] Handling call
0709 13:01:07.590498 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.591253 (+   755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.591438 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:07.575374  4941 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:07.591409  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 232172us
I20260709 13:01:07.058627  1687 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:01:07.593636  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 562) took 1873 ms. Trace:
W20260709 13:01:07.507701  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 588723us
I20260709 13:01:07.593978  4941 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:07.594210  1622 rpcz_store.cc:276] 0709 13:01:05.720568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.592896 (+1872328us) service_pool.cc:224] Handling call
0709 13:01:07.593175 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.593340 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.593366 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:07.593406 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:07.593433 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.593487 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.593586 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:07.589022  4907 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:07.595742  1622 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:07.595835  1616 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 12: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:07.596297  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 2069) took 1604 ms. Trace:
I20260709 13:01:07.596547  4907 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:07.591464  4841 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:07.587961  4868 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:07.598484  4990 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.599028  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:07.599376  1538 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:07.596654  1622 rpcz_store.cc:276] 0709 13:01:05.994305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.595175 (+1600870us) service_pool.cc:224] Handling call
0709 13:01:07.595457 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.596074 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.596250 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:07.601735  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:07.603281  4875 raft_consensus.cc:3055] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:07.605036  4868 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:07.605523  1546 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:07.608207  1696 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:01:07.609632  4446 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:07.610162  1659 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:07.610435  4921 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:07.611045  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.611570  1691 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:07.613619  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:07.636569  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:06.958732  4870 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:07.637176  1687 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:06.906939  4838 consensus_queue.cc:1059] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.709s
I20260709 13:01:07.616222  1587 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:07.097157  4796 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.628814  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:07.639966  4921 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:07.638057  4446 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:07.615909  4875 raft_consensus.cc:740] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:07.644791  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:07.616567  1538 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:07.649829  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:07.650871  1694 raft_consensus.cc:2393] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 7: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:07.614522  4841 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:06.935070  4829 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:07.699615  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:07.701072  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:07.702222  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:07.706022  2240 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:07.707791  4729 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.708596  4729 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:07.711804  4838 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.712524  4838 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:07.715909  4838 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:07.715793  4875 consensus_queue.cc:260] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:07.717214  4875 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:07.717453  4921 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:07.718101  4921 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:07.638784  4797 consensus_queue.cc:1059] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:01:07.719796  4797 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:07.647455  4870 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:07.727392  4997 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:07.728464  4870 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:07.728173  4997 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:07.661895  4860 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.032s	sys 0.069s
I20260709 13:01:07.730388  4997 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:07.730566  4860 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.032s	sys 0.069s
I20260709 13:01:07.732147  1617 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:07.732771  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2473) took 3039 ms (client timeout 1627 ms). Trace:
W20260709 13:01:07.733191  1614 rpcz_store.cc:269] 0709 13:01:04.693064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.693176 (+   112us) service_pool.cc:224] Handling call
0709 13:01:07.732553 (+3039377us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b54003205d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:07.732663 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5295050112}
I20260709 13:01:07.733808  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2503) took 2042 ms. Trace:
I20260709 13:01:07.651998  4446 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.734153  1617 rpcz_store.cc:276] 0709 13:01:05.691744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.920037 (+1228293us) service_pool.cc:224] Handling call
0709 13:01:07.503344 (+583307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.732505 (+229161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.733563 (+  1058us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b540033c554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:07.733732 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525693312}
I20260709 13:01:07.735194  4841 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:07.738368  4841 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:07.739187  4841 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:07.739742  4841 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:07.653117  4796 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:07.746421  1687 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:07.748857  1687 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:07.753348  1541 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:07.779635  1687 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:07.781363  1687 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:07.788381  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:07.789404  1694 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:07.733201  4829 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:07.796787  4796 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:07.797250  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2063) took 1807 ms (client timeout 2401 ms). Trace:
W20260709 13:01:07.797785  1620 rpcz_store.cc:269] 0709 13:01:05.990030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.012757 (+ 22727us) service_pool.cc:224] Handling call
0709 13:01:07.797003 (+1784246us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b5400201cd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:07.797177 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107983104}
I20260709 13:01:07.799736  1613 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:01:07.801347  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2492) took 2127 ms. Trace:
I20260709 13:01:07.801779  1613 rpcz_store.cc:276] 0709 13:01:05.673663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.306651 (+632988us) service_pool.cc:224] Handling call
0709 13:01:07.799415 (+1492764us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.800188 (+   773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.801133 (+   945us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400201cd0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:07.801282 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3404620032}
I20260709 13:01:07.785336  4997 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.804188  4997 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:07.805167  4860 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.805754  4860 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:07.806692  4997 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:07.808108  4860 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:07.811755  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 552) took 2172 ms. Trace:
I20260709 13:01:07.812276  2241 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:07.812227  1615 rpcz_store.cc:276] 0709 13:01:05.639585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.172690 (+533105us) service_pool.cc:224] Handling call
0709 13:01:06.592015 (+419325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.592216 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.592242 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.592284 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:06.592315 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.592374 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.811573 (+1219199us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b540042ca50. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:07.811695 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938458368}
I20260709 13:01:07.815716  4841 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:07.818365  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 432) took 1128 ms. Trace:
I20260709 13:01:07.792695  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42846 (request call id 9) took 1021 ms. Trace:
I20260709 13:01:07.789786  4921 raft_consensus.cc:3055] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:07.818858  1546 rpcz_store.cc:276] 0709 13:01:06.690391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.918523 (+228132us) service_pool.cc:224] Handling call
0709 13:01:07.518577 (+600054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.635959 (+117382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.818089 (+182130us) spinlock_profiling.cc:243] Waited 86.7 ms on lock 0x7b54003c41d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:07.818294 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199502208}
I20260709 13:01:07.819342  1541 rpcz_store.cc:276] 0709 13:01:06.770997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.790349 (+1019352us) service_pool.cc:224] Handling call
0709 13:01:07.792614 (+  2265us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:07.863998  1493 auto_rebalancer.cc:893] Removing replace marker failed: Replica d7158d6c3b634dc7abb69eac58eba291 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:01:07.864583  1493 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:01:07.864914  1493 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:01:07.827069  4446 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:07.872772  1696 raft_consensus.cc:2393] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:07.873754  4446 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:07.823982  4921 raft_consensus.cc:740] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:01:07.887735  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2465) took 2155 ms (client timeout 2124 ms). Trace:
W20260709 13:01:07.888334  1540 rpcz_store.cc:269] 0709 13:01:05.732766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.026919 (+294153us) service_pool.cc:224] Handling call
0709 13:01:07.887475 (+1860556us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x7b54000b6154. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:07.887651 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122699008}
I20260709 13:01:07.887900  4446 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:07.899922  4446 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:07.902825  4446 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:07.941383  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.954957  1621 raft_consensus.cc:1240] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:07.956928  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:07.957665  1617 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:07.959259  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:07.966025  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:07.967183  1621 raft_consensus.cc:2393] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 8: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:07.968048  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:07.944885  4989 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.980811  1613 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:07.968189  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:07.990689  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 347470us
I20260709 13:01:07.947062  4796 consensus_queue.cc:1059] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:01:08.000896  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:07.982410  4446 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:08.003880  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 393721us
I20260709 13:01:08.004505  1613 raft_consensus.cc:1275] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:08.010264  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2461) took 2292 ms. Trace:
I20260709 13:01:08.010752  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:08.011461  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:08.011673  1613 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:01:08.010670  1544 rpcz_store.cc:276] 0709 13:01:05.717369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.159338 (+441969us) service_pool.cc:224] Handling call
0709 13:01:06.159662 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.667004 (+507342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.010008 (+1343004us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b540006a4d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:08.010203 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152108288}
I20260709 13:01:07.988967  4988 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.005777  1617 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:01:08.005941  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:08.015564  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 367889us
I20260709 13:01:08.016713  1587 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:07.945422  4921 consensus_queue.cc:260] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:08.017654  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 423374us
I20260709 13:01:08.019373  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1359) took 1306 ms. Trace:
I20260709 13:01:07.989212  4989 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:08.032485  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2502) took 2342 ms. Trace:
I20260709 13:01:08.030932  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:08.039358  1512 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:08.033634  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2112) took 1191 ms. Trace:
I20260709 13:01:08.042040  1695 rpcz_store.cc:276] 0709 13:01:06.842138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.849042 (+  6904us) service_pool.cc:224] Handling call
0709 13:01:06.900776 (+ 51734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.901014 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:06.934808 (+ 33794us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.031596 (+1096788us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.031685 (+    89us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:08.033367 (+  1682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.033442 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.033565 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":671923,"prepare.queue_time_us":33648,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":6476,"raft.queue_time_us":668844,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":69,"thread_start_us":431049,"threads_started":1}
I20260709 13:01:08.030730  1547 rpcz_store.cc:276] 0709 13:01:06.712771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.923510 (+210739us) service_pool.cc:224] Handling call
0709 13:01:06.979776 (+ 56266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.980041 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:06.980362 (+   321us) log.cc:844] Serialized 14 byte log entry
0709 13:01:07.561093 (+580731us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.019010 (+457917us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.019068 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:08.019126 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.019194 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.019319 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88959,"prepare.queue_time_us":2166,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":3314,"raft.queue_time_us":90707,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":140,"spinlock_wait_cycles":16768,"thread_start_us":948809,"threads_started":2,"wal-append.queue_time_us":665108}
I20260709 13:01:08.035769  1619 rpcz_store.cc:276] 0709 13:01:05.690416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.896497 (+1206081us) service_pool.cc:224] Handling call
0709 13:01:06.901771 (+  5274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.902068 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:06.950125 (+ 48057us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.031903 (+1081778us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.032082 (+   179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.032123 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:08.032176 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.032263 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.032416 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28882,"prepare.queue_time_us":55587,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":29624,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":59328256,"thread_start_us":1052231,"threads_started":2,"wal-append.queue_time_us":665908}
I20260709 13:01:08.019342  4900 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:08.090528  5013 log.cc:927] Time spent T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:01:08.097245  1620 raft_consensus.cc:2410] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:01:08.101872  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 62616.7us
I20260709 13:01:08.102931  1512 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:08.013957  4446 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:08.131553  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:08.206599  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 94449.9us
I20260709 13:01:08.207803  1512 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:08.209668  1512 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:08.047631  4860 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:08.018420  4988 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:08.051458  4921 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:08.108868  4838 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:08.248632  4990 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:08.284096  4705 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:08.061293  4900 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:08.349723  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.024s	sys 0.043s
W20260709 13:01:08.350226  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.024s	sys 0.043s
W20260709 13:01:08.350705  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 740543us
W20260709 13:01:08.283814  4947 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.011s	sys 0.031s
I20260709 13:01:08.326601  4851 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:08.275964  4792 consensus_queue.cc:1059] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.080s
W20260709 13:01:08.422894  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:08.421175  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 427) took 1732 ms (client timeout 2142 ms). Trace:
W20260709 13:01:08.429944  1539 rpcz_store.cc:269] 0709 13:01:06.689012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.715543 (+ 26531us) service_pool.cc:224] Handling call
0709 13:01:08.421007 (+1705464us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400193054. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:08.421118 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323283840}
I20260709 13:01:08.431393  4329 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.323983  4870 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.108s
W20260709 13:01:08.373793  1688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.024s	sys 0.030s
W20260709 13:01:08.432610  1688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.024s	sys 0.037s
I20260709 13:01:08.329216  4860 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:08.410609  5016 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:01:08.352623  4816 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.016s	sys 0.032s
W20260709 13:01:08.408831  4785 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.014s	sys 0.039s
I20260709 13:01:08.434262  5016 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:08.431977  4329 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:08.438817  4778 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.439960  4778 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:08.349066  4705 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:08.441414  4907 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:08.442659  4778 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:08.435870  4816 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.017s	sys 0.037s
W20260709 13:01:08.435956  4785 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.015s	sys 0.039s
I20260709 13:01:08.394474  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2467) took 2615 ms. Trace:
I20260709 13:01:08.447503  1545 rpcz_store.cc:276] 0709 13:01:05.778747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.601026 (+822279us) service_pool.cc:224] Handling call
0709 13:01:06.601423 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.605154 (+  3731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.394184 (+1789030us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b54002fadd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:08.394404 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3707776}
I20260709 13:01:08.449658  4829 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:08.450554  4829 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.435748  4876 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:08.444656  4988 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:08.451085  4829 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:08.443368  4329 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:08.454478  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:08.390195  1538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.017s	sys 0.033s
W20260709 13:01:08.490999  1538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.018s	sys 0.034s
W20260709 13:01:08.429201  4947 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.012s	sys 0.032s
W20260709 13:01:08.535581  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 67774.5us
I20260709 13:01:08.536487  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:08.347901  4838 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:01:08.541612  1614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.010s	sys 0.001s
W20260709 13:01:08.551757  1614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.011s	sys 0.001s
I20260709 13:01:08.540087  4851 raft_consensus.cc:697] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:08.541374  4982 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.523687  4816 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:01:08.566366  4851 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:08.565907  4982 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:08.571364  4982 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:08.553364  5019 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.572238  5019 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:08.552292  4860 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:08.576373  4860 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:08.575009  5019 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:08.583631  2210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.004s	sys 0.009s
W20260709 13:01:08.584017  2210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.004s	sys 0.009s
I20260709 13:01:08.563308  4989 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:08.582442  4875 consensus_meta.cc:287] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.864s	user 0.010s	sys 0.001s
I20260709 13:01:08.553920  4838 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:08.598274  4829 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:08.601397  4838 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:08.595353  4941 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:08.596606  5029 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:08.597534  4900 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:08.611984  4911 raft_consensus.cc:3055] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:08.612592  4911 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:08.613634  4911 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:08.606912  5029 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:08.615748  5029 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:08.621603  4997 raft_consensus.cc:3055] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:08.622107  4997 raft_consensus.cc:740] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:08.621807  4911 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:08.623014  4997 consensus_queue.cc:260] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:08.646298  4997 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:08.657912  5012 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.997s	user 0.000s	sys 0.012s
W20260709 13:01:08.665364  5017 log.cc:927] Time spent T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:01:08.667308  5010 log.cc:927] Time spent T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 1.739s	user 0.005s	sys 0.027s
I20260709 13:01:08.672640  5029 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:08.675791  5016 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:08.715209  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:08.716917  1511 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.013s	sys 0.016s
W20260709 13:01:08.717464  1511 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.014s	sys 0.016s
W20260709 13:01:08.718075  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 699312us
W20260709 13:01:08.719655  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.005s	sys 0.027s
W20260709 13:01:08.720186  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.005s	sys 0.027s
I20260709 13:01:08.720402  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 2076) took 2124 ms. Trace:
W20260709 13:01:08.716924  1512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.037s	sys 0.043s
W20260709 13:01:08.721256  1512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.037s	sys 0.043s
W20260709 13:01:08.721858  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 512171us
I20260709 13:01:08.721073  1622 rpcz_store.cc:276] 0709 13:01:06.595361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.613337 (+1017976us) service_pool.cc:224] Handling call
0709 13:01:07.613618 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.643323 (+ 29705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.643354 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:07.643871 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:01:07.992808 (+348937us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:07.992846 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.992909 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.664592 (+671683us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:08.719257 (+ 54665us) raft_consensus.cc:1685] finished
0709 13:01:08.719356 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.720072 (+   716us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6877,"raft.queue_time_us":24491,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":2975,"spinlock_wait_cycles":3694464,"thread_start_us":348570,"threads_started":1,"wal-append.queue_time_us":764282}
W20260709 13:01:08.720557  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 718627us
I20260709 13:01:08.725726  1586 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:08.725838  1659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.025s	sys 0.044s
W20260709 13:01:08.728937  1659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.026s	sys 0.044s
W20260709 13:01:08.729339  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 714953us
I20260709 13:01:08.733594  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 477) took 1125 ms. Trace:
I20260709 13:01:08.734187  1688 rpcz_store.cc:276] 0709 13:01:07.607471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.614706 (+  7235us) service_pool.cc:224] Handling call
0709 13:01:07.614993 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.625027 (+ 10034us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.625066 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:07.625664 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.433307 (+807643us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:08.433354 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.433486 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.732808 (+299322us) raft_consensus.cc:1685] finished
0709 13:01:08.732865 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.733226 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9643,"raft.queue_time_us":123678,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":780714,"threads_started":1,"wal-append.queue_time_us":961705}
W20260709 13:01:08.739019  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2065) took 2748 ms (client timeout 2680 ms). Trace:
W20260709 13:01:08.739715  1618 rpcz_store.cc:269] 0709 13:01:05.990446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.023908 (+ 33462us) service_pool.cc:224] Handling call
0709 13:01:08.738390 (+2714482us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b540033b654. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:08.738691 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111137152}
I20260709 13:01:08.743031  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2080) took 2144 ms. Trace:
I20260709 13:01:08.743587  1616 rpcz_store.cc:276] 0709 13:01:06.598834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.871747 (+272913us) service_pool.cc:224] Handling call
0709 13:01:08.742412 (+1870665us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b540042c054. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:08.742748 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1649222528}
I20260709 13:01:08.745949  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 479) took 1137 ms. Trace:
I20260709 13:01:08.746474  1696 rpcz_store.cc:276] 0709 13:01:07.608057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.637465 (+ 29408us) service_pool.cc:224] Handling call
0709 13:01:08.745355 (+1107890us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400133b54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:08.745642 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514000768}
W20260709 13:01:08.736292  1543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2481) took 2048 ms (client timeout 2141 ms). Trace:
W20260709 13:01:08.751725  1543 rpcz_store.cc:269] 0709 13:01:06.688159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.709413 (+ 21254us) service_pool.cc:224] Handling call
0709 13:01:08.735768 (+2026355us) spinlock_profiling.cc:243] Waited 70 ms on lock 0x7b54001289d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:08.736028 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160947584}
I20260709 13:01:08.753922  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1342) took 2721 ms. Trace:
I20260709 13:01:08.754441  1542 rpcz_store.cc:276] 0709 13:01:06.032203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.607836 (+575633us) service_pool.cc:224] Handling call
0709 13:01:06.636653 (+ 28817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.858485 (+221832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.733298 (+1874813us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b5400123754. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:08.753420 (+ 20122us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b5400123750. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:08.753673 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":573237888}
W20260709 13:01:08.755527  2209 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.007s	sys 0.006s
W20260709 13:01:08.755681  1659 connection.cc:256] RPC call timeout handler was delayed by -1.1044038229999842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
I20260709 13:01:08.586225  4446 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:08.755999  1692 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.004s	sys 0.008s
I20260709 13:01:08.723492  1512 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:08.764809  2245 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.018s	sys 0.025s
W20260709 13:01:08.781482  2209 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.008s	sys 0.006s
W20260709 13:01:08.810653  2245 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.019s	sys 0.025s
W20260709 13:01:08.583523  4841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.008s	sys 0.004s
W20260709 13:01:08.811611  1692 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.005s	sys 0.009s
W20260709 13:01:08.584403  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 639824us
W20260709 13:01:08.836270  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.836412  5016 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:08.836344  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.838613  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1381) took 1920 ms. Trace:
I20260709 13:01:08.840936  5043 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:08.839380  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.841602  5043 raft_consensus.cc:697] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:08.839074  1692 rpcz_store.cc:276] 0709 13:01:06.918577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.918733 (+   156us) service_pool.cc:224] Handling call
0709 13:01:06.919004 (+   271us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:07.505923 (+586919us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.505968 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:07.506695 (+   727us) log.cc:844] Serialized 52 byte log entry
0709 13:01:08.000223 (+493528us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:08.837562 (+837339us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.838054 (+   492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.838201 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.838282 (+    81us) raft_consensus.cc:1685] finished
0709 13:01:08.838295 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.838556 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":647012,"prepare.queue_time_us":598560,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":599519,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":114,"thread_start_us":1179865,"threads_started":2,"wal-append.queue_time_us":988236}
W20260709 13:01:08.844379  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 121265us
W20260709 13:01:08.845202  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 85770.4us
W20260709 13:01:08.839213  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 109035us
I20260709 13:01:08.846416  1586 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:08.848645  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:08.852555  5043 consensus_queue.cc:237] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:08.855970  4987 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.856995  4987 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:08.857295  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 320601us
I20260709 13:01:08.861268  5029 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:08.863333  4841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.008s	sys 0.005s
I20260709 13:01:08.864488  4993 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.865463  4993 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:08.868160  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:08.870242  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.000s	sys 0.015s
W20260709 13:01:08.870684  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.000s	sys 0.015s
I20260709 13:01:08.871649  4841 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:08.872347  4841 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:08.872969  4841 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:08.879025  4446 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.880017  4446 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:08.880851  4788 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.881640  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:08.884194  5029 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:08.884488  4446 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:08.884876  5029 raft_consensus.cc:697] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:01:08.886426  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 869655us
I20260709 13:01:08.888346  1587 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:08.887845  5029 consensus_queue.cc:237] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:08.889839  4746 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:08.891330  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 1.04546e+06us
I20260709 13:01:08.894151  4741 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:08.897586  2245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 760) took 1827 ms. Trace:
I20260709 13:01:08.899334  5006 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:08.900218  5006 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:08.902649  5016 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:08.903561  5016 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:08.848642  4705 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:08.910482  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:08.910773  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 64606.8us
I20260709 13:01:08.911525  1618 raft_consensus.cc:2393] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:08.911790  1586 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:08.913180  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:08.913427  4916 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:08.913954  1616 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:08.914364  4916 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:08.920255  1511 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:08.921604  5045 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:08.922461  1511 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:08.922585  5045 consensus_queue.cc:1059] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:08.923908  4729 raft_consensus.cc:3055] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:08.923730  5042 consensus_queue.cc:1059] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:08.924332  4729 raft_consensus.cc:740] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:08.925289  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:08.925438  5042 raft_consensus.cc:3055] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:08.925938  5042 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:08.925805  4729 consensus_queue.cc:260] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:08.926172  5035 consensus_queue.cc:1059] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:08.706256   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:08.930637  4729 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.933525  4868 raft_consensus.cc:3055] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:08.933802  4883 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:08.934167  4868 raft_consensus.cc:740] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:08.934752  4883 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:08.935750  4868 consensus_queue.cc:260] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:08.937338  4868 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:08.937805  4883 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:08.898013  2245 rpcz_store.cc:276] 0709 13:01:07.070334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.504101 (+433767us) service_pool.cc:224] Handling call
0709 13:01:07.541932 (+ 37831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.542215 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:08.019752 (+477537us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.896785 (+877033us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.896911 (+   126us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:08.897093 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.897243 (+   150us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.897443 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":996827,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":64668,"thread_start_us":1242704,"threads_started":2,"wal-append.queue_time_us":629986}
I20260709 13:01:08.942281  1587 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:08.881704  4788 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:08.966074  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 84916.3us
I20260709 13:01:08.975311  4929 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:08.975625  4987 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:08.976331  4929 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.977207  4929 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:08.978047  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:08.980259  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:08.982318  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:08.983353  1619 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:01:08.983795  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:08.984704  1621 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:08.984766  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:08.985508  5041 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.985745  1617 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:08.986637  5016 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:08.931879  5006 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:08.987120  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:08.987710  5041 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:08.988355  1615 raft_consensus.cc:2393] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 8: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:08.990751  5041 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:08.991124  1660 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:08.992187  1622 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:08.993273  4793 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:08.993897  4793 raft_consensus.cc:697] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:01:08.995388  2211 connection.cc:256] RPC call timeout handler was delayed by -1.1938756559999888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
I20260709 13:01:08.998891  4741 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.999662  4741 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:09.002067  4921 consensus_meta.cc:287] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.712s	user 0.012s	sys 0.005s
I20260709 13:01:08.994992  4793 consensus_queue.cc:237] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.004125  4993 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:09.005179  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 93540.4us
I20260709 13:01:09.006211  4796 consensus_queue.cc:1059] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:09.006485  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:09.006434  5042 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.007483  2244 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 3.
I20260709 13:01:09.007570  5006 consensus_queue.cc:1048] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:09.008283  5042 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:09.009797  4877 raft_consensus.cc:3055] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:09.010383  4877 raft_consensus.cc:740] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:09.010974  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:09.011575  4877 consensus_queue.cc:260] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.009858  2210 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:09.012845  4877 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:09.012924  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:09.002280  4741 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:09.017530  4741 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:09.006243  1586 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:09.018097  4741 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.018664  4741 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:08.966516  4788 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:09.021862  5016 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:08.998999  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 434) took 2085 ms. Trace:
W20260709 13:01:09.027355  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 104147us
I20260709 13:01:09.028645  1616 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:09.029323  1586 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:09.029623  1622 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:09.030948  5036 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:09.024360  1538 rpcz_store.cc:276] 0709 13:01:06.913509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.662526 (+749017us) service_pool.cc:224] Handling call
0709 13:01:07.688598 (+ 26072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.740296 (+ 51698us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:07.776423 (+ 36127us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.995618 (+1219195us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.995943 (+   325us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.996033 (+    90us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:08.996085 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.998571 (+  2486us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b54001284d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:08.998611 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.998810 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59999,"prepare.queue_time_us":168766,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":70362,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":250,"spinlock_wait_cycles":118297472,"thread_start_us":1069917,"threads_started":2,"wal-append.queue_time_us":820859}
I20260709 13:01:09.025839  1441 catalog_manager.cc:5697] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 3 to 4, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 4 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.067524  4929 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:09.069303  4841 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.070698  1692 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:09.071442  1441 catalog_manager.cc:5697] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 4 to 6, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:01:09.075663  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 84847.8us
I20260709 13:01:09.076472  1660 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:09.076553  2209 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:09.077505  1660 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:09.080021  5035 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:09.080470  5035 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:09.080860  5035 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:09.079021  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:09.032148  4916 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:09.091462  4788 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:09.092274  5050 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:09.092916  5016 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.108541  1441 catalog_manager.cc:5697] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 3 to 8, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:09.093647  4947 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:09.095531  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 173295us
I20260709 13:01:09.099714  1586 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:09.108309  1660 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:09.109109  5016 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.094161  5036 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:09.100225  5048 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:01:09.122589  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 174066us
W20260709 13:01:09.131083  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 44204us
I20260709 13:01:09.130602  5048 raft_consensus.cc:697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:01:09.134804  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 43704.2us
I20260709 13:01:09.064141  4921 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:09.143869  5048 consensus_queue.cc:237] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.145848  4997 consensus_queue.cc:1059] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:09.147439  4841 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:09.147284  1441 catalog_manager.cc:5697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:09.150357  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.150919  4911 consensus_meta.cc:287] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.514s	user 0.005s	sys 0.006s
I20260709 13:01:09.149745  1441 catalog_manager.cc:5697] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 4 to 8, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 8 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.109818  5050 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:09.111645  4788 raft_consensus.cc:697] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:09.158466  2209 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:09.171437  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 64685.6us
I20260709 13:01:09.173419  2244 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:09.156566  4796 consensus_queue.cc:1243] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:09.175294  4796 raft_consensus.cc:3055] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:09.175449  1696 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:01:09.176173  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 68057.4us
I20260709 13:01:09.177175  1660 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:09.177779  4975 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.178601  4975 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.180047  1441 catalog_manager.cc:5697] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.140051  5036 consensus_queue.cc:1243] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:09.151700  4874 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.181010  4975 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:09.184865  4975 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:09.177845  4907 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.184206  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:09.153877  4933 raft_consensus.cc:3055] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:01:09.183874  1445 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42122 (request call id 240) took 15403 ms (client timeout 15000 ms). Trace:
I20260709 13:01:09.161316  5050 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:09.182917  1441 catalog_manager.cc:5697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.184080  4874 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.200893  4874 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:09.201820  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:09.201831  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:09.183975  4796 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:09.168339  4746 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:01:09.205117  5047 consensus_queue.cc:1059] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:01:09.206651  5047 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:09.206887  5006 raft_consensus.cc:3055] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:09.207358  5006 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:09.163012  4947 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.201102  1441 catalog_manager.cc:5697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 3 to 4, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 4 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.183305  5029 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:09.181867  4788 consensus_queue.cc:237] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.188390  4907 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.214494  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:09.215265  4907 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:09.193899  4933 raft_consensus.cc:740] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:09.217206  4933 consensus_queue.cc:260] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.218883  4933 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:09.220778  4997 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:01:09.222870  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 45927.8us
I20260709 13:01:09.223935  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:09.224601  2240 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:09.224655  5038 consensus_queue.cc:1059] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:09.224933  5029 consensus_queue.cc:1059] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:09.226229  4841 raft_consensus.cc:3055] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:09.226668  4841 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:09.226806  5028 raft_consensus.cc:3055] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:09.227293  5028 raft_consensus.cc:740] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:09.227783  4841 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.228303  5028 consensus_queue.cc:260] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.229753  5028 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:09.230918  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 131451us
I20260709 13:01:09.231168  1690 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:09.194090  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:09.226012  5029 consensus_queue.cc:1059] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:09.231047  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.238039  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.238466  5016 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:09.237870  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.239427  1696 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:01:09.239459  4911 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:09.238102  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.231868  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.229317  4841 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:09.239465  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 80897.7us
I20260709 13:01:09.237849  4907 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.231920  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.243269  1693 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:09.252420  1692 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:09.245029  4796 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.208424  5006 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.239045  5016 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:01:09.265560  4796 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:09.271680  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.248013  4911 raft_consensus.cc:697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:09.279132  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.269966  4929 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:01:09.280197  4911 consensus_queue.cc:237] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.283517  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.284371  1538 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:09.286837  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:09.288182  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.245702  4921 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:09.253788  4874 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:01:09.289610  5036 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.292382  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.289764  5016 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.313339  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:09.313627  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:09.313804  5016 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:09.300680  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.302166  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.315323  2245 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:09.316828  1618 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:01:09.302871  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.307992  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.308830  1541 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:09.309988  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.311483  1538 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:09.262888  4947 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:09.312798  5036 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.323339  4797 consensus_queue.cc:1059] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:09.324800  4797 raft_consensus.cc:3055] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:09.325173  4797 raft_consensus.cc:740] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:09.326141  4797 consensus_queue.cc:260] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.326952  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:09.314311  2239 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:01:09.312005  4816 consensus_queue.cc:1059] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:01:09.328325  4816 raft_consensus.cc:3055] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:09.328706  4816 raft_consensus.cc:740] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:09.328758  4796 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:09.329905  4816 consensus_queue.cc:260] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.331607  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:09.320858  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 46741.4us
I20260709 13:01:09.334486  4785 consensus_queue.cc:1059] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:09.335429  5029 raft_consensus.cc:3055] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:09.335343  4785 consensus_queue.cc:1059] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:09.300079  4907 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.335865  5029 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:09.336964  4785 raft_consensus.cc:3055] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:09.336802  5029 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.337356  4785 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:09.337796  4907 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:09.338089  5029 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:09.321583  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.338843  4785 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.338569  1441 catalog_manager.cc:5697] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 2 to 4, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:09.340188  4785 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:09.341166  5016 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:09.341588  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.340593  1441 catalog_manager.cc:5697] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 3 to 5, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 5 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.341974  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:09.342690  2244 raft_consensus.cc:2393] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:09.325018  5036 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:09.331110  4816 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:09.352701  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:09.353051  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:09.353427  2239 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:09.355665  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:09.356350  2244 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:01:09.319941  5047 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:09.359630  5047 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:09.360805  5047 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.362370  5047 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.362640  2239 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:09.364755  5038 raft_consensus.cc:3055] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:09.365326  5038 raft_consensus.cc:740] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:09.266211  4446 consensus_queue.cc:1059] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:01:09.370388  4446 raft_consensus.cc:3055] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:09.370812  4446 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:09.371876  4796 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:09.371901  4446 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.374373  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.374678  4446 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:09.375299  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.376848  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.377488  1693 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
W20260709 13:01:09.377981  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.377317  5035 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.379293  5024 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.379516  5006 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:09.379957  5024 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.382126  5024 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:09.352701  2211 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:09.383580  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 84220.7us
I20260709 13:01:09.386139  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:09.387197  5068 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:09.387401  1696 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:09.391563  4793 raft_consensus.cc:2804] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:09.391957  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.392108  4793 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.392629  4793 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:09.393237  4797 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:09.395994  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:09.399113  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.399483  1511 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:09.400374  1540 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:09.401774  5043 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:09.402212  5043 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.402562  5043 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.402738  5024 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.403290  5024 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.405423  5024 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:09.194028  1445 rpcz_store.cc:269] 0709 13:00:53.780001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.780288 (+   287us) service_pool.cc:224] Handling call
0709 13:00:54.264745 (+484457us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b540029ff90. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e6070b2 00007fc497580a89 00007fc497518da6 00007fc4974ea088 00007fc4975e837e 00007fc495aa92a4 00007fc495aa9232 00007fc495aa9161 00007fc495aa90dc
0709 13:00:54.335086 (+ 70341us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b540029ff90. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606e9c 00007fc48e6070f6 00007fc497580a89 00007fc497518da6 00007fc4974ea088 00007fc4975e837e 00007fc495aa92a4 00007fc495aa9232 00007fc495aa9161 00007fc495aa90dc
0709 13:01:09.183470 (+14848384us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:04.549437 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:04.662775 (+113338us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:04.668804 (+  6029us) write_op.cc:435] Acquired schema lock
0709 13:01:04.668833 (+    29us) tablet.cc:662] Decoding operations
0709 13:01:05.056967 (+388134us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:05.057023 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:05.057056 (+    33us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:01:05.058175 (+  1119us) tablet.cc:701] Row locks acquired
0709 13:01:05.058199 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:01:05.058350 (+   151us) write_op.cc:270] Start()
0709 13:01:05.058466 (+   116us) write_op.cc:276] Timestamp: P: 1783602065058301 usec, L: 0
0709 13:01:05.058488 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:01:05.059213 (+   725us) log.cc:844] Serialized 6022 byte log entry
0709 13:01:05.735184 (+675971us) op_driver.cc:464] REPLICATION: finished
0709 13:01:06.001822 (+266638us) write_op.cc:301] APPLY: starting
0709 13:01:06.001907 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:06.002195 (+   288us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:06.002323 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:06.040281 (+ 37958us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:06.040611 (+   330us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:01:06.040658 (+    47us) write_op.cc:312] APPLY: finished
0709 13:01:06.105919 (+ 65261us) log.cc:844] Serialized 107 byte log entry
0709 13:01:06.106116 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:06.106277 (+   161us) write_op.cc:454] Released schema lock
0709 13:01:06.106337 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:06.106697 (+   360us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:06.106729 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3279179,"reported_tablets":45,"spinlock_wait_cycles":203221248,"child_traces":[["op",{"apply.queue_time_us":262850,"apply.run_cpu_time_us":8411,"apply.run_wall_time_us":104841,"num_ops":15,"prepare.queue_time_us":182344,"prepare.run_cpu_time_us":70299,"prepare.run_wall_time_us":760730,"raft.queue_time_us":129869,"raft.run_cpu_time_us":13936,"raft.run_wall_time_us":271595,"replication_time_us":654516,"thread_start_us":616480,"threads_started":4,"wal-append.queue_time_us":317075,"wal-append.run_cpu_time_us":16351,"wal-append.run_wall_time_us":1921143}]]}
I20260709 13:01:09.401573  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:09.407744  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.408303  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.401578  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:09.410676  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.342582  1441 catalog_manager.cc:5697] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 6 to 9, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 9 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.435354  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.446728  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:09.447553  2244 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:09.448913  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.449079  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:09.449543  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.450121  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:09.450711  2238 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:01:09.449041  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.366530  5038 consensus_queue.cc:260] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.459539  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.464656  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:09.463133  1547 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:09.424386  4907 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.460188  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:09.469501  1619 raft_consensus.cc:2393] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 7: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:09.469941  1696 raft_consensus.cc:1240] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:09.473865  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.454815  5041 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:09.477486  1620 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:01:09.477607  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:09.478142  1693 raft_consensus.cc:2410] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:09.478042  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.478363  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.478739  5038 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:09.478413  4741 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.479398  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.480048  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.483883  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:09.485147  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:09.485776  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:09.486193  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:01:09.494232  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.501245  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 284984us
I20260709 13:01:09.506071  1617 raft_consensus.cc:1240] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:01:09.506079  1619 raft_consensus.cc:2410] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:09.506825  2244 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:09.486799  4921 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:09.513758  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:09.453965  4868 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:01:09.473603  4705 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:09.518536  1547 raft_consensus.cc:2393] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 9: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:09.511080  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.528832  1616 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:09.524915  1541 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:01:09.539484  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:09.508354  4446 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:09.542639  1692 raft_consensus.cc:1240] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:09.542791  2246 raft_consensus.cc:2393] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 8: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:09.511694  5041 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 7 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:09.537135  5035 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:09.559851  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.564819  1620 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:09.533005  4788 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.565479  1541 raft_consensus.cc:2410] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:09.565973  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:09.563050  5041 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.567710  5050 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.568913  1689 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:09.571615  5050 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:09.575394  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:09.576321  1613 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:09.578346  1613 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:01:09.578765  1613 pending_rounds.cc:85] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 5
I20260709 13:01:09.583408  5022 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.584121  5022 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.587334  4705 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.589838  4705 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:09.513926  5024 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:09.540253  1538 raft_consensus.cc:2376] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10. Re-sending same reply.
I20260709 13:01:09.565492  4788 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.562992  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 2078) took 2965 ms. Trace:
I20260709 13:01:09.563629  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.567092  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:09.609267  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.533731  4907 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.591883  1613 pending_rounds.cc:107] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:01:09.623659  1613 raft_consensus.cc:2889] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:09.591120  4746 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:09.606909  4860 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.556806  5043 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.606210  5022 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:09.611609  4929 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:09.630605  2246 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:09.633962  4788 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:09.637070  1615 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:01:09.613530  4446 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.639976  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:09.596009  1614 rpcz_store.cc:276] 0709 13:01:06.597865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.734566 (+1136701us) service_pool.cc:224] Handling call
0709 13:01:07.734893 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.735199 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.735226 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:07.777495 (+ 42269us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.552177 (+774682us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:09.063573 (+511396us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.559931 (+496358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.562633 (+  2702us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:09.562698 (+    65us) raft_consensus.cc:1685] finished
0709 13:01:09.562709 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.562846 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40489,"prepare.queue_time_us":278866,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":114016,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":167,"thread_start_us":1304876,"threads_started":3,"wal-append.queue_time_us":856400}
I20260709 13:01:09.641320  1547 pending_rounds.cc:85] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 7
I20260709 13:01:09.656360  1547 pending_rounds.cc:107] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:01:09.630664  1621 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:09.645870  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.661696  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:09.655471  2241 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:09.664407  1540 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:09.656687  1547 raft_consensus.cc:2889] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:09.669373  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 196842us
I20260709 13:01:09.641023  4933 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:09.677210  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.678383  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:09.694347  1615 raft_consensus.cc:2410] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:09.696040  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:09.690965  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:09.626221  5024 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.699409  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.699074  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.666464  4741 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:09.710034  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.708199  1689 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:01:09.713196  1617 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:01:09.700230  1690 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:09.672477  5028 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.725638  1613 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:09.727210  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.724893  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:09.728955  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.653148  4746 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.735622  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:09.746021  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.746930  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.748524  1696 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:09.748919  1538 raft_consensus.cc:2410] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:09.749586  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:09.748561  1689 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:09.665083  4860 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.755722  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:09.762854  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.763797  1690 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:09.765142  1620 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:09.765465  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:09.717643  4933 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:09.775309  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.776284  1539 raft_consensus.cc:2410] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:01:09.777575  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.778200  1690 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:09.779211  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.779639  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:09.779927  1690 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:01:09.780372  1615 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:09.780807  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.781913  1615 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:09.783975  4907 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:09.732187  5028 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:09.785094  5071 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:01:09.786492  5028 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:09.779125  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.804836  2240 raft_consensus.cc:2410] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:01:09.801780  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.808053  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.781999  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.814790  4933 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:09.815936  5076 log.cc:927] Time spent T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:09.816187  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:09.817286  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.818322  1690 raft_consensus.cc:2393] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:09.821432  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.830951  1622 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:01:09.838256  1660 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:09.829332  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:09.840129  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:09.778229  4446 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:09.844177  2211 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:09.854451  2246 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:09.861534  2245 raft_consensus.cc:1240] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:09.864357  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:09.867954  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.878046  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.890090  1692 raft_consensus.cc:2410] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:01:09.893402  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 49297.3us
I20260709 13:01:09.880009  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:09.807260  4793 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:09.898141  2211 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:09.899319  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:09.901585  2245 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:09.867964  4933 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.903730  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:09.905467  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:09.906239  1586 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:09.862160  5043 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:09.876096  5035 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:09.911597  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:09.911783  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.917145  1690 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:09.877565  4788 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:09.904567  1696 raft_consensus.cc:2376] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9. Re-sending same reply.
I20260709 13:01:09.915668  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:09.924512  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.938727  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 83315.2us
I20260709 13:01:09.944620  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:09.919632  1511 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:09.939992  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.941757  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 113329us
I20260709 13:01:09.946727  2246 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:09.917574  1543 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
W20260709 13:01:09.941954  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 72907.3us
I20260709 13:01:09.940574  2211 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:09.942692  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:09.948453  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:09.948915  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.030965  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.949096  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:10.055320  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 110075us
I20260709 13:01:09.918234  4741 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:09.914424  5022 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:09.916882  5035 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:09.907358  4446 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.115994  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:10.060003  4947 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:10.087282  1692 raft_consensus.cc:2393] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 9: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:10.116349  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:10.128137  1696 raft_consensus.cc:2410] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:10.126358  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:09.945552  1617 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:10.098665  4793 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:10.090631  1539 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:09.914021  4933 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:10.066936  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 119779us
I20260709 13:01:10.065572  5024 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:10.102648  1511 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:10.093904  4741 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:10.093945  5047 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:10.119712  5075 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.350s	user 0.000s	sys 0.001s
W20260709 13:01:10.152643  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 50079.7us
I20260709 13:01:10.159555  1541 raft_consensus.cc:1240] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:10.160979  2244 consensus_meta.cc:287] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.637s	user 0.011s	sys 0.000s
I20260709 13:01:10.161638  2244 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:01:10.163156  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:10.127028  5041 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.116544  5035 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.165148  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:10.119865  5083 log.cc:927] Time spent T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
I20260709 13:01:10.165016  1660 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:10.166385  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:10.132120  4947 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.065953  5046 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:01:10.088161  5048 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:01:10.171972  1621 raft_consensus.cc:2410] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:10.120445  5036 consensus_queue.cc:1059] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:01:10.116353  5022 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:10.134004  4446 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:10.156198  4741 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:10.277086  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 116284us
I20260709 13:01:10.219018  1619 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:01:10.222213  1543 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:01:10.204855  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 294925us
I20260709 13:01:10.153277  5047 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:10.217571  1696 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:01:10.260161  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.249481  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.276953  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 158919us
I20260709 13:01:10.162819  4987 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:10.297590  1511 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:10.221078  5086 log.cc:927] Time spent T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:01:10.301050  1542 raft_consensus.cc:1240] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:10.304713  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:10.220486  5077 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:01:10.204720  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:10.311882  1660 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:10.312857  2246 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:01:10.252846  5074 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:01:10.177062  4947 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.213362  5024 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:10.284386  4860 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:10.328485  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:10.307181  4911 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.221197  5091 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:10.294721  4868 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:10.318696  5038 consensus_meta.cc:287] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.804s	user 0.006s	sys 0.006s
I20260709 13:01:10.305521  4987 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.306044  5047 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.345162  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:10.345125  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:10.354130  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:10.358969  1619 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:10.352948  1687 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
W20260709 13:01:10.368758  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 84674.3us
I20260709 13:01:10.370568  1511 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:10.372680  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:10.340339  5091 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:10.353001  4987 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.244035  5041 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:10.378147  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:10.344316  4868 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:10.360464  5072 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:10.380455  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 92454.2us
I20260709 13:01:10.387537  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:10.386556  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 585) took 1055 ms. Trace:
I20260709 13:01:10.393697  1617 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:10.380151  4860 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:10.405460  1543 raft_consensus.cc:1240] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:10.413667  1660 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:10.417045  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:10.417919  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:10.420644  4868 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:10.422703  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:10.424005  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:10.424525  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:10.427400  1620 consensus_meta.cc:287] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.005s
I20260709 13:01:10.428397  1620 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:01:10.383050  5091 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.393672  1618 rpcz_store.cc:276] 0709 13:01:09.331166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.331346 (+   180us) service_pool.cc:224] Handling call
0709 13:01:09.331649 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.405162 (+ 73513us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:09.405205 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.588830 (+183625us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b2c000653e8. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc490024a11 00007fc490034372 00007fc491766a01 00007fc49172b43a 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2
0709 13:01:09.589257 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:01:09.734197 (+144940us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:09.734235 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.734298 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.384832 (+650534us) raft_consensus.cc:1685] finished
0709 13:01:10.384853 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.386497 (+  1644us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73101,"raft.queue_time_us":73610,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"spinlock_wait_cycles":13787520,"thread_start_us":144594,"threads_started":1,"wal-append.queue_time_us":299388}
I20260709 13:01:10.435727  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:10.438644  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 129820us
W20260709 13:01:10.442800  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.444285  1660 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:10.444566  1690 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
W20260709 13:01:10.444269  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.380729  4793 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:01:10.428166  4860 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:10.447752  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.449784  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:10.452859  1622 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:10.450172  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:10.457512  2246 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:10.396437  5072 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:10.442586  5024 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:10.435678  4933 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:10.451252  4816 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:10.470090  1617 raft_consensus.cc:1275] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:01:10.458252  4785 consensus_meta.cc:287] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 1.116s	user 0.014s	sys 0.000s
I20260709 13:01:10.468808  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:10.475296  1618 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:10.455400  4860 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.480810  1691 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:10.464797  5048 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:10.485416  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:10.486004  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:10.486799  5082 log.cc:927] Time spent T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:01:10.472743  5024 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.483757  1659 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:10.501274  1660 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:10.475167  5038 consensus_queue.cc:1059] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:01:10.510475  1587 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:10.478916  5046 consensus_queue.cc:1059] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:01:10.504858  5024 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:10.521556  1613 consensus_meta.cc:287] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.772s	user 0.009s	sys 0.002s
I20260709 13:01:10.522333  1613 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:10.522877  1619 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:10.524230  1587 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:10.517557  4785 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:10.547531  4785 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.547950  4785 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.551409  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 2141) took 1138 ms. Trace:
I20260709 13:01:10.516743  5048 raft_consensus.cc:697] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:10.520673  5102 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:10.536267  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2140) took 1124 ms. Trace:
I20260709 13:01:10.537204  5046 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:10.543283  5101 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
W20260709 13:01:10.543958  5094 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:01:10.545456  5035 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:10.529898  4446 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:10.546603  4907 raft_consensus.cc:3055] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:10.546761  4877 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:10.519515  5022 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:10.551980  1687 rpcz_store.cc:276] 0709 13:01:09.413493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.469766 (+ 56273us) service_pool.cc:224] Handling call
0709 13:01:10.551146 (+1081380us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b5400223dd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:10.551321 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1985134848}
W20260709 13:01:10.554996  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.555191  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 1404) took 1182 ms. Trace:
W20260709 13:01:10.571904  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 88223.1us
I20260709 13:01:10.530588  5081 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:10.580932  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 210386us
W20260709 13:01:10.558109  4929 consensus_meta.cc:287] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.895s	user 0.009s	sys 0.000s
W20260709 13:01:10.571259  5079 log.cc:927] Time spent T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.674s	user 0.000s	sys 0.001s
W20260709 13:01:10.562613  5093 log.cc:927] Time spent T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:01:10.596171  1691 rpcz_store.cc:276] 0709 13:01:09.372716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.374106 (+  1390us) service_pool.cc:224] Handling call
0709 13:01:10.555031 (+1180925us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400224cd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:10.555134 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2542803840}
I20260709 13:01:10.598515  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:10.572240  5102 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.562974  4911 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:10.576866  5046 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.624080  1511 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:10.630366  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 163815us
W20260709 13:01:10.631455  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 100653us
I20260709 13:01:10.572319  1695 rpcz_store.cc:276] 0709 13:01:09.412033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.424434 (+ 12401us) service_pool.cc:224] Handling call
0709 13:01:09.456793 (+ 32359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:09.503829 (+ 47036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.503862 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:09.542497 (+ 38635us) log.cc:844] Serialized 52 byte log entry
0709 13:01:09.732305 (+189808us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:09.732344 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.732415 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.535915 (+803500us) raft_consensus.cc:1685] finished
0709 13:01:10.535946 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.536104 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15287,"raft.queue_time_us":36303,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":25169,"thread_start_us":167855,"threads_started":1,"wal-append.queue_time_us":657322}
I20260709 13:01:10.638392  2209 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:10.591388  4907 raft_consensus.cc:740] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:10.565038  4741 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:10.564916  5006 consensus_queue.cc:1059] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:01:10.641507  1512 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:10.630015  5022 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:10.632025  5041 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:10.646064  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 128732us
I20260709 13:01:10.633365  5102 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.623157  4929 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:10.637401  5046 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.639595  4446 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:10.655339  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1411) took 1173 ms. Trace:
I20260709 13:01:10.659435  1587 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:10.645237  4911 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.645602  4868 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.662454  1692 rpcz_store.cc:276] 0709 13:01:09.481792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.222406 (+740614us) service_pool.cc:224] Handling call
0709 13:01:10.253441 (+ 31035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.253679 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:10.396658 (+142979us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.654964 (+258306us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:10.655013 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:10.655053 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.655110 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.655264 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7729,"prepare.queue_time_us":113212,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":77394,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5548,"spinlock_wait_cycles":3294464,"thread_start_us":367000,"threads_started":3,"wal-append.queue_time_us":236516}
I20260709 13:01:10.635949  4793 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:01:10.655280  5022 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.678097  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1403) took 1306 ms. Trace:
I20260709 13:01:10.678776  4933 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:10.680254  5048 consensus_queue.cc:237] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:10.681278  5047 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:10.684186  2240 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45882 (request call id 700) took 1332 ms (client timeout 1578 ms). Trace:
I20260709 13:01:10.668514  4987 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:10.684599  2240 rpcz_store.cc:269] 0709 13:01:09.351946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.352801 (+   855us) service_pool.cc:224] Handling call
0709 13:01:10.683948 (+1331147us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b5400910ad4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:10.684108 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1022177536}
I20260709 13:01:10.678522  1688 rpcz_store.cc:276] 0709 13:01:09.372173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.372330 (+   157us) service_pool.cc:224] Handling call
0709 13:01:09.372669 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.373071 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.373097 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.373573 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:01:09.628485 (+254912us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:09.628539 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.628633 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.570628 (+941995us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:10.671286 (+100658us) raft_consensus.cc:1685] finished
0709 13:01:10.671315 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.678024 (+  6709us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3349,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":11564416,"thread_start_us":254293,"threads_started":1,"wal-append.queue_time_us":425474}
W20260709 13:01:10.694741  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.666296  4446 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.696094  1547 raft_consensus.cc:2368] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 9. Current term is 10.
W20260709 13:01:10.703081  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 201835us
I20260709 13:01:10.703461  2239 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:01:10.704188  2239 pending_rounds.cc:85] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Aborting all ops after (but not including) 6
I20260709 13:01:10.704496  2239 pending_rounds.cc:107] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:01:10.704839  2239 raft_consensus.cc:2889] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:10.706329  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 136511us
I20260709 13:01:10.667877  5108 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:10.731403  5108 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:10.731571  4741 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:10.731848  5108 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.733554  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:10.687312  5022 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.688310  5101 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:10.737793  4987 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:10.738473  4997 raft_consensus.cc:3055] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:10.738878  4997 raft_consensus.cc:740] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:10.739825  4997 consensus_queue.cc:260] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:10.740571  2242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 771) took 1067 ms. Trace:
I20260709 13:01:10.741096  4997 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.740950  2242 rpcz_store.cc:276] 0709 13:01:09.630404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.691558 (+ 61154us) service_pool.cc:224] Handling call
0709 13:01:09.733494 (+ 41936us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.816661 (+ 83167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.816695 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.817193 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:01:09.900812 (+ 83619us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:09.900857 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.900936 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.697638 (+796702us) raft_consensus.cc:1685] finished
0709 13:01:10.697666 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.697845 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11610,"raft.queue_time_us":41353,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":83263,"threads_started":1,"wal-append.queue_time_us":318111}
I20260709 13:01:10.672874  4911 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:10.744468  4911 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:10.748086  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1376) took 1288 ms. Trace:
I20260709 13:01:10.748522  1540 rpcz_store.cc:276] 0709 13:01:09.464990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.470159 (+  5169us) service_pool.cc:224] Handling call
0709 13:01:10.747875 (+1277716us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54000b6154. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:10.748016 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367674112}
I20260709 13:01:10.749859  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2490) took 1457 ms. Trace:
I20260709 13:01:10.705157  4446 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:10.750233  1545 rpcz_store.cc:276] 0709 13:01:09.291964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.292950 (+   986us) service_pool.cc:224] Handling call
0709 13:01:09.293334 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.293828 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.293866 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.294443 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 13:01:09.612943 (+318500us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:09.612995 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.613064 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.736875 (+1123811us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b2400144368. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e4c49c4 00007fc48e4c2acb 00007fc48e67ddc9 00007fc48e67da55 00007fc48e67cfb0 00007fc4912f3488 00007fc4912f3be8 00007fc4912cb398 00007fc4912c676a 00007fc4912c5bb6
0709 13:01:10.745712 (+  8837us) raft_consensus.cc:1685] finished
0709 13:01:10.745731 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.749692 (+  3961us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1389,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":104,"spinlock_wait_cycles":32172288,"thread_start_us":318026,"threads_started":1,"wal-append.queue_time_us":612665}
I20260709 13:01:10.706009  1587 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:10.708806  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 67446.7us
I20260709 13:01:10.674443  4868 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:10.712786  5088 log.cc:927] Time spent T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.867s	user 0.000s	sys 0.002s
W20260709 13:01:10.714057  5089 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 13:01:10.714533  5024 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:10.715939  4947 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:10.717742  5035 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:10.722997  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.668253  5041 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:01:10.704384  5072 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:10.674664  5111 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:10.727512  4907 consensus_queue.cc:260] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:10.755136  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 112324us
W20260709 13:01:10.755654  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 49741.5us
I20260709 13:01:10.698932  5047 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:10.759683  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 55537.5us
I20260709 13:01:10.769188  4911 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:10.769939  1512 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:10.771888  2240 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:10.768069  4916 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:10.779844  4916 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.780298  4916 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.787153  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:10.788054  2238 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:10.775446  1587 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:10.794044  1511 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:10.800212  1621 raft_consensus.cc:2368] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9.
W20260709 13:01:10.802587  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.773558  5038 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:10.806916  5024 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:10.807672  4788 raft_consensus.cc:3055] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:10.849640  4788 raft_consensus.cc:740] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:10.850690  4788 consensus_queue.cc:260] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:10.852041  4788 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.854518  5038 raft_consensus.cc:697] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:10.855739  5038 consensus_queue.cc:237] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:10.811602  4746 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:10.858001  4746 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:10.858428  4746 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.858112  5091 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:10.858815  4746 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.814436  5036 raft_consensus.cc:3055] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:10.772224  4933 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:01:10.859484  5036 raft_consensus.cc:740] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:10.815276  2239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 769) took 1199 ms. Trace:
I20260709 13:01:10.815979  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 501) took 1001 ms. Trace:
I20260709 13:01:10.816594  5112 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.860430  5036 consensus_queue.cc:260] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:10.816967  4868 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:10.817359  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 2108) took 1340 ms. Trace:
I20260709 13:01:10.861156  5112 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:10.860489  2239 rpcz_store.cc:276] 0709 13:01:09.616386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.616522 (+   136us) service_pool.cc:224] Handling call
0709 13:01:10.685767 (+1069245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.736350 (+ 50583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.815071 (+ 78721us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400910ad0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:10.815203 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2427535744}
I20260709 13:01:10.861938  1616 rpcz_store.cc:276] 0709 13:01:09.477250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.537829 (+ 60579us) service_pool.cc:224] Handling call
0709 13:01:09.560927 (+ 23098us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.616995 (+ 56068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.617042 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.630334 (+ 13292us) log.cc:844] Serialized 26 byte log entry
0709 13:01:09.698701 (+ 68367us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:09.699283 (+   582us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.699669 (+   386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.699811 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.712171 (+1012360us) spinlock_profiling.cc:243] Waited 9.75 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:10.817057 (+104886us) raft_consensus.cc:1685] finished
0709 13:01:10.817159 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.817304 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":781,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":5580,"raft.run_cpu_time_us":3463,"raft.run_wall_time_us":23309,"spinlock_wait_cycles":22421888,"thread_start_us":29231,"threads_started":1,"wal-append.queue_time_us":97897}
I20260709 13:01:10.860806  1696 rpcz_store.cc:276] 0709 13:01:09.814940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.327007 (+512067us) service_pool.cc:224] Handling call
0709 13:01:10.352450 (+ 25443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:10.380214 (+ 27764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.380243 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:10.396030 (+ 15787us) log.cc:844] Serialized 26 byte log entry
0709 13:01:10.590502 (+194472us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:10.624039 (+ 33537us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.630515 (+  6476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.815614 (+185099us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b54000f19d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:10.815657 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.815701 (+    44us) raft_consensus.cc:1685] finished
0709 13:01:10.815791 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.815924 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6209,"prepare.queue_time_us":41055,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":13671,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":11447,"spinlock_wait_cycles":45737344,"thread_start_us":141274,"threads_started":1,"wal-append.queue_time_us":245038}
I20260709 13:01:10.864243  5112 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:10.818421  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:10.818920  1688 raft_consensus.cc:1240] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:10.865078  1692 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:01:10.819273  4911 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:10.865744  4911 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:10.866178  4911 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.820564  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:10.867937  1695 raft_consensus.cc:2368] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8.
I20260709 13:01:10.821233  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:10.821389  4987 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:10.868836  4987 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.869259  4987 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:10.821811  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 57734.9us
I20260709 13:01:10.872062  1512 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:10.775524  5041 consensus_queue.cc:1243] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:10.822928  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:10.825204  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:10.875741  5036 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:10.889070  4987 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:10.814778  5046 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:10.834033  5070 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:10.835618  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 48525us
I20260709 13:01:10.899931  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:10.836119  5047 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:01:10.836758  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 64023.6us
I20260709 13:01:10.837833  4785 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:10.838548  5022 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:10.840731  4907 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.840742  5102 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:10.830837  4446 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:10.844208  4860 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:10.809875  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.818496  4947 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:10.931668  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:10.932492  2245 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.830158  5108 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:10.893129  1687 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:01:10.900645  1621 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
W20260709 13:01:10.900837  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 192495us
I20260709 13:01:10.902562  2210 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:10.906114  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:10.913352  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:10.960832  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 58520.4us
I20260709 13:01:10.960908  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:10.916051  2246 raft_consensus.cc:1240] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:10.918394  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:10.917052  1511 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:10.924690  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:10.926854  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:10.938628  5112 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.965157  2211 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:10.943563  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:10.944242  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:10.966496  2241 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:10.925978  5070 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.969295  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:10.970139  1687 raft_consensus.cc:2393] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:10.954101  5127 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.954010  4916 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:10.956514  5046 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:10.956830  4446 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:10.957820  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 52398.6us
I20260709 13:01:10.984112  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:10.970710  2240 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
W20260709 13:01:10.984632  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.971289  1619 raft_consensus.cc:2393] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 8: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:10.971673  2210 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:10.953187  4911 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:10.974045  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:10.973924  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:10.974382  1690 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:10.974680  5047 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:10.975943  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 58989.3us
I20260709 13:01:11.001170  2243 raft_consensus.cc:2393] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:10.976809  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:10.920965  5041 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:10.979846  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 216979us
I20260709 13:01:10.977608  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:10.955091  4947 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.970171  2237 raft_consensus.cc:2393] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 4: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:10.993712  1688 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:10.994791  1695 raft_consensus.cc:2410] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:10.994855  1696 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:11.009065  1692 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:10.995584  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:11.010044  2241 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.995530  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:10.997728  1689 raft_consensus.cc:2410] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:01:10.998363  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.999079  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:11.000159  1660 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 1.733s (SENT) [suppressed 28 similar messages]
I20260709 13:01:11.011085  1687 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:10.964694  5024 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.026976  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:10.976776  5112 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.033324  4446 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.985330  5127 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.034025  4446 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.035910  5091 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:11.036118  2209 leader_election.cc:336] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.142s (SENT)
W20260709 13:01:11.036391  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 102810us
I20260709 13:01:11.036602  5065 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:11.036132  5127 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.037976  2211 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:11.038280  1690 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:10.984042  5111 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.039186  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:11.054376  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 69823us
I20260709 13:01:11.001717  4933 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:11.001296  4997 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:11.028294  1694 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:11.056622  1512 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:10.933702  5120 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:01:11.045960  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:01:11.067512  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 292098us
W20260709 13:01:11.077024  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 99504.9us
I20260709 13:01:11.012486  5047 raft_consensus.cc:697] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:01:11.084116  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 45013.5us
I20260709 13:01:11.040458  5022 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:11.042896  5108 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.081928  1587 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:11.004475  4746 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.056761  5091 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.062659  5036 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:11.055150  5065 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:10.983206  5070 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.061543  4997 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.029452  4947 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:11.100871  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 44318.9us
I20260709 13:01:11.048583  5024 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.104955  1512 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:11.082070  4868 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:11.082224  5048 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:11.083388  4933 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:11.106488  1587 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:11.119953  2241 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:11.102108  4997 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.130844  1660 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:11.145481  4785 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:11.137481  5114 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.151346  2211 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:11.125375  5120 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:11.142055  5047 consensus_queue.cc:237] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.130955  5108 consensus_queue.cc:1059] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 13:01:11.152541  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 46115.9us
I20260709 13:01:11.102443  5091 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.164515  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:11.154696  2245 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:11.163211  1512 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:11.076191  5111 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:11.179925  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 47449.3us
I20260709 13:01:11.151311  5127 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:11.151312  5038 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:01:11.160987  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 64138.6us
I20260709 13:01:11.182119  2211 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:11.151517  4987 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.185176  5127 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:11.182543  5124 log.cc:927] Time spent T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Append to log took a long time: real 0.139s	user 0.000s	sys 0.002s
I20260709 13:01:11.180033  4933 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.129509  5048 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.183284  5108 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:01:11.216743  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 93225.3us
I20260709 13:01:11.151029  5046 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:01:11.210738  4446 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:11.192416  4793 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:11.181120  5035 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:11.162281  5114 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.222702  4947 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.206563  5112 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:11.224566  5114 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:11.216137  1585 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:11.184108  4907 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:11.225600  4907 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.219219  4793 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:11.225965  4987 consensus_queue.cc:1059] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:11.227128  4929 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:11.228897  5048 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:11.229117  4929 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:01:11.229982  2209 leader_election.cc:336] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.194s (SENT)
I20260709 13:01:11.230248  5087 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:11.230675  2209 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:11.187523  5102 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.226332  4793 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.207456  5038 raft_consensus.cc:697] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:11.234297  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:11.221225  1587 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:11.183574  5119 raft_consensus.cc:3055] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:11.217830  5006 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:11.208822  5127 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:11.209925  4911 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:11.184079  4916 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.189059  4860 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.239554  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:11.230038  5138 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:01:11.225979  4907 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:11.181041  5072 raft_consensus.cc:2764] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:01:11.243497  1616 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
W20260709 13:01:11.272996  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 90913.5us
I20260709 13:01:11.247473  5048 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.234897  5120 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:01:11.249645  5116 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:11.250216  5137 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:11.250455  5111 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.183574  5134 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.108s
I20260709 13:01:11.255879  1585 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:11.310278  4916 raft_consensus.cc:3055] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:11.310811  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 55095.7us
I20260709 13:01:11.312191  5116 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:11.313198  1585 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:11.260555  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:11.314129  2241 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:11.267529  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.250957  5006 raft_consensus.cc:697] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:11.280823  5137 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:11.317135  5006 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.298676  5035 consensus_queue.cc:1059] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:01:11.323434  1660 leader_election.cc:336] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 2.019s (SENT)
I20260709 13:01:11.325776  1660 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:11.328606  4788 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:11.281177  5048 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.332590  5087 raft_consensus.cc:3055] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:11.333010  5087 raft_consensus.cc:740] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:11.333937  5024 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:11.334092  5048 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:11.333894  5087 consensus_queue.cc:260] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.335249  1691 raft_consensus.cc:2410] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:01:11.332520  4746 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.335223  5087 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:11.338676  2210 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:11.340304  1585 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:11.276639  2211 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:11.239679  5114 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:11.239925  5119 raft_consensus.cc:740] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:11.279592  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:11.281993  4793 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.282850  5091 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.233565  5108 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.317162  5137 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.296125  5131 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:11.299803  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.275188  5065 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:11.300690  5038 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.279043  5139 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 13:01:11.347998  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 126707us
I20260709 13:01:11.373972  4997 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.375923  5070 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:11.379551  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 102982us
I20260709 13:01:11.380740  2244 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:01:11.294863  5133 log.cc:927] Time spent T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:01:11.383394  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.310778  4916 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:01:11.389236  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.394083  2241 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
W20260709 13:01:11.389959  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 140749us
I20260709 13:01:11.361521  5104 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:11.403155  1512 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:11.409927  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 69723.7us
I20260709 13:01:11.412528  1585 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:11.412592  1512 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:11.414891  2211 leader_election.cc:400] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8.
I20260709 13:01:11.415271  2211 leader_election.cc:403] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:01:11.400307  5068 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:11.417346  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.417505  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:11.419515  2211 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:11.420936  1540 raft_consensus.cc:2368] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11.
W20260709 13:01:11.431269  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.438328  1546 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:01:11.438755  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.438589  4916 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.439486  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:11.431497  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:11.440642  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:11.439496  1544 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 10: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:11.441252  1696 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.440138  4916 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.441545  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.439392  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.447754  1546 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:11.448582  4997 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:11.435407  4933 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:11.449256  4933 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:11.449708  4933 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.452694  4788 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:11.453430  5121 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8.
I20260709 13:01:11.454003  1542 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:11.450477  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:11.454532  5122 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:11.454556  1619 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.455814  1547 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:11.456801  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:11.457687  1694 raft_consensus.cc:2393] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 6: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:11.458915  1695 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:01:11.441368  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet d0a7e28ddafe4ac389f2603e93af8dba: Illegal state: Replica dcc91bf6e3bd468bbbbfc26e3a7c5e01 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:11.411017  5111 raft_consensus.cc:3055] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:11.450667  4793 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.460132  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.462154  1660 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:11.469413  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.464259  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:11.467602  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 55135.6us
W20260709 13:01:11.470621  1659 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.124s (SENT)
I20260709 13:01:11.440866  1545 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:11.421960  2211 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:11.479964  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.480614  1691 raft_consensus.cc:2410] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:01:11.481837  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 59941.2us
I20260709 13:01:11.484318  1585 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:11.484395  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:11.486124  1659 leader_election.cc:336] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.141s (SENT)
I20260709 13:01:11.479566  5143 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:11.416216  5036 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.495772  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:11.488162  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:11.487107  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 50645.8us
I20260709 13:01:11.496914  1694 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.411401  5104 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.403865  5065 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.497128  1586 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:11.491709  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:11.491133  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:11.467700  5111 raft_consensus.cc:740] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:11.493430  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:11.494792  1538 raft_consensus.cc:1240] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:11.403692  5131 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.498219  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.499078  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:11.504312  1542 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:11.499878  2242 raft_consensus.cc:1240] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:11.418879  5068 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:11.500375  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.405988  5127 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.493616  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:11.494910  5070 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.502403  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:11.501442  1692 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.514274  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:11.515112  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:11.515848  1538 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:11.502924  5104 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:11.490067  4788 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.492339  5122 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:11.509328  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:11.509366  1545 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:11.508405  4746 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.421156  5119 consensus_queue.cc:260] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.511070  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:11.530292  1613 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 12: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:11.509789  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:11.511826  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:11.491447  5143 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:11.531571  5143 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:11.512821  1689 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.501534  1687 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:11.539662  1690 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:11.530447  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:11.541859  1511 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:11.506340  1585 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:11.517891  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:11.521672  1619 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:11.515687  1621 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:11.522423  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:11.522733  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:11.544298  1614 raft_consensus.cc:2410] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 11 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:01:11.524503  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 62465.6us
I20260709 13:01:11.545128  1694 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:11.495029  5048 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:11.546396  1688 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.546510  5148 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:11.547223  5148 raft_consensus.cc:697] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:11.548156  5148 consensus_queue.cc:237] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.550781  5144 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:11.551410  4929 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:11.551841  4929 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:11.551999  5130 log.cc:927] Time spent T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:11.552191  4929 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.552376  1542 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:11.553362  5036 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:11.553463  5101 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:11.556495  5065 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.537724  4793 consensus_queue.cc:1059] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:01:11.559296  5122 raft_consensus.cc:697] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:11.560295  5122 consensus_queue.cc:237] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.562354  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:11.565510  5108 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.566805  1696 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:11.511606  5068 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.529063  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.513942  5138 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:11.568572  4907 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.571597  1616 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:11.508091  5142 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:11.571372  5111 consensus_queue.cc:260] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.540103  1617 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:11.573359  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:11.523731  5070 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:11.539050  5041 consensus_meta.cc:287] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.002s
W20260709 13:01:11.576109  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet c528a0f6bdb44c4187c750d0b1429ba1: Illegal state: Replica dcc91bf6e3bd468bbbbfc26e3a7c5e01 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:11.577677  1585 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:11.575169  5116 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:11.579893  4933 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:11.580818  5152 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:11.540349  4746 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.584404  5127 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.589540  1692 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:11.594264  1543 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:01:11.594633  2210 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:11.594861  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:11.597481  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 55640.5us
I20260709 13:01:11.609769  1545 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:11.611315  5070 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.637418  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:11.638150  1690 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:11.611538  5041 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:11.639542  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:11.640208  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.640389  1617 raft_consensus.cc:2410] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:11.640436  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:11.527796  4788 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.526901  5087 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:11.595372  5131 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:11.599876  1689 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:11.640894  1543 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:11.641381  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:11.612787  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 66974.9us
I20260709 13:01:11.619630  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:11.620188  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 5a69de749cce497b83e6489ad367017a: Illegal state: Replica dcc91bf6e3bd468bbbbfc26e3a7c5e01 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:11.658918  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:11.623968  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.660948  1542 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:11.624199  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.625424  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:11.598497  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:11.662883  1619 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:11.639191  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:11.624925  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.632061  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:11.649986  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:11.663959  1540 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:11.663954  1691 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:11.665254  1511 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:11.634241  1613 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:11.649504  1541 raft_consensus.cc:1275] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:11.666425  5120 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:11.667842  5108 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:11.668383  5108 raft_consensus.cc:697] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:11.671200  1659 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:11.599700  5144 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:11.662339  1539 raft_consensus.cc:2376] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6. Re-sending same reply.
I20260709 13:01:11.677201  1687 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:11.599604  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:11.625016  5143 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.661854  1547 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:11.678829  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:11.626180  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.692451  4788 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:11.627353  2209 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:11.623553  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:11.599546  5138 raft_consensus.cc:697] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:01:11.693792  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 66572.5us
I20260709 13:01:11.677371  5144 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.694494  5138 consensus_queue.cc:237] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.695478  5144 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.695592  2209 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:11.696642  5114 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:11.697374  5114 consensus_queue.cc:1059] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:11.697979  4997 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:11.605624  4929 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.698724  4997 raft_consensus.cc:3055] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:11.699142  4997 raft_consensus.cc:740] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:11.700059  4997 consensus_queue.cc:260] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.700821  4929 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:11.701442  4997 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:11.612164  4907 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.702601  4785 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:11.680116  5143 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.703095  4785 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.614814  5048 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:01:11.703619  4785 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:11.682287  1615 raft_consensus.cc:1240] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:11.618700  4933 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.669241  5108 consensus_queue.cc:237] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.683607  5127 consensus_queue.cc:1059] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:01:11.706943  5127 raft_consensus.cc:3055] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:11.707324  5127 raft_consensus.cc:740] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:11.685078  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:11.685882  1617 raft_consensus.cc:2410] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:11.686584  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:11.687583  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 68021.6us
I20260709 13:01:11.709478  1585 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:11.688227  5131 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:11.619864  5116 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:11.620354  5111 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.621812  4746 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.631635  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:11.599992  1688 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:11.687117  5041 consensus_queue.cc:1059] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:01:11.690514  5120 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:11.720513  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:11.721568  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:11.722746  1694 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:11.691215  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:11.619782  5146 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:01:11.692420  1620 raft_consensus.cc:2376] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6. Re-sending same reply.
I20260709 13:01:11.687840  5137 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.709977  1660 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:11.646960  1587 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:11.714013  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:11.726673  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:11.726688  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 80147.1us
I20260709 13:01:11.727480  1687 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.641522  5072 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:11.720515  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:11.720626  1696 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:11.607031  5119 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.727845  1587 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:11.598937  5038 consensus_queue.cc:1059] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 13:01:11.735574  1545 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:11.715461  4788 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:11.738466  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:11.739351  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:11.741072  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:11.741240  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:11.741819  1696 raft_consensus.cc:2410] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:11.742794  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:11.743007  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.743637  1688 raft_consensus.cc:2410] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:01:11.748646  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:11.749415  1690 raft_consensus.cc:2368] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9.
I20260709 13:01:11.720629  5143 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:11.750598  1587 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:11.755134  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:11.756083  1694 raft_consensus.cc:2410] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:01:11.756872  5070 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:11.756987  5142 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:11.757398  5070 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.757592  5142 raft_consensus.cc:697] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:11.757871  5070 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.758579  5142 consensus_queue.cc:237] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:11.761394  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 47417.7us
I20260709 13:01:11.761590  1587 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:11.737480  5131 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:11.766753  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:11.763749  4788 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:11.767786  1587 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:11.768731  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:11.769451  1620 raft_consensus.cc:606] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:11.769392  1587 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:11.769893  1620 raft_consensus.cc:614] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:11.770902  5046 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:11.771416  4947 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:11.771974  4947 raft_consensus.cc:697] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:11.772835  4947 consensus_queue.cc:237] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.773789  5137 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:11.771442  5046 raft_consensus.cc:697] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:11.763561  5038 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:01:11.776064  5046 consensus_queue.cc:237] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.767702  1615 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:11.780776  4916 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:11.781368  4916 raft_consensus.cc:697] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:11.781937  4933 raft_consensus.cc:3055] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:11.782555  4933 raft_consensus.cc:740] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:11.783946  5081 raft_consensus.cc:3055] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:11.751030  5048 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:11.784448  5081 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:11.748512  5072 raft_consensus.cc:697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:11.760803  5104 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.764767  5112 consensus_queue.cc:1048] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:01:11.791751  1687 raft_consensus.cc:2410] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:11.787094  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:11.764981  5131 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.800578  2242 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:11.801332  1617 raft_consensus.cc:1240] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:11.782366  4916 consensus_queue.cc:237] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.804337  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:11.789525  5148 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.787907  5048 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:11.807405  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:11.814630  2246 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.807818  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:11.815908  1617 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:11.808101  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:11.810001  1688 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:01:11.816416  1660 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:11.823177  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:11.824678  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.825273  1542 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:01:11.833366  1693 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: [7.4-8.5]
I20260709 13:01:11.834856  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:11.835809  1687 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:11.804129  5131 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.847410  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.845956  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:11.839704  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:11.842016  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:11.845767  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.846030  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:11.853305  1539 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:11.856093  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:11.846309  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.859021  1617 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:11.859581  1544 raft_consensus.cc:2368] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8.
I20260709 13:01:11.820951  5048 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:11.837316  4929 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.859450  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.818882  5041 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.863515  2246 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:11.870368  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:11.834851  1512 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:11.883884  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 49114.9us
I20260709 13:01:11.805349  5068 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.884676  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:11.885685  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:11.838914  4788 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:11.792461  5072 consensus_queue.cc:237] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.909345  1694 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:11.916785  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:11.917969  1545 raft_consensus.cc:2393] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:11.933863  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:11.805630  4933 consensus_queue.cc:260] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:11.893184  4793 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:11.957377  1618 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
W20260709 13:01:11.964063  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 153686us
I20260709 13:01:11.914332  4911 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:11.972074  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 87486.1us
I20260709 13:01:11.882562  5112 consensus_queue.cc:1059] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:01:11.974416  1690 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:11.886556  4929 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:11.981264  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 130039us
I20260709 13:01:11.893003  5041 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:11.987020  1615 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:01:11.987689  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.977077  1512 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:11.968885  1687 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:11.997732  1512 leader_election.cc:400] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9.
I20260709 13:01:11.998108  1512 leader_election.cc:403] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:01:11.989029  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:11.998988  2246 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:11.961712  4793 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.963836  5036 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:11.867906  5081 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:12.013947  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 00924ae4c66740e59de627a44de33c38: Illegal state: Replica dcc91bf6e3bd468bbbbfc26e3a7c5e01 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:11.979836  4788 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:11.980947  5114 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.980304  4911 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.017076  1587 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:11.996352  4933 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.037055  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:12.008870  4793 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.034583  4911 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.057500  1617 raft_consensus.cc:1240] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:12.062780  5087 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:12.037030  5114 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:12.063755  5169 log.cc:927] Time spent T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:12.065210  5114 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:12.066913  4929 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:12.067517  4929 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.071872  5068 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:12.043193  5104 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:12.048156  5081 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:12.045172  5137 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:12.082206  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:12.077251  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:12.084405  1619 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:12.018513  5036 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:12.051321  5120 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:12.098973  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:12.080677  5155 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:01:12.082852  1614 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:12.048427  4788 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:12.141404  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:12.090327  5158 log.cc:927] Time spent T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
W20260709 13:01:12.144390  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 155426us
I20260709 13:01:12.145668  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:12.142733  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:12.083987  5087 raft_consensus.cc:697] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:12.090288  5024 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:12.149463  1619 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:12.146361  1614 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.117605  5137 raft_consensus.cc:697] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:12.081054  5038 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 13:01:12.150005  5159 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
W20260709 13:01:12.163208  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 165597us
I20260709 13:01:12.123869  5172 raft_consensus.cc:3055] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:12.145468  5165 consensus_queue.cc:1059] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:01:12.179630  5172 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:12.180696  5172 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.181984  5137 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.181203  4788 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:12.121506  5070 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.189850  5174 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:12.186496  1512 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:12.173967  5157 log.cc:927] Time spent T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 13:01:12.173466  5167 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:12.211072  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 213235us
I20260709 13:01:12.213833  1659 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:12.182011  5172 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.224316  5070 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:12.229087  5127 consensus_queue.cc:260] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:12.230362  5127 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.231396  1616 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:12.231355  5167 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:12.220221  5036 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:12.220993  5163 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:01:12.222741  5131 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.201812  5038 raft_consensus.cc:3055] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:12.233182  1621 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:12.213896  4785 consensus_meta.cc:287] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.004s
I20260709 13:01:12.200186  5174 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:12.178602  4911 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.229650  5048 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.235932  5041 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:12.239913  5038 raft_consensus.cc:740] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:01:12.275110  5119 consensus_meta.cc:287] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.000s
I20260709 13:01:12.266952  5087 consensus_queue.cc:237] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:12.276693  1619 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:01:12.278364  1546 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:12.280222  5131 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:12.281730  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:12.282485  1618 raft_consensus.cc:2393] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 9: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:12.283480  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:12.284440  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:12.266837  5182 consensus_queue.cc:1059] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:01:12.284976  1618 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:01:12.285804  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:12.286103  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:12.286751  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:12.287106  1622 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 13:01:12.288065  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 471617us
I20260709 13:01:12.288918  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:12.288727  5174 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.289709  5172 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:12.290009  5174 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.290894  1660 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:12.241369  5120 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:01:12.260299  5166 log.cc:927] Time spent T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:01:12.293546  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:12.293954  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:12.294678  1660 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:12.295663  1618 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:12.272598  5167 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:12.256558  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.252038  1659 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:12.315305  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 63316.8us
I20260709 13:01:12.316135  1659 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:12.317520  1659 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:12.246245  1687 raft_consensus.cc:1240] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:12.294696  1615 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:12.288101  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:12.314718  1542 raft_consensus.cc:2410] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:12.319518  1622 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.321069  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:12.322503  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:12.323460  2244 raft_consensus.cc:2368] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9.
I20260709 13:01:12.238024  5177 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:12.264086  5164 log.cc:927] Time spent T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:01:12.329336  1586 leader_election.cc:400] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9.
I20260709 13:01:12.333288  1586 leader_election.cc:403] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:12.260929  5161 log.cc:927] Time spent T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:01:12.321383  1659 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:12.335492  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 126573us
I20260709 13:01:12.337442  1660 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:12.266503  4911 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:12.341082  5185 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:12.375564  5185 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:12.375998  5185 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.343451  5173 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:12.379690  5173 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.380085  5173 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.344017  5186 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:12.383566  5186 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.383962  5186 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.351519  5024 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:12.388003  5024 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:12.353048  5182 raft_consensus.cc:3055] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:12.391649  1688 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:12.353641  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:12.392975  1688 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:12.253491  4785 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.395265  4785 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:12.396063  1691 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 12: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:01:12.358022  5148 consensus_meta.cc:287] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.003s
I20260709 13:01:12.398588  5148 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:12.360468  5144 consensus_meta.cc:287] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.664s	user 0.010s	sys 0.002s
I20260709 13:01:12.404304  5144 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:12.406356  5144 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:12.406440  1613 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:12.386344  5038 consensus_queue.cc:260] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:12.408427  5038 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:12.408672  5111 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:12.356635  4793 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.413682  4793 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:12.336506  5167 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:12.414244  5167 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:12.414637  5167 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.365152  4929 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9.
I20260709 13:01:12.366590  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:12.428880  1615 raft_consensus.cc:606] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:12.367928  1687 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:01:12.368851  5178 consensus_queue.cc:1048] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:01:12.333070  5081 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:12.431867  5148 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.371619  1621 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:12.432385  5148 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:12.372648  2241 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:12.391572  5182 raft_consensus.cc:740] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:12.363737  5048 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:12.435359  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 114027us
I20260709 13:01:12.435966  5048 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:12.436514  5048 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.436832  1659 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:12.437004  5048 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.437960  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:12.438763  5104 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:12.434255  5182 consensus_queue.cc:260] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.440181  5182 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.360808  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:12.445326  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 84598.8us
I20260709 13:01:12.451990  2244 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:12.456395  1614 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:12.459393  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:12.459510  1687 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:12.451331  1620 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
W20260709 13:01:12.465047  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.465741  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.463802  1511 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:12.467526  5091 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:12.468365  4911 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:12.468799  4911 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.469143  4911 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.479701  1622 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:12.479350  1618 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:01:12.489902  5024 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.493884  5139 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:12.458473  4929 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:01:12.507369  1692 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.022s	sys 0.043s
W20260709 13:01:12.507805  1692 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.022s	sys 0.043s
I20260709 13:01:12.510872  1687 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:12.458381  5172 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:12.522346  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.480880  5131 consensus_queue.cc:1059] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:01:12.483965  1511 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:12.496308  1441 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58806 (request call id 176) took 15044 ms (client timeout 15000 ms). Trace:
W20260709 13:01:12.530386  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 46496.2us
W20260709 13:01:12.528424  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 341953us
I20260709 13:01:12.532089  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:12.532531  1512 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:12.482029  5116 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9.
I20260709 13:01:12.496722  5167 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.481690  5112 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:12.535123  1511 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:12.536031  5041 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:12.535873  5120 consensus_queue.cc:1059] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:12.536809  5091 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:12.552606  5091 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:12.553125  5091 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.491406  5165 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:12.458067  5144 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:01:12.491524  4785 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:12.483465  5081 raft_consensus.cc:697] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:12.479104  5127 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:01:12.540443  1512 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:12.458133  4746 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:01:12.557439  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:12.549263  5131 consensus_queue.cc:1243] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer 822e08445eae4a33b2f2fe92060192c6 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:01:12.530220  1441 rpcz_store.cc:269] 0709 13:00:57.451717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.492808 (+ 41091us) service_pool.cc:224] Handling call
0709 13:01:12.496235 (+15003427us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:10.152465 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:10.243204 (+ 90739us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:10.280106 (+ 36902us) write_op.cc:435] Acquired schema lock
0709 13:01:10.285024 (+  4918us) tablet.cc:662] Decoding operations
0709 13:01:10.516657 (+231633us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:10.531536 (+ 14879us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:10.532651 (+  1115us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:01:10.550136 (+ 17485us) tablet.cc:701] Row locks acquired
0709 13:01:10.550184 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:01:10.550359 (+   175us) write_op.cc:270] Start()
0709 13:01:10.550509 (+   150us) write_op.cc:276] Timestamp: P: 1783602070550298 usec, L: 0
0709 13:01:10.550547 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:01:10.636840 (+ 86293us) log.cc:844] Serialized 4367 byte log entry
0709 13:01:11.620089 (+983249us) op_driver.cc:464] REPLICATION: finished
0709 13:01:11.777728 (+157639us) write_op.cc:301] APPLY: starting
0709 13:01:11.777829 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:11.778126 (+   297us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:11.789974 (+ 11848us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:11.791631 (+  1657us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:11.868171 (+ 76540us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:01:11.897872 (+ 29701us) write_op.cc:312] APPLY: finished
0709 13:01:12.049808 (+151936us) log.cc:844] Serialized 83 byte log entry
0709 13:01:12.061149 (+ 11341us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:12.086759 (+ 25610us) write_op.cc:454] Released schema lock
0709 13:01:12.121120 (+ 34361us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:12.178058 (+ 56938us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:12.186513 (+  8455us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":127859,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":140665,"apply.run_cpu_time_us":9380,"apply.run_wall_time_us":382282,"num_ops":11,"prepare.queue_time_us":171423,"prepare.run_cpu_time_us":40631,"prepare.run_wall_time_us":810041,"raft.queue_time_us":231898,"raft.run_cpu_time_us":19358,"raft.run_wall_time_us":136610,"replication_time_us":1069358,"thread_start_us":595337,"threads_started":4,"wal-append.queue_time_us":353381}]]}
I20260709 13:01:12.538118  4793 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:12.566890  5171 consensus_queue.cc:1059] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:01:12.577307  2210 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:12.537842  5046 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:01:12.593688  5024 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:12.594878  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 54513us
I20260709 13:01:12.534432  5186 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.573100  5196 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:12.576776  1442 catalog_manager.cc:5697] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 4 to 6, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.599107  1512 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:12.584614  4785 raft_consensus.cc:697] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:12.590289  4929 raft_consensus.cc:3055] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:12.590015  4793 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:12.605849  5193 log.cc:927] Time spent T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:01:12.598287  5087 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:12.596666  5104 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:12.599076  5119 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:12.601576  5196 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.618510  1442 catalog_manager.cc:5697] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 5 to 8, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:12.611039  4929 raft_consensus.cc:740] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:12.615113  4793 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.655279  1442 catalog_manager.cc:5697] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:01:12.658497  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 188425us
I20260709 13:01:12.659955  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:12.660804  1618 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:12.662585  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:12.654774  5087 consensus_queue.cc:1059] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:01:12.619479  5198 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:12.644189  5196 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:12.624114  5171 consensus_queue.cc:1059] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:01:12.649853  5104 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:12.673664  1618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:12.624256  5185 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:12.693617  1618 raft_consensus.cc:606] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:12.667558  5087 consensus_queue.cc:1243] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:12.698138  5186 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:12.697567  1442 catalog_manager.cc:5697] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 6 to 7, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:12.699187  1442 catalog_manager.cc:5697] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 9 to 10, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:12.649549  5108 consensus_queue.cc:1059] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:01:12.700064  5171 consensus_queue.cc:1243] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:12.653388  5081 consensus_queue.cc:237] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.694672  5198 raft_consensus.cc:697] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:01:12.716342  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 70006.4us
I20260709 13:01:12.718418  5104 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:12.704033  5167 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:12.721174  1442 catalog_manager.cc:5697] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:12.726111  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:12.727393  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:12.727514  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 82480.3us
I20260709 13:01:12.727980  1618 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.730937  1442 catalog_manager.cc:5697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 2 to 4, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:12.724025  5171 raft_consensus.cc:3055] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:12.762480  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:12.674921  4785 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.768178  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:12.742350  1539 raft_consensus.cc:1240] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:12.766343  1540 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:12.767095  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:12.769698  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:12.767100  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:12.770238  1539 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:12.741905  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.726778  5177 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:12.773855  1615 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:01:12.776288  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:12.774555  5148 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:12.779222  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:12.782835  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:12.783628  1547 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 7: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:12.784116  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:12.784901  1694 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:12.786271  1693 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:12.788365  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:12.789067  1693 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.793708  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:12.794494  1694 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.765959  5171 raft_consensus.cc:740] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:12.783116  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:12.796077  1695 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:12.801914  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:12.802655  1691 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.806268  1618 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
W20260709 13:01:12.782696  5189 log.cc:927] Time spent T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:01:12.813560  1688 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:12.814384  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
W20260709 13:01:12.813906  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 483056us
I20260709 13:01:12.815119  1615 raft_consensus.cc:606] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:12.815341  1696 raft_consensus.cc:1240] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:12.815507  1615 raft_consensus.cc:614] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:12.815528  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:12.816227  1687 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:01:12.822716  1618 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:12.825516  1694 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:12.786314  5119 raft_consensus.cc:697] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:01:12.831161  5199 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:01:12.811030  5108 consensus_queue.cc:1243] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:12.831276  5072 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:01:12.839915  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:12.841518  5197 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:01:12.841589  1660 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:12.844177  5174 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:12.844964  5174 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:12.846259  1691 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:12.831204  5185 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:12.849813  5174 consensus_queue.cc:1059] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:12.851390  5185 raft_consensus.cc:3055] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:12.851838  5185 raft_consensus.cc:740] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:12.852999  5185 consensus_queue.cc:260] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.854672  1660 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:12.855916  5186 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:12.857300  1660 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:12.858682  5119 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.862761  5186 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:12.863509  5186 raft_consensus.cc:697] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:12.864374  5186 consensus_queue.cc:237] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:12.867707  5192 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:01:12.868768  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:12.870631  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.871027  5211 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:12.873767  1442 catalog_manager.cc:5697] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 6 to 8, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:12.800539  5038 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:01:12.880363  2244 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:12.881848  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:12.832079  5177 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:12.872864  5194 log.cc:927] Time spent T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:01:12.888726  2244 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:12.892838  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:12.888640  1442 catalog_manager.cc:5697] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:12.894889  1442 catalog_manager.cc:5697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 4 to 8, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:12.896401  5211 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.896919  5211 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:12.896633  1442 catalog_manager.cc:5697] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 6 to 8, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:12.899003  5211 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:12.900106  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:12.900838  2246 raft_consensus.cc:2393] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 10: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:12.901674  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:12.902731  1696 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:01:12.902784  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:12.903285  1696 pending_rounds.cc:85] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 8
I20260709 13:01:12.903549  1696 pending_rounds.cc:107] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:01:12.903762  1696 raft_consensus.cc:2889] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:12.905546  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:12.906065  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:12.898784  1442 catalog_manager.cc:5697] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:12.908756  1696 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:01:12.909245  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.912346  1696 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:12.888794  5200 log.cc:927] Time spent T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:01:12.914775  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:12.889242  5072 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.920825  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:12.920856  1539 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:12.926167  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:12.937660  1622 raft_consensus.cc:606] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:12.938030  1622 raft_consensus.cc:614] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:12.821645  5198 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.939747  1693 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
W20260709 13:01:12.928943  5173 consensus_meta.cc:287] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.000s
I20260709 13:01:12.930380  5144 raft_consensus.cc:3055] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:12.931456  5120 raft_consensus.cc:3055] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:12.920248  5165 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:01:12.931993  5143 raft_consensus.cc:3055] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:12.927596  5091 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.953738   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:12.964425   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:12.877461  5171 consensus_queue.cc:260] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:12.916886  5190 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:01:12.948500  5047 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:12.917961  5211 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 13:01:12.998208  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 77457.1us
I20260709 13:01:12.937533  5072 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:13.005350  5072 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:12.948751  5144 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:13.008690  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2175) took 1187 ms. Trace:
I20260709 13:01:12.960971  5143 raft_consensus.cc:740] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:01:13.013126  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 68022.1us
I20260709 13:01:12.966683  5148 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.010720  1689 rpcz_store.cc:276] 0709 13:01:11.821610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.083339 (+261729us) service_pool.cc:224] Handling call
0709 13:01:12.083676 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:12.148728 (+ 65052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.148762 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:12.159728 (+ 10966us) log.cc:844] Serialized 52 byte log entry
0709 13:01:12.456864 (+297136us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:12.456906 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.456972 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.008449 (+551477us) raft_consensus.cc:1685] finished
0709 13:01:13.008471 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.008630 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54438,"raft.queue_time_us":95447,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":260462,"threads_started":1,"wal-append.queue_time_us":416184}
I20260709 13:01:12.955482  5120 raft_consensus.cc:740] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:12.956017  5173 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.056989  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:13.059376  1621 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:01:13.012555  5171 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:13.063759  5048 consensus_meta.cc:287] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.626s	user 0.014s	sys 0.001s
I20260709 13:01:13.078370  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:13.079370  5091 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:13.079866  5143 consensus_queue.cc:260] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.074783  5144 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:13.082084  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.081607  5120 consensus_queue.cc:260] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.091480  5223 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:13.059267  5047 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:01:13.058843  5148 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:13.104528  5173 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:13.104928  5143 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:13.105558  5120 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:13.096732  5048 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:13.136759  4911 consensus_meta.cc:287] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.667s	user 0.011s	sys 0.001s
I20260709 13:01:13.137238  4911 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.141000  4929 consensus_queue.cc:260] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.142604  4929 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:13.144778  5048 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:13.146965  5148 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:13.107537  4793 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.161026  1545 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 12: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:13.162209  4793 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:13.163841  5223 consensus_queue.cc:1059] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:13.167044  5047 raft_consensus.cc:3055] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:13.167559  5047 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:13.165616  5223 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.132181  5144 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:13.174413  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 129878us
I20260709 13:01:13.171518  5046 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.172935  5038 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:13.168707  5047 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:13.208912  5185 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:13.191735  5223 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:13.219615  5230 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:13.233863  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 88595us
I20260709 13:01:13.233736  1688 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:13.222988  1687 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:13.234476  2210 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:13.236634  5230 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:13.185879  4911 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:13.252170  1694 raft_consensus.cc:1217] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[8.5-10.6]   Dedup: 8.5->[10.6-10.6]
I20260709 13:01:13.253957  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:13.254599  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2179) took 1423 ms. Trace:
I20260709 13:01:13.271996  1694 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:01:13.274838  1695 rpcz_store.cc:276] 0709 13:01:11.831314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.281150 (+449836us) service_pool.cc:224] Handling call
0709 13:01:12.281456 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.801409 (+519953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.254279 (+452870us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b5400459054. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:13.254520 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178127616}
I20260709 13:01:13.255424  1618 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:13.256713  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:13.277818  1620 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:01:13.281968  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 389829us
I20260709 13:01:13.286671  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:13.286808  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:13.287411  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:13.287669  1618 raft_consensus.cc:2393] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 12: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:13.287621  1614 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:13.288035  1619 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.278376  1688 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:13.294023  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:13.294776  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:13.186352  5196 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.297051  1617 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:01:13.297868  1614 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:13.299010  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:13.294715  1622 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:13.305442  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:13.307578  1614 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
W20260709 13:01:13.307940  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.222517  5046 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.309428  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:13.308037  1688 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:13.274641  5148 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.282855  5047 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:13.322783  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:13.326674  1619 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:13.326892  1617 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:13.324667  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:13.235402  5038 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:13.330420  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.333957  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:13.338336  1620 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:13.304729  5087 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.358351  1587 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:13.304541  4785 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:01:13.381017  1620 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
W20260709 13:01:13.391943  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.349906  5127 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:13.343367  5232 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:13.323491  5036 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:01:13.333230  5116 consensus_queue.cc:1059] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:01:13.361819  4916 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:13.411780  5038 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:13.411923  4746 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:01:13.413498  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 117698us
W20260709 13:01:13.413806  5229 log.cc:927] Time spent T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:01:13.414561  1511 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:13.415830  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:13.416945  5204 consensus_queue.cc:1059] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:13.418200  5204 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:13.418730  5204 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:13.419437  5181 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:13.420037  5181 raft_consensus.cc:697] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:13.421077  5181 consensus_queue.cc:237] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.355909  5087 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.322129  5119 consensus_queue.cc:1059] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:01:13.424441  5119 raft_consensus.cc:3055] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:13.424853  5119 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:13.425763  5119 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:13.422909  5091 raft_consensus.cc:3055] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:13.428524  5091 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:13.429455  5091 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:13.430895  5091 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:13.367499  5222 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:13.409639  5116 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:13.433933  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:13.410926  4916 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:13.431547  5127 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:13.445916  5207 log.cc:927] Time spent T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.520s	user 0.004s	sys 0.016s
I20260709 13:01:13.342623  5148 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.427117  5119 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.438987  5204 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.432533  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:13.467564  5173 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.405282  5217 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:13.456630  5087 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:13.488142  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:13.579698  1693 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:01:13.441073  5139 raft_consensus.cc:3055] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:13.594426  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:13.595055  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:13.440429  5223 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:13.454881  5196 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:13.432701  5230 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:13.443048  5046 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:13.435874  5206 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.527s	user 0.002s	sys 0.003s
W20260709 13:01:13.490033  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.606781  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.456511  5228 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:13.493687  1617 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:13.550321  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:13.612035  1539 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.550503  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:13.615651  1547 raft_consensus.cc:2393] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:13.557456  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:13.561731  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 129242us
I20260709 13:01:13.576759  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:13.581169  2211 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:13.616623  1542 raft_consensus.cc:2410] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:13.616789  1544 raft_consensus.cc:2368] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7.
I20260709 13:01:13.582316  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:13.617637  1538 raft_consensus.cc:2410] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:01:13.583127  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:13.618360  1545 raft_consensus.cc:2393] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 9: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:13.545593  5222 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:13.546471  5116 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.625829  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:13.626157  5116 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:13.626663  1547 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:13.627522  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:13.628674  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:13.544507  5211 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:13.631877  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.631563  5211 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:13.595804  4947 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:13.632630  4947 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.634124  5211 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:13.598634  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:13.593590  5139 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:13.601761  1546 raft_consensus.cc:2410] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:13.636072  5139 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.636854  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:13.637614  5139 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:13.638175  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:13.547226  5144 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.621233  1511 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:13.621402  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:13.646996  1542 raft_consensus.cc:2410] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:01:13.491564  5232 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:13.623044  1539 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:13.635191  1540 raft_consensus.cc:2410] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:13.580291  5198 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:13.644946  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 63858.6us
I20260709 13:01:13.623855  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:13.655264  1545 raft_consensus.cc:2368] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10.
W20260709 13:01:13.607712  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.648679  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:13.609644  5223 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:13.657078  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.657500  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:13.658710  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:13.659298  2245 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:01:13.660141  1543 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:13.661408  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:13.661801  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:13.662155  1543 raft_consensus.cc:2410] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:13.662700  1617 raft_consensus.cc:2368] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 9. Current term is 10.
I20260709 13:01:13.664320  1619 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:13.665436  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:13.665946  1618 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:13.594604  5173 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.635124  4947 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:13.672106  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 437628us
I20260709 13:01:13.677290  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:13.693331  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:13.694152  1620 raft_consensus.cc:2393] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 11: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:13.643676  5222 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:13.697325  2245 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:13.692395  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:13.698462  1613 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:13.694279  1622 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 12: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:13.702181  1538 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:01:13.654399  5196 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:13.702579  1538 pending_rounds.cc:85] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 4
I20260709 13:01:13.702886  1538 pending_rounds.cc:107] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:01:13.593745  5217 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:13.669117  5198 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.703142  1538 raft_consensus.cc:2889] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:13.703975  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:13.710083  1543 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:01:13.706596  1540 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:13.710572  1543 pending_rounds.cc:85] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 5
I20260709 13:01:13.710863  1543 pending_rounds.cc:107] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:01:13.711095  1543 raft_consensus.cc:2889] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:13.711706  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1454) took 1101 ms. Trace:
I20260709 13:01:13.712440  1618 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:13.719058  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:13.621592  5228 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:13.721048  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:13.721279  1511 leader_election.cc:400] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 9. Current term is 10.
I20260709 13:01:13.722067  1511 leader_election.cc:403] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:01:13.712175  1690 rpcz_store.cc:276] 0709 13:01:12.610463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.610766 (+   303us) service_pool.cc:224] Handling call
0709 13:01:12.644515 (+ 33749us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:12.644933 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.644966 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:12.649826 (+  4860us) log.cc:844] Serialized 52 byte log entry
0709 13:01:12.783482 (+133656us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:12.783538 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.783626 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.445508 (+661882us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b24001f7d38. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e4c49c4 00007fc48e4c2acb 00007fc48e67ddc9 00007fc48e67da55 00007fc48e67d09d 00007fc4912af10e 00007fc4912c688c 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221
0709 13:01:13.702153 (+256645us) raft_consensus.cc:1685] finished
0709 13:01:13.702185 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.711626 (+  9441us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20946,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":29425,"spinlock_wait_cycles":39659264,"thread_start_us":115843,"threads_started":1,"wal-append.queue_time_us":173390}
I20260709 13:01:13.700043  5238 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:13.710408  5143 consensus_meta.cc:287] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.578s	user 0.006s	sys 0.005s
I20260709 13:01:13.710256  5198 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:13.713959  5210 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.714171  5091 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:13.729763  1540 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:13.654663  5144 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:13.707984  5104 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.738638  2209 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:13.746155  1511 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:13.747789  1511 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:13.720117  5196 raft_consensus.cc:697] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:13.685362  5223 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:13.751844  2245 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:13.728477  4911 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:13.731218  5238 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.764196  1540 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:13.753860  4933 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:13.769647  5238 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.772749  4933 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.773147  4933 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:13.774825  5240 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:01:13.777148  5138 raft_consensus.cc:993] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:01:13.777683  5139 raft_consensus.cc:1081] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:01:13.777879  4785 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.778538  4785 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.781354  4785 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:13.783082  4916 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:13.783912  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 416730us
I20260709 13:01:13.784883  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:13.786005  1660 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:13.754391  5216 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:13.788642  2242 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:13.793004  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:13.793843  1694 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 13: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:13.789930  1618 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:13.794471  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:13.790388  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:13.795370  1687 raft_consensus.cc:2393] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 7: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:13.730463  5108 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:01:13.792644  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:13.796380  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:13.732528  5203 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:01:13.803021  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:13.800834  1619 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
W20260709 13:01:13.810396  1510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.020s	sys 0.020s
W20260709 13:01:13.810880  1510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.020s	sys 0.020s
I20260709 13:01:13.802134  5048 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:13.822216  1620 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:01:13.823187  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.845525  1622 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:13.846095  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:13.857504  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:13.793756  4785 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:13.756109  5210 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:13.863569  1660 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:13.880844  1660 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:13.799736  5185 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:13.760210  5091 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:13.844663  5148 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:13.870630  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 132046us
I20260709 13:01:13.756985  5104 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:13.864570  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:13.897456  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:13.885440  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1453) took 1302 ms. Trace:
I20260709 13:01:13.860395  5211 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:13.813083  5216 raft_consensus.cc:697] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 7 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:13.888366  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:13.843686  5241 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.894840  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:13.813531  1687 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:45660
I20260709 13:01:13.892664  5196 consensus_queue.cc:237] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.889111  5081 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:13.896623  1660 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:13.904163  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.909329  1543 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:13.870404  5024 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:13.913941  1659 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:13.909740  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:13.889133  4785 raft_consensus.cc:697] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:13.899519  1546 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 4.
I20260709 13:01:13.892184  5185 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.928956  1545 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:01:13.924527  1544 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:01:13.923195  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:13.925817  1687 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:13.954723  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:14.019691  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:14.023993  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:13.915869  5245 log.cc:927] Time spent T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:01:13.867573  5041 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.135s
I20260709 13:01:14.000672  5038 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:13.895413  5127 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:13.934661  5228 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:13.931205  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet ded1641387fd4fd4be29caddb22781fb: Illegal state: Replica d7158d6c3b634dc7abb69eac58eba291 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:14.072516  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:14.081028  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.118219  1687 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.927197  5238 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.145614  5238 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:13.935849  5232 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:14.091797  5024 consensus_queue.cc:1059] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:01:13.908273  5223 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:14.132500  5207 log.cc:927] Time spent T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:14.124120  5185 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:13.898794  5243 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:01:14.007449  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 70978.5us
W20260709 13:01:14.149111  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 453820us
I20260709 13:01:14.152863  2209 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:13.919570  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:14.154567  2246 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 4.
I20260709 13:01:14.104193  5242 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.119207  1696 raft_consensus.cc:2410] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:13.933979  4911 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 9. Current term is 10.
I20260709 13:01:14.048753  5173 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:13.927455  5241 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:13.919514  5081 raft_consensus.cc:697] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:14.183640  1586 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:14.183868  1619 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:14.116637  1544 pending_rounds.cc:85] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 7
I20260709 13:01:14.185149  1544 pending_rounds.cc:107] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:01:14.185488  1544 raft_consensus.cc:2889] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:14.017373  5072 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:13.925452  5139 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:13.914981  5048 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:13.916407  5047 consensus_meta.cc:287] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.572s	user 0.005s	sys 0.004s
I20260709 13:01:13.903357  5217 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:14.157606  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:13.918183  5210 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:13.921217  5091 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:13.930459  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:14.182143  5203 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:14.133272  5116 consensus_meta.cc:287] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
I20260709 13:01:14.227699  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:14.227869  5217 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:14.228488  5217 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.228919  5217 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:14.229179  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:13.925148  5216 consensus_queue.cc:237] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.221627  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:14.232161  2243 raft_consensus.cc:2368] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8.
I20260709 13:01:14.162288  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:14.163223  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:14.233132  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:14.233335  1696 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
W20260709 13:01:14.168818  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 416002us
I20260709 13:01:14.163812  5243 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.234463  1696 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:14.212126  5249 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:14.235497  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.235769  5249 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.236233  5249 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:14.238056  1585 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:14.240689  5241 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:14.242327  5104 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:14.221648  5263 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:13.898276  1692 rpcz_store.cc:276] 0709 13:01:12.583472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.583634 (+   162us) service_pool.cc:224] Handling call
0709 13:01:12.590131 (+  6497us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:12.595694 (+  5563us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:12.613256 (+ 17562us) log.cc:844] Serialized 14 byte log entry
0709 13:01:12.731132 (+117876us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:12.761670 (+ 30538us) log.cc:844] Serialized 52 byte log entry
0709 13:01:12.761810 (+   140us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:12.762047 (+   237us) log.cc:844] Serialized 14 byte log entry
0709 13:01:12.763957 (+  1910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.764020 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.081029 (+317009us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b180038abe0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:01:13.435511 (+354482us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b24001f7d38. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e4c49c4 00007fc48e4c2acb 00007fc48e67ddc9 00007fc48e67da55 00007fc48e67d09d 00007fc4912af10e 00007fc4912c688c 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221
0709 13:01:13.885177 (+449666us) raft_consensus.cc:1685] finished
0709 13:01:13.885205 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.885361 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":506,"prepare.queue_time_us":16217,"prepare.run_cpu_time_us":4579,"prepare.run_wall_time_us":26379,"raft.queue_time_us":1942,"raft.run_cpu_time_us":418,"raft.run_wall_time_us":34650,"spinlock_wait_cycles":30393856,"thread_start_us":65383,"threads_started":1,"wal-append.queue_time_us":168299}
I20260709 13:01:14.181794  4785 consensus_queue.cc:237] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.178614  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:14.105367  4933 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:14.168991  5181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.004s	sys 0.008s
I20260709 13:01:14.245240  5251 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:14.245435  5181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.004s	sys 0.009s
I20260709 13:01:14.150534  5144 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:14.210194  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:14.211160  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:14.259351  1539 raft_consensus.cc:2393] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:14.259455  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:14.211907   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:14.263332  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:14.264272  2239 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:14.139573  5230 consensus_queue.cc:1059] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:01:14.222088  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:14.166194  5254 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:14.224030  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 66521us
I20260709 13:01:14.266801  1538 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:14.208621  1687 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:14.268158  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.118439  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:14.268872  1692 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:14.228502  1621 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:01:14.161010  5182 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.265196  2242 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 5.
I20260709 13:01:14.217379  4911 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.214488  5108 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.285058  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:14.285810  1618 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 4.
I20260709 13:01:14.278244  1543 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:01:14.265718  5119 consensus_meta.cc:287] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.664s	user 0.008s	sys 0.004s
I20260709 13:01:14.282258  1687 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:14.257507  5173 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:14.282604  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:14.224494  5238 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.170432  5242 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.287137  1546 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:14.293545  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:14.258198  5048 raft_consensus.cc:697] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:14.219558  5139 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:14.302538  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.302222  1547 raft_consensus.cc:2410] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:01:14.328511  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:14.269675  5144 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:14.331123  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:14.331458  2237 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
W20260709 13:01:14.316001  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.245813  5251 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.227730  5116 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.358995  1512 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:14.283488  4916 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:14.328541  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 414603us
W20260709 13:01:14.335409  2209 leader_election.cc:336] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.520s (SENT)
I20260709 13:01:14.364212  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:14.301273  5138 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:14.289306  5198 consensus_meta.cc:287] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 13:01:14.366410  1539 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
W20260709 13:01:14.354378  5250 log.cc:927] Time spent T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:01:14.334609  5222 consensus_meta.cc:287] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.616s	user 0.011s	sys 0.000s
I20260709 13:01:14.385607  1617 raft_consensus.cc:2368] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 9. Current term is 10.
W20260709 13:01:14.368647  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 427896us
I20260709 13:01:14.227661  5203 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.386714  1660 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:14.392386  1613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.016s	sys 0.045s
I20260709 13:01:14.362774  5230 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:14.392836  1613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.016s	sys 0.046s
I20260709 13:01:14.382323  1659 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:14.332653  5210 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:14.375731  5196 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:14.361573  5173 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.388023  1512 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:14.301728  5108 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.287137  5182 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.277076  5254 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.289084  4911 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.365312  5144 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.290109  5181 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.333817  5205 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:01:14.389544  5119 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:14.325227  5081 consensus_queue.cc:237] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.333398  5238 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.390714  5262 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.388583  5243 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:14.365703  5204 consensus_queue.cc:1059] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:01:14.392714  4933 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:14.385613  5198 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.390475  5222 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.390878  5241 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:01:14.460312  5254 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:14.428543  5265 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:01:14.430158  5214 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:14.379150  5138 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.463621  5138 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:14.429908  5196 raft_consensus.cc:697] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:14.465775  5196 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.436885  5181 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.468691  5222 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:14.469942  5214 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.470507  5214 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.472504  5214 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:14.457813  5251 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:14.416302  5230 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:14.481002  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 99569.8us
I20260709 13:01:14.481058  1541 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:14.492494  1621 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:01:14.417199  5210 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.428769  5173 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.504412  5182 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:14.505154  5173 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:14.506369  5173 raft_consensus.cc:3055] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:14.446341  5119 raft_consensus.cc:697] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:14.514822  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:14.516067  2242 raft_consensus.cc:2410] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:14.512470  2210 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:14.506788  5173 raft_consensus.cc:740] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:14.520490  5230 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:14.521076  5198 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:14.522604  5210 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:14.525100  5144 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:14.420492  5048 consensus_queue.cc:237] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.555088  2210 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:14.525642  5217 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.526721  5182 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:14.532852  5249 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.561239  5203 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:14.562026  5116 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:14.562600  5119 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.563161  5249 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:14.534596  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:14.563591  5238 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:14.454325  5091 consensus_queue.cc:1059] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:01:14.565412  5091 raft_consensus.cc:3055] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:14.565812  5091 raft_consensus.cc:740] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:14.566018  5139 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:14.566924  5242 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:14.450332  5262 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.483831  5211 raft_consensus.cc:697] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:14.568224  5173 consensus_queue.cc:260] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.568408  5211 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.569269  5262 leader_election.cc:290] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:14.569363  5173 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:14.565421  4911 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:14.572664  5261 raft_consensus.cc:3055] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:14.573087  5261 raft_consensus.cc:740] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:14.566691  5091 consensus_queue.cc:260] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.573954  5261 consensus_queue.cc:260] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.574395  5091 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:14.513917  5214 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:14.554060  5223 raft_consensus.cc:2804] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:14.561035  5276 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.601819  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:14.602655  2246 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:14.614439  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:14.575205  5261 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:14.626260  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:14.576135  5024 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:14.627862  1511 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:14.588310  5223 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.578065  5217 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:14.581022  5269 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.217s	user 0.003s	sys 0.000s
I20260709 13:01:14.600971  5038 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:01:14.699515  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 309228us
I20260709 13:01:14.586484  5181 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:14.684715  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:14.623612  5127 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.578773  5108 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:14.633427  5024 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.629660  5277 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:14.684590  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 129596us
I20260709 13:01:14.731105  2210 leader_election.cc:400] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 9. Current term is 10.
I20260709 13:01:14.578058  5214 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.682087  4911 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:14.595669  5276 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.694480  5228 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:01:14.735221  1695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.010s	sys 0.012s
I20260709 13:01:14.693598  5139 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:14.696745  5249 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:14.755038  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.760257  2210 leader_election.cc:403] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:14.732934  5278 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.686600  5223 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:14.727294  5024 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:14.788748  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.777264  1695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.011s	sys 0.012s
I20260709 13:01:14.814091  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1463) took 1529 ms. Trace:
I20260709 13:01:14.814518  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:14.797739  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 66847.3us
I20260709 13:01:14.814509  1695 rpcz_store.cc:276] 0709 13:01:13.284576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.284905 (+   329us) service_pool.cc:224] Handling call
0709 13:01:13.304886 (+ 19981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.305104 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:13.646400 (+341296us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.813659 (+1167259us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:14.813735 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:14.813793 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.813883 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.814023 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31698,"prepare.queue_time_us":71454,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":464651,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":62,"thread_start_us":1356276,"threads_started":3,"wal-append.queue_time_us":542721}
I20260709 13:01:14.591360  5173 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.185s
W20260709 13:01:14.818015  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.818876  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:14.819834  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:14.820118  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:14.821218  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.018s	sys 0.026s
I20260709 13:01:14.717186  2237 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:14.821520  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.019s	sys 0.026s
W20260709 13:01:14.821831  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 572527us
I20260709 13:01:14.822674  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:14.823256  1616 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:14.824558  2211 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:14.771507  5281 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.821051  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:14.776047  4911 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.833691  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:14.855734  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:14.827886  1696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.011s	sys 0.032s
I20260709 13:01:14.815397  1691 raft_consensus.cc:2393] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 9: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:01:14.828701  1619 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.014s	sys 0.037s
W20260709 13:01:14.875836  1619 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.014s	sys 0.037s
W20260709 13:01:14.811524  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 444438us
I20260709 13:01:14.727855  5127 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:14.835471  5185 consensus_meta.cc:287] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.687s	user 0.016s	sys 0.004s
W20260709 13:01:14.832533  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 378746us
I20260709 13:01:14.834487  1687 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:14.835997  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.827399  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 459621us
I20260709 13:01:14.892262  1659 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:14.812668  5277 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.880421  4916 consensus_queue.cc:1059] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:01:14.899901  5277 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.812887  5230 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.903775  5285 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.904465  5285 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.799264  5108 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.907585  5108 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.909552  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:14.910154  5108 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:14.910323  1615 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:14.854156  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:14.874823  1692 raft_consensus.cc:2393] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 11: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:14.798466  5210 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.913494  5210 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.914011  5230 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 9. Current term is 10.
I20260709 13:01:14.914803  1621 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:14.915774  5210 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:14.875587  1618 raft_consensus.cc:3055] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:14.917474  1618 raft_consensus.cc:740] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:14.918485  1618 consensus_queue.cc:260] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.920007  1618 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:14.920806  5276 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:14.921499  5276 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:14.922024  5276 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:14.875789  1696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.011s	sys 0.033s
I20260709 13:01:14.924084  5277 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:14.924703  5277 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:14.925251  5277 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.927677  5277 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:14.933923  1659 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:14.935391  1659 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:14.938951  1689 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.012s	sys 0.012s
W20260709 13:01:14.939355  1689 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.013s	sys 0.012s
I20260709 13:01:14.941107  2210 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:14.882262  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:14.944305  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:14.832283  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.025s	sys 0.022s
I20260709 13:01:14.813876  5228 raft_consensus.cc:697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:14.817688  5116 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.846644  5238 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:14.880825  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:14.957639  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:14.945271  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.025s	sys 0.022s
I20260709 13:01:14.774861  5283 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 13:01:14.963614  1616 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:14.835726  5137 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:14.948227  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:14.951619  5282 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.218s	user 0.000s	sys 0.002s
I20260709 13:01:14.869313  4911 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:14.887212  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:14.955857  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:14.957365  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:14.979924  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 4ceaee3af9aa446a8796bde98fd46779: Illegal state: Replica dcc91bf6e3bd468bbbbfc26e3a7c5e01 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:14.812520  5139 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.968588  1618 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:14.971975  1540 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 7 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:14.974427  1692 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:14.949331  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:14.813037  5249 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:14.984660  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:14.985656  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:14.989219  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:14.938486  4933 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:14.880116  4785 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.019s	sys 0.011s
I20260709 13:01:14.978762  1687 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
W20260709 13:01:14.961632  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.958760  5271 log.cc:927] Time spent T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:01:14.982510  1695 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:14.988047  1696 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.977341  5263 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:14.975524  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 79546.9us
I20260709 13:01:14.832005  5038 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:14.972820  5253 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:14.990234  1692 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:14.820294  5278 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:15.010026  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:15.010200  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:14.951820  5185 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:15.001231  4785 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.020s	sys 0.011s
W20260709 13:01:14.994796  5148 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:01:15.026429  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:14.984380  5196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.017s	sys 0.020s
I20260709 13:01:14.962661  5116 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:15.071604  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:15.071874  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 2189) took 1052 ms. Trace:
I20260709 13:01:15.072430  1539 raft_consensus.cc:2368] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8.
I20260709 13:01:14.868144  5281 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:15.069348  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:15.088655  1541 raft_consensus.cc:2393] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 5: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:15.070328  1691 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:15.070560  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:15.072259  1693 rpcz_store.cc:276] 0709 13:01:14.019301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.019433 (+   132us) service_pool.cc:224] Handling call
0709 13:01:15.071681 (+1052248us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b540044b954. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:15.071819 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2036201856}
I20260709 13:01:15.072773  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:15.092604  1540 raft_consensus.cc:2393] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:15.070537  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:15.093096  1695 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:01:15.029743  1586 leader_election.cc:400] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8.
I20260709 13:01:15.074162  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:15.035207  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:15.093888  1586 leader_election.cc:403] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:15.094111  1538 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:01:15.037945  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:15.037271  2241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 751) took 1104 ms. Trace:
W20260709 13:01:15.094647  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 65064.5us
I20260709 13:01:15.011325  5263 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.101105  1694 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:01:15.086203  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:15.086936  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:14.981668  5137 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:15.066161  5196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.019s	sys 0.020s
I20260709 13:01:15.095757  1547 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:01:15.105155  1547 pending_rounds.cc:85] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 8
I20260709 13:01:15.105402  1547 pending_rounds.cc:107] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:01:15.105616  1547 raft_consensus.cc:2889] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:15.103669  1696 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:15.098105  1586 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:15.101035  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:15.094760  2241 rpcz_store.cc:276] 0709 13:01:13.932628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.932797 (+   169us) service_pool.cc:224] Handling call
0709 13:01:13.933217 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.001607 (+ 68390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.001659 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.002225 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.385559 (+383334us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:14.385603 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.385672 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.036977 (+651305us) raft_consensus.cc:1685] finished
0709 13:01:15.037009 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.037196 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67851,"raft.queue_time_us":157193,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3384,"thread_start_us":310840,"threads_started":1,"wal-append.queue_time_us":816236}
I20260709 13:01:15.033336  5081 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:15.104465  1689 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:15.097878  1692 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:15.107769  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:15.107896  2244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 800) took 1436 ms. Trace:
I20260709 13:01:15.137182  1695 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:01:15.000092  4933 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:15.168715  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 70709.7us
I20260709 13:01:15.028038  5048 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.139667  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2572) took 1350 ms. Trace:
I20260709 13:01:15.186064  1613 rpcz_store.cc:276] 0709 13:01:13.789617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.790250 (+   633us) service_pool.cc:224] Handling call
0709 13:01:13.823635 (+ 33385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.824089 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.824134 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.824739 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.393352 (+568613us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:14.393396 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.393464 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.111845 (+718381us) raft_consensus.cc:1685] finished
0709 13:01:15.139436 (+ 27591us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.139596 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3068,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":17992,"thread_start_us":501295,"threads_started":1,"wal-append.queue_time_us":854533}
I20260709 13:01:15.170737  1695 pending_rounds.cc:85] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 7
W20260709 13:01:15.041201  5204 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.017s	sys 0.005s
W20260709 13:01:15.188935  5204 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.017s	sys 0.006s
I20260709 13:01:15.017307  5290 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:15.139211  1688 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:15.184051  5251 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8.
I20260709 13:01:15.169687  2244 rpcz_store.cc:276] 0709 13:01:13.671616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.671736 (+   120us) service_pool.cc:224] Handling call
0709 13:01:13.672002 (+   266us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:14.104144 (+432142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.104178 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:14.104927 (+   749us) log.cc:844] Serialized 52 byte log entry
0709 13:01:14.595563 (+490636us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:14.595601 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.595662 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.107684 (+512022us) raft_consensus.cc:1685] finished
0709 13:01:15.107702 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.107827 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44110,"raft.queue_time_us":193344,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":24375,"thread_start_us":850358,"threads_started":2,"wal-append.queue_time_us":733435}
I20260709 13:01:15.195562  5196 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:15.196578  5281 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:15.184573  1696 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:15.196175  5196 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:15.201862  1695 pending_rounds.cc:107] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:01:15.259408  1695 raft_consensus.cc:2889] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:15.066757  5253 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:15.265350  5181 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:15.266018  5181 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:15.266989  5253 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:15.260644  5276 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:15.104838  5263 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:15.143267  5214 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:15.139619  5210 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:15.072440  5265 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:01:15.088574  5228 consensus_queue.cc:237] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:15.269025  4746 raft_consensus.cc:2804] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:15.260370  5262 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:15.258066  5091 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:15.276499  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 450599us
I20260709 13:01:15.295771  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:15.307461  2241 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
W20260709 13:01:15.283782  5295 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:01:15.317185  2246 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:15.308720  1660 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:15.357204  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 48552.9us
W20260709 13:01:15.321133  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 380008us
I20260709 13:01:15.366962  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:15.367897  1619 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:15.368427  5289 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.369026  5289 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:15.371446  5283 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:15.371922  5283 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.372265  5283 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:15.293722  5210 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:15.279647  5196 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:15.376176  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:15.376936  2237 consensus_meta.cc:287] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.000s
I20260709 13:01:15.407996  2210 leader_election.cc:304] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:15.408375  2237 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 5.
I20260709 13:01:15.408443  2211 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:15.279102  4933 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:15.284227  5185 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:15.402153  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:15.431733  1618 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 11: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:15.405939  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:15.432775  1621 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:01:15.304040  4746 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:15.283768  5278 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:15.301079  5127 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:15.447120  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:15.412197  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.414414  1613 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:01:15.418833  5024 consensus_meta.cc:287] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.001s
I20260709 13:01:15.420481  5137 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:15.310580  5091 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:15.422004  5181 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:15.307868  5262 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:15.435863  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:15.438917  2211 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:15.450951  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:15.455657  1662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.009s	sys 0.035s
I20260709 13:01:15.456056  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:15.418507  4911 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:15.463660  1621 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:15.464834  1662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.009s	sys 0.035s
I20260709 13:01:15.430845  5214 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.465219  1688 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:15.427635  5243 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:15.463199  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.224s	user 0.032s	sys 0.040s
W20260709 13:01:15.491024  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.252s	user 0.032s	sys 0.041s
W20260709 13:01:15.491780  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 1.25356e+06us
I20260709 13:01:15.454422  5253 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:15.496016  1585 leader_election.cc:400] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7.
I20260709 13:01:15.496655  1585 leader_election.cc:403] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:15.478394  1660 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:15.498317  1660 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:15.499692  1660 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:15.480079  5308 log.cc:927] Time spent T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:01:15.486231  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:15.506759  2237 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 7: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:15.507021  1546 raft_consensus.cc:2368] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 8. Current term is 9.
I20260709 13:01:15.443918  4746 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:15.412683  5289 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:15.493417  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:15.444377  5139 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:15.478497  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2537) took 1219 ms. Trace:
W20260709 13:01:15.462201  5275 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.007s	sys 0.011s
I20260709 13:01:15.480444  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:15.484604  5290 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.508630  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:15.511520  2246 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:15.462430  5280 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.012s	sys 0.026s
W20260709 13:01:15.515308  1620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.004s	sys 0.010s
I20260709 13:01:15.485962  5185 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:15.485040  5281 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:15.514546  1544 rpcz_store.cc:276] 0709 13:01:14.259386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.259498 (+   112us) service_pool.cc:224] Handling call
0709 13:01:14.259771 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.260142 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.260171 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.269039 (+  8868us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.764814 (+495775us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:14.764878 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.764980 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.478280 (+713300us) raft_consensus.cc:1685] finished
0709 13:01:15.478298 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.478437 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36160,"raft.queue_time_us":4632,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":18465,"thread_start_us":430440,"threads_started":1,"wal-append.queue_time_us":696136}
I20260709 13:01:15.494467  5243 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:15.529515  1620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.004s	sys 0.010s
I20260709 13:01:15.531899  1660 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:15.463955  5024 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:15.536104  1621 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
W20260709 13:01:15.522142  5275 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.007s	sys 0.012s
I20260709 13:01:15.508641  5278 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:15.543017  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 49729.8us
I20260709 13:01:15.513626  5048 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:15.492057  5214 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:15.561512  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 59001.3us
I20260709 13:01:15.624202  1585 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:15.570847  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:15.571131  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:15.598028  1622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.011s	sys 0.036s
W20260709 13:01:15.630510  1622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.012s	sys 0.036s
I20260709 13:01:15.632267  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 627) took 1479 ms. Trace:
I20260709 13:01:15.531729  5253 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:15.522535  5276 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:15.551858  5243 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:15.561061  4916 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.005s	sys 0.012s
I20260709 13:01:15.545259  5138 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7.
I20260709 13:01:15.540556  5185 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.551345  5249 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:15.633448  1622 rpcz_store.cc:276] 0709 13:01:14.153430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.153630 (+   200us) service_pool.cc:224] Handling call
0709 13:01:14.178991 (+ 25361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.179296 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:14.625701 (+446405us) log.cc:844] Serialized 14 byte log entry
0709 13:01:15.631917 (+1006216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:15.631989 (+    72us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:15.632031 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.632096 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.632212 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":382261,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":94230,"spinlock_wait_cycles":24621952,"thread_start_us":1417660,"threads_started":3,"wal-append.queue_time_us":868983}
I20260709 13:01:15.624126  5278 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:15.630528  1659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.000s	sys 0.020s
W20260709 13:01:15.726420  1659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.000s	sys 0.021s
W20260709 13:01:15.726830  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 788719us
I20260709 13:01:15.727707  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:15.527086  5116 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:15.647329  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 471482us
W20260709 13:01:15.633985  5279 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:01:15.638743  1585 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:15.606063  5024 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:15.645711  5276 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.602380  5211 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:15.730902  1586 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:15.689271  4916 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.006s	sys 0.014s
W20260709 13:01:15.734982  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 96315.2us
I20260709 13:01:15.750413  1585 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:15.528889  5280 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.013s	sys 0.027s
W20260709 13:01:15.689590  5298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.005s	sys 0.012s
I20260709 13:01:15.540083  5290 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:15.641037  5291 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:15.641796  5048 raft_consensus.cc:697] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:01:15.722911  5314 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.421s	user 0.000s	sys 0.001s
W20260709 13:01:15.736145  5038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.014s	sys 0.027s
I20260709 13:01:15.693979  5185 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:15.795334  5254 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.552639  5281 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:15.732002  5278 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.767747  1585 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:15.775609  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:15.771622  5139 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:15.740051  5249 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:15.645763  5253 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:15.816797  2242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 760) took 1222 ms. Trace:
I20260709 13:01:15.742086  5276 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:15.764566  5081 consensus_meta.cc:287] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.003s
I20260709 13:01:15.741744  5210 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:15.749456  5138 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:15.740253  5320 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:15.740294  5211 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.764309  5127 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:15.795879  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 356993us
W20260709 13:01:15.779531  5261 consensus_meta.cc:287] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 1.097s	user 0.011s	sys 0.002s
W20260709 13:01:15.780048  5038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.015s	sys 0.028s
I20260709 13:01:15.634943  5321 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:15.804916  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:15.759577  5024 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:01:15.793967  5307 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.317s	user 0.001s	sys 0.001s
I20260709 13:01:15.788224  5091 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:15.802645  5318 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
W20260709 13:01:15.815685  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:15.815995  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 48368.3us
I20260709 13:01:15.852722  1585 leader_election.cc:400] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10.
I20260709 13:01:15.854579  1585 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:15.817432  1696 raft_consensus.cc:2410] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:01:15.817174  2242 rpcz_store.cc:276] 0709 13:01:14.594090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.594245 (+   155us) service_pool.cc:224] Handling call
0709 13:01:14.594605 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.595547 (+   942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.595578 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.602255 (+  6677us) log.cc:844] Serialized 26 byte log entry
0709 13:01:15.101899 (+499644us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:15.103077 (+  1178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.103143 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.816563 (+713420us) raft_consensus.cc:1685] finished
0709 13:01:15.816586 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.816734 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1236,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":19046,"spinlock_wait_cycles":489216,"thread_start_us":472596,"threads_started":1,"wal-append.queue_time_us":671959}
W20260709 13:01:15.818039  5317 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:01:15.805682  4911 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:15.815385  5262 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:15.829872  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 100032us
I20260709 13:01:15.772480  5316 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:01:15.842438  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:15.818178  5324 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:15.806584  5254 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:15.842159  2211 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:15.808874  5283 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:15.869547  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.838269  5211 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:15.825759  5081 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:15.870260  5223 consensus_meta.cc:287] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 1.038s	user 0.009s	sys 0.003s
I20260709 13:01:15.875371  5173 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.135s
I20260709 13:01:15.947413  5285 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:15.929597  5313 log.cc:927] Time spent T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:01:15.841828  5127 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:15.929157  5335 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:01:15.940701  5330 log.cc:927] Time spent T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:01:15.939780  5332 log.cc:927] Time spent T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:01:15.920600  5336 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:01:15.935277  5310 log.cc:927] Time spent T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.579s	user 0.000s	sys 0.001s
I20260709 13:01:15.838136  5321 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:15.930825  5301 log.cc:927] Time spent T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.757s	user 0.001s	sys 0.001s
W20260709 13:01:15.919705  5323 log.cc:927] Time spent T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:01:16.003331  5253 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:16.024153  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 182043us
W20260709 13:01:16.015942  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 228675us
I20260709 13:01:15.951467  5214 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:15.924875  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.841291  5048 consensus_queue.cc:237] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.039731  1687 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:16.029117  5261 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:16.033947  5277 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:16.038883  5348 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:16.062436  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:16.070613  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:16.039217  5223 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.072427  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2201) took 1171 ms. Trace:
I20260709 13:01:16.072912  1693 rpcz_store.cc:276] 0709 13:01:14.901138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.091795 (+190657us) service_pool.cc:224] Handling call
0709 13:01:15.092157 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.105358 (+ 13201us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:15.105390 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.105825 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:01:15.633358 (+527533us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:15.633420 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.633507 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.072213 (+438706us) raft_consensus.cc:1685] finished
0709 13:01:16.072237 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.072368 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84960,"raft.queue_time_us":18794,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6533,"thread_start_us":393469,"threads_started":1,"wal-append.queue_time_us":689822}
I20260709 13:01:16.044718  5276 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.076455  5214 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:16.069790  5348 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.083838  5223 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:16.056480  5321 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.065852  5261 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:16.069913  5277 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.094116  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 639) took 1275 ms. Trace:
W20260709 13:01:16.174641  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 178143us
W20260709 13:01:16.095212  1511 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 1.551s (SENT) [suppressed 26 similar messages]
I20260709 13:01:16.096928  5127 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:16.100850  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:16.177665  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:16.104081  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:16.107649  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:16.179468  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:16.180213  1694 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:16.181164  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:16.108773  5241 raft_consensus.cc:3055] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:16.109956  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:16.110723  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:16.182468  1688 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:16.182981  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:16.111735  5210 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.111832  5281 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:16.112409  5196 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.113060  5091 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.115006  5302 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.116259  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:16.210701  1541 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:16.212062  1619 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:16.212939  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2208) took 1310 ms. Trace:
I20260709 13:01:16.213668  1619 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:16.214255  1613 raft_consensus.cc:1275] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:16.215634  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:16.216342  1617 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:16.218741  5327 log.cc:927] Time spent T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.461s	user 0.001s	sys 0.001s
W20260709 13:01:16.220639  5339 log.cc:927] Time spent T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:01:16.118328  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:16.221609  1539 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 7: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:16.119597  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:16.222306  1538 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:16.119882  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:16.120535  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:16.121996  1547 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:16.164350  5116 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:16.123795  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 2191) took 2096 ms (client timeout 2684 ms). Trace:
I20260709 13:01:16.124311  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:16.124429  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:16.229363  1690 rpcz_store.cc:269] 0709 13:01:14.027372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.027500 (+   128us) service_pool.cc:224] Handling call
0709 13:01:16.123598 (+2096098us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b5400386654. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:16.123739 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3958766976}
I20260709 13:01:16.229873  1545 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 5.
W20260709 13:01:16.074788  4746 consensus_meta.cc:287] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.001s
I20260709 13:01:16.062839  5290 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:16.128530  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:16.129256  1512 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:16.139803  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 2203) took 1238 ms. Trace:
I20260709 13:01:16.151491  5283 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:16.156351  5329 log.cc:927] Time spent T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.352s	user 0.000s	sys 0.003s
I20260709 13:01:16.156476  5138 raft_consensus.cc:697] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:01:16.163594  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 309057us
I20260709 13:01:16.299535  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:16.300431  1585 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:16.166230  1660 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:16.168162  5222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.183s	user 0.025s	sys 0.073s
W20260709 13:01:16.175796  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.183223  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:16.187343  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:16.309033  1694 raft_consensus.cc:2393] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 9: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:16.187605  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 531) took 1363 ms. Trace:
I20260709 13:01:16.310020  1687 rpcz_store.cc:276] 0709 13:01:14.823709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.032967 (+209258us) service_pool.cc:224] Handling call
0709 13:01:15.033237 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.064409 (+1031172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.187346 (+122937us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000f19d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:16.187537 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2314034048}
W20260709 13:01:16.282562  5243 consensus_meta.cc:287] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.004s
I20260709 13:01:16.311609  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:16.312742  1687 raft_consensus.cc:2410] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:16.170615  5173 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 13:01:16.313988  1687 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:16.302893  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 136721us
I20260709 13:01:16.174940  1620 rpcz_store.cc:276] 0709 13:01:14.818978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.821703 (+  2725us) service_pool.cc:224] Handling call
0709 13:01:14.822030 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.852323 (+ 30293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.852373 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.872652 (+ 20279us) log.cc:844] Serialized 26 byte log entry
0709 13:01:15.547671 (+675019us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:15.547729 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.547826 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.093845 (+546019us) raft_consensus.cc:1685] finished
0709 13:01:16.093869 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.094034 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5951,"raft.queue_time_us":32969,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":15971,"thread_start_us":571534,"threads_started":1,"wal-append.queue_time_us":812496}
I20260709 13:01:16.179011  1695 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:16.205588  5278 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.206388  5185 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.213333  1691 rpcz_store.cc:276] 0709 13:01:14.902935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.099071 (+196136us) service_pool.cc:224] Handling call
0709 13:01:15.191473 (+ 92402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.270971 (+ 79498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.271002 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.275194 (+  4192us) log.cc:844] Serialized 26 byte log entry
0709 13:01:15.511431 (+236237us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:15.511468 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.511537 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.072259 (+560722us) raft_consensus.cc:1685] finished
0709 13:01:16.072294 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.212683 (+140389us) spinlock_profiling.cc:243] Waited 92 ms on lock 0x7b540014f850. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:16.212879 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96908,"raft.queue_time_us":80971,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":2723,"spinlock_wait_cycles":211685120,"thread_start_us":233380,"threads_started":1,"wal-append.queue_time_us":454063}
I20260709 13:01:16.116420  5254 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:16.221424  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.119141  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:16.219691  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.123458  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:16.335369  1622 raft_consensus.cc:2410] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:16.226219  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.247995  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:16.335937  1538 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:16.336098  1615 raft_consensus.cc:2410] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:16.283980  1692 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:16.284433  1689 rpcz_store.cc:276] 0709 13:01:14.901670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.957414 (+ 55744us) service_pool.cc:224] Handling call
0709 13:01:16.139492 (+1182078us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54001351d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:16.139707 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330517248}
I20260709 13:01:16.250006  1541 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:16.263792  1617 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:16.170693  5214 raft_consensus.cc:697] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:16.287051  1587 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:16.338905  1542 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 10: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:01:16.339025  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 52055us
W20260709 13:01:16.307904  5222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.327s	user 0.026s	sys 0.073s
W20260709 13:01:16.297783  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 168570us
I20260709 13:01:16.340086  1538 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:01:16.340857  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:16.176159  5261 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:16.176707  5341 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:16.186600  5241 raft_consensus.cc:740] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:01:16.283988  5263 consensus_meta.cc:287] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.997s	user 0.012s	sys 0.001s
I20260709 13:01:16.307214  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:16.320935  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 258752us
I20260709 13:01:16.323719  1687 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:16.325596  1585 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:16.330348  1696 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:16.337229  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:16.309341  4933 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:16.348060  1547 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:16.328608  5290 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:16.249176  5302 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.249548  5091 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.367552  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.356521  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.357729  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:16.223553  5210 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.331355  5289 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:16.359318  1688 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:16.250289  5196 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.290051  4746 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.371417  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:16.372179  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:16.374612  5091 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:16.377635  1585 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:16.348572  5288 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:01:16.383702  5127 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:16.384423  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 289187us
W20260709 13:01:16.345094  5228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.006s	sys 0.001s
W20260709 13:01:16.392573  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.353770  5137 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:16.395089  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 260736us
I20260709 13:01:16.344255  5341 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:16.404047  1617 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:16.339289  5291 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:01:16.357003  5299 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:16.343263  5143 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:01:16.331739  5243 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:16.410688  5228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.006s	sys 0.002s
I20260709 13:01:16.422513  1617 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
W20260709 13:01:16.416883  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 73384.8us
I20260709 13:01:16.471705  1587 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:16.357271  5263 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.409763  5290 raft_consensus.cc:697] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:16.459882  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:16.366694  5254 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:01:16.424337  5289 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.440883  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:16.410476  5137 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.487066  2209 leader_election.cc:400] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8.
I20260709 13:01:16.501319  2209 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:16.488139  2242 raft_consensus.cc:1240] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:16.491794  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:16.503922  2237 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
W20260709 13:01:16.496203  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 118584us
I20260709 13:01:16.493639  2241 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:16.425179  5341 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.518452  2209 leader_election.cc:400] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 8. Current term is 9.
I20260709 13:01:16.513167  1660 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:16.476778  4933 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.524986  2244 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:16.486135  5356 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.540580  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:16.541324  1615 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.440672  5320 consensus_queue.cc:1059] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:01:16.508602  5137 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.514358  5276 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:16.513613  5251 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:16.412117  5138 consensus_queue.cc:237] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:16.565773  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 58837.1us
I20260709 13:01:16.569629  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.579267  1618 raft_consensus.cc:2393] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 11: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 13:01:16.578632  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 236339us
I20260709 13:01:16.540863  4933 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.462037  5299 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.487751  5173 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:01:16.470846  5214 consensus_queue.cc:237] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.579811  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:16.493631  5311 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:01:16.512091  5355 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:16.580437  1512 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:16.587180  1586 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:16.577054  5048 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:16.424118  5241 consensus_queue.cc:260] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.528067  5316 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:01:16.534410  5081 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:16.547876  5348 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:16.597726  5320 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:16.605006  4933 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:16.625695  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:16.626210  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.626425  1617 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.627209  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.605799  5322 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:01:16.512501  5289 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.629935  1512 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:16.633105  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.642984  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.627508  5320 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.650900  1620 raft_consensus.cc:2393] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:16.656149  1617 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:16.657941  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:16.659596  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.660271  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.660509  1613 raft_consensus.cc:2393] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:16.621290  5119 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:16.548717  5356 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.619338  5185 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:16.661846  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:16.628677  5302 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:16.679365  1620 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:16.649142  5241 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.642850  5081 raft_consensus.cc:697] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:16.681260  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:16.684934  1620 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:16.669746  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.681663  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:16.683600  5349 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:01:16.686430  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:16.688928  1617 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:16.668843  5348 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:16.624292  5048 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.703048  1617 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:16.676990  5355 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:16.689884  5211 consensus_meta.cc:287] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.005s
I20260709 13:01:16.640161  4911 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:01:16.715510  1620 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:16.676755  4746 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:16.653363  4933 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
W20260709 13:01:16.708261  5358 log.cc:927] Time spent T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:01:16.735733  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.733283  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.737224  1620 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:16.738054  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.738554  1620 raft_consensus.cc:2410] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:16.718051  5173 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:16.745132  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:16.745746  1620 raft_consensus.cc:2393] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:16.746238  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.663111  5290 consensus_queue.cc:237] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.725112  5348 raft_consensus.cc:697] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:16.750501  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.751075  1620 raft_consensus.cc:2393] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 6: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:16.751782  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:16.760212  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 93072.2us
I20260709 13:01:16.742313  5376 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.762681  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.765148  1512 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:16.765897  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.766897  1621 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:16.767143  1512 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:16.768676  1621 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:16.744556  5263 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:16.748955  5196 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:16.762048  5374 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:16.732090  5211 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.759116  5243 leader_election.cc:290] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:16.791658  5359 log.cc:927] Time spent T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:01:16.791785  4911 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:16.792268  5370 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:16.792618  4911 consensus_queue.cc:1059] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:16.792999  5372 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:16.793370  4911 consensus_queue.cc:1243] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer 822e08445eae4a33b2f2fe92060192c6 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:16.793490  5372 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:16.793990  5372 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:16.796876  5368 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:01:16.797501  5357 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:01:16.724293  5355 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.799844  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:16.800343  5355 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:16.801131  5363 log.cc:927] Time spent T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:01:16.751816  5173 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.791062  1615 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:16.805977  1620 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:16.758800  5366 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:16.807346  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.772549  5139 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:16.813011  1615 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:16.812575  5366 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.818364  5366 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:16.819384  5173 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:16.821825  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 206582us
I20260709 13:01:16.805145  5196 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:16.832970  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:16.814620  4933 raft_consensus.cc:3055] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:16.837574  5382 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:16.820722  5371 log.cc:927] Time spent T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:01:16.814218  5119 raft_consensus.cc:697] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:16.759860  5081 consensus_queue.cc:237] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.850004  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.780656  5376 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.853524  5376 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:16.853719  5382 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:16.854195  5382 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:16.854554  5382 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:16.854606  5373 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:01:16.822178  5348 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.863132  5283 raft_consensus.cc:3055] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:16.863673  5283 raft_consensus.cc:740] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:16.863994  1511 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:16.864451  5283 consensus_queue.cc:260] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.865187  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:16.865846  5283 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:16.870960  5277 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:16.866973  1511 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:16.843271  5356 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:16.834200  5196 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.835680  4933 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:01:16.846262  5321 consensus_meta.cc:287] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.001s
I20260709 13:01:16.874848  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.882452  1615 raft_consensus.cc:2393] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 9: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:16.831918  5299 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:16.893415  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.839593  5127 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:16.898950  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.879472  5230 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.878818  5196 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:16.899968  1618 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:16.902058  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 133140us
I20260709 13:01:16.906857  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.897493  5385 raft_consensus.cc:3060] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:16.895735  5321 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.907651  5091 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:16.922744  5382 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.905859  5372 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.930770  5210 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:16.929692  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.913899  5119 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.900089  5341 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.905110  5320 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:16.904304  5230 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:16.934041  1615 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:01:16.911420  4933 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.958977  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.953934  5372 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:16.955801  5382 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:16.956436  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 52489.3us
I20260709 13:01:16.963069  2246 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:16.964607  5382 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:16.967171  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.969348  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.970201  1615 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:16.971467  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:16.972697  1615 raft_consensus.cc:2410] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:16.975833  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:16.978344  5382 consensus_queue.cc:1059] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:16.979915  5382 raft_consensus.cc:3055] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:16.980449  5382 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:16.981570  5382 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:16.983065  5382 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.985918  2238 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:16.967757  5367 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:16.986482  2210 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:16.990032  2210 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:16.971095  5352 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.658s	user 0.000s	sys 0.003s
I20260709 13:01:16.994011  2210 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:16.960750  5320 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:17.000066  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:16.963879  4933 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:16.958292  5290 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:17.006269  2209 leader_election.cc:336] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.703s (SENT)
I20260709 13:01:17.012652  2209 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:16.988348  5367 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.014873  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:16.992257  5350 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:16.996097  5355 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:16.998013  5263 raft_consensus.cc:2804] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:16.962446  5137 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.018965  5367 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.028584  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.020059  5322 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:17.034235  5137 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:17.035091  5211 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:17.015955  5290 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:17.026122  5263 raft_consensus.cc:697] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:17.011850  5320 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.050653  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.051193  1541 raft_consensus.cc:2376] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7. Re-sending same reply.
W20260709 13:01:17.044430  5261 consensus_meta.cc:287] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.685s	user 0.008s	sys 0.004s
W20260709 13:01:17.053532  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 186603us
I20260709 13:01:17.061853  5289 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:17.061919  1545 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:01:17.064482  5048 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:17.068753  5392 log.cc:927] Time spent T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:01:17.071126  5388 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:01:17.048341  5366 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.073011  1619 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:17.073591  5366 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:17.074183  1619 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:17.075335  1619 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:17.075441  5230 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:17.075937  5048 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.076375  1619 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:17.076426  5048 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.080010  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:17.080622  2242 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:17.081461  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:17.081461  2244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45882 (request call id 737) took 1455 ms. Trace:
I20260709 13:01:17.082988  2244 rpcz_store.cc:276] 0709 13:01:15.625683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.627082 (+  1399us) service_pool.cc:224] Handling call
0709 13:01:15.644381 (+ 17299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.535563 (+891182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.081242 (+545679us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54005da2d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:17.081402 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2024529280}
I20260709 13:01:17.082290  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:17.092612  5320 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:17.068262  5261 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:17.094360  2243 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:17.095412  5048 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:17.096520  5341 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:17.096761  5278 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:17.097371  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:17.098011  2245 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:17.101994  5385 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:17.103189  5393 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:01:17.105819  5321 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:17.158218  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2563) took 1033 ms. Trace:
I20260709 13:01:17.095439  5261 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:17.158685  1544 rpcz_store.cc:276] 0709 13:01:16.127958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.311065 (+183107us) service_pool.cc:224] Handling call
0709 13:01:16.343960 (+ 32895us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.344239 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.344266 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:16.354369 (+ 10103us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.858816 (+504447us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b18002075e0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb0d1 00007fc4916e6a0f
0709 13:01:16.899620 (+ 40804us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:16.899709 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.899911 (+   202us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.157884 (+257973us) raft_consensus.cc:1685] finished
0709 13:01:17.157914 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.158149 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3463,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":10892,"spinlock_wait_cycles":38047488,"thread_start_us":38462,"threads_started":1,"wal-append.queue_time_us":628154}
I20260709 13:01:17.165473  5290 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:17.148532  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 646909798f0047ef9e8073d28a784525: Illegal state: Replica d7158d6c3b634dc7abb69eac58eba291 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:17.105201  5382 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:01:17.156337  2243 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:17.170161  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:17.169420  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:17.171967  5278 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:17.172070  5263 consensus_queue.cc:237] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:17.172744  5278 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:17.174985  5278 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:17.176714  5278 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.177245  5278 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:17.178524  5048 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.179373  5278 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:17.179184  5048 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:17.178433  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:17.180478  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:17.180714  2242 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:17.183653  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.184321  1544 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:01:17.185982  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:17.184633  5048 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:17.170136  5290 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.179899  5278 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:17.191010  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:17.191062  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:17.194056  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:17.199750  2242 raft_consensus.cc:2410] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:01:17.189157  5241 consensus_meta.cc:287] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.006s
W20260709 13:01:17.200479  5394 log.cc:927] Time spent T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.104s	user 0.000s	sys 0.003s
I20260709 13:01:17.200361  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:17.186839  5285 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:01:17.202322  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.213899  5385 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:17.214301  5385 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:17.220183  4916 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:17.220775  4916 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:17.222886  5277 raft_consensus.cc:3055] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:17.223312  5277 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:17.224519  4916 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:17.224223  5277 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:17.225430  5277 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:17.195951  5320 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:17.231389  1544 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:01:17.231781  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2589) took 1020 ms. Trace:
I20260709 13:01:17.185484  5196 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.232252  1614 rpcz_store.cc:276] 0709 13:01:16.211624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.222088 (+ 10464us) service_pool.cc:224] Handling call
0709 13:01:16.222446 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.222688 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:16.412041 (+189353us) log.cc:844] Serialized 14 byte log entry
0709 13:01:17.231435 (+819394us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:17.231488 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:17.231538 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.231620 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.231725 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":356837,"prepare.queue_time_us":120576,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"thread_start_us":570259,"threads_started":2,"wal-append.queue_time_us":493447}
I20260709 13:01:17.236208  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:17.237067  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:17.231082  1542 raft_consensus.cc:1240] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:17.239120  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.239809  1614 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:17.196707  5048 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.214852  5385 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.244807  5385 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:17.232831  5320 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:17.245848  5127 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.246263  5320 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:17.246369  5127 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.247506  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:17.251682  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.252168  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:17.252713  1687 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:17.252835  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.253607  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.253876  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.254736  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.255555  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:17.255841  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.256067  1619 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.254930  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.256873  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.197646  5290 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.258059  1616 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:01:17.258625  1696 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:17.262338  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 439676us
I20260709 13:01:17.242440  4785 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:17.266578  4785 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:17.268496  5366 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.269227  5196 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:17.269047  5366 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.270030  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:17.270639  5048 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.271368  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.272650  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.273731  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.279175  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:17.283293  5397 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.112s	user 0.000s	sys 0.002s
I20260709 13:01:17.285176  5091 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.286250  5254 consensus_queue.cc:1059] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:17.286839  5091 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.287456  5254 raft_consensus.cc:3055] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:17.287842  5254 raft_consensus.cc:740] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:17.288859  5091 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:17.288995  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.288569  5254 consensus_queue.cc:260] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.290098  5254 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:17.279837  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.292721  1620 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:17.293535  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:17.293728  1693 raft_consensus.cc:2410] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:17.294545  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.295782  5285 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.296416  5285 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.297011  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.298121  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:17.299643  5285 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:17.301203  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:17.301626  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:17.301821  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:17.302295  1691 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:01:17.302663  1660 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:17.302950  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:17.303087  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:17.303594  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:17.303881  1690 raft_consensus.cc:2368] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 8. Current term is 9.
I20260709 13:01:17.304134  5285 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:17.301991  1692 raft_consensus.cc:2410] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:01:17.307847  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 927e42de9e944ae8a2d45f30be59d5df: Illegal state: Replica dcc91bf6e3bd468bbbbfc26e3a7c5e01 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:17.304497  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:17.308533  1695 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:17.309513  5285 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:17.305073  5127 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:17.286127  1511 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:17.313689  1511 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:17.305915  5367 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.312934  5285 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.306290  1693 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:17.297503  5196 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.316522  1511 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:17.302577  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:17.310060  1687 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:17.310698  5211 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.285517  4785 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:17.306128  1441 catalog_manager.cc:5697] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 9 to 11, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:17.313513  1619 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:01:17.321045  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.279906  1617 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:17.359406  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:17.359084  1441 catalog_manager.cc:5697] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.360206  1619 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:17.317019  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.362232  1539 raft_consensus.cc:2376] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6. Re-sending same reply.
I20260709 13:01:17.338280  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:17.339469  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:17.364184  1692 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:17.341908  1511 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:17.366557  1511 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:17.367123  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.368459  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.370189  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:17.370898  1619 raft_consensus.cc:2376] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8. Re-sending same reply.
I20260709 13:01:17.368635   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:17.371915  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.373342  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.374500  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.374716  1511 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:17.375308  1618 raft_consensus.cc:2368] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7.
W20260709 13:01:17.375392  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.360899  1441 catalog_manager.cc:5697] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:17.368547  1660 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:17.376641  1441 catalog_manager.cc:5697] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 8 to 9, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 9 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.381492  1441 catalog_manager.cc:5697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.383842  1617 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:17.356575  4933 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:17.376617  1587 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:17.404239  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:17.404310  1511 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:17.403364  5238 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:17.406865  5238 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:17.387687  5302 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:17.411149  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.412259  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.407581  1696 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:17.412839  1544 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:01:17.413509  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.414238  1543 raft_consensus.cc:2368] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 8. Current term is 9.
I20260709 13:01:17.415593  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.415885  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:17.416415  1694 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:01:17.416767  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:17.417474  5238 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:17.417644  1692 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:01:17.417979  1692 pending_rounds.cc:85] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 4
I20260709 13:01:17.365480  5196 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.201675  5278 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.387881  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.389645  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.284483  5366 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:17.418234  1692 pending_rounds.cc:107] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:01:17.422784  1615 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:17.423014  1692 raft_consensus.cc:2889] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:17.426218  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:17.426417  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.426869  1687 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:17.367617  5091 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:17.429661  5281 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:17.430236  5395 consensus_queue.cc:1059] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:17.431049  1511 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:17.401228  5181 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:17.431306  5214 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:17.405390  1587 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:17.426431  1442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42132 (request call id 240) took 17341 ms (client timeout 15000 ms). Trace:
I20260709 13:01:17.432420  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:17.450750  1694 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:17.432991  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.452569  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.433215  5299 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:17.432996  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:17.434365  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.455478  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.455830  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:17.456516  1543 raft_consensus.cc:2368] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:01:17.434499  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.457402  1511 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:17.435097  1659 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:17.435742  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.435950  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:17.459311  1538 raft_consensus.cc:2376] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9. Re-sending same reply.
I20260709 13:01:17.459506  1692 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:17.460561  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.462023  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.436474  5348 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:17.436626  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.436053  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.437021  5119 consensus_queue.cc:1059] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:17.438546  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.473603  1539 raft_consensus.cc:2368] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:01:17.473541  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.474635  1540 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:17.439071  1690 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:01:17.439179  1617 raft_consensus.cc:1240] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:17.440507  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:17.446103  1618 raft_consensus.cc:2393] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 5: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:17.336386  5400 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:17.382617  1441 catalog_manager.cc:5697] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 6 to 8, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:17.435037  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:17.464073  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 58748.6us
I20260709 13:01:17.465255  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.477456  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:17.482096  1441 catalog_manager.cc:5697] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 5 to 9, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:17.484073  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.484856  1539 raft_consensus.cc:2368] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6.
I20260709 13:01:17.485607  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.484541  1441 catalog_manager.cc:5697] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 7 to 8, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:17.487422  1441 catalog_manager.cc:5697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.495312  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.444665  5383 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:17.498978  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:17.499509  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.467594  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.400301  5389 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:17.469393  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:17.478281  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.478710  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.501832  1546 raft_consensus.cc:2368] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13.
I20260709 13:01:17.502899  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.445845  5091 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:17.504041  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:17.504942  1690 raft_consensus.cc:2368] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7.
I20260709 13:01:17.504992  1587 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:17.504081  1543 raft_consensus.cc:2410] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:01:17.375598  5211 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.454763  5381 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.512671  1538 raft_consensus.cc:2393] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:17.513477  1693 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:01:17.471688  4911 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:17.454428  5299 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:17.472276  5143 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:17.489847  1441 catalog_manager.cc:5697] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:17.479635  4933 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:17.470326  5348 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:17.545297  1441 catalog_manager.cc:5697] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 5 to 7, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:17.548486  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.557017  1441 catalog_manager.cc:5697] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 4 to 7, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 7 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.502635  5389 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.512431  4916 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:17.514341  5181 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:17.539639  5119 consensus_queue.cc:1243] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:17.483846  5341 consensus_queue.cc:1059] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:01:17.589003  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.523581  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:17.590107  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 331234us
I20260709 13:01:17.540293  5048 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:17.548966  5299 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:17.510728  5091 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.619508  1538 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:17.624627  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.605610  1441 catalog_manager.cc:5697] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:17.626595  1441 catalog_manager.cc:5697] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.539795  5383 raft_consensus.cc:697] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:17.546226  5367 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:17.570168  5400 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:17.561060  5348 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:17.549103  5143 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.625607  1538 raft_consensus.cc:2393] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:17.582331  5389 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.655275  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.591276  5181 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.557855  5381 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.660445  1544 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:17.662417  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:17.449852  1442 rpcz_store.cc:269] 0709 13:01:00.086362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.087993 (+  1631us) service_pool.cc:224] Handling call
0709 13:01:17.426323 (+17338330us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:13.298308 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:13.463662 (+165354us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:13.463699 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:01:13.463717 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:13.465062 (+  1345us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:13.465120 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:13.465145 (+    25us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:01:13.466083 (+   938us) tablet.cc:701] Row locks acquired
0709 13:01:13.466102 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:01:13.466360 (+   258us) write_op.cc:270] Start()
0709 13:01:13.466467 (+   107us) write_op.cc:276] Timestamp: P: 1783602073466315 usec, L: 0
0709 13:01:13.466487 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:01:13.467214 (+   727us) log.cc:844] Serialized 4848 byte log entry
0709 13:01:14.025250 (+558036us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x7b1800042040. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:01:14.865424 (+840174us) op_driver.cc:464] REPLICATION: finished
0709 13:01:15.798353 (+932929us) write_op.cc:301] APPLY: starting
0709 13:01:15.811178 (+ 12825us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:15.858102 (+ 46924us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:15.862310 (+  4208us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:16.117738 (+255428us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:16.118075 (+   337us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:01:16.118153 (+    78us) write_op.cc:312] APPLY: finished
0709 13:01:16.118549 (+   396us) log.cc:844] Serialized 89 byte log entry
0709 13:01:16.338444 (+219895us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:16.342764 (+  4320us) write_op.cc:454] Released schema lock
0709 13:01:16.352932 (+ 10168us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:16.423202 (+ 70270us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:16.440164 (+ 16962us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1082535,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":896405,"apply.run_cpu_time_us":27358,"apply.run_wall_time_us":606791,"num_ops":12,"prepare.queue_time_us":138866,"prepare.run_cpu_time_us":31855,"prepare.run_wall_time_us":628258,"raft.queue_time_us":666144,"raft.run_cpu_time_us":49894,"raft.run_wall_time_us":986196,"replication_time_us":1355421,"spinlock_wait_cycles":18046720,"thread_start_us":1853215,"threads_started":5,"wal-append.queue_time_us":780327,"wal-append.run_cpu_time_us":27864,"wal-append.run_wall_time_us":1508815}]]}
I20260709 13:01:17.682992  1540 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:17.622352  4916 raft_consensus.cc:697] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:17.651065  5048 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:17.656113  5143 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:17.698729  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.653977  5238 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:17.672019  5181 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:17.704288  1689 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:01:17.723932  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 288839us
I20260709 13:01:17.631824  1441 catalog_manager.cc:5697] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 4 to 8, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 8 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.728382  1441 catalog_manager.cc:5697] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 5 to 9, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 9 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.738377  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.739934  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:17.744261  1659 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:17.748054  1659 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:17.749506  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 272121us
I20260709 13:01:17.751188  1511 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:17.757923  1511 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:17.744402  5278 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:17.765753  5367 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:17.770229  5278 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:17.762874  1511 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:17.708869  5238 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:17.771975  1511 leader_election.cc:400] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7.
I20260709 13:01:17.773397  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:17.783581  1614 raft_consensus.cc:606] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:17.783994  1614 raft_consensus.cc:614] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:17.748908  5251 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:17.783015  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:17.803566  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:17.804111  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 56109us
I20260709 13:01:17.815776  1659 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:17.767412  4911 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:17.809710  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:17.829627  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.832800  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:17.833653  1617 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.834185  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:17.834990  1614 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:17.770973  5278 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:01:17.847419  1659 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:17.856324  1617 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
W20260709 13:01:17.848143  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 378770us
W20260709 13:01:17.860296  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.862633  1659 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:17.864168  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:17.868144  1617 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:17.809407  5119 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:17.809821  4933 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:17.839860  5405 log.cc:927] Time spent T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:01:17.876492  1585 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:17.872123  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.749351  5383 consensus_queue.cc:237] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.830683  1511 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:17.910286  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 79714.2us
I20260709 13:01:17.876485  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:17.912184  1615 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:17.822939  5211 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:17.854085  5400 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:17.911188  1511 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:17.921785  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 50573.6us
I20260709 13:01:17.905723  1614 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:17.819531  4785 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.755795  4916 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:17.916234  2209 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:17.924629  1511 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:17.922689  1585 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:17.932425  1585 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:17.861886  5081 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:17.809599  5251 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:17.948649  2209 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:17.948844  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:17.907739  5382 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:17.937583  1585 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:17.928460  5366 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:17.928948  5119 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:17.938402  5127 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:17.938056  5395 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:17.946013  5356 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:17.928893  5211 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:17.988353  5406 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
W20260709 13:01:17.989163  5402 log.cc:927] Time spent T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:01:17.990207  5210 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:17.992035  5414 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:17.992676  5119 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:17.995601  5241 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:17.997329  5214 raft_consensus.cc:3055] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:18.003407  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:17.963636  5416 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:18.008320  5407 log.cc:927] Time spent T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:01:17.956853  5382 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:18.012353  5408 log.cc:927] Time spent T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:01:18.013342  5420 consensus_queue.cc:1059] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:17.971422  5395 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.027618  5414 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.960242  5138 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:18.003973  5372 raft_consensus.cc:3055] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:17.956306  4933 consensus_queue.cc:1059] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:01:18.040172  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:18.027787  5278 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:18.031595  5285 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:18.027606  5210 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.006387  5381 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:18.036885  5320 consensus_meta.cc:287] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.790s	user 0.013s	sys 0.001s
I20260709 13:01:18.107661  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:18.108525  1542 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 6.
I20260709 13:01:18.034027  5214 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:18.037460  5416 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:17.970310  5038 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:01:18.120052  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2603) took 1420 ms. Trace:
W20260709 13:01:18.064757  5281 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.009s	sys 0.016s
I20260709 13:01:18.049963  5395 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:18.126690  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:18.026861  5211 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:18.135133  1542 raft_consensus.cc:2410] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:18.051203  5414 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:18.118944  5385 consensus_meta.cc:287] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.874s	user 0.011s	sys 0.005s
I20260709 13:01:18.138269  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:18.138833  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2604) took 1421 ms. Trace:
I20260709 13:01:18.120500  1621 rpcz_store.cc:276] 0709 13:01:16.699388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.769838 (+ 70450us) service_pool.cc:224] Handling call
0709 13:01:16.770235 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:17.267429 (+497194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:17.267460 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:17.267946 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:01:17.497682 (+229736us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:17.497724 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.724058 (+226334us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540033ac54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:17.724126 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:18.107150 (+383024us) raft_consensus.cc:1685] finished
0709 13:01:18.107173 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.119975 (+ 12802us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":392579,"raft.queue_time_us":394299,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"spinlock_wait_cycles":239543168,"thread_start_us":229351,"threads_started":1,"wal-append.queue_time_us":404009}
I20260709 13:01:18.034982  5321 consensus_queue.cc:1059] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
W20260709 13:01:18.085331  5277 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.007s	sys 0.020s
W20260709 13:01:18.127717  5281 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.010s	sys 0.017s
I20260709 13:01:18.085474  5210 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:18.139159  1542 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:18.139271  1613 rpcz_store.cc:276] 0709 13:01:16.717867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.779119 (+ 61252us) service_pool.cc:224] Handling call
0709 13:01:16.779516 (+   397us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:17.216754 (+437238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:17.216785 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:17.217380 (+   595us) log.cc:844] Serialized 52 byte log entry
0709 13:01:17.550349 (+332969us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:17.550389 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.550455 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:18.138604 (+588149us) raft_consensus.cc:1685] finished
0709 13:01:18.138624 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.138777 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":436836,"raft.queue_time_us":437176,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":74,"thread_start_us":332632,"threads_started":1,"wal-append.queue_time_us":461856}
I20260709 13:01:18.050122  5372 raft_consensus.cc:740] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:18.142807  1544 raft_consensus.cc:2410] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:01:18.087098  5367 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:18.171847  5263 raft_consensus.cc:3055] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:18.116354  5320 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:18.172431  5263 raft_consensus.cc:740] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:18.173249  1688 raft_consensus.cc:2393] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 9: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:18.173642  5414 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:18.174363  5320 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:18.154999  5411 log.cc:927] Time spent T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:01:18.151809  5281 raft_consensus.cc:697] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:18.165141  5382 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:18.165968  5425 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:18.165689  5210 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:18.166718  5119 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:18.142510  5277 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.007s	sys 0.021s
I20260709 13:01:18.170754  1542 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:01:18.152290  5238 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:18.160945  5211 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:18.176395  1695 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:18.123059  5416 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:18.205037  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:18.173537  5263 consensus_queue.cc:260] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:18.211637  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:18.200019  5425 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.222700  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:18.206827  5290 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:18.232508  1545 raft_consensus.cc:2376] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9. Re-sending same reply.
I20260709 13:01:18.233974  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:18.234921  1542 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:18.247095  1688 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:01:18.248852  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 384685us
I20260709 13:01:18.249883  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:18.226872  5389 consensus_meta.cc:287] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.000s
I20260709 13:01:18.228242  5425 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:18.258576  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:18.198589  5214 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:18.276700  1660 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:18.251998  5381 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.258077  5290 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:18.218811  5372 consensus_queue.cc:260] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:18.337388  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 388445us
I20260709 13:01:18.288476  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:18.343715  2209 leader_election.cc:400] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 8. Current term is 9.
I20260709 13:01:18.349016  2209 leader_election.cc:403] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:01:18.350419  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:18.351055  2243 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:18.351617  2209 leader_election.cc:304] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:18.259284  5048 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:18.356652  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 49197.9us
I20260709 13:01:18.256958  5196 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:18.257375  5389 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:18.279919  5283 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:01:18.382262  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:18.384842  1541 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 13: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:18.387401  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:18.275801  5211 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:18.348460  5382 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.389338  5382 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:18.391490  1619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.009s	sys 0.017s
I20260709 13:01:18.392046  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:18.392256  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:18.304627  5214 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:18.305645  5322 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:18.367167  5348 consensus_meta.cc:287] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.695s	user 0.007s	sys 0.004s
I20260709 13:01:18.307037  5320 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:18.357198  4911 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:18.255831  5281 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:18.403198  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.404196  2245 raft_consensus.cc:2393] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 11: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
W20260709 13:01:18.410092  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.410075  2243 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:18.393788  5372 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.418344  2242 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:18.419978  1547 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:18.434232  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:18.436038  5424 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:01:18.436529  5038 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:18.437134  5038 raft_consensus.cc:697] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:01:18.438556  4785 consensus_meta.cc:287] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.000s
I20260709 13:01:18.438138  5038 consensus_queue.cc:237] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:18.439093  1541 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:18.440058  5210 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:18.391516  5414 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:18.441015  1547 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:18.427485  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:18.442443  5427 log.cc:927] Time spent T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
W20260709 13:01:18.429594  5181 consensus_meta.cc:287] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.715s	user 0.009s	sys 0.000s
I20260709 13:01:18.432968  2241 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:18.447471  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:18.433298  2211 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:18.438936  4785 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:18.434373  5389 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:18.365276  5381 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:18.449658  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 496843us
I20260709 13:01:18.514081  1512 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:18.433102  5320 raft_consensus.cc:697] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:18.517910  1512 leader_election.cc:400] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7.
I20260709 13:01:18.513422  1511 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:01:18.525815  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.015s	sys 0.052s
I20260709 13:01:18.422335  5348 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:18.527530  1512 leader_election.cc:403] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:01:18.527554  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.016s	sys 0.052s
I20260709 13:01:18.421864  5322 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:18.528666  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 591154us
I20260709 13:01:18.530030  1585 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:18.532248  1585 leader_election.cc:400] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
W20260709 13:01:18.532790  1659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.017s	sys 0.021s
I20260709 13:01:18.534216  5138 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:18.533475  1585 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:18.543440  5138 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:18.544062  1585 leader_election.cc:400] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:01:18.544514  1585 leader_election.cc:403] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:01:18.545189  5138 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:01:18.545806  1585 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:18.547915  1585 leader_election.cc:400] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6.
I20260709 13:01:18.548277  1585 leader_election.cc:403] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:01:18.548940  5291 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 5. Current term is 6.
W20260709 13:01:18.542563  1659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.018s	sys 0.021s
I20260709 13:01:18.574311  1585 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:18.591122  1696 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.588158  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:18.593232  2242 raft_consensus.cc:2393] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 7: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:18.445297  5395 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:18.448762  5181 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:18.514746  5436 consensus_queue.cc:1059] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:01:18.608201  5320 consensus_queue.cc:237] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:18.611555  5440 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:18.530615  5385 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:18.612316  5385 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.612401  5440 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:18.612924  5385 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:18.613684  5445 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:18.614480  5445 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.615000  5445 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:18.617374  5445 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:18.587007  5426 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:18.591169  5382 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:18.601114  5322 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:18.548497  5138 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:18.602581  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:18.622588  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.450893  5386 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:18.602973  5091 consensus_meta.cc:287] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.941s	user 0.007s	sys 0.002s
I20260709 13:01:18.529349  5321 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 8. Current term is 9.
I20260709 13:01:18.629170  1616 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 5.
I20260709 13:01:18.638617  1540 raft_consensus.cc:2368] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:18.603360  5444 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.629858  5436 consensus_queue.cc:1243] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer e8a64798e5f94de8909707bcbd11804a log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:18.613165  5440 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:18.669631  5251 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:18.670334  5251 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:18.621208  5196 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.553509  5389 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 6. Current term is 7.
I20260709 13:01:18.671285  5196 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:18.673475  5196 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:18.643273  5299 consensus_meta.cc:287] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.989s	user 0.007s	sys 0.005s
I20260709 13:01:18.680034  4911 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:18.679757  5299 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:18.680537  4911 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:18.681015  1689 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:18.683892  5241 raft_consensus.cc:3055] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:18.684267  5241 raft_consensus.cc:740] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:18.684773  5299 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:18.685079  5241 consensus_queue.cc:260] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:18.686096  5241 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:18.687853  5418 raft_consensus.cc:3055] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:18.688287  5418 raft_consensus.cc:740] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:18.689172  5418 consensus_queue.cc:260] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:18.690277  5418 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:18.705994  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2570) took 1024 ms. Trace:
I20260709 13:01:18.708207  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:18.709159  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:18.709744  1619 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:18.709758  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2572) took 1013 ms. Trace:
I20260709 13:01:18.710660  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:18.710450  1544 rpcz_store.cc:276] 0709 13:01:17.696742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.739633 (+ 42891us) service_pool.cc:224] Handling call
0709 13:01:18.707756 (+968123us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b5400123754. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:18.709684 (+  1928us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":924054784}
I20260709 13:01:18.711629  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:18.706590  1540 rpcz_store.cc:276] 0709 13:01:17.681849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.683903 (+  2054us) service_pool.cc:224] Handling call
0709 13:01:18.705717 (+1021814us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b5400186ad4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:18.705904 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2156756224}
I20260709 13:01:18.712577  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:18.588991  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 726522us
I20260709 13:01:18.627189  1696 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
W20260709 13:01:18.645852  5254 consensus_meta.cc:287] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 1.355s	user 0.011s	sys 0.002s
I20260709 13:01:18.646651  5348 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:18.649163  5395 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:18.732323  1538 raft_consensus.cc:2410] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:01:18.653393  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1437) took 1214 ms. Trace:
W20260709 13:01:18.654196  5403 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.734s	user 0.005s	sys 0.000s
I20260709 13:01:18.654747  5444 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:18.629554  5426 raft_consensus.cc:697] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:18.660723  5381 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:18.662242  5181 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:18.664837  5143 consensus_meta.cc:287] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.957s	user 0.008s	sys 0.004s
I20260709 13:01:18.628105  5302 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:18.637637  5119 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:18.628858  5138 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:18.637974  5091 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:18.715158  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:18.769268  1690 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:18.528770  5367 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.109s
I20260709 13:01:18.719420  1689 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:18.637573  1511 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:18.721939  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:18.724156  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:18.726315  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:18.533186  5400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.005s	sys 0.027s
I20260709 13:01:18.729427  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:18.730044  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:18.730696  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:18.649662  5448 raft_consensus.cc:3055] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:18.732717  1545 rpcz_store.cc:276] 0709 13:01:17.438823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.457842 (+ 19019us) service_pool.cc:224] Handling call
0709 13:01:18.653137 (+1195295us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b54000d1954. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:18.653319 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1681121536}
I20260709 13:01:18.733477  1620 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:18.744235  1614 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:18.708177  5440 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:18.751129  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:18.822165  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 184656us
I20260709 13:01:18.822278  5457 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:18.822883  5457 raft_consensus.cc:697] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:18.752197  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:18.674849  5425 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:18.823724  5457 consensus_queue.cc:237] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:18.824756  5381 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:18.752600  1659 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:18.736275  5382 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.817796  5127 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.825285  5381 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:18.825827  5382 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:18.816679  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:18.827513  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 74997.3us
I20260709 13:01:18.827639  1540 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:01:18.822382  1618 raft_consensus.cc:2368] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:18.828241  1659 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:18.819550  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 63642.8us
I20260709 13:01:18.754022  1660 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:18.825922  5127 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:18.838411  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.854436  1694 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:18.768383  5119 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:18.861786  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 107838us
I20260709 13:01:18.768560  5138 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:18.821417  5400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.007s	sys 0.032s
I20260709 13:01:18.869145  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:18.863790  5416 consensus_meta.cc:287] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.635s	user 0.007s	sys 0.003s
W20260709 13:01:18.875607  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 47428.8us
I20260709 13:01:18.913040  1659 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:18.879060  1690 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:18.914135  1660 leader_election.cc:400] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:18.825323  5425 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:18.914290  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:18.915125  1660 leader_election.cc:403] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:01:18.890962  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:18.915788  1689 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:18.762080  5143 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:18.914362  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:18.918066  1690 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.766654  5302 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:18.926397  1690 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:18.916469  1618 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:01:18.827070  5448 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:01:18.874462  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 449371us
I20260709 13:01:18.933964  2211 leader_election.cc:400] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 8. Current term is 9.
I20260709 13:01:18.934336  1659 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:18.935007  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:18.908566  5432 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:18.941262  1694 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
W20260709 13:01:18.918233  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 327948us
I20260709 13:01:18.950997  1586 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:18.951771  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:18.954555  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:18.897023  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:18.908878  5440 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:18.942625  2211 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:18.943807  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.941471  2210 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:18.945443  1619 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 12: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:18.866801  5372 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:01:18.917685  5290 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:01:18.913748  5400 raft_consensus.cc:697] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:18.861464  5434 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:18.945906  5038 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:18.874694  5348 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:18.956465  1689 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:18.959101  2211 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:18.959532  1694 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:18.986835  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:18.946064  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:18.913034  4916 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:01:18.912251  5415 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:01:18.939044  5381 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:18.965703  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 391438us
I20260709 13:01:18.995977  1585 leader_election.cc:400] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13.
I20260709 13:01:18.996281  1585 leader_election.cc:403] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:01:18.919044  5416 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:18.941956  5431 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:18.985749  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:18.988004  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:18.988066  1690 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:18.955811  5432 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:18.982890  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 386772us
I20260709 13:01:18.999730  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:18.999773  2209 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:18.960364  5251 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:18.990588  1687 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:01:18.930007  4911 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:18.961148  5395 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.001356  5395 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:19.003341  4911 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:19.003399  5395 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:18.988929  5348 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.021538  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:19.011759  5302 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:19.028649  2209 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:18.962323  5440 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.013190  5251 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:19.013979  5416 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:19.033634  5444 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:18.918552  5426 consensus_queue.cc:237] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:19.020164  5449 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:01:19.022915  5348 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:19.021682  5143 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:19.028571  5425 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:19.007819  5383 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:01:18.989770  5448 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.051508  5440 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:19.054247  5385 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:19.030968  5321 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:19.057710  5460 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:19.062266  5459 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:19.065421  5425 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:19.069974  5460 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.080925  5460 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:19.045230  5400 consensus_queue.cc:237] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.072098  5440 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:19.069955  5448 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:19.069396  5459 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.087515  5440 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:01:19.129743  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 193585us
W20260709 13:01:19.139394  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.142010  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 146032us
I20260709 13:01:19.144416  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:19.145087  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:19.147913  1585 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:19.148777  1543 raft_consensus.cc:1275] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:19.150763  1585 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:19.151708  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:19.153337  1543 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:19.012902  1688 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:19.064034  5127 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:19.204800  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2569) took 1560 ms (client timeout 1668 ms). Trace:
I20260709 13:01:19.197711  1616 raft_consensus.cc:3055] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:19.157764  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 216206us
W20260709 13:01:19.157927  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 223509us
I20260709 13:01:19.155227  1585 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:19.199901  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2576) took 1445 ms. Trace:
I20260709 13:01:19.168301  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:19.198829  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1452) took 1696 ms. Trace:
I20260709 13:01:19.255187  1616 raft_consensus.cc:740] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:19.169245  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:19.176180  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:19.190513  5385 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:19.184772  5356 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.145s	user 0.008s	sys 0.016s
I20260709 13:01:19.178220  5127 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13.
I20260709 13:01:19.274129  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:19.263269  1546 rpcz_store.cc:276] 0709 13:01:17.501959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.512063 (+ 10104us) service_pool.cc:224] Handling call
0709 13:01:17.740682 (+228619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:17.741121 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:18.227982 (+486861us) log.cc:844] Serialized 14 byte log entry
0709 13:01:18.764741 (+536759us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:18.769224 (+  4483us) log.cc:844] Serialized 26 byte log entry
0709 13:01:18.769358 (+   134us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:18.901990 (+132632us) log.cc:844] Serialized 14 byte log entry
0709 13:01:18.902266 (+   276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.902389 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:19.127351 (+224962us) raft_consensus.cc:1685] finished
0709 13:01:19.127428 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.198442 (+ 71014us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400347e50. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:19.198634 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111747,"prepare.queue_time_us":260816,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":7082,"raft.run_cpu_time_us":436,"raft.run_wall_time_us":68075,"spinlock_wait_cycles":524702080,"thread_start_us":933776,"threads_started":2,"wal-append.queue_time_us":700067}
I20260709 13:01:19.181967  5251 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:19.180567  5214 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.180518  5143 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:19.180006  5210 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:19.176743  5119 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:19.099081  5459 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:19.279038  5356 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.247s	user 0.008s	sys 0.016s
W20260709 13:01:19.286499  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.252511  1538 rpcz_store.cc:269] 0709 13:01:17.645146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.655015 (+  9869us) service_pool.cc:224] Handling call
0709 13:01:19.204255 (+1549240us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540011fb54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:19.204582 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2474728320}
I20260709 13:01:19.259796  1547 rpcz_store.cc:276] 0709 13:01:17.754285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.436101 (+681816us) service_pool.cc:224] Handling call
0709 13:01:18.440821 (+  4720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.441430 (+   609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.199459 (+758029us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b54002fa8d0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:19.199675 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10127744}
I20260709 13:01:19.291172  1689 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:19.311992  5214 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:19.300776  5444 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:19.292258  5458 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:19.327643  5458 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.327476  5444 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:19.328104  5458 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:19.330390  5444 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:19.300559  5210 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:19.336182  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:19.336205  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:19.338300  5210 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:19.293901  1616 consensus_queue.cc:260] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.338395  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:19.339643  1616 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:19.340768  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:19.343915  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:19.346045  1696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 2243) took 1912 ms (client timeout 1515 ms). Trace:
W20260709 13:01:19.346572  1696 rpcz_store.cc:269] 0709 13:01:17.433708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.440218 (+  6510us) service_pool.cc:224] Handling call
0709 13:01:19.345576 (+1905358us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000f23d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:19.345765 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2557374336}
I20260709 13:01:19.315492  5440 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:19.360953  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 61715.8us
W20260709 13:01:19.368552  5467 log.cc:927] Time spent T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:01:19.358749  5356 raft_consensus.cc:697] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:19.361477  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:19.371456  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.371970  1693 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.374930  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1512) took 1143 ms. Trace:
I20260709 13:01:19.375402  1688 rpcz_store.cc:276] 0709 13:01:18.231023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.699596 (+468573us) service_pool.cc:224] Handling call
0709 13:01:18.699939 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.156496 (+456557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.374523 (+218027us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b5400459554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:19.374736 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719139200}
I20260709 13:01:19.378065  5290 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:19.381956  5263 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:19.386045  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1502) took 2057 ms. Trace:
W20260709 13:01:19.387543  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.386502  1695 rpcz_store.cc:276] 0709 13:01:17.328584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.329558 (+   974us) service_pool.cc:224] Handling call
0709 13:01:18.175786 (+846228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.216314 (+ 40528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.385622 (+1169308us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b54002c6850. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:19.385843 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1810630016}
W20260709 13:01:19.396829  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.395880  1587 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:19.397986  5127 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:19.398418  5127 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:19.398615  1587 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:19.398904  5127 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.400142  5251 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:19.400641  5251 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:19.400852  1512 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:19.402113  1512 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:19.401057  5251 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:19.403600  5447 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:19.404201  5447 raft_consensus.cc:697] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:19.405428  5447 consensus_queue.cc:237] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:19.407287  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.408121  5214 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:19.400501  5356 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:19.415364  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.417050  2209 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:19.412338  5241 consensus_meta.cc:287] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.726s	user 0.018s	sys 0.008s
I20260709 13:01:19.407424  5385 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:19.419138  5478 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:19.410678  5464 log.cc:927] Time spent T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.348s	user 0.000s	sys 0.004s
I20260709 13:01:19.419440  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2244) took 1985 ms. Trace:
W20260709 13:01:19.407096  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 447918us
I20260709 13:01:19.423529  5138 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:19.445343  1693 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:01:19.454069  1616 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:01:19.453778  1659 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:19.443964  1687 rpcz_store.cc:276] 0709 13:01:17.433958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.547542 (+113584us) service_pool.cc:224] Handling call
0709 13:01:17.547958 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:19.000890 (+1452932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.418776 (+417886us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400223dd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:19.419221 (+   445us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3316605824}
W20260709 13:01:19.459719  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.459807  5471 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:19.461899  1659 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:19.462731  5382 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:19.462829  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 307741us
I20260709 13:01:19.424407  5322 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:19.463900  5322 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.471354  5385 raft_consensus.cc:697] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:19.472713  2211 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:19.473188  5445 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:19.474231  5321 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:19.476883  5477 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:19.478164  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 61353.5us
I20260709 13:01:19.479427  5477 consensus_queue.cc:1048] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:19.482795  5471 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:19.484788  1659 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:19.486521  5418 consensus_meta.cc:287] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.796s	user 0.014s	sys 0.006s
I20260709 13:01:19.486995  5471 raft_consensus.cc:2764] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:01:19.472750  5385 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.489921  5138 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:19.491298  1622 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:19.493142  5091 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:19.494294  5038 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:19.493927  5478 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.497314  5478 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:19.501585  5320 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:19.504354  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1454) took 1965 ms. Trace:
I20260709 13:01:19.504808  1542 rpcz_store.cc:276] 0709 13:01:17.540066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.251346 (+711280us) service_pool.cc:224] Handling call
0709 13:01:18.252455 (+  1109us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:18.253079 (+   624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:18.253121 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:18.257614 (+  4493us) log.cc:844] Serialized 52 byte log entry
0709 13:01:18.764613 (+506999us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:18.858437 (+ 93824us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.489777 (+631340us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b18003d6cc0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e5b8c0a 00007fc497cf8219 00007fc48e640a40 00007fc48e63b4e4 00007fc48e63b455 00007fc4951233c7 00007fc4917359a7 00007fc4917450bf 00007fc491745038
0709 13:01:19.490141 (+   364us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.503551 (+ 13410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.503637 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:19.503805 (+   168us) raft_consensus.cc:1685] finished
0709 13:01:19.503824 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.504172 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":596356,"prepare.queue_time_us":738643,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":17930,"raft.queue_time_us":750,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":22149,"spinlock_wait_cycles":40044800,"thread_start_us":376049,"threads_started":1,"wal-append.queue_time_us":642239}
I20260709 13:01:19.505295  1659 leader_election.cc:400] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:19.509750  1659 leader_election.cc:403] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:19.466928  5322 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:19.414836  5460 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.519362  5471 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:19.519974  5048 consensus_queue.cc:1059] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:19.521103  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:19.521588  2210 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:19.522716  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:19.526078  1585 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:19.527807  1512 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:19.532384  1660 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:19.538059  1618 raft_consensus.cc:1275] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:19.538087  5320 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
W20260709 13:01:19.589963  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 141926us
W20260709 13:01:19.590744  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 58522us
W20260709 13:01:19.592633  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 71155.4us
I20260709 13:01:19.583077  5138 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:19.606834  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 131936us
W20260709 13:01:19.609704  5348 consensus_meta.cc:287] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.554s	user 0.015s	sys 0.008s
I20260709 13:01:19.610242  5348 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:19.608264  5459 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.610517  2211 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:19.595769  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 368014us
I20260709 13:01:19.653131  1694 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:01:19.594801  5440 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.651539  5322 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:19.667743  5322 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.668180  5322 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:19.669212  5440 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:19.671577  2241 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:19.655932  5356 consensus_queue.cc:1048] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:01:19.673962  5437 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:19.675289  5448 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:19.675956  5448 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.678275  5448 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:19.678046  5381 consensus_queue.cc:1059] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:19.680640  1615 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:19.681350  5348 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:19.682410  5381 raft_consensus.cc:3055] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:19.682837  5381 raft_consensus.cc:740] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:19.683948  5381 consensus_queue.cc:260] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:19.685328  5381 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:19.690136  5458 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:19.654552  5048 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:19.664373  4916 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:19.666860  5460 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:19.654856  5418 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:19.719465  1512 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:19.720870  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:19.725797  1622 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:19.711457  5457 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:19.726936  5457 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.729310  5457 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:19.731077  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 120725us
I20260709 13:01:19.732507  5127 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.733613  5454 consensus_queue.cc:1059] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:19.735472  5477 raft_consensus.cc:3055] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:19.712815  5048 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.735919  5477 raft_consensus.cc:740] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:19.736200  5048 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.737061  5477 consensus_queue.cc:260] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.738945  5477 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:19.740142  2243 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:19.740698  1614 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:19.729362  1617 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:01:19.743585  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 217653us
I20260709 13:01:19.725199  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:19.735517  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:19.730962  5283 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.763200  5459 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:19.762995  5283 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.753046  4916 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:19.765341  5488 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.076s	user 0.000s	sys 0.002s
I20260709 13:01:19.754308  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:19.767730  5483 log.cc:927] Time spent T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.116s	user 0.002s	sys 0.000s
I20260709 13:01:19.770057  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:19.742152  5418 raft_consensus.cc:697] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:19.741668  5458 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:19.763419  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1448) took 2278 ms. Trace:
I20260709 13:01:19.757047  5211 raft_consensus.cc:3055] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:19.753767  5415 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:01:19.760609  5491 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.072s	user 0.003s	sys 0.000s
I20260709 13:01:19.735036  5127 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:19.788319  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:19.788339  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:19.808576  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:19.801888  1615 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:19.778259  5283 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:19.813022  1687 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:19.812788  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:19.814409  2245 raft_consensus.cc:2393] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 9: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:19.777729  5211 raft_consensus.cc:740] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:19.786054  5385 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:19.820317  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:19.825191  1622 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:19.775460  1539 rpcz_store.cc:276] 0709 13:01:17.484620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.510187 (+ 25567us) service_pool.cc:224] Handling call
0709 13:01:18.654491 (+1144304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:18.654791 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:18.654829 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:18.655387 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:01:18.949210 (+293823us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:19.643073 (+693863us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.664177 (+ 21104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.664294 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:19.664343 (+    49us) raft_consensus.cc:1685] finished
0709 13:01:19.664359 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.763105 (+ 98746us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54000d1950. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:19.763251 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":544617,"prepare.queue_time_us":547520,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":617,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":117,"spinlock_wait_cycles":2614722304,"thread_start_us":411938,"threads_started":2,"wal-append.queue_time_us":378522}
I20260709 13:01:19.828559  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:19.825054  1690 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:01:19.855921  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:19.831459  5385 raft_consensus.cc:697] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:19.842039  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:19.864511  5211 consensus_queue.cc:260] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:19.865943  5211 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:19.867332  5489 log.cc:927] Time spent T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.126s	user 0.000s	sys 0.003s
I20260709 13:01:19.869355  2242 raft_consensus.cc:1240] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:19.870023  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:19.873745  1620 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:19.875589  2241 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 8: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:19.878404  5475 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.878670  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:19.879072  5475 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:19.881537  5475 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:19.882040  1696 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:19.882267  5426 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.882913  5426 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.883558  5400 consensus_queue.cc:1059] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:19.885038  5382 raft_consensus.cc:3055] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:19.885414  5426 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:19.885447  5382 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:19.887269  5382 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:19.887956  5499 log.cc:927] Time spent T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:01:19.888782  5382 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:19.889525  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:19.833385  5448 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:19.891681  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.892598  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.897820  1615 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 6.
I20260709 13:01:19.889184  5048 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:19.903043  2210 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:19.905082  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:19.906725  1692 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:19.908226  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:19.904206  5143 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:01:19.907768  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:19.913717  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.915923  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 55989.8us
I20260709 13:01:19.914033  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:19.919791  1694 raft_consensus.cc:2368] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:01:19.922039  5356 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:19.917726  5254 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:19.931649  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.918038  5460 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:01:19.950501  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.914695  5426 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:01:19.930517  5251 consensus_meta.cc:287] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.527s	user 0.014s	sys 0.000s
W20260709 13:01:19.966729  5500 log.cc:927] Time spent T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:01:19.973634  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:19.977576  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:19.922741  5356 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.891957  5418 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.982024  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:19.934419  5210 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.966810  5460 raft_consensus.cc:697] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:19.984081  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:19.932917  5448 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:19.999912  2242 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:01:19.987277  5263 consensus_meta.cc:287] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.005s
I20260709 13:01:19.992954  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:19.996307  1542 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:19.982244  5091 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.012920  5091 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:20.012679  5460 consensus_queue.cc:237] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.013747  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:20.014443  1547 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:19.982000  5283 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:01:20.022399  5038 consensus_queue.cc:1059] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:20.024523  1615 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:20.003772  5241 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.979206  5251 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:19.982132  5254 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.027312  2243 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:20.028667  5210 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:19.990746  4916 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:20.037576  1614 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
W20260709 13:01:20.039800  5465 log.cc:927] Time spent T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:01:20.041172  1538 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:20.042698  5480 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.046226  5254 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:20.048385  5048 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:20.050419  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:20.050781  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:20.051568  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet bd6921d4b2d8478f99effa533f8d9f3d: Illegal state: Replica dcc91bf6e3bd468bbbbfc26e3a7c5e01 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:20.052596  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:20.066022  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:20.030099  5486 log.cc:927] Time spent T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.389s	user 0.003s	sys 0.001s
I20260709 13:01:20.037400  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:19.996986  5426 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:20.072666  2211 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:20.035791  5417 raft_consensus.cc:3055] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:20.057503  5210 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:20.060758  5138 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.081583  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:20.074258  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:20.031116  5381 consensus_queue.cc:1059] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:01:20.121661  5381 raft_consensus.cc:3055] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:20.122047  5381 raft_consensus.cc:740] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:20.086679  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:20.123695  1540 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:20.124879  5356 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:20.073670  5480 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.126816  2240 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:20.087044  1543 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:01:20.076469  5417 raft_consensus.cc:740] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:20.127472  1543 pending_rounds.cc:85] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 7
I20260709 13:01:20.127774  1543 pending_rounds.cc:107] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:01:20.128057  1543 raft_consensus.cc:2889] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:20.128232  5417 consensus_queue.cc:260] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:20.129446  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:20.130210  1659 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:20.130712  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:20.086758  2242 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:20.131134  5420 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:20.131846  5420 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.134423  5420 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:20.087601  2243 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:01:20.067067  5091 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:20.091543  4916 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:20.094127  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:20.096592  1614 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:01:20.097618  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:20.098656  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.099404  1619 raft_consensus.cc:1240] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:20.100268  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:20.100556  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.101764  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:20.102478  1613 raft_consensus.cc:1240] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:20.103091  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:01:20.104274  5498 log.cc:927] Time spent T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.352s	user 0.002s	sys 0.009s
I20260709 13:01:20.104635  5241 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:20.161211  1622 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:20.107157  5495 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.364s	user 0.001s	sys 0.015s
I20260709 13:01:20.111197  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.162295  1617 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:20.112293  5251 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:20.113619  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:20.118605  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:20.006997  5385 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:20.147634  5437 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:20.147732  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:20.148881  5322 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.150014  5480 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:20.151500  5290 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:20.152505  5426 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:20.156638  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.159868  1587 leader_election.cc:400] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:01:20.175755  1587 leader_election.cc:403] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:01:20.168802  2242 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:20.169646  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:20.172806  1543 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:20.157063  5211 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:20.166910  1538 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:20.161927  1511 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:20.180934  2246 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:20.181053  1545 raft_consensus.cc:2368] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:20.181648  5211 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:20.182135  5211 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:20.185993  1540 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:20.182055  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:20.190593  5211 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:20.153290  4916 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.192512  1538 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:20.194198  4916 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:20.195479  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:20.196770  2243 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:20.195482  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.177807  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:20.195784  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.199136  1615 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:20.122840  5381 consensus_queue.cc:260] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.220976  2237 raft_consensus.cc:2368] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8.
I20260709 13:01:20.221803  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.176977  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.195118  5211 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:20.227517  1544 raft_consensus.cc:2410] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:20.223369  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:20.228741  1617 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:20.229104  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 88444.7us
I20260709 13:01:20.229862  1586 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:20.231680  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:20.236896  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:20.239763  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:20.240509  1542 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:20.162637  5415 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:01:20.242920  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.243818  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:20.197379  5091 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:20.232941  5498 log.cc:927] Time spent T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:01:20.253366  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 190723us
I20260709 13:01:20.249816  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.230683  1614 raft_consensus.cc:2376] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12. Re-sending same reply.
W20260709 13:01:20.256906  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 262486us
I20260709 13:01:20.257712  1660 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:20.259841  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.227751  5048 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:20.235502  5251 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:20.243033  4916 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:20.263230  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.266255  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:20.262281  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 108632us
I20260709 13:01:20.269562  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.275652  1690 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:01:20.276377  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 44897.9us
I20260709 13:01:20.262144  5381 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:20.283380  5448 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:20.251863  5320 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:20.257058  5426 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:20.286780  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.298316  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:20.299084  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 44825.8us
I20260709 13:01:20.301407  1619 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:20.272282  5211 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:20.258394  5091 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:20.306033  1620 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:20.306594  2211 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:20.308660  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.309237  1622 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:20.270995  4916 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:20.316673  2241 raft_consensus.cc:1240] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:20.318215  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.320573  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:20.322024  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.322197  1694 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:20.315405  4916 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:20.339504  5460 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.344697  5460 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.346917  5460 leader_election.cc:290] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:20.314576  5480 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.340167  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:20.360258  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:20.361387  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:20.362493  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:20.293305  5048 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.303787  5471 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:01:20.364923  5048 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:20.365197  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:20.365641  5447 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:20.366114  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:20.371606  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:20.348520  5493 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.659s	user 0.007s	sys 0.018s
W20260709 13:01:20.352777  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.326375  5383 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:20.350049  1587 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:20.377579  1547 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:20.373132  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:20.358065  1542 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:20.382287  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:20.384534  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2260) took 1215 ms. Trace:
I20260709 13:01:20.388687  1694 raft_consensus.cc:2393] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:20.396247  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:20.397215  1542 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:20.403738  5472 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.404289  5472 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:20.405895  1511 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:20.383765  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:20.412479  1542 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
W20260709 13:01:20.413843  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 111462us
I20260709 13:01:20.415356  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:20.406488  5472 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:20.416136  1542 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:20.375978  5447 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:20.422924  1541 raft_consensus.cc:2410] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:20.422013  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:20.419245  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:20.385841  5127 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:20.384904  1689 rpcz_store.cc:276] 0709 13:01:19.169664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.341978 (+172314us) service_pool.cc:224] Handling call
0709 13:01:19.342552 (+   574us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:19.366135 (+ 23583us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:19.546917 (+180782us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.620103 (+ 73186us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:19.620652 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 13:01:19.620826 (+   174us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:19.620861 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.620942 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:20.066739 (+445797us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:20.373026 (+306287us) raft_consensus.cc:1685] finished
0709 13:01:20.384337 (+ 11311us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:20.384475 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":103955,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":903,"raft.queue_time_us":24455,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":243,"spinlock_wait_cycles":9212800,"thread_start_us":23861,"threads_started":1,"wal-append.queue_time_us":133638}
I20260709 13:01:20.427076  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:20.420125  5426 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.432144  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:20.434763  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:20.435307  1547 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:20.436285  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:20.431916  5448 consensus_queue.cc:1059] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:01:20.393842  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5814bf31e900408885160ea0f89d6189"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:20.439486  5448 raft_consensus.cc:3055] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:20.439678  1620 raft_consensus.cc:606] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:20.439955  5448 raft_consensus.cc:740] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:20.440961  5448 consensus_queue.cc:260] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.442179  5448 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:20.443698  5516 consensus_queue.cc:1059] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:20.444612  5516 raft_consensus.cc:3055] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:20.444928  5516 raft_consensus.cc:740] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:20.445816  5516 consensus_queue.cc:260] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.447610  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:20.447604  5510 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:01:20.447052  5516 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:20.435596  1621 consensus_queue.cc:237] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:01:20.456598  1547 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:20.421317  5241 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:20.421381  5447 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:20.410663  5400 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:01:20.414116  5211 raft_consensus.cc:697] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:20.460335  2211 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:20.469481  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:20.470999  5477 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:20.461802  1542 raft_consensus.cc:2410] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:01:20.407253  5437 consensus_queue.cc:1059] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 13:01:20.465734  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 59929.7us
I20260709 13:01:20.474128  1688 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:20.426033  5348 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:01:20.459559  5382 consensus_meta.cc:287] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.003s
I20260709 13:01:20.412804  5383 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:20.476001  2241 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:01:20.473716  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:20.477777  1541 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:01:20.463585  5447 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:20.479041  1541 pending_rounds.cc:85] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 7
I20260709 13:01:20.481205  1541 pending_rounds.cc:107] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:01:20.481448  1541 raft_consensus.cc:2889] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:20.483012  1539 raft_consensus.cc:2410] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:01:20.504073  4785 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:20.512041  1543 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:20.512814  1547 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:20.511694  5519 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:20.513545  5437 consensus_queue.cc:1059] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:20.513974  5519 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.515113  1541 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:01:20.515381  5454 raft_consensus.cc:3055] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:20.515808  5454 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:20.515895  1540 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:20.516242  5519 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:20.516685  5454 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.518607  5509 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:20.520955  5211 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:20.510349  5477 raft_consensus.cc:3055] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:20.522995  5477 raft_consensus.cc:740] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:20.523898  5477 consensus_queue.cc:260] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.525123  5477 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:20.526242  5515 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:01:20.531404  1511 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:20.532335  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:20.532661  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 51892us
I20260709 13:01:20.533241  2244 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 11: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:20.533386  5251 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:01:20.533607  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:20.534140  1615 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
W20260709 13:01:20.534382  5512 log.cc:927] Time spent T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:01:20.536279  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.518649  1540 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:01:20.538606  1622 raft_consensus.cc:2410] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:01:20.534925  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:20.555871  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.557232  1542 raft_consensus.cc:1240] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:20.556799  1616 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:01:20.556155  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.571305  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:20.575486  5400 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:20.576064  5400 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.576467  5400 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:20.578413  5322 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:20.511976  5048 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:20.579363  5048 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.580219  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:20.580844  1695 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:20.582492  5048 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:20.583586  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 48739.1us
I20260709 13:01:20.584208  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:20.584409  1511 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:20.585053  2246 raft_consensus.cc:2393] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 11: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:20.585752  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:20.586290  1618 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:20.589080  1542 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:20.556627  5418 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.556931  5382 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.604701  4785 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.605324  4785 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:20.607141  5506 log.cc:927] Time spent T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:01:20.612701  1585 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:20.595923  1542 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:20.598004  5417 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:20.622521  4916 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.613726  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.623699  1613 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:20.613963  5383 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:20.616341  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:20.595227  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.619289  1692 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:20.619978  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:20.627915  1585 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:20.619087  1618 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
W20260709 13:01:20.635370  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 51044us
I20260709 13:01:20.636312  1617 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:01:20.627408  1696 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:20.642267  1511 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:20.643131  1585 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:20.660276  1693 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:20.667881  1511 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:20.638397  5383 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:20.676192  1511 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:20.640152  5241 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:20.676290  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:20.673996  5420 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:20.692792  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:20.679894  5510 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.700034  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:20.702981  1544 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:20.693161  5383 raft_consensus.cc:697] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:20.695914  5420 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.704363  5322 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.710537  5457 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:20.737493  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 44826.2us
I20260709 13:01:20.745457  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:20.744886  1511 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:20.727340  5251 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.726102  5420 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:20.786970  5291 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:20.735431  5322 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.799291  1695 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
W20260709 13:01:20.812388  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 169280us
I20260709 13:01:20.814162  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:20.738781  5138 consensus_queue.cc:1059] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 13:01:20.816999  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 72177.8us
I20260709 13:01:20.831753  1539 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:20.794344  5457 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:20.822504  1511 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:20.832949  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:20.794487  5210 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:20.865698  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.874501  5521 log.cc:927] Time spent T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.404s	user 0.001s	sys 0.000s
I20260709 13:01:20.815837  4916 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:20.815224  5524 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:20.894317  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 80286.1us
W20260709 13:01:20.892266  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 209033us
I20260709 13:01:20.899967  1585 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:20.901082  5251 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:20.901232  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:20.893983  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 71586us
I20260709 13:01:20.902379  1585 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:20.903115  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:20.883740  5457 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:20.906338  1511 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:20.912173  5524 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:20.909708  2210 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:20.916282  1585 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:20.912827  5510 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:20.917074  5529 log.cc:927] Time spent T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:01:20.906189  5426 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:20.918499  4916 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:20.940124  2210 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:20.865334  5383 consensus_queue.cc:237] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:20.904729  5385 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:20.948282  1539 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
W20260709 13:01:20.950377  5528 log.cc:927] Time spent T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:01:20.951030  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 44759.1us
W20260709 13:01:20.952224  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 45473.3us
I20260709 13:01:20.890846  5535 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.906735  5291 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:20.956223  2209 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:20.955513  1539 pending_rounds.cc:85] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 6
I20260709 13:01:20.961652  1539 pending_rounds.cc:107] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:01:20.960335  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:20.962934  1539 raft_consensus.cc:2889] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:20.947556  5460 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:20.976065  4916 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:20.976619  4916 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:20.977089  4916 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:20.981674  1511 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:20.959812  5541 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:20.991279  1547 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:20.979421  5531 log.cc:927] Time spent T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:01:20.986614  5524 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:20.993357  5385 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:20.999042  2209 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:21.006283  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 51006.5us
I20260709 13:01:21.008035  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:20.974987  4785 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:20.996279  5541 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.012817  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:21.016719  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:21.013375  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 97153.3us
I20260709 13:01:21.011394  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:21.008386  2210 leader_election.cc:304] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:21.026005  1696 raft_consensus.cc:2393] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:21.025624  1694 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:21.041301  1696 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:21.045933  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:21.042697  5322 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:21.049216  1691 raft_consensus.cc:2410] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:21.023733  5541 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.040494  5385 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:21.058379  5385 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:21.042702  5460 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:21.059511  5539 log.cc:927] Time spent T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:01:21.060271  5537 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:01:21.017645  5533 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:21.040457  5426 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.053968  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:21.073747  1690 raft_consensus.cc:2410] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:01:21.074369  5546 log.cc:927] Time spent T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:01:21.073323  5552 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:21.034272  5457 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:21.074688  5460 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:21.095023  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 96056.9us
I20260709 13:01:21.097061  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:21.092867  5460 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.101230  2209 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:21.103472  4785 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:21.104728  5385 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.100529  1687 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:21.107250  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:21.107911  5420 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:21.117794  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:21.088162  5555 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:01:21.110581  5460 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:21.130378  1586 leader_election.cc:400] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8.
I20260709 13:01:21.132953  1586 leader_election.cc:403] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:01:21.126940  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 48848.1us
W20260709 13:01:21.135071  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 95443.6us
I20260709 13:01:21.133689  4785 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.129383  5558 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:21.123373  5385 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:21.132211  5322 consensus_queue.cc:1059] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:01:21.151633  5447 consensus_meta.cc:287] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.002s
W20260709 13:01:21.142282  5400 consensus_meta.cc:287] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.565s	user 0.013s	sys 0.000s
W20260709 13:01:21.173039  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 133508us
I20260709 13:01:21.151633  5383 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8.
I20260709 13:01:21.174959  1511 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:21.174659  5400 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:21.177671  5547 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:01:21.183872  1540 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:21.171794  5558 raft_consensus.cc:697] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:01:21.181558  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 43671.9us
I20260709 13:01:21.177416  5322 consensus_queue.cc:1243] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:21.169425  4785 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:21.168080  5562 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:01:21.177956  4916 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:21.195215  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:21.206269  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:21.194211  5567 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:21.211490  5322 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.212076  5322 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:21.214699  5322 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:21.215595  2246 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:21.216558  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:21.217700  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:21.218053  4785 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:21.219895  5420 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:21.220777  5420 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:21.221424  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:21.221593  5420 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:21.223225  5558 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:21.225054  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:21.229784  2237 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:21.177064  5447 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:21.236182  5447 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:21.238970  5564 log.cc:927] Time spent T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:01:21.243094  5385 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:21.245504  4916 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:21.246650  5400 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:21.250092  2241 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
W20260709 13:01:21.252736  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:21.253575  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.258070  1659 leader_election.cc:400] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
W20260709 13:01:21.245790  5561 log.cc:927] Time spent T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:01:21.268349  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2607) took 1168 ms. Trace:
W20260709 13:01:21.271974  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 263659us
I20260709 13:01:21.272195  1540 rpcz_store.cc:276] 0709 13:01:20.100684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.629238 (+528554us) service_pool.cc:224] Handling call
0709 13:01:20.662364 (+ 33126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:21.185363 (+522999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.268091 (+ 82728us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54001603d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:21.268284 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1198591872}
I20260709 13:01:21.273238  2210 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:21.277627  5530 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.367s	user 0.002s	sys 0.000s
I20260709 13:01:21.279404  1659 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:21.281345  5572 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:21.284137  4785 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:21.284736  4785 raft_consensus.cc:697] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:21.266993  5541 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:21.285460  5542 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.373s	user 0.000s	sys 0.001s
I20260709 13:01:21.285862  4785 consensus_queue.cc:237] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:21.287117  5541 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:21.287511  5572 raft_consensus.cc:697] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:21.284652  1659 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:21.292074  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.293190  5048 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:21.293784  5048 raft_consensus.cc:697] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:21.294721  5048 consensus_queue.cc:237] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:21.302191  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2224) took 1188 ms. Trace:
I20260709 13:01:21.302594  1615 rpcz_store.cc:276] 0709 13:01:20.113427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.233178 (+119751us) service_pool.cc:224] Handling call
0709 13:01:21.302005 (+1068827us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54003809d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:21.302110 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642121984}
I20260709 13:01:21.288563  5572 consensus_queue.cc:237] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:21.306923  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 113817us
I20260709 13:01:21.309247  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:21.306993  1659 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:21.313207  1659 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:21.318614  5417 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:21.319314  5348 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:21.320724  5091 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:21.321019  5533 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:21.321223  5508 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:21.322067  5508 consensus_queue.cc:1243] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:21.333526  1511 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:21.333882  5517 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.809s	user 0.011s	sys 0.000s
I20260709 13:01:21.322762  5348 raft_consensus.cc:697] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:21.335963  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2588) took 1325 ms. Trace:
I20260709 13:01:21.336371  1546 rpcz_store.cc:276] 0709 13:01:20.010205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.010361 (+   156us) service_pool.cc:224] Handling call
0709 13:01:20.012429 (+  2068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:20.272947 (+260518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:20.272989 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:20.293146 (+ 20157us) log.cc:844] Serialized 26 byte log entry
0709 13:01:20.458104 (+164958us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:20.465502 (+  7398us) log.cc:844] Serialized 14 byte log entry
0709 13:01:20.465730 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.584799 (+119069us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b18000a2fa0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:01:20.799808 (+215009us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b54002f9ed4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:20.799861 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:21.333165 (+533304us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:21.335747 (+  2582us) raft_consensus.cc:1685] finished
0709 13:01:21.335768 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:21.335904 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3990,"prepare.queue_time_us":9470,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":7243,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":5314,"spinlock_wait_cycles":149290880,"thread_start_us":354382,"threads_started":2,"wal-append.queue_time_us":201866}
I20260709 13:01:21.335502  5348 consensus_queue.cc:237] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:21.338243  1445 catalog_manager.cc:5697] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 7 to 10, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.339459  5091 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:21.341403  5568 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.342017  5568 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:21.343309  5382 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:21.340387  1445 catalog_manager.cc:5697] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 8 to 11, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.342376  5523 raft_consensus.cc:3055] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:21.352015  5400 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:21.345376  5091 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:01:21.352465  5400 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.357250  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:21.357875  2244 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:21.307212  5460 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:21.358084  1512 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:21.370190  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:21.371037  1542 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:21.355408  5400 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.353163  5211 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.372329  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:21.372454  5211 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:21.373755  1543 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:01:21.374189  1543 pending_rounds.cc:85] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 5
I20260709 13:01:21.374436  1543 pending_rounds.cc:107] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:01:21.374579  5211 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:21.374713  1543 raft_consensus.cc:2889] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:21.352900  5523 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:21.364705  1511 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:21.356393  5382 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:01:21.346585  5417 raft_consensus.cc:697] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:21.380043  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:21.380662  5523 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:21.381994  1544 raft_consensus.cc:1275] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:01:21.379729  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:21.376186  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:21.383002  2244 raft_consensus.cc:1240] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:01:21.382390  1544 pending_rounds.cc:85] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 5
I20260709 13:01:21.384683  1544 pending_rounds.cc:107] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:01:21.384933  1544 raft_consensus.cc:2889] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:21.376565  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:21.375653  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:21.387904  1695 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:21.396339  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:21.399137  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:21.399917  1687 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:21.375551  5385 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:21.402841  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 85662.9us
I20260709 13:01:21.406064  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:21.356956  5426 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:01:21.409207  5385 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.407819  5457 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:21.411314  5048 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:21.439766  5048 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:21.408097  5541 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:01:21.432709  5578 consensus_queue.cc:1059] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:01:21.434300  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1465) took 1285 ms. Trace:
I20260709 13:01:21.444128  1547 rpcz_store.cc:276] 0709 13:01:20.148950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.820891 (+671941us) service_pool.cc:224] Handling call
0709 13:01:20.888189 (+ 67298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:20.996448 (+108259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.434046 (+437598us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54000b6b54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:21.434240 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236317568}
I20260709 13:01:21.435346  5571 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.435712  5576 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.454396  1659 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:21.413112  5447 consensus_queue.cc:1059] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:01:21.471200  5454 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:21.454821  5417 consensus_queue.cc:237] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:21.474028  5526 log.cc:927] Time spent T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.679s	user 0.002s	sys 0.000s
I20260709 13:01:21.476979  5460 leader_election.cc:290] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:21.478571  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 290673us
I20260709 13:01:21.454370  5571 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:21.481604  5571 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:21.432091  5457 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.431726  5385 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:21.443113  5048 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:21.458468  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:21.462276  5579 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:21.465471  5568 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:21.467541  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:21.490227  1690 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:21.492678  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:21.493286  2237 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.455765  5576 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:21.495314  5538 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.583s	user 0.001s	sys 0.002s
I20260709 13:01:21.495484  1545 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:21.496771  5576 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:21.497273  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:21.498049  1538 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:21.491425  2211 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:21.506151  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:21.507292  2241 raft_consensus.cc:2393] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 11: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:21.509393  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2602) took 1418 ms. Trace:
I20260709 13:01:21.510128  5579 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:21.510731  5579 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:21.509792  1541 rpcz_store.cc:276] 0709 13:01:20.091159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.515955 (+424796us) service_pool.cc:224] Handling call
0709 13:01:20.516258 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:20.516742 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:20.517078 (+   336us) log.cc:844] Serialized 14 byte log entry
0709 13:01:20.684367 (+167289us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:20.708066 (+ 23699us) log.cc:844] Serialized 52 byte log entry
0709 13:01:20.708270 (+   204us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:20.708577 (+   307us) log.cc:844] Serialized 14 byte log entry
0709 13:01:20.708936 (+   359us) log.cc:844] Serialized 14 byte log entry
0709 13:01:20.979346 (+270410us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b1800331ea0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63b455 00007fc491723060 00007fc491735716 00007fc491746287 00007fc491746208
0709 13:01:21.039670 (+ 60324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.042303 (+  2633us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:21.443903 (+401600us) spinlock_profiling.cc:243] Waited 9.2 ms on lock 0x7b1800331ea0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:01:21.473227 (+ 29324us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:21.493908 (+ 20681us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b1800331ea0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:01:21.509172 (+ 15264us) raft_consensus.cc:1685] finished
0709 13:01:21.509195 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:21.509338 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9980,"prepare.queue_time_us":18917,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":113,"raft.queue_time_us":15624,"raft.run_cpu_time_us":479,"raft.run_wall_time_us":10178,"spinlock_wait_cycles":63916416,"thread_start_us":224197,"threads_started":2,"wal-append.queue_time_us":221060}
I20260709 13:01:21.512854  5565 consensus_queue.cc:1059] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:01:21.513832  5565 raft_consensus.cc:3055] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:21.517606  2211 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:21.485487  5291 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:01:21.524277  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:21.482744  5457 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.527576  1545 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:21.518334  5541 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.526047  5383 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.526474  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:21.530474  5383 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:21.532572  5383 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:21.532506  5400 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:21.534804  5400 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:21.535425  1540 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:21.514225  5565 raft_consensus.cc:740] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:21.537223  1585 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:21.539511  2237 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:21.539024  1538 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:01:21.560132  2209 leader_election.cc:304] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:21.569854  1585 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:21.571291  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 95350.8us
I20260709 13:01:21.483167  5348 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:01:21.593611  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:21.594658  2237 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
W20260709 13:01:21.573181  1511 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 2.173s (SENT) [suppressed 18 similar messages]
I20260709 13:01:21.539599  5524 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:21.598902  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:21.594893  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 133170us
I20260709 13:01:21.600128  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:21.603214  5447 raft_consensus.cc:3055] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:21.603657  5447 raft_consensus.cc:740] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:21.603823  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:21.604408  1617 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:21.604496  5447 consensus_queue.cc:260] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:21.605325  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:21.605639  5447 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.606817  1622 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:21.607348  5524 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:21.608415  1614 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:21.609579  5524 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:21.610584  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:21.571480  5541 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:21.616833  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:21.617219  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:21.617194  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 90406.5us
I20260709 13:01:21.597536  5572 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:21.691934  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:21.706209  5558 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.591372  5383 consensus_queue.cc:1059] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:01:21.593953  5143 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:21.717178  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:21.717222  1613 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:21.726027  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:21.698431  5541 raft_consensus.cc:697] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:21.724761  1620 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
W20260709 13:01:21.732501  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 159343us
I20260709 13:01:21.748663  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:21.726699  1622 raft_consensus.cc:606] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
W20260709 13:01:21.759182  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 541966us
I20260709 13:01:21.767274  1511 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:21.776836  1511 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:21.777150  1586 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:01:21.785997  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.787248  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:21.788882  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:21.772229  5524 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.728896  5558 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:21.775638  5510 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:21.785418  5138 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:21.783125  5458 consensus_queue.cc:1059] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:01:21.818712  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:21.619807  5565 consensus_queue.cc:260] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:01:21.799772  5594 consensus_queue.cc:1059] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:01:21.785372  5091 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.816896  5382 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:01:21.798280  5426 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:21.785108  5553 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:21.819077  5143 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.843910  2246 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:01:21.844340  2246 pending_rounds.cc:85] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Aborting all ops after (but not including) 7
I20260709 13:01:21.844624  2246 pending_rounds.cc:107] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:01:21.844933  2246 raft_consensus.cc:2889] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:21.842832  1545 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
W20260709 13:01:21.828291  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:21.843176  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 127464us
I20260709 13:01:21.822436  5138 raft_consensus.cc:697] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:01:21.842548  5589 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:21.828101  5594 consensus_queue.cc:1243] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:21.865401  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:21.824443  5576 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.837720  5523 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.821224  5400 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:21.836470  5382 consensus_queue.cc:1243] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:21.840004  5558 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:21.829389  5603 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:21.835641  5541 consensus_queue.cc:237] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:21.837241  5143 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:21.820217  5524 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:21.873785  5291 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:21.872385  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:21.907586  5291 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:21.912729  5143 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:21.902853  1511 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:21.878664  5415 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:21.919792  5415 raft_consensus.cc:697] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:21.920670  5415 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:21.862583  5138 consensus_queue.cc:237] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:21.922608  1614 raft_consensus.cc:1275] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:21.858844  5568 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.924170  5568 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:21.926607  5560 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:21.927126  5560 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.927603  5560 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:21.932039  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:21.935034  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:21.935631  1622 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:21.936944  1511 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:21.937795  5576 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:21.831704  4785 raft_consensus.cc:3055] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:21.938170  5576 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.938382  4785 raft_consensus.cc:740] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:21.938622  5510 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:21.938633  5576 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.956475  5383 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.956991  5383 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:21.953383  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:21.958770  1621 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:21.935074  1696 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:21.939349  4785 consensus_queue.cc:260] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:21.954912  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7803266de9984fac88726b08bee73921"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:21.961239  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:21.976110  1617 raft_consensus.cc:606] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:21.976572  1617 raft_consensus.cc:614] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:21.877549  5594 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:21.961391  1622 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:01:21.961475  1690 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:21.968343  1616 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:21.968892  1613 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:21.984572  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:21.987576  1511 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:21.910243  5291 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:21.991894  1511 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:21.994196  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:21.996282  2246 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:22.002583  2210 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:21.989748  5385 consensus_meta.cc:287] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.500s	user 0.010s	sys 0.000s
I20260709 13:01:22.004963  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:21.996483  1614 pending_rounds.cc:85] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 4
I20260709 13:01:22.008900  1614 pending_rounds.cc:107] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:01:22.009414  1614 raft_consensus.cc:2889] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:21.988667  5480 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:22.033440  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 430734us
I20260709 13:01:22.038786  1659 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:21.995993  5400 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:22.032126  5091 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:22.047672  5091 raft_consensus.cc:697] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:22.048623  5091 consensus_queue.cc:237] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:22.051340  5400 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:22.051815  5400 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:22.028067  5454 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:21.991093  5594 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:22.057991  5594 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:22.074016  5457 consensus_meta.cc:287] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.000s
I20260709 13:01:22.074473  5457 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:22.081527  5568 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:22.085382  1445 catalog_manager.cc:5697] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 8 to 12, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.087630  5579 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:22.087755  1445 catalog_manager.cc:5697] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 5 to 8, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.091352  1445 catalog_manager.cc:5697] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 3 to 9, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:22.090262  1585 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:22.093477  5291 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:22.093966  5291 raft_consensus.cc:697] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:22.094187  5565 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:22.022318  5382 raft_consensus.cc:2764] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:01:22.095412  5522 consensus_queue.cc:1059] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:22.031220  5552 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:01:22.096163  5522 consensus_queue.cc:1243] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:22.096753  5522 raft_consensus.cc:3055] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:22.032889  5480 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.986392  5603 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:22.097493  5480 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.099224  5603 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:22.094851  5291 consensus_queue.cc:237] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:22.097070  5522 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:22.103070  5522 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:22.104322  5522 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.996673  5524 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:22.110147  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:22.113998  1620 raft_consensus.cc:606] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:22.114473  1620 raft_consensus.cc:614] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:22.111193  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:22.115316  1445 catalog_manager.cc:5697] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 9 to 10, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
W20260709 13:01:22.112865  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.019s	sys 0.019s
I20260709 13:01:22.116269  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:22.116902  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.019s	sys 0.019s
I20260709 13:01:22.117182  1696 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:01:22.118340  5417 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.114969  5533 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.123914  5533 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:22.126626  5533 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:22.128751  1618 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:22.037261  4785 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:22.132725  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 94084.1us
I20260709 13:01:22.133498  1547 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 12: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:22.134871  1586 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:22.134954  1659 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:22.140229  5586 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:22.146819  1615 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:22.140585  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:22.147480  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 100765us
I20260709 13:01:22.147989  1618 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.142557  1613 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:22.115996  5574 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:01:22.116997  5594 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.146345  5586 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:22.146543  5291 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:22.122890  5417 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:22.159986  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:22.027256  5385 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:22.116369  5572 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:22.162283  1445 catalog_manager.cc:5697] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 7 to 11, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.198628  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:22.197829  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:22.199846  1694 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.169291  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:22.201714  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:22.174742  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:22.166276  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:22.217612  1696 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
W20260709 13:01:22.183681  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 48815.7us
I20260709 13:01:22.187096  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:22.191577  1542 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:22.219146  1659 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:22.153389  5555 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:01:22.222455  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:22.223090  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:22.167003  5586 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:22.229395  1619 raft_consensus.cc:2393] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:22.253682  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:22.265789  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.266186  1539 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:22.256538   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:22.256771  5533 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:22.268744  1620 raft_consensus.cc:1240] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:22.257651  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:22.269301  1547 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
W20260709 13:01:22.258404  5600 log.cc:927] Time spent T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:01:22.262916  1441 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58806 (request call id 177) took 9117 ms. Trace:
I20260709 13:01:22.188308  5291 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.263826  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:22.241974  1618 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:22.270695  1546 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:22.271157  1694 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
W20260709 13:01:22.219159  5589 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:01:22.284890  1696 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:22.279263  1621 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:22.281966  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:22.317497  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 98432.2us
I20260709 13:01:22.166963  5594 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:22.290956  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:22.280982  5291 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.314180  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:22.373143  5460 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:01:22.374611  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 180293us
I20260709 13:01:22.272915  5555 consensus_queue.cc:1243] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:22.365902   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:22.277591  5210 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:01:22.367862  5523 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.368317  5143 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:22.370843  5417 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:22.289201  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:22.384377  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:22.296900  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:22.272739  1441 rpcz_store.cc:276] 0709 13:01:13.145192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.145432 (+   240us) service_pool.cc:224] Handling call
0709 13:01:22.262675 (+9117243us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:18.615833 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:18.616430 (+   597us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:18.616465 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:01:18.616485 (+    20us) tablet.cc:662] Decoding operations
0709 13:01:18.617943 (+  1458us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:18.618008 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:18.618038 (+    30us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:01:18.641851 (+ 23813us) tablet.cc:701] Row locks acquired
0709 13:01:18.643415 (+  1564us) write_op.cc:260] PREPARE: finished
0709 13:01:18.685498 (+ 42083us) write_op.cc:270] Start()
0709 13:01:18.685616 (+   118us) write_op.cc:276] Timestamp: P: 1783602078685447 usec, L: 0
0709 13:01:18.685636 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:01:18.686449 (+   813us) log.cc:844] Serialized 6404 byte log entry
0709 13:01:19.484078 (+797629us) op_driver.cc:464] REPLICATION: finished
0709 13:01:19.832707 (+348629us) write_op.cc:301] APPLY: starting
0709 13:01:19.856970 (+ 24263us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:19.878726 (+ 21756us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:19.878860 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:19.889028 (+ 10168us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:19.889438 (+   410us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:01:19.889514 (+    76us) write_op.cc:312] APPLY: finished
0709 13:01:19.890308 (+   794us) log.cc:844] Serialized 113 byte log entry
0709 13:01:19.905484 (+ 15176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:19.989879 (+ 84395us) write_op.cc:454] Released schema lock
0709 13:01:20.011683 (+ 21804us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:20.136234 (+124551us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:20.149605 (+ 13371us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39531,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":293122,"apply.run_cpu_time_us":6277,"apply.run_wall_time_us":269527,"num_ops":16,"prepare.queue_time_us":639649,"prepare.run_cpu_time_us":21584,"prepare.run_wall_time_us":367915,"raft.queue_time_us":397514,"raft.run_cpu_time_us":13895,"raft.run_wall_time_us":132273,"replication_time_us":798139,"thread_start_us":985525,"threads_started":4,"wal-append.queue_time_us":388905,"wal-append.run_cpu_time_us":21638,"wal-append.run_wall_time_us":1994577}]]}
I20260709 13:01:22.386137  2211 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:22.402417  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:22.405936  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:22.411527  1696 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:22.406322  1695 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:01:22.218145  5572 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:22.408917  1693 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:01:22.413748  1693 pending_rounds.cc:85] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 5
I20260709 13:01:22.414047  1693 pending_rounds.cc:107] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:01:22.414333  1693 raft_consensus.cc:2889] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:22.278745  5383 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:22.417234  1546 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:22.412309  1585 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:22.419800  1687 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:22.407022  5454 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.427546  5454 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:22.427608  1445 catalog_manager.cc:5697] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.428741  5607 raft_consensus.cc:993] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:01:22.429289  5607 raft_consensus.cc:1081] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:01:22.429265  1445 catalog_manager.cc:5697] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 3 to 10, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.416121  5551 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:01:22.429797  5454 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:22.437323  5510 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:22.374636  5457 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:22.437898  5510 raft_consensus.cc:697] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:22.438475  5457 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:22.427644  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:22.431675  1585 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:22.444245  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:22.445863  1445 catalog_manager.cc:5697] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 6 to 10, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.444847  1691 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:22.412747  5210 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.412955  5555 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:22.489675  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:22.491398  1587 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:22.475034  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.497761  1616 pending_rounds.cc:85] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 5
I20260709 13:01:22.498324  1616 pending_rounds.cc:107] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:01:22.498633  1616 raft_consensus.cc:2889] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:22.440550  5578 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:22.416293  5568 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:01:22.409637  5523 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:22.516851  5607 raft_consensus.cc:993] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:01:22.517549  5607 raft_consensus.cc:1081] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:01:22.490160  5210 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:22.463503  5557 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:22.443531  5383 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:22.432442  5143 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:22.465818  5417 raft_consensus.cc:3055] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:22.524781  1547 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:22.509665  1445 catalog_manager.cc:5697] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 8 to 9, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
W20260709 13:01:22.532902  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 384041us
I20260709 13:01:22.491724  5382 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:22.442036  5576 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:22.572098  5210 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:22.572664  5210 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:22.573100  5210 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:22.573840  5586 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:22.575122  5210 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:22.581964  5382 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:22.584082  5611 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:01:22.562567  5417 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:22.507952  5578 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:22.521415  1546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5814bf31e900408885160ea0f89d6189"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39628
I20260709 13:01:22.589071  1546 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:22.589445  1546 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:22.592087  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:22.592861  1622 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:22.529847  5383 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.530676  5557 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:22.604041  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:22.596689  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:22.604656  2241 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:22.605125  2246 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:22.502027  5555 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:22.589286  5596 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:22.637058  1445 catalog_manager.cc:5697] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 6 to 10, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.638082  2210 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:22.567368  5552 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:22.640377  1694 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.640324  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:22.524932  5480 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:22.588673  5448 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.663203  5558 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:22.584249  5382 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:22.664868  1445 catalog_manager.cc:5697] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.594154  5578 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:22.664340  2244 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 12: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:22.604331  5383 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:22.438869  5510 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:22.686197  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 194851us
I20260709 13:01:22.611763  5557 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:22.638447  5385 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:22.690474  1694 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
W20260709 13:01:22.682245  5091 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.041s	sys 0.059s
W20260709 13:01:22.644551  5400 consensus_meta.cc:287] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.000s
I20260709 13:01:22.699204  1587 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:22.686996  5558 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.702520  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:22.703557  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:22.602600  5417 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:22.697827  5091 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.042s	sys 0.059s
I20260709 13:01:22.704035  2209 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:22.702298  5558 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:22.713268  1445 catalog_manager.cc:5697] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 2 to 6, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.724817  1696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:45660
I20260709 13:01:22.725598  1696 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:22.726078  1696 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:22.708467  5524 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:22.711935  5594 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:22.686826  5448 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:22.702752  5522 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:01:22.733074  5541 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:22.702320  5400 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:22.738694  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 420190us
I20260709 13:01:22.778131  5524 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.788877  5524 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:22.788985  5617 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:01:22.789251  5560 consensus_meta.cc:287] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.861s	user 0.017s	sys 0.000s
I20260709 13:01:22.789654  5560 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:22.791765  5616 log.cc:927] Time spent T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:01:22.792507  5448 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:22.723685  5417 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.796271  1545 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:22.736330  5568 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:22.812493  5568 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.813064  5568 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:22.817595  1614 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:22.818171  5621 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:22.819571  5143 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:22.822083  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.829257  1445 catalog_manager.cc:5697] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 5 to 6, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:22.833647  5602 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.837308  1445 catalog_manager.cc:5697] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
W20260709 13:01:22.837186  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 567251us
I20260709 13:01:22.778813  5356 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:01:22.839293  1445 catalog_manager.cc:5697] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 2 to 5, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:22.828225  5480 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:22.861339  1445 catalog_manager.cc:5697] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:22.778275  5541 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:22.864267  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 418608us
I20260709 13:01:22.837603  5586 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:22.837093  5594 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:22.840374  5576 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:22.840335  5477 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:01:22.840324  5608 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:22.860469  5555 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:22.889400  5613 log.cc:927] Time spent T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
W20260709 13:01:22.969532  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 75639.2us
I20260709 13:01:22.972009  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:22.973980  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:22.982991  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:22.984751  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:22.986552  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:22.987306  1622 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:22.972450  5615 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:01:22.990283  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:22.990918  1614 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:22.991686  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:22.995985  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:22.992911  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:22.835583  5602 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.004269  1695 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:23.005646  5602 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:22.869084  5605 consensus_queue.cc:1059] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
I20260709 13:01:22.870505  5618 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.147s
I20260709 13:01:22.818837  5621 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.012137  5621 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:23.012763  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:22.969729  5560 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:22.944667  5457 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:22.970263  5522 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.998669  1546 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:22.892597  5594 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:22.982931  5143 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.036710  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:23.034773  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:23.032673  2246 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:22.994711  5381 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:23.045321  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:23.049167  1622 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:23.022935  5555 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.022727  5210 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:23.056450  1546 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:23.057355  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:23.057976  2238 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.063907  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:23.077119  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:23.054670  5522 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.060272  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:23.064042  5400 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:23.065429  5620 log.cc:927] Time spent T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:01:23.099874  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:23.101017  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:23.101346  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:23.101487  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:23.065762  5619 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:01:23.102243  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:23.102401  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:23.102687  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:23.103916  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:23.105381  1622 raft_consensus.cc:3055] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:23.084527  5594 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:23.085979  5541 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:23.121948  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:23.085585  5524 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.086591  5576 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:23.087831  5552 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:23.089347  5211 consensus_queue.cc:1059] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:23.089231  5558 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.139062  5558 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:23.059932  5632 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.142504  5632 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.144855  5623 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:23.146241  5632 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:23.035771  5457 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:23.147364  5291 consensus_meta.cc:287] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.740s	user 0.006s	sys 0.005s
I20260709 13:01:23.147780  5291 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.148307  5457 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:23.148906  1617 raft_consensus.cc:2368] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:23.098973  5522 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:23.056668  5555 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.150915  5555 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:23.155369  5624 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:23.155893  5624 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:23.156260  5624 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:23.158380  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1554) took 1117 ms. Trace:
I20260709 13:01:23.083359  2241 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:23.050051  5143 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.105913  1622 raft_consensus.cc:740] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:01:23.161962  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.162761  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.106750  1614 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:23.098858  5605 raft_consensus.cc:3055] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:23.118172  5610 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:23.064038  5571 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:23.185235  1546 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:01:23.190407  1542 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:23.106328  1696 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.120427  2238 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
W20260709 13:01:23.118083  5565 consensus_meta.cc:287] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 1.023s	user 0.012s	sys 0.000s
I20260709 13:01:23.136258  5576 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.136471  5383 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.136953  5552 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:23.143599  2240 raft_consensus.cc:2393] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 10: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
W20260709 13:01:23.143846  5629 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 13:01:23.066095  5626 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 13:01:23.063725  5210 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.163681  1620 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:23.143885  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:23.161489  1622 consensus_queue.cc:260] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.164939  5605 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:23.168920  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:23.234813  1614 raft_consensus.cc:2393] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 10: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:23.192819  5610 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.172602  5568 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.175627  5143 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:23.248070  1614 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:01:23.248833  2237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 817) took 1136 ms. Trace:
I20260709 13:01:23.249208  2237 rpcz_store.cc:276] 0709 13:01:22.112780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.113020 (+   240us) service_pool.cc:224] Handling call
0709 13:01:22.141633 (+ 28613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:22.373493 (+231860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:22.373525 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:22.374015 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:01:22.560454 (+186439us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:22.560514 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.560610 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:23.248585 (+687975us) raft_consensus.cc:1685] finished
0709 13:01:23.248606 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.248753 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":231323,"raft.queue_time_us":231600,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":186109,"threads_started":1,"wal-append.queue_time_us":459175}
I20260709 13:01:23.248865  5210 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:23.246968  1512 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:23.253326  1512 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:23.254410  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:23.254601  5632 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:23.255326  5632 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:23.256165  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2303) took 1119 ms. Trace:
I20260709 13:01:23.208220  5560 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:23.256551  1688 rpcz_store.cc:276] 0709 13:01:22.136570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.136901 (+   331us) service_pool.cc:224] Handling call
0709 13:01:22.163912 (+ 27011us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:22.313185 (+149273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:22.313214 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:22.367497 (+ 54283us) log.cc:844] Serialized 26 byte log entry
0709 13:01:22.838955 (+471458us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:22.839012 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.839117 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:23.255970 (+416853us) raft_consensus.cc:1685] finished
0709 13:01:23.255990 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.256112 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":179429,"raft.queue_time_us":145384,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":3781,"thread_start_us":418094,"threads_started":1,"wal-append.queue_time_us":649749}
I20260709 13:01:23.257856  5560 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.229776  5211 consensus_queue.cc:1243] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:23.260464  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1482) took 1073 ms. Trace:
I20260709 13:01:23.260965  1545 rpcz_store.cc:276] 0709 13:01:22.186671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.186822 (+   151us) service_pool.cc:224] Handling call
0709 13:01:23.260251 (+1073429us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b5400068bd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:23.260410 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1327244544}
I20260709 13:01:23.262259  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:23.262885  1545 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:23.158932  1689 rpcz_store.cc:276] 0709 13:01:22.041574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.041754 (+   180us) service_pool.cc:224] Handling call
0709 13:01:22.047678 (+  5924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:22.110290 (+ 62612us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:22.135750 (+ 25460us) log.cc:844] Serialized 14 byte log entry
0709 13:01:22.441198 (+305448us) spinlock_profiling.cc:243] Waited 8.87 ms on lock 0x7b180045dc60. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb23a 00007fc491735a2a
0709 13:01:22.873293 (+432095us) log.cc:844] Serialized 14 byte log entry
0709 13:01:22.980362 (+107069us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:22.980411 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:22.980451 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.089107 (+108656us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b180045dc60. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e5b8c0a 00007fc497cf8219 00007fc4955ff58f 00007fc48e63e571 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd
0709 13:01:23.156765 (+ 67658us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b180045dc60. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e60c2a6 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419
0709 13:01:23.158077 (+  1312us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b54002c5e54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:23.158133 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.158294 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":234662,"prepare.queue_time_us":25641,"prepare.run_cpu_time_us":393,"prepare.run_wall_time_us":1605,"raft.queue_time_us":137968,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":55397,"spinlock_wait_cycles":222190464,"thread_start_us":420680,"threads_started":1}
I20260709 13:01:23.264223  1689 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:23.264344  5381 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:23.264940  5210 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.265527  5210 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.209019  1544 raft_consensus.cc:1240] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:01:23.267777  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:23.212435  5571 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.268400  1544 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:23.269380  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:23.269796  5210 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:23.269943  5571 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:23.270401  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:23.273660  5594 raft_consensus.cc:3055] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:23.274066  5594 raft_consensus.cc:740] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:23.275641  1613 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:23.276651  5523 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:23.279775  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2677) took 1111 ms. Trace:
I20260709 13:01:23.280260  1617 rpcz_store.cc:276] 0709 13:01:22.168701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.168872 (+   171us) service_pool.cc:224] Handling call
0709 13:01:23.279539 (+1110667us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b5400086454. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:23.279707 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2177271040}
I20260709 13:01:23.282152  5605 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.216547  1615 raft_consensus.cc:2410] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:23.223557  5579 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:01:23.283514  5523 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.284053  5523 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:01:23.214015  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:23.285316  1542 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:23.286145  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:23.286610  1542 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:23.287441  2209 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:23.288911  1619 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:01:23.289386  1619 pending_rounds.cc:85] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 6
I20260709 13:01:23.289655  1619 pending_rounds.cc:107] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 9.7
I20260709 13:01:23.290026  1619 raft_consensus.cc:2917] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Aborting config change with OpId 9.7: Aborted: Op aborted by new leader
I20260709 13:01:23.290586  1619 raft_consensus.cc:2889] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:23.274835  5594 consensus_queue.cc:260] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.267124  5572 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:23.218513  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:23.219949  1547 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:23.220954  1543 raft_consensus.cc:1217] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[6.4-12.7]   Dedup: 8.5->[10.6-12.7]
W20260709 13:01:23.213027  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 108762us
I20260709 13:01:23.211309  5522 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:23.312224  1512 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:23.228422  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:23.232311  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:23.211565  5555 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:23.237618  5383 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:23.237888  5612 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:23.238051  5524 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:23.239123  1618 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 13:01:23.245755  5557 consensus_meta.cc:287] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.003s
I20260709 13:01:23.260548  5576 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:23.240614  5610 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:23.282550  1585 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:23.306376  1542 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:23.294275  1540 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:23.295364  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:23.298075  1622 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:23.295493  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:23.295974  1543 pending_rounds.cc:85] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 5
I20260709 13:01:23.295531  2209 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:23.298467  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:23.339066  1545 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:23.339437  1543 pending_rounds.cc:107] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 11.6
W20260709 13:01:23.339898  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 44448.3us
I20260709 13:01:23.340157  1543 raft_consensus.cc:2889] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:23.297578  5605 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:23.311299  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:23.314035  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:23.291213  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50542 (request call id 17) took 3128 ms. Trace:
I20260709 13:01:23.327142  1539 raft_consensus.cc:2368] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:23.324734  1511 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:23.203193  2241 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:23.334859  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:23.361166  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:23.339676  1538 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:23.359645  1692 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:23.358748  1622 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:23.292264  5594 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:23.227439  1696 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:23.342088  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 59622.4us
I20260709 13:01:23.336114  5555 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.368649  1511 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:23.340826  5612 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.300269  5624 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.339187  1547 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:23.310933  5291 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:23.351384  1659 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:23.369016  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 224718us
I20260709 13:01:23.372625  1544 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:01:23.377336  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.381119  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:23.359797  1619 rpcz_store.cc:276] 0709 13:01:20.163088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.296729 (+133641us) service_pool.cc:224] Handling call
0709 13:01:20.524169 (+227440us) log.cc:844] Serialized 506 byte log entry
0709 13:01:21.263523 (+739354us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b5400465da0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916a4142 00007fc491684eaa 00007fc49168bd53 00007fc49168bcd9 00007fc49168bc69 00007fc49168bc31 00007fc49168adfd 000000000038f354 000000000038f199 00007fc48e63e475
0709 13:01:21.924978 (+661455us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b5400465da0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916a4142 00007fc491684eaa 00007fc49168bd53 00007fc49168bcd9 00007fc49168bc69 00007fc49168bc31 00007fc49168adfd 000000000038f354 000000000038f199 00007fc48e63e475
0709 13:01:23.291126 (+1366148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":265028,"raft.queue_time_us":19422,"raft.run_cpu_time_us":10105,"raft.run_wall_time_us":1899538,"spinlock_wait_cycles":25329152,"thread_start_us":121718,"threads_started":1,"wal-append.queue_time_us":214280,"wal-append.run_cpu_time_us":3568,"wal-append.run_wall_time_us":1323818}
I20260709 13:01:23.393992  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:23.384967  1659 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:23.394778  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:23.389542  2241 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:23.388533  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:23.380956  5091 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:23.383926  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:23.398552  2240 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:23.400243  2246 raft_consensus.cc:2393] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 10: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:23.349757  5645 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:23.350020  5524 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:23.360519  5572 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:23.403985  1547 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:23.403658  1511 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:23.407032  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:23.409901  2242 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.410285  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:23.332309  5522 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.413997  1539 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:01:23.413003  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 352678us
I20260709 13:01:23.415637  1694 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:23.377406  5210 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:23.417382  1511 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:23.414309  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:23.336827  5048 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:01:23.337541  5579 consensus_queue.cc:1059] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:01:23.424625  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:23.430004  1695 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.427501  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:23.434525  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:23.435142  1622 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: [6.5-9.6]
I20260709 13:01:23.442939  1618 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:23.443954  1615 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:23.447423  2245 raft_consensus.cc:1240] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:23.406414  5623 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:23.409768  5602 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:23.450027  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:23.455880  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.451210  1617 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:23.457525  1547 raft_consensus.cc:1240] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:23.383672  5638 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:23.440620  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:23.403707  5645 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:23.343391  5557 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.480635  1546 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:23.480926  5524 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:23.481354  5638 raft_consensus.cc:697] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:23.481914  2242 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:23.482348  5638 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.457222  1696 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:23.485234  1618 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:23.485919  1622 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:23.456261  1660 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:23.487612  5640 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.249s	user 0.000s	sys 0.004s
I20260709 13:01:23.437155  5560 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:23.476145   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:23.476574  5645 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:23.476922  5508 consensus_queue.cc:1059] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:23.459256  5533 raft_consensus.cc:3055] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:23.454128  5091 raft_consensus.cc:697] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:23.491806  1585 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:23.508987  1585 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:23.486593  5400 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:23.524405  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:23.525213  1694 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:23.462076  1544 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:23.490284  1587 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:23.452527  5623 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.497256  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:23.498061  1660 leader_election.cc:400] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:23.545354  1660 leader_election.cc:403] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:23.546308  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 56819.6us
I20260709 13:01:23.494375  5420 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:23.500162  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 82831.3us
I20260709 13:01:23.551126  1511 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:23.408118  5607 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:01:23.503955  1545 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:23.458041  5602 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.397217  5552 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.504935  1547 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:01:23.529008  5578 consensus_meta.cc:287] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.833s	user 0.004s	sys 0.008s
I20260709 13:01:23.492816  1659 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:23.518819  1695 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:23.488158  4785 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:23.537659  1512 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:23.542659  5523 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:23.454131  5143 consensus_queue.cc:1059] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:01:23.496186  5586 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:23.457026  5211 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:01:23.507594  5426 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:23.503463  5533 raft_consensus.cc:740] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:23.510327  1585 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:23.564482  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:23.551146  5623 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:23.550714  5553 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:23.564623  5400 raft_consensus.cc:697] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:23.551010  5631 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:23.563099  5420 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.564896  5417 consensus_queue.cc:1059] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:01:23.591696  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 98975.7us
I20260709 13:01:23.622776  1659 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:23.593086  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 82834.6us
I20260709 13:01:23.593737  1694 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:23.564280  5602 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:23.596160  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 58599.6us
I20260709 13:01:23.632285  1512 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:23.596077  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 45041us
I20260709 13:01:23.632869  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:23.634147  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:23.561968  5551 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:23.635522  5551 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.637706  5551 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:23.584425  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:23.574601  5048 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:23.614629  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 2259) took 1148 ms. Trace:
I20260709 13:01:23.564445  5091 consensus_queue.cc:237] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.639197  1616 rpcz_store.cc:276] 0709 13:01:22.455468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.455600 (+   132us) service_pool.cc:224] Handling call
0709 13:01:22.497494 (+ 41894us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:22.530501 (+ 33007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:22.530548 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:22.563797 (+ 33249us) log.cc:844] Serialized 52 byte log entry
0709 13:01:22.972258 (+408461us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:22.972323 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.972437 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:23.287016 (+314579us) spinlock_profiling.cc:243] Waited 8.21 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:23.595046 (+308030us) raft_consensus.cc:1685] finished
0709 13:01:23.595069 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.603356 (+  8287us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":30228,"spinlock_wait_cycles":18881792,"thread_start_us":328118,"threads_started":1,"wal-append.queue_time_us":506005}
I20260709 13:01:23.641081  5558 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:23.641615  5558 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.642493  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:23.616711  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:23.529595  5653 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:23.613406  5555 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:23.611634  5631 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:23.564749  5567 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:01:23.589479  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:23.624022  1585 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:23.660485  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:23.651614  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:23.652518  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:23.582190  4785 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.598706  5382 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:23.654184  1691 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 12: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:23.575367  5578 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.596287  5595 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:23.678301  4785 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:23.679044  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:23.673686  5653 raft_consensus.cc:697] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:23.680637  5508 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:23.680764  1690 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.681094  5508 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:23.681636  5508 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.681403  5653 consensus_queue.cc:237] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.684682  5639 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:23.685184  5639 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.663558  1687 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:23.598417  5648 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:23.598431  5553 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:23.671916  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:23.595679  5348 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:01:23.596045  5603 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:01:23.673507  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:23.713832  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:23.674770  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:23.661482  2245 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:23.714955  1618 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:23.691345  1690 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:23.702332  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:23.703200  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:23.704003  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:23.720517  1616 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:01:23.680213  5578 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:23.665443  5383 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:23.667069  5631 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:23.687963  5624 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:23.725643  1692 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:23.697774  5648 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.705935  5553 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.697878  5639 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:23.743300  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 121828us
I20260709 13:01:23.699787  5522 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:23.716419  5348 consensus_queue.cc:1243] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:23.703543  5565 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:23.748361  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:23.765920  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 4b6f3b457deb4725b437c627cc3a5cd7: Aborted: Op aborted by new leader
I20260709 13:01:23.765921  5417 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:01:23.769061  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.770326  5417 consensus_queue.cc:1059] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:23.771399  5586 raft_consensus.cc:3055] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:23.771756  5586 raft_consensus.cc:740] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:23.771890  5624 consensus_queue.cc:1059] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:23.773005  5211 raft_consensus.cc:3055] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:23.772632  5586 consensus_queue.cc:260] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.773384  5211 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:23.774055  5586 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:23.774268  5211 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.733218  5612 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:23.778944  2211 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:23.789151  2211 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:23.781427  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:23.783393  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:23.791982  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:23.745942  5648 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:23.800439  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 177764us
I20260709 13:01:23.802189  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:23.805717  1659 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:23.807912  1616 raft_consensus.cc:2368] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:23.809530  1659 leader_election.cc:400] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:23.809891  1659 leader_election.cc:403] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:01:23.816707  2240 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:23.791162  5383 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:23.800599  5211 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.733397  5400 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.804263  5454 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:23.798300  5627 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:23.788223  5565 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.817584  5417 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:23.816722  5552 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:23.825589  5579 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
W20260709 13:01:23.831174  5662 log.cc:927] Time spent T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:01:23.860695  4785 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:23.861258  5578 consensus_queue.cc:1059] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:01:23.862238  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.863535  5595 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:23.858244  5420 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:23.873600  5595 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:23.865058  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 646909798f0047ef9e8073d28a784525: Illegal state: Replica dcc91bf6e3bd468bbbbfc26e3a7c5e01 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
W20260709 13:01:23.866429  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.867565  5674 consensus_queue.cc:1059] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:01:23.853942  5417 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:23.838863  5383 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.870693  5627 raft_consensus.cc:697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:01:23.901062  5605 consensus_meta.cc:287] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.533s	user 0.006s	sys 0.005s
I20260709 13:01:23.908811  5417 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:23.920258  5603 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.930831  5595 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:23.930974  5618 raft_consensus.cc:3055] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:23.920738  5508 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.942216  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:23.942984  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.925917  5637 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:23.948458  1586 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:23.948685  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:23.949401  2245 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:23.937879  5664 log.cc:927] Time spent T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:01:23.952178  2240 raft_consensus.cc:2393] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 9: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:23.950580  2209 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:23.956490  5668 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:23.953454  5607 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:23.957860  5607 raft_consensus.cc:697] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:23.958760  5607 consensus_queue.cc:237] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.959308  5637 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.957020  5668 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.961910  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:23.962589  1617 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:23.941500  5618 raft_consensus.cc:740] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:23.979969  5553 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:23.981137  1619 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:23.981690  5627 consensus_queue.cc:237] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:23.988735  1617 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:23.990399  5645 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:24.000586  5594 consensus_meta.cc:287] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.621s	user 0.005s	sys 0.005s
W20260709 13:01:24.002583  5650 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.493s	user 0.000s	sys 0.003s
I20260709 13:01:24.008072  5623 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:24.009569  1695 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 14: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:24.010329  5623 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:23.953611  5639 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.018844  1692 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:24.020938  1692 raft_consensus.cc:1240] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:23.944882  5603 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:24.026839  5383 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:23.967722  5572 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:01:24.048659  5677 log.cc:927] Time spent T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:01:24.053674  5603 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:24.056779  5557 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:24.024001  5639 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:24.046162  5565 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:23.947425  5631 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:24.062911  5631 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:24.068518  1691 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:24.077466  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:24.076033  5639 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:24.063637  5618 consensus_queue.cc:260] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:24.091205  5654 log.cc:927] Time spent T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.447s	user 0.000s	sys 0.001s
I20260709 13:01:24.092164  5417 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:24.093091  5672 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:24.093695  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 2323) took 1115 ms. Trace:
I20260709 13:01:24.094244  1620 raft_consensus.cc:3055] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:24.097098  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 717) took 1082 ms. Trace:
I20260709 13:01:24.098752  5426 raft_consensus.cc:697] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:24.099040  5602 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:24.099720  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 467412us
I20260709 13:01:24.100246  5210 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:24.101061  1511 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:24.104048  5567 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:24.105000  5420 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.147675  5420 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:24.150125  5420 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:24.151221  1687 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:01:24.152383  5602 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:24.107605  5558 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:24.109200  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:24.109664  5649 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:24.113039  5508 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:24.183272  5676 log.cc:927] Time spent T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:01:24.113572  5627 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:01:24.186969  5675 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:01:24.187119  5627 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:24.189009  5681 log.cc:927] Time spent T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:01:24.189608  5627 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:24.115381  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:24.190066  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2620) took 1003 ms. Trace:
I20260709 13:01:24.116720  5533 consensus_queue.cc:260] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:24.120437  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 109754us
I20260709 13:01:24.191617  5417 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:24.190392  1543 rpcz_store.cc:276] 0709 13:01:23.186872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.187366 (+   494us) service_pool.cc:224] Handling call
0709 13:01:23.220715 (+ 33349us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:01:23.350082 (+129367us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:23.644465 (+294383us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b180033e260. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63b455 00007fc4951233c7 00007fc4917359a7 00007fc4917450bf 00007fc491745038
0709 13:01:23.687935 (+ 43470us) log.cc:844] Serialized 14 byte log entry
0709 13:01:24.105129 (+417194us) log.cc:844] Serialized 14 byte log entry
0709 13:01:24.105276 (+   147us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:24.105813 (+   537us) log.cc:844] Serialized 52 byte log entry
0709 13:01:24.105939 (+   126us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:24.106121 (+   182us) log.cc:844] Serialized 14 byte log entry
0709 13:01:24.106430 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 13:01:24.106653 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.106726 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:24.189834 (+ 83108us) raft_consensus.cc:1685] finished
0709 13:01:24.189855 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:24.190009 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":272085,"prepare.queue_time_us":297341,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":82,"raft.queue_time_us":278446,"raft.run_cpu_time_us":446,"raft.run_wall_time_us":16239,"spinlock_wait_cycles":10218240,"thread_start_us":146676,"threads_started":2,"wal-append.queue_time_us":191256}
I20260709 13:01:24.193397  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:24.193956  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:01:24.194353  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 85213.9us
I20260709 13:01:24.194712  2245 raft_consensus.cc:2368] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:24.122082  1690 rpcz_store.cc:276] 0709 13:01:22.978008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.102188 (+124180us) service_pool.cc:224] Handling call
0709 13:01:24.093493 (+991305us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b5400134cd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:24.093624 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328611712}
I20260709 13:01:24.195111  5648 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:24.197000  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:24.197999  5508 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:24.198505  5508 raft_consensus.cc:697] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:24.190937  5533 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.199156  5648 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:24.200300  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:24.122237  1620 raft_consensus.cc:740] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:24.130759  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:24.143169  1512 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:24.203972  1620 consensus_queue.cc:260] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:24.204780  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 61706.7us
I20260709 13:01:24.146703  1587 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:24.206466  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 59849.4us
I20260709 13:01:24.156152  5385 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.208715  5508 consensus_queue.cc:237] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:24.156319  5560 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.129990  5672 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:24.118461  5645 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:24.164340  5567 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:24.175493  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 74524.3us
I20260709 13:01:24.141603  5618 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:24.164583  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2322) took 1186 ms. Trace:
I20260709 13:01:24.204910  1620 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.208806  5385 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:24.122876  1621 rpcz_store.cc:276] 0709 13:01:23.014967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.015903 (+   936us) service_pool.cc:224] Handling call
0709 13:01:23.016238 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:23.174446 (+158208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:23.174475 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:23.174923 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:01:23.496441 (+321518us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:23.496501 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.888203 (+391702us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400087854. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:23.888253 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:24.090542 (+202289us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:24.096827 (+  6285us) raft_consensus.cc:1685] finished
0709 13:01:24.096855 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:24.097029 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1635,"raft.queue_time_us":9454,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7429,"spinlock_wait_cycles":367686528,"thread_start_us":320761,"threads_started":1,"wal-append.queue_time_us":413727}
W20260709 13:01:24.162909  5610 consensus_meta.cc:287] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.000s
I20260709 13:01:24.185400  5420 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:24.206589  5382 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:24.243640  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.227013  1621 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:01:24.236760  1618 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: [9.6-12.7]
I20260709 13:01:24.226308  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:24.248731  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.248631  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:24.220391  1693 rpcz_store.cc:276] 0709 13:01:22.977705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.156931 (+179226us) service_pool.cc:224] Handling call
0709 13:01:23.157193 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:23.927511 (+770318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:23.927541 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:23.927577 (+    36us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:23.927613 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.164293 (+236680us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b540044b954. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:24.164354 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:24.164514 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":16747,"spinlock_wait_cycles":1771147776}
I20260709 13:01:24.219867  5639 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:24.257023  2245 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:24.218176  5553 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:24.261866  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:24.262635  1695 raft_consensus.cc:2410] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:01:24.261181  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:24.249614  5382 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.266264  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:24.264276  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 298443us
I20260709 13:01:24.269052  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:24.269889  1613 raft_consensus.cc:2410] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:01:24.272544  1621 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: [6.5-9.6]
I20260709 13:01:24.251130  5420 raft_consensus.cc:697] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 7 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:24.222263  5631 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:01:24.276628  2245 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:24.277838  1511 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:24.259121  5632 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:24.219350  5560 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:24.284359  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:24.284911  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:24.210083  5426 consensus_queue.cc:237] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:24.224002  5610 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:24.291739  5553 consensus_queue.cc:1059] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:24.289573  5555 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:24.297977  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:24.293283  5625 raft_consensus.cc:3055] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:24.300676  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:24.303622  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:24.341302  1695 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:24.342387  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:24.342446  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:24.342749  1587 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:24.343640  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:24.310809  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:24.297878  5448 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:24.296545  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:24.274215  5382 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.254146  5603 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:01:24.267258  5637 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:24.330924  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:24.332742  1621 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:24.286881  5632 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.288754  5457 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:24.347229  1693 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:24.347113  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:24.364019  1691 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:24.352206  1688 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:24.364382  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:24.353737  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:24.354846  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:24.356647  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 60174.1us
I20260709 13:01:24.365006  1540 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.365866  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:24.366077  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:24.366317  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:24.360601  1587 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:24.320362  5557 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:01:24.371059  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:24.376390  5457 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:24.379097  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:24.382025  1587 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:24.383150  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:24.340876  5625 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:24.347375  5595 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:24.385751  1547 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:24.394637  1660 leader_election.cc:400] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:24.363736  5555 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:24.395406  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:24.411459  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:24.395012  1660 leader_election.cc:403] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:01:24.411882  1538 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:24.372041  5632 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.413144  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:24.403563  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:24.415620  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 573) took 1086 ms. Trace:
I20260709 13:01:24.383468  5138 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:24.419118  1547 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:24.419364  5138 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:24.419988  5138 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.418809  1687 rpcz_store.cc:276] 0709 13:01:23.329237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.713842 (+384605us) service_pool.cc:224] Handling call
0709 13:01:23.736698 (+ 22856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.151809 (+415111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.415311 (+263502us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b5400097754. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:24.415549 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":952448256}
I20260709 13:01:24.430629  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:24.436266  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 50138.5us
I20260709 13:01:24.438439  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:24.386373  5653 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:24.393745  5553 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:24.471964  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:24.473721  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:24.395426  5568 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:24.478163  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:24.452549  5651 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:01:24.484719  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 117450us
I20260709 13:01:24.485515  1511 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:24.496663  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.450336  5586 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:24.499508  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:24.392976  5595 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:24.506866  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:24.473299  5553 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.483721  5672 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:24.500800  5576 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:24.539630  2237 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:24.502712  5385 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:24.483109  5637 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:01:24.470402  5607 consensus_queue.cc:1059] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:01:24.544750  1620 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:24.549633  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2698) took 1109 ms. Trace:
I20260709 13:01:24.546824  1540 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:24.501482  5567 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:24.487488  5415 consensus_queue.cc:1059] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:01:24.549973  1620 rpcz_store.cc:276] 0709 13:01:23.440065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.440330 (+   265us) service_pool.cc:224] Handling call
0709 13:01:24.094128 (+653798us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400293c20. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916a2dc0 00007fc49172ee18 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:24.549572 (+455444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327328640}
I20260709 13:01:24.508916  5696 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:24.557850  1621 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:24.511483  5553 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:24.559823  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:24.560010  1540 raft_consensus.cc:1275] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:24.508870  5594 consensus_queue.cc:1059] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:01:24.568499  1690 raft_consensus.cc:2410] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:01:24.601428  5572 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:24.612632  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:24.556320  5523 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260709 13:01:24.563788  5688 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:01:24.559726  5415 consensus_queue.cc:1243] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:01:24.571432  5694 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:01:24.416126  5420 consensus_queue.cc:237] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:24.600481  5610 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:24.555410  5385 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:01:24.607717  5568 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:24.688769  5382 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:24.692426  5381 raft_consensus.cc:3055] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:24.692991  5381 raft_consensus.cc:740] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:24.693754  5381 consensus_queue.cc:260] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:24.694692  5381 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:24.695503  5211 consensus_meta.cc:287] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.854s	user 0.006s	sys 0.006s
W20260709 13:01:24.695742  5701 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:01:24.696763  5698 log.cc:927] Time spent T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:01:24.570513  5138 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:24.859913  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:24.681458  5560 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:24.871291  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:24.871378  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 364792us
I20260709 13:01:24.873647  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:24.871510  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 369414us
I20260709 13:01:24.876438  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:24.879191  1692 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
W20260709 13:01:24.813632  5565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.005s	sys 0.016s
I20260709 13:01:24.691135  5382 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:24.880985  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:24.865638  5694 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:01:24.888589  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:24.889339  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:24.889424  1687 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.892200  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:24.895224  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:24.902372  1618 raft_consensus.cc:2368] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:24.904045  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:24.904664  1616 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.906139  1687 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:24.909785  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:24.910578  2237 raft_consensus.cc:2368] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:24.910452  5460 consensus_queue.cc:1059] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:24.886307  5211 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:24.912611  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:24.913020  5211 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.913425  5211 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:24.917385  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:24.919799  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:24.686033  5568 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:24.923277  5568 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:24.925582  1660 leader_election.cc:400] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:24.925935  1660 leader_election.cc:403] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:01:24.937038  5138 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:24.937209  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:24.937991  5683 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:24.941998  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:24.946223  1660 leader_election.cc:400] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:24.946621  1660 leader_election.cc:403] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:24.948788  5683 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:24.952661  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:24.953002  5699 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.267s	user 0.000s	sys 0.000s
I20260709 13:01:24.953740  5552 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:24.954417  5552 raft_consensus.cc:697] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:24.957226  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:24.957509  1616 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:24.958796  1616 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:24.960318  5568 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.960903  5568 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:24.959376  1511 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:24.963665  5568 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:24.953758  5610 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:24.955590  5552 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:24.942708  5632 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:24.998072  5555 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:24.972610  5426 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:25.001034  5668 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:24.984171  5560 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:01:25.012696  5709 log.cc:927] Time spent T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:01:25.013931  5560 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:25.015719  5417 raft_consensus.cc:3055] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:25.016227  5417 raft_consensus.cc:740] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:25.018715  1540 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:01:25.022924  1541 raft_consensus.cc:2368] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10.
I20260709 13:01:25.024528  5426 raft_consensus.cc:697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:25.025475  5426 consensus_queue.cc:237] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:25.026325  5553 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:25.023900  5632 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:25.029314  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:25.030143  5608 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:25.030565  5719 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:25.030649  5608 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:25.031414  5717 consensus_queue.cc:1059] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:25.033144  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:25.033783  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:25.045045  1585 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:25.034214  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:25.034440  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:25.046352  1542 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:25.047155  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:25.047919  5702 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:25.048138  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:25.048666  1542 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:25.051964  1544 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:25.052814  1585 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:25.048445  5702 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:25.055186  5711 log.cc:927] Time spent T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:01:25.056378  5704 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:25.056557  5702 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:25.056836  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:25.056849  5704 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:25.057999  5719 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:25.035296  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:25.060132  1545 raft_consensus.cc:2368] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:25.036993  5560 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:25.039366  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:25.060794  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:25.061120  1614 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:01:25.040825  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:25.062142  1538 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:25.042315  5638 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:25.042860  5382 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:25.010041  5555 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:25.050069  5618 consensus_meta.cc:287] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.821s	user 0.010s	sys 0.002s
I20260709 13:01:25.038414  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:25.068897  2240 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:25.069114  1585 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:25.063416  2209 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:25.056384  5417 consensus_queue.cc:260] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:25.064510  1540 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:01:25.064656  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:25.066337  1620 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:25.058077  5704 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:25.071059  2209 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:25.071055  1585 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:25.058571  5719 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:25.093382  1614 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:25.085731  1542 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:25.086759  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:25.088028  5717 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:25.091161  1512 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:25.063881  5522 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:25.067349  5702 raft_consensus.cc:3055] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:25.116937  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:25.111357  2238 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:25.119815  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:25.105368  2209 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:25.092185  5607 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:25.132606  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:25.132953  2240 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:25.064131  5211 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:25.107667  5417 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:25.104242  5448 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:25.068022  5382 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:25.069904  5638 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:25.113385  5702 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:25.145427  1538 raft_consensus.cc:2410] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:25.146346  1540 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:25.108619  5381 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:01:25.103947  5717 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:25.142441  5607 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:25.154258  5710 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:25.166342  1545 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:01:25.168819  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 97798.7us
I20260709 13:01:25.132660  5636 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:01:25.176195  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:25.179173  1616 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:01:25.182538  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 77237.6us
I20260709 13:01:25.184473  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:25.165294  5695 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.019s	sys 0.022s
I20260709 13:01:25.166427  5460 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:25.137094  5608 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:25.173174  5636 consensus_queue.cc:1243] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer e8a64798e5f94de8909707bcbd11804a log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:25.199954  5553 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:25.200450  5638 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:25.181896  5723 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.203650  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:25.204715  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:25.184441  5696 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:25.188942  5713 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:25.214251  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1570) took 1971 ms. Trace:
I20260709 13:01:25.214649  1688 rpcz_store.cc:276] 0709 13:01:23.243004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.258443 (+ 15439us) service_pool.cc:224] Handling call
0709 13:01:23.258731 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.370535 (+1111804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.214030 (+843495us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400450e54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:25.214186 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2513770880}
I20260709 13:01:25.202494  5726 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:25.207268  5608 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:25.188400  5420 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:01:25.208204  5714 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:25.201349  5723 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:25.231065  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:25.233851  1616 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:25.218382  5696 raft_consensus.cc:697] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:25.253470  5211 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:25.255739  5723 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:25.209586  5702 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:25.257405  5702 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:25.228642  5726 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:25.248360  5719 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:25.264519  5724 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:01:25.268805  5696 consensus_queue.cc:237] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:25.275131  5625 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:25.276430  5625 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:25.278169  5382 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:25.285494  5723 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.286077  5723 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:25.288095  5723 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:25.264130  5717 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:25.293155  5726 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:25.256016  5725 log.cc:927] Time spent T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:01:25.263648  5716 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 13:01:25.304456  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.270936  5522 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:25.319571  5143 raft_consensus.cc:3055] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:25.320209  5143 raft_consensus.cc:740] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:25.321345  5143 consensus_queue.cc:260] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:25.329008  5522 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.329594  5522 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:25.319602  5704 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:25.333298  5704 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:25.336472  1617 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:25.356742  5417 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.357347  5417 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:25.358613  5693 consensus_queue.cc:1059] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:01:25.359608  4785 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:25.368095  1659 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:25.370357  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 179699us
I20260709 13:01:25.372570  1659 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:25.384784  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:25.385543  1545 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:25.391836  1659 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:25.322976  5143 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:25.375779  5048 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:25.410672  5048 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:25.400071  5727 log.cc:927] Time spent T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.006s
I20260709 13:01:25.422060  5048 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:25.422324  5522 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:25.382198  5610 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:25.407083  5715 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:01:25.407042  5740 log.cc:927] Time spent T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.072s	user 0.006s	sys 0.000s
W20260709 13:01:25.469565  5712 log.cc:927] Time spent T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:25.379709  5608 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:25.381958  5586 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:25.360360  4785 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:25.431033  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:25.436586  5718 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:25.450114  5417 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:25.426599  2240 pending_rounds.cc:85] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Aborting all ops after (but not including) 8
W20260709 13:01:26.000598  1545 consensus_meta.cc:287] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.614s	user 0.015s	sys 0.032s
I20260709 13:01:26.029978  2240 pending_rounds.cc:107] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:01:26.030112  1545 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:26.030308  2240 raft_consensus.cc:2889] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:25.606635  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 2341) took 1358 ms. Trace:
I20260709 13:01:26.031070  1690 rpcz_store.cc:276] 0709 13:01:24.248236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.248367 (+   131us) service_pool.cc:224] Handling call
0709 13:01:25.606304 (+1357937us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b5400223dd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:25.606537 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":732253952}
W20260709 13:01:26.004114  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:25.993407  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 601517us
I20260709 13:01:26.033097  1659 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:25.970961  5143 consensus_meta.cc:287] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.002s
W20260709 13:01:26.001065  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 629919us
I20260709 13:01:26.034516  2209 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:25.664964  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.035164  1617 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:26.036629  1587 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:25.994206  5631 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:01:25.820293  5552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.022s	sys 0.028s
I20260709 13:01:25.448289   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:26.002997  5595 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:25.769389  5523 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:25.494025  5649 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.503535  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1502) took 1139 ms. Trace:
W20260709 13:01:26.011062  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.075022  1541 rpcz_store.cc:276] 0709 13:01:24.365784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.366088 (+   304us) service_pool.cc:224] Handling call
0709 13:01:25.503201 (+1137113us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b5400321ed4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:25.503449 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507670400}
W20260709 13:01:25.668606  5707 log.cc:927] Time spent T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.801s	user 0.004s	sys 0.000s
I20260709 13:01:26.029052  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:26.011829  5048 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.074463  1659 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:26.019455  5555 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:26.023383  5653 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:01:26.083652  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:26.040531  5552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.028s	sys 0.028s
I20260709 13:01:26.088742  1659 leader_election.cc:400] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:26.090188  1659 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:26.098631  1659 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:26.028594  5608 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.074142  5383 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:26.071177  5417 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.069718  5703 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:26.077322  5649 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:26.081346  5586 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:01:26.107514  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.095058  5595 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:26.095537  5415 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:26.108202  5625 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:26.081444  5523 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.150914  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:26.111431  5715 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:26.040670  5718 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.086449  5048 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.151890  5418 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:26.152709  5608 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:26.152611  5091 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:26.111727  5417 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.080519  5143 consensus_queue.cc:1059] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:01:26.070657  5631 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.096426  5653 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.099870  5618 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:26.156463  5558 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:26.156646  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 122213us
I20260709 13:01:26.157090  5742 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.158812  5736 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:26.159134  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:26.161453  5706 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:26.161895  5735 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.162303  5689 raft_consensus.cc:3055] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:26.154573  5560 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:26.095082  5508 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:26.122839  5703 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.219648  1617 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:26.196291  5625 raft_consensus.cc:697] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:26.170261  5415 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.242731  2245 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:26.220933  5138 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:26.276453  2237 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:26.237543  5565 raft_consensus.cc:3055] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:26.238772  5595 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:26.238036  5717 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:26.209198  5418 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.271298  5382 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:26.277740  5645 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.231066  5091 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.290970  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:26.267005  5552 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:26.248172  5736 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.338469  5552 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:26.323410  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.319193  5717 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.340756  5736 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:26.341439  5717 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:26.311862  5138 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.344064  5552 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:26.344328  5138 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:26.265908  5706 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.318372  5595 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.349651  5595 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:26.351716  5418 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:26.369237  5415 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:26.287664  5565 raft_consensus.cc:740] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:26.370824  5415 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.371594  5415 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.371295  5565 consensus_queue.cc:260] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.375435  5415 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:26.376552  5631 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:26.289229  4785 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:26.378036  5748 log.cc:927] Time spent T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
W20260709 13:01:26.379520  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 64734.9us
I20260709 13:01:26.382396  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:26.383333  5718 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:26.388955  5649 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.391867  5523 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:26.393533  5048 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:26.239609  5618 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.405511  5618 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:26.407577  5454 raft_consensus.cc:3055] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:26.408200  5454 raft_consensus.cc:740] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:26.409338  5454 consensus_queue.cc:260] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.412783  5653 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:26.271066  5735 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.426582  2242 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:26.427976  5735 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:26.430464  5703 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:26.433270  5091 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:26.433765  5753 log.cc:927] Time spent T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:01:26.278321  5508 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.438320  5508 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:26.278146  5560 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.441437  5454 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:26.271761  5742 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.445693  5742 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:26.446786  2238 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:26.448671  5508 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.424145  5645 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.507218  5645 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:26.337754  5568 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 13:01:26.455422  5417 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:26.457444  5560 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:26.459088  5624 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.508988  5508 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.509048  5624 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.466388  5523 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:26.511565  5523 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.512316  5508 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:26.514317  5523 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:26.516031  5624 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:26.468477  5703 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:26.347076  5706 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:26.476003  5631 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:26.519371  5631 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.522127  5631 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:26.485931  5618 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.523054  5618 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.489270  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:26.526444  2238 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:26.402455  5625 consensus_queue.cc:237] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.532366  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:26.533066  2246 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:26.542831  1586 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:26.544176  1586 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:26.545255  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.545483  5703 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:26.546020  5703 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:26.546476  5703 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:26.552371  5649 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:26.553467  5523 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:26.554020  5523 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:26.554540  5523 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:26.559801  5618 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:26.564339  5631 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:26.565099  5631 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.567741  5631 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:26.269363  5689 raft_consensus.cc:740] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:26.579679  5624 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:26.580245  5689 consensus_queue.cc:260] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.581991  5689 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:26.580581  5624 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.590037  5624 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:26.590765  5624 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.591488  5624 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.592902  5653 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:26.648893  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:26.736764  2240 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.021s	sys 0.033s
W20260709 13:01:26.738394  1512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.071s	sys 0.169s
W20260709 13:01:26.740700  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.004s	sys 0.033s
W20260709 13:01:26.740923  1512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.072s	sys 0.169s
I20260709 13:01:26.645479  5138 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:26.670200  5668 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.014s	sys 0.031s
W20260709 13:01:26.744148  1585 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.017s	sys 0.037s
W20260709 13:01:26.744534  1585 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.017s	sys 0.037s
W20260709 13:01:26.744853  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 673314us
I20260709 13:01:26.746416  1659 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:26.743366  2212 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.010s	sys 0.044s
W20260709 13:01:26.750620  1661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.030s	sys 0.060s
W20260709 13:01:26.740749  2240 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.021s	sys 0.033s
W20260709 13:01:26.750747  2212 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.010s	sys 0.045s
W20260709 13:01:26.743716  5668 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.016s	sys 0.031s
W20260709 13:01:26.752271  1546 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.027s	sys 0.063s
W20260709 13:01:26.754642  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:26.770357  1546 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.027s	sys 0.065s
W20260709 13:01:26.768889  1661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.031s	sys 0.060s
I20260709 13:01:26.688017  5653 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.751780  5508 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:26.845090  5510 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.820812  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:26.822850  1540 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:01:26.850816  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.030s	sys 0.068s
I20260709 13:01:26.852579  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:26.874841  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.030s	sys 0.068s
I20260709 13:01:26.884840  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:26.885401  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 734436us
I20260709 13:01:26.887161  1545 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:26.775668  1617 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:26.854276  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:26.772477  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.023s	sys 0.034s
W20260709 13:01:26.888960  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.024s	sys 0.045s
W20260709 13:01:26.889441  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 851118us
W20260709 13:01:26.772370  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.891047  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:26.859958  1614 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.014s	sys 0.023s
W20260709 13:01:26.892535  1614 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.015s	sys 0.023s
I20260709 13:01:26.892338  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:26.892993  1687 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:26.893337  1691 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
W20260709 13:01:26.741166  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.004s	sys 0.033s
I20260709 13:01:26.893687  1691 pending_rounds.cc:85] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 5
I20260709 13:01:26.893913  1691 pending_rounds.cc:107] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:01:26.894150  1691 raft_consensus.cc:2889] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:26.899389  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:26.899497  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:26.900419  1695 raft_consensus.cc:2393] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:01:26.843473  5633 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.021s	sys 0.043s
W20260709 13:01:26.737720  5383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.032s	sys 0.022s
I20260709 13:01:26.915611  1691 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:26.770280  5649 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:26.930965  5649 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.902647  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:26.931366  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:26.931902  1545 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:26.932317  1696 raft_consensus.cc:2410] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:26.932745  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:26.933988  5756 log.cc:927] Time spent T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:26.771940  5417 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.909391  1687 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:26.840186  5091 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:26.934778  5417 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:26.935410  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2662) took 1566 ms. Trace:
I20260709 13:01:26.935843  1544 rpcz_store.cc:276] 0709 13:01:25.368882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.369046 (+   164us) service_pool.cc:224] Handling call
0709 13:01:25.409294 (+ 40248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:25.416863 (+  7569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.416918 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:25.417578 (+   660us) log.cc:844] Serialized 26 byte log entry
0709 13:01:26.197152 (+779574us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:26.197197 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.197270 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.222049 (+ 24779us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b18003e4400. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e522 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:01:26.935121 (+713072us) raft_consensus.cc:1685] finished
0709 13:01:26.935148 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.935355 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2626,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":20775,"spinlock_wait_cycles":6373120,"thread_start_us":194988,"threads_started":1,"wal-append.queue_time_us":1338683}
I20260709 13:01:26.938519  5417 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:26.941154  5649 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:26.941795  5649 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:01:26.945705  1660 connection.cc:256] RPC call timeout handler was delayed by -1.8464710339999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
W20260709 13:01:26.948683  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.907876  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:26.917459  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:26.919102  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:26.915879  5742 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:26.933910  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:26.916224  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:26.768860  5631 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:26.745071  5138 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.888827  5510 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:27.460985  5689 consensus_meta.cc:287] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.874s	user 0.012s	sys 0.000s
I20260709 13:01:27.138546  5618 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.042580  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.263715  5764 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:26.990689  1445 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42114 (request call id 270) took 15009 ms (client timeout 15000 ms). Trace:
I20260709 13:01:27.469211  5764 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.464645  5618 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:27.268594  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:27.140813  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:27.469314  1445 rpcz_store.cc:269] 0709 13:01:12.037133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.050467 (+ 13334us) service_pool.cc:224] Handling call
0709 13:01:26.990556 (+14940089us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:23.557560 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:23.558340 (+   780us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:23.558386 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:01:23.558404 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:23.865743 (+307339us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:23.875581 (+  9838us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:23.875615 (+    34us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:01:23.877044 (+  1429us) tablet.cc:701] Row locks acquired
0709 13:01:23.877094 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:01:23.877253 (+   159us) write_op.cc:270] Start()
0709 13:01:23.877411 (+   158us) write_op.cc:276] Timestamp: P: 1783602083877192 usec, L: 0
0709 13:01:23.877434 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:01:23.878214 (+   780us) log.cc:844] Serialized 7114 byte log entry
0709 13:01:24.469172 (+590958us) op_driver.cc:464] REPLICATION: finished
0709 13:01:25.160706 (+691534us) write_op.cc:301] APPLY: starting
0709 13:01:25.165374 (+  4668us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:25.228847 (+ 63473us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:25.239549 (+ 10702us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:25.268988 (+ 29439us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:25.269331 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:01:25.269373 (+    42us) write_op.cc:312] APPLY: finished
0709 13:01:25.269734 (+   361us) log.cc:844] Serialized 125 byte log entry
0709 13:01:25.269893 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:25.270051 (+   158us) write_op.cc:454] Released schema lock
0709 13:01:25.270103 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:25.272326 (+  2223us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:25.272357 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1799169,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":662773,"apply.run_cpu_time_us":4947,"apply.run_wall_time_us":126916,"num_ops":18,"prepare.queue_time_us":426870,"prepare.run_cpu_time_us":20341,"prepare.run_wall_time_us":371208,"raft.queue_time_us":428925,"raft.run_cpu_time_us":43568,"raft.run_wall_time_us":818647,"replication_time_us":535568,"thread_start_us":1411251,"threads_started":4,"wal-append.queue_time_us":55136,"wal-append.run_cpu_time_us":23095,"wal-append.run_wall_time_us":2337817}]]}
W20260709 13:01:27.293431  1513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.128s	user 0.008s	sys 0.029s
W20260709 13:01:27.490206  1513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.325s	user 0.014s	sys 0.035s
W20260709 13:01:27.281996  1510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.119s	user 0.019s	sys 0.021s
I20260709 13:01:27.465896  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:26.960978  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:27.491003  1510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.328s	user 0.023s	sys 0.029s
I20260709 13:01:27.491482  5768 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:27.492138  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:27.493130  5703 consensus_meta.cc:287] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.946s	user 0.001s	sys 0.012s
I20260709 13:01:27.493685  5703 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.492157  5768 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.495316  5770 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:27.496021  5770 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.497648  5768 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:27.498447  5770 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:27.464490  1544 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:27.499218  5768 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:27.503703  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:26.915563  5383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.032s	sys 0.023s
I20260709 13:01:27.461845  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:27.504876  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:27.460538  2240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 847) took 2034 ms. Trace:
W20260709 13:01:27.467707  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.935439  5091 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:26.951555  5560 consensus_queue.cc:1059] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.549s
I20260709 13:01:26.954809  1539 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:26.901180  5508 raft_consensus.cc:697] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:27.374356  5706 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:27.031698  5415 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.473727  5618 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:27.263381  5607 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.080s	user 0.007s	sys 0.032s
I20260709 13:01:27.031517  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:26.908717  4785 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.474661  5764 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:26.911648  5633 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.027s	sys 0.043s
I20260709 13:01:27.474905  1540 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:27.254168  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:27.104614  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:27.109159  2211 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.129s	sys 0.203s
W20260709 13:01:27.318892  2244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.011s	sys 0.030s
W20260709 13:01:27.347095  2210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.058s	user 0.004s	sys 0.026s
I20260709 13:01:27.030668  1660 leader_election.cc:400] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:27.489781  5510 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:27.528477  1543 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:27.340015  1443 catalog_manager.cc:5697] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 8 to 9, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:27.526650  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:27.521940  5607 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.354s	user 0.010s	sys 0.041s
W20260709 13:01:27.530305  2210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.241s	user 0.004s	sys 0.030s
I20260709 13:01:27.073693  5624 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:27.479959  5631 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:27.481216  5523 consensus_meta.cc:287] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.926s	user 0.018s	sys 0.004s
I20260709 13:01:27.002105  5742 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.483407  5653 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:27.095160  1690 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:27.299060  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:27.002561  5417 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.111555  5565 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:27.052152  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.555114  1691 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:27.556246  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:27.486864  1546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.006s	sys 0.008s
W20260709 13:01:27.557164  1546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.007s	sys 0.009s
I20260709 13:01:27.557453  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:27.558058  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2661) took 2521 ms. Trace:
I20260709 13:01:27.055725  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.505167  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:27.090662  5757 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:27.507665  2242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.003s	sys 0.025s
W20260709 13:01:27.561951  2242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.003s	sys 0.026s
I20260709 13:01:27.507817  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:27.562758  1544 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:27.513079  1696 raft_consensus.cc:2393] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:27.513634  5048 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:27.522858  1693 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:27.503032  5768 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.508663  2240 rpcz_store.cc:276] 0709 13:01:25.425766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.425900 (+   134us) service_pool.cc:224] Handling call
0709 13:01:25.426327 (+   427us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:26.157756 (+731429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.157805 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:26.158536 (+   731us) log.cc:844] Serialized 52 byte log entry
0709 13:01:26.769003 (+610467us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:26.769062 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.769163 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:27.460307 (+691144us) raft_consensus.cc:1685] finished
0709 13:01:27.460329 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.460475 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126637,"raft.queue_time_us":128326,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":4763,"thread_start_us":609849,"threads_started":1,"wal-append.queue_time_us":932307}
W20260709 13:01:27.523949  1588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.013s	sys 0.008s
I20260709 13:01:27.524961  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:27.565788  1588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.014s	sys 0.008s
I20260709 13:01:27.486357  5143 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:27.527711  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 497140us
I20260709 13:01:27.569015  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:27.070870  5718 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:27.478899  5138 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:27.529891  1538 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:27.530464  1659 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:27.574862  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 44464.4us
I20260709 13:01:27.576308  1659 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:27.530891  2211 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.355s	user 0.140s	sys 0.205s
W20260709 13:01:27.577437  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 1.41364e+06us
I20260709 13:01:27.510325  5383 raft_consensus.cc:697] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:01:27.531162  2244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.192s	user 0.013s	sys 0.031s
W20260709 13:01:27.528595  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.014s	sys 0.010s
W20260709 13:01:27.586352  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.014s	sys 0.010s
W20260709 13:01:27.533244  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 1.24419e+06us
I20260709 13:01:27.558537  1546 rpcz_store.cc:276] 0709 13:01:25.037131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.053502 (+ 16371us) service_pool.cc:224] Handling call
0709 13:01:25.055993 (+  2491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.056204 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:25.190509 (+134305us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.510546 (+320037us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b180042cb80. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc4912d34bc 00007fc48e62148b 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb23a
0709 13:01:26.770839 (+1260293us) log.cc:844] Serialized 14 byte log entry
0709 13:01:27.557628 (+786789us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:27.557697 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:27.557768 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.557852 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.557992 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":635788,"prepare.queue_time_us":361113,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":86,"raft.queue_time_us":597281,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":133,"spinlock_wait_cycles":4538112,"thread_start_us":1632966,"threads_started":4,"wal-append.queue_time_us":143794,"wal-append.run_cpu_time_us":7499,"wal-append.run_wall_time_us":1140856}
I20260709 13:01:27.529191  4785 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.526962  5560 consensus_queue.cc:1243] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:27.551167  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:27.593734  1542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.001s	sys 0.041s
I20260709 13:01:27.553275  5653 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:27.554075  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:27.597357  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:27.597638  1690 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:27.566128  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.598497  1691 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:27.599285  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:27.566377  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.566862  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:27.567268  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.006s	sys 0.026s
W20260709 13:01:27.600373  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.006s	sys 0.026s
I20260709 13:01:27.567219  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:27.560920  5555 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:27.581282  1511 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:27.540002  5510 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:27.584491  1544 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 10. Current term is 12. Ops: []
I20260709 13:01:27.607331  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.607946  1693 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:27.609611  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:27.584491  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:27.588797  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:27.525856  5706 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:27.546942  1512 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:34459 timed out after 1.525s (SENT) [suppressed 2 similar messages]
I20260709 13:01:27.572973  1443 catalog_manager.cc:5697] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:27.572530  5703 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:27.592469  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:27.527076  5415 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.538657  5764 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:01:27.621938  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.596544  2244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 867) took 1322 ms. Trace:
I20260709 13:01:27.598863  1541 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:27.591833  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:27.580502  5767 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:27.617183  2246 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:27.551818  5523 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.618037  1695 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:27.571753  5048 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:27.600505  5618 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:27.622503  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.560370  5417 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:27.620347  1443 catalog_manager.cc:5697] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:27.638458  1688 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:27.630529  2244 rpcz_store.cc:276] 0709 13:01:26.274681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.274832 (+   151us) service_pool.cc:224] Handling call
0709 13:01:26.275200 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:26.339101 (+ 63901us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:26.339442 (+   341us) log.cc:844] Serialized 14 byte log entry
0709 13:01:27.586455 (+1247013us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:27.586505 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:27.586559 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.596368 (+  9809us) spinlock_profiling.cc:243] Waited 63.6 ms on lock 0x7b54006211d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:27.596411 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.596499 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":601,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":438,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":5952,"spinlock_wait_cycles":146385792,"thread_start_us":1246684,"threads_started":1}
W20260709 13:01:27.649276  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.037s	sys 0.029s
I20260709 13:01:27.617025  5720 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:27.620347  5510 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.587311  5143 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.590044  5718 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.635742  5703 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:27.628921  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.568845  5757 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.641824  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.617260  5607 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:27.623885  5560 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:27.599771  5668 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.007s	sys 0.033s
I20260709 13:01:27.613533  5555 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:27.582938  5508 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:27.651116  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.037s	sys 0.029s
I20260709 13:01:27.608920  5653 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:27.632422  5624 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:27.661046  1690 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:27.618907  1585 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:27.594231  1542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.001s	sys 0.041s
I20260709 13:01:27.664518  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.663038  1693 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:27.640761  5618 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.666677  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.667547  1443 catalog_manager.cc:5697] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:27.680962  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:27.684212  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.685011  1694 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:01:27.685549  1694 pending_rounds.cc:85] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 5
I20260709 13:01:27.685860  1694 pending_rounds.cc:107] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:01:27.686167  1694 raft_consensus.cc:2889] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:27.692713  1614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.027s	sys 0.059s
W20260709 13:01:27.693048  1614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.027s	sys 0.059s
I20260709 13:01:27.694217  1695 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:27.695369  1696 raft_consensus.cc:1275] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:27.703960  1694 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:27.695147  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.706588  1443 catalog_manager.cc:5697] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 7 to 10, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
W20260709 13:01:27.677724  5668 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.007s	sys 0.033s
I20260709 13:01:27.653153  5720 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.671648  5560 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:27.721804  4785 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:27.724057  1689 raft_consensus.cc:1275] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:27.689491  5618 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:27.679976  5624 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:27.674013  5607 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.683900  5703 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.720289  5091 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:27.732874  5560 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:27.669219  5383 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:27.746352  5624 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:27.768901  1443 catalog_manager.cc:5697] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.746688  5763 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.750038  5631 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:27.749125  5771 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:27.755801  5625 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.226s	user 0.006s	sys 0.028s
I20260709 13:01:27.808624  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.809255  4785 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.812057  1688 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:27.812103  4785 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:27.814357  4785 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:27.814797  5668 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.767930  5742 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:27.815318  5668 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.824183  1443 catalog_manager.cc:5697] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 7 to 9, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:27.784117  5759 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:27.836164  5555 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:27.800268  5762 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:27.768400  5773 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 13:01:27.841193  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 258480us
I20260709 13:01:27.797149  5091 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:01:27.823885  5631 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.846210  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:27.856653  2244 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.857903  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.848387  1443 catalog_manager.cc:5697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:27.843158  5510 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:27.827009  5781 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:27.827205  5706 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:27.859388  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.893759  1695 raft_consensus.cc:2410] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:01:27.817860  5625 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.288s	user 0.006s	sys 0.029s
I20260709 13:01:27.862162  1692 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:01:27.809856  5763 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:27.820067  5771 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.890615  1693 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:27.890667  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:27.901048  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:27.891628  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 344675us
I20260709 13:01:27.843685  5523 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:27.845099  5775 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.895421  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:27.911209  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:27.894760  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 275847us
I20260709 13:01:27.912039  1692 raft_consensus.cc:2410] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:01:27.859934  5048 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:27.897486  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:27.915547  2240 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:27.916069  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.916826  1692 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:01:27.917004  1586 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:27.908476  2246 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:27.897424  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.920034  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:27.913470  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 337185us
I20260709 13:01:27.860409  5784 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:27.921522  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:27.922574  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.912570  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05911a041e044f48bce12648b58061be"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:27.925284  1620 raft_consensus.cc:606] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:27.920272  1695 raft_consensus.cc:2393] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 11: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:27.927495  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.914108  1618 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:27.928435  1692 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:01:27.929061  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.929327  1690 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:27.930095  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:27.930766  1616 raft_consensus.cc:2393] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 10: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:27.931703  1443 catalog_manager.cc:5697] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.933787  1443 catalog_manager.cc:5697] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 6 to 9, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:27.889572  5143 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:27.950481  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2670) took 1104 ms. Trace:
I20260709 13:01:27.959560  1542 rpcz_store.cc:276] 0709 13:01:26.845737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.845939 (+   202us) service_pool.cc:224] Handling call
0709 13:01:26.846261 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:26.846524 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:26.846825 (+   301us) log.cc:844] Serialized 14 byte log entry
0709 13:01:27.950027 (+1103202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:27.950097 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:27.950163 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.950263 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.950407 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3711,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":157040,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":1102742,"threads_started":2,"wal-append.queue_time_us":1018493}
I20260709 13:01:27.962234  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:27.962736  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:27.902725  5417 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:27.964937  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.965713  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.908403  5718 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:27.959981  1659 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:27.970237  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:27.979923  1547 raft_consensus.cc:2410] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:01:27.864017  5631 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:27.972889  1692 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:27.968037  4785 consensus_queue.cc:1059] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:27.972149  1688 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:27.976451  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:27.841065  5759 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.982270  1620 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 7.
I20260709 13:01:27.984612  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:27.986706  2246 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:27.957885  5523 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:27.989705  2211 connection.cc:256] RPC call timeout handler was delayed by -1.0065254589999881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
I20260709 13:01:27.939726  5653 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:27.989188  1659 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:27.991918  1620 raft_consensus.cc:2393] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 9: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:28.024607  1690 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:27.845538  5762 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:27.995194  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:27.998888  4785 raft_consensus.cc:3055] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:28.027670  4785 raft_consensus.cc:740] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:27.963771  5779 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:27.974148  5143 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:28.042912  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:28.032986  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.022753  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:27.973459  5757 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:28.043694  1621 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:28.051115  1659 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:28.036048  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 119109us
I20260709 13:01:28.053586  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.054431  2246 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:28.054917  1586 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:28.031735  5415 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:28.060699  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:28.053565  4785 consensus_queue.cc:260] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:28.062165  4785 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:27.992746  5764 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.068920  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:28.063169  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 62737.1us
I20260709 13:01:27.896283  5781 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:28.065851  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.066787  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:28.031430  5417 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:28.070632  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:28.084098  1621 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:28.071375  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.037297  5718 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:28.092590  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:28.093050  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.076387  2240 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:28.031103  5689 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:28.037644  5653 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.072252  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.096680  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:28.097421  2246 raft_consensus.cc:2393] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:28.089162  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:28.090783  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.030668  5720 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:28.052771  5607 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:28.086766  5772 log.cc:927] Time spent T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:01:27.958241  5784 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:28.100833  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.135756  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:28.101428  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.102377  2239 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:28.102629  2211 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:28.095664  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.103652  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:27.985783  5768 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:27.915181  5775 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:28.067740  5508 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:28.077316  5625 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:28.037439  5523 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:28.059844  5779 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:28.085508  5774 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:01:28.511960  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:28.214923  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2357) took 1258 ms. Trace:
W20260709 13:01:28.097997  5783 log.cc:927] Time spent T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 13:01:28.524581  1687 rpcz_store.cc:276] 0709 13:01:26.956636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.956804 (+   168us) service_pool.cc:224] Handling call
0709 13:01:26.957233 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:26.957502 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.957526 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:27.461133 (+503607us) log.cc:844] Serialized 26 byte log entry
0709 13:01:27.839562 (+378429us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:28.004109 (+164547us) log.cc:844] Serialized 14 byte log entry
0709 13:01:28.025723 (+ 21614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.025787 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.214650 (+188863us) raft_consensus.cc:1685] finished
0709 13:01:28.214673 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.214847 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21378,"prepare.queue_time_us":232522,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":24050,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":23426,"thread_start_us":542374,"threads_started":2,"wal-append.queue_time_us":673152}
I20260709 13:01:28.498229  1616 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:28.136533  1693 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:28.512732  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:28.495668  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 4f5673bb37ab4e1b9ae5af2d2091b347: Illegal state: Replica 822e08445eae4a33b2f2fe92060192c6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
W20260709 13:01:28.523833  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 421254us
I20260709 13:01:28.087194  5796 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:28.206051  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 135010us
I20260709 13:01:28.083693  5417 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:28.488821  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.554625  1586 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:28.138401  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.557693  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.558516  2238 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
W20260709 13:01:28.229985  5777 log.cc:927] Time spent T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.399s	user 0.001s	sys 0.001s
I20260709 13:01:28.309727  2244 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
W20260709 13:01:28.397202  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.175926  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.096704  5718 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.592090  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.092833  5138 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:28.525445  5508 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.086097  5792 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:28.599162  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:28.537057  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:28.537902  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:28.600296  1692 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:28.130249  5689 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:28.425213  5787 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:28.542246  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:28.614566  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.544700  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:28.544901  5812 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:28.545718  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:28.546013  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:28.616454  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.547797  5091 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:28.548322  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:28.549311  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:28.252506  5798 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:01:28.559484  1587 connection.cc:256] RPC call timeout handler was delayed by -1.1922606509999696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
W20260709 13:01:28.183663  5776 log.cc:927] Time spent T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260709 13:01:28.188781  5778 log.cc:927] Time spent T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.328s	user 0.001s	sys 0.002s
W20260709 13:01:28.223704  5785 log.cc:927] Time spent T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
W20260709 13:01:28.490033  5618 consensus_meta.cc:287] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.739s	user 0.007s	sys 0.004s
W20260709 13:01:28.168274  5782 log.cc:927] Time spent T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:01:28.490163  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:28.665413  5618 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:28.563872  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.666343  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 2304) took 2633 ms. Trace:
W20260709 13:01:28.234473  5565 consensus_meta.cc:287] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.002s
I20260709 13:01:28.592665  1618 raft_consensus.cc:1275] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:28.665433  5818 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:01:28.571465  4785 consensus_queue.cc:1059] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:01:28.667877  5618 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:28.093780  5757 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.668895  1617 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:01:28.668967  5757 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:28.533018  2211 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:28.670779  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 137862us
I20260709 13:01:28.663831  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:28.671801  1615 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:28.501888  5703 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:28.599593  5508 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:28.238207  5510 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.531083  5625 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.087483  5764 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:28.250139  5784 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:28.490720  5789 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.179378  5706 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.570887  1660 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:28.510008  5668 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:28.570741  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.260226  5781 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:28.181679  5799 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:28.241679  5631 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:28.598438  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.535483  5796 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.529770  5791 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:28.241951  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.708828  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:28.490303  5759 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:28.229540  5763 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:28.557966  5417 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:28.610469  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:28.560611  5788 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.456s	user 0.003s	sys 0.007s
I20260709 13:01:28.103847  5770 raft_consensus.cc:3055] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:28.131961  5653 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:28.535346  5797 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:28.636361  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:28.638777  1586 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:28.620489  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 84409.5us
I20260709 13:01:28.642469  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.615504  1621 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:28.569023  5806 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:28.650835  1587 connection.cc:256] RPC call timeout handler was delayed by -1.1908989510000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 13:01:28.728820  1587 connection.cc:256] RPC call timeout handler was delayed by -1.1872778720000383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
I20260709 13:01:28.730481  1587 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:28.644867  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.157204  5809 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.471s
I20260709 13:01:28.597097  5718 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:28.663658  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 67075.4us
I20260709 13:01:28.645395  2240 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:28.181692  5771 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:28.600361  5555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.001s	sys 0.022s
I20260709 13:01:28.666781  1614 rpcz_store.cc:276] 0709 13:01:26.032923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.033245 (+   322us) service_pool.cc:224] Handling call
0709 13:01:26.081026 (+ 47781us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:26.895104 (+814078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.895131 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:26.910988 (+ 15857us) log.cc:844] Serialized 52 byte log entry
0709 13:01:27.693356 (+782368us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:27.718031 (+ 24675us) log.cc:844] Serialized 14 byte log entry
0709 13:01:28.004357 (+286326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.004430 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.666098 (+661668us) raft_consensus.cc:1685] finished
0709 13:01:28.666118 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.666262 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6515,"prepare.queue_time_us":24739,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":390624,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":24903,"thread_start_us":1846322,"threads_started":3,"wal-append.queue_time_us":884624}
I20260709 13:01:28.685408  5762 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:28.616429  5138 raft_consensus.cc:697] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:28.686980  1622 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
W20260709 13:01:28.693828  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 123003us
I20260709 13:01:28.647794  5794 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:28.672564  5607 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.648455  5787 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:28.782295  5787 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:28.687698  5818 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.690376  5625 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:28.711489  2239 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:28.734931  5806 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:28.715880  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 73419.4us
I20260709 13:01:28.736209  5759 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:28.705849  5799 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:28.716540  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1606) took 1187 ms. Trace:
I20260709 13:01:28.662294  5091 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:28.816646  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 75852.1us
I20260709 13:01:28.617241  5792 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:28.701473  5415 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:28.661386  5812 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:28.700009  5706 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:28.728188  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 89525.4us
I20260709 13:01:28.731910  2237 raft_consensus.cc:2410] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:28.728852  1512 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:28.732942  1587 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:28.689616  5510 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:28.708076  5796 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:28.774952  1620 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:28.719830  5770 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:01:28.778009  5800 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:01:28.779568  5817 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 13:01:28.738049  5560 consensus_meta.cc:287] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.940s	user 0.012s	sys 0.001s
I20260709 13:01:28.739033  5631 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:28.700805  5789 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:28.710335  2242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 874) took 2173 ms. Trace:
I20260709 13:01:28.716066  1618 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:28.790910  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:28.721221  5801 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:01:28.812228  1696 rpcz_store.cc:276] 0709 13:01:27.529173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.696048 (+166875us) service_pool.cc:224] Handling call
0709 13:01:27.696336 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.696665 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.696696 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:27.711560 (+ 14864us) log.cc:844] Serialized 26 byte log entry
0709 13:01:27.964257 (+252697us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:27.964460 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.964532 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.716328 (+751796us) raft_consensus.cc:1685] finished
0709 13:01:28.716346 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.716478 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4593,"raft.queue_time_us":865,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":21824,"spinlock_wait_cycles":43904,"thread_start_us":247572,"threads_started":1,"wal-append.queue_time_us":469807}
I20260709 13:01:28.835618  2210 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:28.835886  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 107072us
W20260709 13:01:28.838011  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 166013us
W20260709 13:01:28.840197  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 107348us
I20260709 13:01:28.891826  2242 rpcz_store.cc:276] 0709 13:01:26.531642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.531878 (+   236us) service_pool.cc:224] Handling call
0709 13:01:26.532256 (+   378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:26.532620 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.532645 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:26.533231 (+   586us) log.cc:844] Serialized 52 byte log entry
0709 13:01:27.562349 (+1029118us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:27.562385 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.562445 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.704752 (+1142307us) raft_consensus.cc:1685] finished
0709 13:01:28.704771 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.704894 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":193,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":128,"thread_start_us":1028775,"threads_started":1,"wal-append.queue_time_us":1243429}
I20260709 13:01:28.896697  2211 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:28.897460  1587 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:28.783541  5774 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:28.844063  5787 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:28.899868  2211 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:28.907063  1587 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:28.909017  1587 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:28.791807  5607 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:28.791695  5689 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:28.836377  5788 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:01:28.816280  5806 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:28.890189  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:28.737349  5797 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:28.893443  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 102634us
W20260709 13:01:28.887889  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 199930us
I20260709 13:01:28.883014  5807 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:28.922155  1660 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:28.922904  1587 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:28.814263  5794 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:28.883968  5703 consensus_queue.cc:1059] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
W20260709 13:01:28.944501  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 124911us
I20260709 13:01:28.898304  5415 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:28.945194  5415 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:28.945715  5415 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:28.946457  5812 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:28.947681  5795 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:28.920619  5383 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:28.946458  5618 raft_consensus.cc:3055] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:28.948995  5618 raft_consensus.cc:740] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:28.949862  5618 consensus_queue.cc:260] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:28.909853  5631 raft_consensus.cc:697] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:28.948508  5827 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:28.811306  5818 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:28.910182  5565 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:28.943197  2211 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:28.935516  5790 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:28.910579  5787 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:28.917125  5779 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:28.936872  1587 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:28.915120  5759 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:28.952929  1622 raft_consensus.cc:606] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:28.944617  5703 raft_consensus.cc:3055] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:28.927624  5807 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.888748  5560 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:28.977056  5789 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:28.978545  5821 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:01:28.979564  5523 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:28.979859  5091 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:28.971771  1587 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:28.917309  5773 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:01:28.973119  1622 raft_consensus.cc:614] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:28.951184  5618 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:28.976493  5807 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:28.975409  5720 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:28.984159  1587 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:29.031548  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 47464.6us
I20260709 13:01:28.983356  5048 consensus_queue.cc:1059] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:01:28.984856  5565 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:28.917152  5774 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:28.985461  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.981209  5826 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:01:28.987221  5818 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:28.973614  5143 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:28.978562  5560 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:28.990036  5794 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:28.963892  5827 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:28.972226  5787 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:28.974310  5833 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:28.991528  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:28.992234  5415 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:28.996465  5797 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:29.051357  5827 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:28.983423  5831 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:29.001272  5624 consensus_meta.cc:287] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 1.191s	user 0.010s	sys 0.002s
I20260709 13:01:29.066764  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:29.067227  5624 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:29.064241  5523 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:01:29.052467  5784 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:01:29.007269  5757 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:29.008510  5706 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:29.063789  5790 raft_consensus.cc:3055] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:29.020205  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.044909  5143 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:29.073539  5143 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:29.053885  5799 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:29.061571  5774 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:29.035203  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 52638.8us
I20260709 13:01:29.062951  5607 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:29.076248  1511 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:29.077108  5653 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:29.039691  1587 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:29.043937  5510 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:29.083668  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 44091.1us
I20260709 13:01:29.085420  1587 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:29.085778  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:29.086203  1587 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:28.974201  5703 raft_consensus.cc:740] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:29.087878  5703 consensus_queue.cc:260] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:29.089248  5703 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:28.980402  5764 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:28.963889  5417 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:29.091811  5795 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:29.093098  5417 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:28.963203  5631 consensus_queue.cc:237] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:29.094947  5795 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:29.095523  5795 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.968961  5770 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:29.095983  5795 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:29.096482  5770 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:29.097596  5625 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:29.044661  5775 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:29.064940  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 127271us
I20260709 13:01:29.099669  5775 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:29.100067  5775 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:29.100427  5775 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:29.069753  1691 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:29.103418  5774 consensus_queue.cc:1048] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:29.104254  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1596) took 1634 ms. Trace:
I20260709 13:01:29.104588  1512 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:29.104753  5797 consensus_queue.cc:1048] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:29.105391  5560 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:29.052872  5832 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:29.106035  5809 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:29.106273  5832 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:29.049638  5821 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260709 13:01:29.106721  5832 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:29.071760  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.913830  5138 consensus_queue.cc:237] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:29.058401  5415 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:29.078348  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:29.079897  5792 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:29.081028  5768 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:29.056804  5508 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:29.083521  5510 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:29.044147  5759 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:29.033576  5718 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:29.106455  5809 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.127389  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.127861  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.128418  1615 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 6.
I20260709 13:01:29.110635  1587 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:29.129357  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.130481  1618 raft_consensus.cc:2410] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:01:29.073046  5790 raft_consensus.cc:740] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:29.104614  1691 rpcz_store.cc:276] 0709 13:01:27.470331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.688874 (+218543us) service_pool.cc:224] Handling call
0709 13:01:27.689171 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:29.103484 (+1414313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.104059 (+   575us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54002689d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:29.104201 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3174130944}
I20260709 13:01:29.113651  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "520ee35af44d4a529e945654996352cc"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:29.105485  1512 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:29.117185  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:29.132771  1622 raft_consensus.cc:606] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:29.117213  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.133111  1622 raft_consensus.cc:614] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:29.119084  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:29.119724  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:29.134308  2242 raft_consensus.cc:2410] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:29.120023  2210 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:29.120359  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:29.120837  5624 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:29.124397  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.125893  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.126223  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.130640  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.137861  1620 raft_consensus.cc:2393] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 11: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:29.138149  1615 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:29.135901  2239 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:29.137182  1617 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:29.148998  5790 consensus_queue.cc:260] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:29.150314  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.150723  5143 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:29.154137  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 48730.1us
I20260709 13:01:29.154834  1512 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:29.155735  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:29.156383  1620 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:29.156680  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.155966  2240 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:29.157248  1614 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:29.160100  5792 consensus_queue.cc:1059] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:29.160223  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.165997  5832 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:29.167893  1620 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
W20260709 13:01:29.168535  5839 log.cc:927] Time spent T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:01:29.169888  1622 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: [9.6-12.7]
I20260709 13:01:29.170562  1512 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:29.173041  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.173841  1543 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:29.174734  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.176707  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.177480  1543 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:29.179114  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.179513  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.179884  1543 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:29.181602  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.181910  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.182518  1543 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:29.130183  5809 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:29.180397  1541 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:29.185724  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.186587  1543 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:29.186857  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.131949  5415 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:29.187340  1511 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:29.312631  5784 raft_consensus.cc:3055] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:29.313164  5784 raft_consensus.cc:740] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:29.314110  5784 consensus_queue.cc:260] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:29.315593  5415 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:29.318467  5415 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:29.199739  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.214568  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.321005  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.322072  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.216976  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.322391  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.323828  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.323987  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:29.280053  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.324939  1694 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:29.326432  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.277693  5806 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:29.327852  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.328869  5832 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:29.139592  5759 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:29.213498  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.169759  5831 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:29.330742  5831 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:29.331480  5831 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:29.188793  5773 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:29.332765  5773 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:29.333596  5773 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:29.227034  5624 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:29.334604  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.335229  5624 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:29.336551  1694 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:29.216374  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.340936  1546 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:29.341454  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.212409  5818 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:29.342478  5818 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:29.343003  5818 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:29.228093  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
W20260709 13:01:29.261703  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 107133us
I20260709 13:01:29.342839  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.347157  1617 raft_consensus.cc:2368] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:29.158172  5768 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:29.351670  5768 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:29.354388  5768 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:29.354513  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.186909  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.357573  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.357896  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:29.381721  2243 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:29.381852  1694 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:01:29.358978  1691 raft_consensus.cc:2393] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:29.358714  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.382936  5143 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:29.383005  1617 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:29.378221  5837 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:29.383702  5784 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:29.384001  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.206172  5625 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:29.384368  5624 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:29.150316  5790 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:29.385128  5827 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:29.359889  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.361179  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.361814  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:29.359336  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:29.365443  1541 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:29.366909  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.368506  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.358026  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.376184  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.377481  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.379653  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.388350  1696 raft_consensus.cc:2376] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8. Re-sending same reply.
I20260709 13:01:29.247380  5417 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:29.388010  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.398449  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.398931  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.389571  1688 raft_consensus.cc:2368] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:29.387938  2237 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:29.389369  1538 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:29.400153  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.401031  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.402350  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.400434  1546 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:29.394165  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:29.409679  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:29.410205  2240 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:29.396936  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:29.429186  1585 leader_election.cc:336] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.827s (SENT)
I20260709 13:01:29.429932  1585 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:29.159061  5796 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:29.364686  5806 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:29.439777  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.259078  5787 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:29.474061  5625 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.474848  5625 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:29.475925  5787 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:29.435602  1586 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:29.479387  5625 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:29.480338  5842 log.cc:927] Time spent T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
I20260709 13:01:29.484710  1617 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:29.484417  1622 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
W20260709 13:01:29.487287  2211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.028s	sys 0.045s
W20260709 13:01:29.487592  2211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.028s	sys 0.045s
W20260709 13:01:29.489233  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 546023us
I20260709 13:01:29.488240  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:29.491349  2242 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:29.491549  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.490764  2211 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:29.489023  2210 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:29.494107  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:29.488250  5806 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:29.497591  5764 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:29.498488  5833 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:29.523865  2242 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:29.525228  2243 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:29.528868  5833 raft_consensus.cc:697] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:29.499076  5720 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:01:29.538223  5806 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.538923  5806 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:29.500384  5832 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:29.556185  5818 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:29.355422  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 168167us
I20260709 13:01:29.592492  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:29.593616  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:29.595784  1543 raft_consensus.cc:2410] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:01:29.611532  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:29.461221  1619 raft_consensus.cc:2368] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11.
I20260709 13:01:29.615384  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:29.616999  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.617666  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:29.618319  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.618582  1618 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:29.452373  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.615528  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.620507  1617 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:29.620843  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:29.621704  1620 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:29.621914  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.622879  1617 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
W20260709 13:01:29.623554  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.636175  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.638471  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.615571  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.640690  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.641809  1693 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 13: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:29.616014  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.505591  2211 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:29.644263  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.624127  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.645633  1622 raft_consensus.cc:2393] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 13: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:29.646219  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.646682  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.639452  1694 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:29.648911  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.676450  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:29.676786  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.678046  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.678256  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.650525  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.679558  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.679847  1690 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:29.680330  1694 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:29.433184  5417 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:29.681151  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.682153  1690 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:29.660342  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.683547  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.469063  5775 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:29.685639  1616 raft_consensus.cc:606] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:29.686154  1616 raft_consensus.cc:614] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:29.687175  5787 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:29.662322  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.473706  5795 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:29.690287  5775 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:29.660554  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.668366  5091 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:29.669600  5383 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:29.469985  5508 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:29.407361  5624 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:29.695932  5417 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:29.696100  5624 raft_consensus.cc:697] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:29.697556  1687 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:29.387687  5718 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:29.530256  5773 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:29.654888  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:29.460626  5796 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:29.692068  5091 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:29.473174  5807 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:29.716099  5091 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:29.718482  5807 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:29.470592  5809 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:29.719609  1688 raft_consensus.cc:2376] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13. Re-sending same reply.
I20260709 13:01:29.720069  1614 raft_consensus.cc:2393] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 8: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:29.721215  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.721695  5809 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:29.387217  5827 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:29.688372  1692 raft_consensus.cc:2393] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 14: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:29.383714  5837 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:29.464263  5831 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:29.612704  1585 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:29.663476  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:29.815744  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.666020  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:29.819295  5837 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:29.820459  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.821861  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.823871  5415 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.824623  5415 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:29.691730  1694 raft_consensus.cc:2410] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:01:29.692531  1622 raft_consensus.cc:2368] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:29.694005  1695 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:29.829186  5844 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:29.694115  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:29.693111  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:29.687760  5787 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:29.832212  5787 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:29.704625  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.834245  1616 raft_consensus.cc:2410] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 13:01:29.834347  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 50675.7us
I20260709 13:01:29.834725  2237 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:29.715783  5795 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:29.724272  5383 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:29.823128  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:29.724038  1613 raft_consensus.cc:2368] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:29.723384  1615 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 12: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:29.835210  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.763916  1545 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:29.558104  5833 consensus_queue.cc:237] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:29.698374  5624 consensus_queue.cc:237] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:29.849777  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.852485  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:29.853912  1617 raft_consensus.cc:2368] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:29.852514  5773 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:29.837023  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:29.873116  1586 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:29.891004  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 278538us
I20260709 13:01:29.898366  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.922120  1618 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:29.923748  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.924407  1622 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
W20260709 13:01:29.921746  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 258745us
I20260709 13:01:29.927557  5774 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:29.927925  5792 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:29.928438  5792 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.928858  5792 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:29.899091  1621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.003s	sys 0.010s
I20260709 13:01:29.932898  1614 raft_consensus.cc:2376] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13. Re-sending same reply.
I20260709 13:01:29.926131  2243 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:29.941009  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.947317  1622 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:29.950238  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.948073  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.938315  5415 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:29.952960  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.937660  5795 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:01:29.957784  5851 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:01:29.959200  5790 consensus_meta.cc:287] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.006s
I20260709 13:01:29.960661  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:29.961035  5818 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:29.961977  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:29.963368  5831 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:29.969419  5774 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:29.970132  5774 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:29.939741  5807 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:29.972721  5807 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:29.975008  1586 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:29.979516  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:29.981734  5143 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:29.983780  2242 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:01:29.987362  5807 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:29.993114  5415 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:29.994563  5796 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:29.979430  5795 raft_consensus.cc:697] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:01:29.975569  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 469886us
I20260709 13:01:30.003415  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:30.003145  1615 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:30.008870  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.011823  1620 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:30.015075  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:30.016497  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.020278  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:30.024158  1622 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:30.021652  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:30.035638  1617 raft_consensus.cc:2410] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:30.037039  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.018100  5796 raft_consensus.cc:697] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:30.049074  1619 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:30.051162  2243 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:30.052429  1614 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.048594  1541 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:30.055114  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.055223  1618 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:30.055478  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:30.055896  1542 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:30.057077  5795 consensus_queue.cc:237] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:30.058533  1618 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:01:30.060932  1615 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:30.065526  5796 consensus_queue.cc:237] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:30.069537  5806 consensus_meta.cc:287] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.003s
I20260709 13:01:30.070319  5806 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:30.117543  5806 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:30.119868  1511 leader_election.cc:400] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11.
I20260709 13:01:30.120236  1511 leader_election.cc:403] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:30.046608  5415 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:30.122929  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.124518  5787 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:30.125072  5415 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:30.125561  5826 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:30.049474  5383 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:30.089375  1614 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
W20260709 13:01:30.152942  5864 log.cc:927] Time spent T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:01:30.162142  5837 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:30.163376  5853 log.cc:927] Time spent T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.158s	user 0.001s	sys 0.001s
I20260709 13:01:30.164037  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:30.167639  5866 log.cc:927] Time spent T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:01:30.168937  1542 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:30.163376  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.165799  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:30.178462  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.180546  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 106973us
W20260709 13:01:30.185137  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 84407.1us
I20260709 13:01:30.185537  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.185917  1660 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:30.194531  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.196329  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:30.200464  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.202355  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:30.203032  1696 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.215058  5857 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:30.215648  5857 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:30.216034  5857 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:30.220547  5508 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:30.221599  5383 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:30.222036  5508 raft_consensus.cc:3055] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:30.222491  5508 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:30.223225  5383 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:01:30.236876  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:30.237339  5797 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:30.237808  5508 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:30.243475  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:30.243584  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:30.248119  5508 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.248037  5774 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:30.248792  1695 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 8.
I20260709 13:01:30.250478  5774 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:30.245594  5792 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:30.246833  5091 consensus_meta.cc:287] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.530s	user 0.021s	sys 0.000s
I20260709 13:01:30.251925  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:30.261610  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:30.267056  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:30.267647  2237 raft_consensus.cc:1240] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:01:30.269104  2210 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:30.269927  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 57493.4us
I20260709 13:01:30.271013  5832 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:30.271462  1585 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:30.271646  5832 raft_consensus.cc:697] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:30.272619  5807 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:30.273136  5807 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:30.272907  5832 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:30.273633  5807 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:30.273967  1585 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:30.276207  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.283062  1696 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
W20260709 13:01:30.270563  5862 log.cc:927] Time spent T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.238s	user 0.004s	sys 0.000s
I20260709 13:01:30.284483  5837 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:30.294281  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:30.295109  1621 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 12. Ops: []
I20260709 13:01:30.296952  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:30.282721  5806 raft_consensus.cc:2764] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:01:30.299844  1543 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:30.301718  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.302573  1540 raft_consensus.cc:2410] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:30.303369  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:30.304082  1540 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:01:30.305263  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:30.306006  1543 raft_consensus.cc:2393] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 10: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:30.306778  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.264344  5091 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:30.307539  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:30.307924  1545 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:30.308207  1539 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.309407  5091 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:30.311188  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:30.299865  1541 raft_consensus.cc:1240] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:30.309268  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:30.311903  1695 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:30.315227  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:30.315867  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:30.316162  1546 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:30.316736  1692 raft_consensus.cc:2393] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 11: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:30.317097  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:30.317546  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:30.317852  1541 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 12: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:30.318480  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:30.318608  5415 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.319336  5415 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:30.319851  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.320886  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:30.322047  1545 raft_consensus.cc:2410] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:30.315896  1695 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:30.318668  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.324540  1541 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:30.325165  1544 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:30.326401  5415 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:30.328142  5792 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:30.328940  5792 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:30.329403  5792 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:30.329849  5792 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.331559  2243 raft_consensus.cc:2368] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11.
I20260709 13:01:30.343827  1538 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:30.344563  1540 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
W20260709 13:01:30.345688  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 52955.4us
I20260709 13:01:30.347919  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:30.350935  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:30.352427  1687 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:01:30.357717  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 120364us
I20260709 13:01:30.365954  2211 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:30.367504  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:30.368338  1695 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:01:30.368670  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:01:30.368779  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2334) took 1243 ms (client timeout 1609 ms). Trace:
I20260709 13:01:30.368969  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:30.369604  5764 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:30.368338  5837 consensus_queue.cc:1059] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:01:30.370576  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:30.371284  1696 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:30.371479  5837 raft_consensus.cc:3055] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:30.371690  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:30.371857  5837 raft_consensus.cc:740] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:30.372830  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:30.372931  5837 consensus_queue.cc:260] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:30.373798  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:30.374420  5837 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:30.367596  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:30.367511  5844 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.377096  5844 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:30.377967  5826 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11.
I20260709 13:01:30.378626  1585 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:30.382156  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:30.383177  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:30.383817  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:30.384127  2244 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:30.386200  5857 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:30.387601  1691 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 9: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:01:30.369251  1613 rpcz_store.cc:269] 0709 13:01:29.125232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.126022 (+   790us) service_pool.cc:224] Handling call
0709 13:01:30.368566 (+1242544us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b5400400454. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:30.368710 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1272288000}
I20260709 13:01:30.391409  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:30.392021  1660 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:30.395524  5415 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:30.395927  5415 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:30.396296  5415 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.374536  1539 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:30.374526  1614 raft_consensus.cc:2393] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:30.398132  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.392738  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:30.423699  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.426474  1696 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:30.428853  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:30.429284  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:30.429821  1687 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:30.430946  5844 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:30.432140  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:30.434448  1660 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:30.429235  1511 leader_election.cc:400] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:30.436772  1511 leader_election.cc:403] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:30.427268  1613 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 13:01:30.439347  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.439179  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:30.444692  1618 raft_consensus.cc:2368] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:30.446801  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:30.452167  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:30.455425  5790 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:30.437649  5624 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:30.457914  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:30.481035  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:30.483258  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:30.484279  1614 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 12: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:30.486696  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 781) took 1009 ms. Trace:
W20260709 13:01:30.499225  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 70163.8us
I20260709 13:01:30.493412  1617 rpcz_store.cc:276] 0709 13:01:29.477781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.153005 (+675224us) service_pool.cc:224] Handling call
0709 13:01:30.375078 (+222073us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b58000f9998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:01:30.375309 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:30.375620 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:30.375930 (+   310us) log.cc:844] Serialized 14 byte log entry
0709 13:01:30.486140 (+110210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:30.486205 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:30.486282 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.486364 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.486645 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":638,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":4727,"spinlock_wait_cycles":4326144,"thread_start_us":109786,"threads_started":1}
I20260709 13:01:30.493746  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:30.504176  1622 raft_consensus.cc:606] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:30.506184  1587 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:30.508970  1587 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:30.519291  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:30.517788  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.518555  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:30.575744  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.511420  5881 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:30.484676  5383 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:30.495517  5807 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:30.486896  5826 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:01:30.546103  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:30.603710  5795 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:30.603374  1540 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:30.604475  1694 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:30.589143  1434 maintenance_manager.cc:419] P b9f5bb9ff31f4ba4a2568147b35a35db: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033340
I20260709 13:01:30.518157  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.534683  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2759) took 1194 ms. Trace:
I20260709 13:01:30.528748  1615 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:30.533466  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 776) took 1186 ms. Trace:
I20260709 13:01:30.548739  1695 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:01:30.519691  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.522935  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.552558  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 775) took 1206 ms. Trace:
I20260709 13:01:30.523679  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:30.517005  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:30.537460  5792 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:30.522323  5870 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.474s	user 0.000s	sys 0.015s
I20260709 13:01:30.507172  1622 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:30.511022  1617 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:30.602423  1542 raft_consensus.cc:2376] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13. Re-sending same reply.
W20260709 13:01:30.570722  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.564986  5787 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:30.557915  5878 log.cc:927] Time spent T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.129s	user 0.000s	sys 0.003s
I20260709 13:01:30.525404  5091 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.652777  1585 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:30.544759  5857 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:30.604666  5881 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:30.547344  5880 log.cc:927] Time spent T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:01:30.667394  1694 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:30.662060  1687 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
W20260709 13:01:30.659778  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 150868us
I20260709 13:01:30.823495  1613 raft_consensus.cc:1240] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:30.823839  1692 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:30.576064  1547 raft_consensus.cc:2410] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:01:30.622007  1693 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:01:30.555670  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:30.648502  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:30.827987  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.827987  1691 raft_consensus.cc:2368] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
W20260709 13:01:30.645476  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 279601us
W20260709 13:01:30.806788  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 347473us
I20260709 13:01:30.813535  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:30.829689  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:30.814553  1511 leader_election.cc:336] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Timed out: RequestConsensusVote RPC to 127.0.107.196:40413 timed out after 1.514s (SENT)
I20260709 13:01:30.831908  1696 raft_consensus.cc:2393] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:01:30.832636  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.808149  1620 rpcz_store.cc:276] 0709 13:01:29.346830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.051341 (+704511us) service_pool.cc:224] Handling call
0709 13:01:30.532330 (+480989us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b58000f9998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:01:30.532685 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:30.532947 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:30.532982 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:30.533056 (+    74us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:30.533181 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.533253 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.533394 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2538880}
I20260709 13:01:30.804951  1695 pending_rounds.cc:85] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 8
I20260709 13:01:30.797679  5833 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:30.727684  2209 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:30.729131  1659 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:30.660141  5867 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.614s	user 0.004s	sys 0.008s
I20260709 13:01:30.817476  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2770) took 1341 ms. Trace:
I20260709 13:01:30.638283   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:01:30.819260  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 166560us
I20260709 13:01:30.805727  1619 rpcz_store.cc:276] 0709 13:01:29.346550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.052139 (+705589us) service_pool.cc:224] Handling call
0709 13:01:30.551656 (+499517us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b58000f9998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:01:30.551895 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:30.552145 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:30.552182 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:30.552237 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:30.552287 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.552356 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.552487 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3412864}
I20260709 13:01:30.811115  1621 rpcz_store.cc:276] 0709 13:01:29.340387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.014729 (+674342us) service_pool.cc:224] Handling call
0709 13:01:30.015100 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:30.296622 (+281522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.534412 (+237790us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54000e6354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:30.534618 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636465536}
I20260709 13:01:30.821168  5881 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:30.835505  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2748) took 1498 ms. Trace:
I20260709 13:01:30.857461  2211 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:30.858588  1587 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:30.752300  1445 catalog_manager.cc:5697] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 9 to 12, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:30.661885  5383 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:30.861708  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:30.861797  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 134233us
I20260709 13:01:30.862560  1696 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 12: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:30.855381  1616 rpcz_store.cc:276] 0709 13:01:29.336809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.939833 (+603024us) service_pool.cc:224] Handling call
0709 13:01:30.648330 (+708497us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b58000f9998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc4966f10a0 00007fc4966f0984 00007fc48fc6b6d4 00007fc48fc6b662
0709 13:01:30.835416 (+187086us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2817280}
I20260709 13:01:30.838259  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:30.555138  5415 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:30.837755  5857 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.914839  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:30.917922  5523 raft_consensus.cc:2764] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:01:30.919975  5523 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:30.920555  5807 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:30.921043  5523 raft_consensus.cc:697] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:30.921442  5831 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:30.921880  5831 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.922194  5831 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:30.922446  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:30.924657  5792 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:30.851213  5508 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:30.929024  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:30.823045  5091 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:30.936358  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 501950us
I20260709 13:01:30.937999  1690 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:30.940313  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2397) took 1265 ms. Trace:
W20260709 13:01:30.940506  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 125983us
I20260709 13:01:30.604580  5795 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:30.834234  1695 pending_rounds.cc:107] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:01:30.912811  1585 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:30.849465  1615 rpcz_store.cc:276] 0709 13:01:29.475755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.063987 (+588232us) service_pool.cc:224] Handling call
0709 13:01:30.528288 (+464301us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b58000f9998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:01:30.528519 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:30.814814 (+286295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.817412 (+  2598us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3634560}
I20260709 13:01:30.943073  1695 raft_consensus.cc:2889] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:30.933678  5886 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:30.946684  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 86680.7us
I20260709 13:01:30.955152  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:30.957723  1692 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:30.959844  2243 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:30.967370  5720 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:30.968143  5720 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:30.970371  1693 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:30.970742  5720 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:30.945461  5886 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:30.971489  5886 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:30.922178  5523 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:30.945091  5795 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:30.961109  5892 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.971585  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2404) took 1121 ms. Trace:
I20260709 13:01:30.916105  5833 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:30.982347  1511 leader_election.cc:400] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:30.989599  1511 leader_election.cc:403] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:30.982532  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 253494us
I20260709 13:01:30.979957  1689 rpcz_store.cc:276] 0709 13:01:29.855847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.858092 (+  2245us) service_pool.cc:224] Handling call
0709 13:01:29.874677 (+ 16585us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:29.875216 (+   539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:29.875265 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:29.875938 (+   673us) log.cc:844] Serialized 26 byte log entry
0709 13:01:29.936893 (+ 60955us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:29.936932 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.936995 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.655226 (+718231us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:30.971316 (+316090us) raft_consensus.cc:1685] finished
0709 13:01:30.971334 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.971526 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3558,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":19932,"spinlock_wait_cycles":10775296,"thread_start_us":60513,"threads_started":1,"wal-append.queue_time_us":132791}
W20260709 13:01:30.987747  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 157956us
I20260709 13:01:30.861313  5383 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:30.991350  1694 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:30.988878   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:30.940724  1688 rpcz_store.cc:276] 0709 13:01:29.669712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.722662 (+ 52950us) service_pool.cc:224] Handling call
0709 13:01:29.755204 (+ 32542us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:29.770229 (+ 15025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:29.770275 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:29.824280 (+ 54005us) log.cc:844] Serialized 26 byte log entry
0709 13:01:30.000329 (+176049us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b1800110020. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb0d1 00007fc4916e6a0f
0709 13:01:30.044287 (+ 43958us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:30.190764 (+146477us) log.cc:844] Serialized 14 byte log entry
0709 13:01:30.191070 (+   306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.191165 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.521723 (+330558us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:30.934387 (+412664us) raft_consensus.cc:1685] finished
0709 13:01:30.934406 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.934542 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":482,"prepare.queue_time_us":83646,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":319,"raft.run_cpu_time_us":493,"raft.run_wall_time_us":29477,"spinlock_wait_cycles":48155264,"thread_start_us":173129,"threads_started":2,"wal-append.queue_time_us":222972}
W20260709 13:01:30.998960  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 139053us
I20260709 13:01:30.976909  5892 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:30.939113  5857 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:31.011197  5837 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:30.981645  5792 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:30.992678  1445 catalog_manager.cc:5697] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 8 to 10, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 10 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.044786  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:31.051492  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 104240us
W20260709 13:01:31.062793  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 106403us
W20260709 13:01:31.094513  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 47995.8us
I20260709 13:01:31.093169  1512 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:31.106242  2209 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:31.110833  5091 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:31.115497  5857 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:31.066051  5415 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:31.121759  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 81285.1us
I20260709 13:01:31.094164  5844 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:31.124725  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 128403us
W20260709 13:01:31.128847  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 298604us
I20260709 13:01:31.137166  5844 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:01:31.139021  5893 log.cc:927] Time spent T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:01:31.134343  1659 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:31.142524  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 93310.8us
W20260709 13:01:31.144104  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 198382us
I20260709 13:01:31.146840  5770 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:31.109274  5832 consensus_queue.cc:1059] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 13:01:31.154234  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 45250.1us
I20260709 13:01:31.154671  1587 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:31.142864  5415 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:31.164203  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 54133.1us
I20260709 13:01:31.169090  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:31.173923  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:31.173923  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:31.175046  1512 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:31.162685  5897 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:31.180886  5891 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:31.181492  1660 leader_election.cc:400] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:31.164122  5833 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:31.188874  1587 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:31.189929  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 62878.3us
I20260709 13:01:31.169440  5383 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:31.163084  5831 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:31.194492  5901 consensus_queue.cc:1059] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:01:31.187397  5091 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:31.199015  1660 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:31.190860  5826 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:31.190371  5837 consensus_queue.cc:1059] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:01:31.213136  1659 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:31.196197  5792 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:31.211675  5891 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:31.217535  5792 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:31.218046  5792 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:31.219884  5891 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:31.221967  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.192997  5892 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:31.183646  5795 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:31.226197  5831 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:31.226791  5795 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:31.222762  5770 raft_consensus.cc:3055] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:31.227344  5894 consensus_queue.cc:1059] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:01:31.227941  5770 raft_consensus.cc:740] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:31.229044  5770 consensus_queue.cc:260] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:31.222675  5787 raft_consensus.cc:3055] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:31.230278  5787 raft_consensus.cc:740] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:31.231186  5787 consensus_queue.cc:260] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:31.232805  5787 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:31.233335  5881 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:31.192795  5415 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:01:31.235466  5415 consensus_queue.cc:1243] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:01:31.243450  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.252205  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 76830.2us
I20260709 13:01:31.249487  1587 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:31.227975  5886 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:31.223595  5857 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:31.258036  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 66817.9us
I20260709 13:01:31.262482  1619 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:31.249146  5891 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:31.285202  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.442654  5899 raft_consensus.cc:3055] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:31.443033  1585 leader_election.cc:336] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.651s (SENT)
I20260709 13:01:31.267174  5415 consensus_queue.cc:1059] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.128s
W20260709 13:01:31.444649  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 245725us
I20260709 13:01:31.448153  2245 raft_consensus.cc:1240] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:31.386444  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 214465us
I20260709 13:01:31.457264  1619 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:31.463979  5795 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:31.457885  5881 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:31.459589  5886 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:31.452937  5897 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:31.466349  1585 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:31.465723  5897 raft_consensus.cc:697] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:31.467767  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:31.468014  5897 consensus_queue.cc:237] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:31.469044  1511 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:31.469846  5901 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:31.469910  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:31.471064  5901 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:31.471354  5770 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:31.471674  5901 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:31.462201  5899 raft_consensus.cc:740] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:31.473069  5899 consensus_queue.cc:260] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:31.474617  5792 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:31.476857  5792 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:31.477887  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:31.482015  5902 consensus_queue.cc:1059] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:31.483068  5792 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:31.483145  5902 raft_consensus.cc:3055] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:31.483916  5902 raft_consensus.cc:740] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:31.484840  1660 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:31.484917  5902 consensus_queue.cc:260] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:31.485330  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:31.461450  1587 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:31.486595  5415 raft_consensus.cc:3055] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:31.488428  5415 raft_consensus.cc:740] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:31.489353  5415 consensus_queue.cc:260] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:31.490170  5898 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:31.490551  5415 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:31.493496  1659 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:31.492062  5857 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:31.498032  5906 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:31.498603  5906 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:31.499100  5857 consensus_queue.cc:1059] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:31.503645  1512 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:31.514025  1660 leader_election.cc:400] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:31.513942  1512 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:31.514128  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:31.515158  1660 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:31.529948  5892 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:01:31.499750  5906 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:31.516644  5905 consensus_queue.cc:1059] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:01:31.537549  5905 raft_consensus.cc:3055] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:31.538215  5905 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:31.528532  5508 raft_consensus.cc:3055] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:31.519568  5902 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:31.516798  5787 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:31.523433  5903 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:31.542115  1621 raft_consensus.cc:1240] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:31.542584  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:31.543282  5792 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:31.543852  5792 raft_consensus.cc:697] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:31.522853  5826 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:31.536573  1512 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:31.543875  5720 consensus_queue.cc:1059] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:31.545128  5792 consensus_queue.cc:237] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:31.524350  5904 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:31.527683  1587 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:31.546602  1445 catalog_manager.cc:5697] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 5 to 12, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:31.545905  5720 raft_consensus.cc:3055] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:31.555548  1587 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:31.559579  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 74201.8us
I20260709 13:01:31.544428  5903 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:31.559171  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 44083.2us
W20260709 13:01:31.565177  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 67886.8us
I20260709 13:01:31.544603  5826 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:31.600971  2245 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:31.554567  5898 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:31.554392  5720 raft_consensus.cc:740] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:31.539224  5508 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:01:31.606030  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 61991.4us
I20260709 13:01:31.559110  5143 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:31.564421  5891 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:31.608024  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:31.614086  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:31.611995  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:31.594228  5523 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:31.596042  5826 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:31.622123  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:31.624979  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.558748  5894 consensus_queue.cc:1059] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 13:01:31.625679  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.540280  5905 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:31.612697  5833 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.621443  5770 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:31.665162  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 57252.6us
W20260709 13:01:31.667145  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.671361  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 108711us
I20260709 13:01:31.673303  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:31.625586  5806 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:01:31.651746  5908 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:31.665166  5833 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:31.687650  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:31.688503  5833 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:31.691300  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 154805us
I20260709 13:01:31.691681  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:31.692597  1512 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:31.692788  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:31.693925  1512 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:31.694901  5787 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:31.695712  5787 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:31.698067  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:31.703097  1621 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:31.681044  5910 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:31.719815  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 104031us
I20260709 13:01:31.716495  1547 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:01:31.724571  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:31.725447  1619 raft_consensus.cc:2410] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:01:31.726401  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:31.651278  5898 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:31.737402  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:31.705369  5908 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:31.744635  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:31.745257  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:31.681380  5508 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:31.747574  5508 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:31.751919  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 55767.6us
I20260709 13:01:31.753415  1660 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:31.760578  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:31.733402  5143 raft_consensus.cc:697] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:31.728180  5912 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:31.775312  1659 leader_election.cc:336] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.510s (SENT)
I20260709 13:01:31.782159  1689 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:31.696612  5720 consensus_queue.cc:260] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:31.784761  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:31.784634  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:31.785859  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:31.788956  1659 leader_election.cc:336] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.621s (SENT)
I20260709 13:01:31.743866  5899 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:31.786264  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:31.789469  1694 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:31.790899  1688 raft_consensus.cc:2410] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:01:31.791672  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:31.793092  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 64437.1us
I20260709 13:01:31.728484  5906 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:31.795284  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 98534.8us
I20260709 13:01:31.803153  1691 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:31.806360  1695 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:31.807683  5906 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:31.811743  5909 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:01:31.794119  5523 raft_consensus.cc:697] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:31.816033  5523 consensus_queue.cc:237] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:31.818034  5920 raft_consensus.cc:3055] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:31.818485  5920 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:31.819590  5908 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:31.823513  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:31.824268  2242 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:31.824443  5898 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:31.824919  5720 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:31.825795  5143 consensus_queue.cc:237] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:31.797012  5891 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:31.828111  5891 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.828485  5891 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.838482  5903 consensus_queue.cc:1059] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:31.839735  1615 raft_consensus.cc:1240] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:31.843989  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.849099  1694 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:31.849931  1512 leader_election.cc:400] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:31.855054  1512 leader_election.cc:403] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:31.846395  5903 raft_consensus.cc:3055] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:31.856727  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 67201.2us
I20260709 13:01:31.861675  5911 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.864051  5415 raft_consensus.cc:3055] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:01:31.869998  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 116628us
I20260709 13:01:31.868404  5415 raft_consensus.cc:740] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:31.865160  5903 raft_consensus.cc:740] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:31.868477  5770 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.870584  5911 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:31.891707  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 58142.7us
I20260709 13:01:31.892796  1512 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:31.893761  5911 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:31.894397  5911 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:31.900481  5925 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:31.901347  5925 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:31.903381  5795 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:31.903963  5795 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:31.906177  5923 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.906733  5923 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:31.908897  5918 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.909529  5918 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:31.912106  5415 consensus_queue.cc:260] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:31.912283  5826 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:31.913513  5415 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:31.915647  5903 consensus_queue.cc:260] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:31.916767  5903 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:31.917196  5919 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:31.917675  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.894269  1512 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:31.927556  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:31.928599  5925 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:31.929807  5826 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:31.934423  1694 raft_consensus.cc:3055] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:31.934990  1694 raft_consensus.cc:740] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:31.941345  1660 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:31.938946  5906 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:31.942343  5906 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:31.942694  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:31.926461  5919 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:31.952589  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 103996us
W20260709 13:01:31.958214  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.937418  5091 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:31.966217  1621 raft_consensus.cc:1240] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:31.967195  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:31.968991  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.969947  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 75756us
I20260709 13:01:31.955018  1694 consensus_queue.cc:260] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:31.971175  1694 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:31.971436  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.973905  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:31.970057  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:31.976547  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 54285.8us
W20260709 13:01:31.981711  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 64337.1us
I20260709 13:01:31.984292  2246 raft_consensus.cc:1240] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:31.960755  5912 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:31.987175  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 44560.8us
I20260709 13:01:31.962642  5902 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:31.986610  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:31.990283  2237 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:31.957199  5881 consensus_queue.cc:1059] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:01:31.971992  5911 consensus_queue.cc:1059] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:01:31.991535  5770 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:32.022146  1512 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:32.022722  1694 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:01:32.023025  1694 pending_rounds.cc:85] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 9
I20260709 13:01:32.023216  1694 pending_rounds.cc:107] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:01:32.013273   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:32.024767  1694 raft_consensus.cc:2889] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:32.029651  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.993489  5902 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:32.018734  5918 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:32.024907  5881 raft_consensus.cc:3055] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:32.033751  1660 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:32.043831  1512 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:32.047915  5928 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:32.050104  5928 raft_consensus.cc:697] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:32.051132  5928 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:32.057776  1659 leader_election.cc:336] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.887s (SENT)
W20260709 13:01:32.058426  1659 leader_election.cc:336] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.888s (SENT)
I20260709 13:01:32.069435  5902 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:32.070986  1445 catalog_manager.cc:5697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:32.072487  5906 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.073086  5906 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.073477  1445 catalog_manager.cc:5697] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 9 to 12, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:01:32.074939  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.047991  5770 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:32.045424  5881 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:32.076948  5881 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.078459  5881 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:32.079933  5891 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.082270  5918 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:32.082418  5891 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:32.040238  5904 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:32.082856  5918 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:32.083429  5904 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.083895  5904 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:32.085455  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.085801  5918 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:32.086341  5901 raft_consensus.cc:3055] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:32.086715  5901 raft_consensus.cc:740] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:32.087576  5901 consensus_queue.cc:260] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.088560  5919 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:32.089064  5901 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:32.089347  1660 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:32.089640  1659 leader_election.cc:336] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.698s (SENT)
W20260709 13:01:32.090579  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.090881  1660 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:32.091771  5912 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:32.092276  5912 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:32.092615  5912 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:32.109910  5920 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.111608  5920 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:32.111816  5795 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:32.113943  5905 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:32.115193  5906 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:32.117895  5091 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:32.123193  5891 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:32.132678  1659 leader_election.cc:336] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.510s (SENT)
W20260709 13:01:32.147724  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 56924.9us
W20260709 13:01:32.128743  1511 consensus_peers.cc:597] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ee97fe9eef14f818a1f9178885dfc31. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:32.153682  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 112292us
W20260709 13:01:32.167405  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.171928  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 128139us
I20260709 13:01:32.152668  1445 catalog_manager.cc:5697] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 8 to 9, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:01:32.175024  2209 leader_election.cc:336] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.671s (SENT)
W20260709 13:01:32.191569  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 58946.6us
W20260709 13:01:32.192173  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.192615  1659 leader_election.cc:336] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.542s (SENT)
I20260709 13:01:32.193039  1659 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:32.191449  1616 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:32.191390  1445 catalog_manager.cc:5697] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 3 to 6, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 6 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:32.193627  1660 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:32.186687  5901 consensus_queue.cc:1059] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:01:32.204628  1445 catalog_manager.cc:5697] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:32.210820  1445 catalog_manager.cc:5697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 5 to 8, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 8 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:32.202495  5928 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:32.218449  1512 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:32.205174  5415 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:32.223649  1445 catalog_manager.cc:5697] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 6 to 8, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:32.200186  5787 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:01:32.226789  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:32.230165  1512 leader_election.cc:400] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:32.244225  5901 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:32.248487  5943 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.087s	user 0.000s	sys 0.004s
W20260709 13:01:32.230171  5942 log.cc:927] Time spent T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:01:32.217739  5923 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:32.280155  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 50188.7us
W20260709 13:01:32.281829  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.229769  5415 raft_consensus.cc:697] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:32.288302  5770 consensus_queue.cc:1059] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:32.289505  5770 raft_consensus.cc:3055] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:32.289856  5770 raft_consensus.cc:740] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:01:32.290583  2209 leader_election.cc:336] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.599s (SENT)
I20260709 13:01:32.283182  5908 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:32.292165  5908 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:32.292559  5908 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:32.293547  1445 catalog_manager.cc:5697] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 9 to 10, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:32.296562  1445 catalog_manager.cc:5697] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 7 to 9, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:32.267081  5912 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.299733  1445 catalog_manager.cc:5697] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:32.302314  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 86546.7us
I20260709 13:01:32.305054  5920 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:32.305728  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:32.306582  5920 consensus_queue.cc:1059] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:01:32.307147  5949 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:01:32.307710  5920 raft_consensus.cc:3055] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:32.308061  5920 raft_consensus.cc:740] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:32.308948  5920 consensus_queue.cc:260] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.310194  5920 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:32.311653  5891 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:32.311923  5415 consensus_queue.cc:237] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.295024  5826 raft_consensus.cc:3055] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:32.316045  5826 raft_consensus.cc:740] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:32.316839  5826 consensus_queue.cc:260] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.290791  5770 consensus_queue.cc:260] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:32.315251  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:32.323863  5891 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:32.286688  1512 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:32.332422  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.333957  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 344567us
W20260709 13:01:32.333729  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 47164.8us
W20260709 13:01:32.334803  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 357159us
I20260709 13:01:32.335168  1512 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:32.301663  5912 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:32.338307  5770 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:32.339368  5837 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:01:32.339892  1443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42122 (request call id 241) took 18100 ms (client timeout 15000 ms). Trace:
I20260709 13:01:32.340320  1512 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:32.349095  1660 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:32.352037  1512 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:32.354022  1587 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:32.331707  5826 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:32.361107  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.353497  1586 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:32.336705  5911 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:32.365926  1660 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:32.370883  1660 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:32.371683  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:32.372845  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:32.354925  5901 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:32.374784  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:32.374884  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:32.374894  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:32.354804  5787 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:32.380859  5911 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.381490  5911 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.364456  5953 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:01:32.382436  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:32.382586  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:32.363034  5143 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:32.383978  2243 raft_consensus.cc:2393] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 8: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:32.384568  1512 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:32.385455  1690 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:32.364439  5792 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:32.370369  5891 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:32.364961  5923 consensus_queue.cc:1059] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:01:32.389420  5928 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:32.392563  5911 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:32.396971  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:32.354730  5523 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:01:32.383533  5912 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:32.411368  1430 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 479456ab418d44c4983d2bb37eb0e700 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica dcc91bf6e3bd468bbbbfc26e3a7c5e01 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:32.412151  5904 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:32.413787  5806 raft_consensus.cc:3055] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:32.414971  5806 raft_consensus.cc:740] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:32.416555  5904 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:32.417275  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:32.418004  2239 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
W20260709 13:01:32.417363  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 46553.1us
I20260709 13:01:32.420315  1660 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:32.416952  5806 consensus_queue.cc:260] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:32.432706  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.400902  5837 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:32.436978  5891 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:32.437215  5837 raft_consensus.cc:697] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:32.437939  5951 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:32.438321  5837 consensus_queue.cc:237] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.439353  5913 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
W20260709 13:01:32.433821  5903 consensus_meta.cc:287] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.517s	user 0.014s	sys 0.002s
I20260709 13:01:32.387331  5935 consensus_queue.cc:1059] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:01:32.441715  5935 raft_consensus.cc:3055] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:32.442044  5935 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:32.442891  5935 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:32.443543  1659 leader_election.cc:336] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.148s (SENT)
I20260709 13:01:32.444052  1659 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:32.444247  5935 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:32.445215  5891 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:32.451844  5806 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:32.438495  5951 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:32.350502  1443 rpcz_store.cc:269] 0709 13:01:14.239634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.239955 (+   321us) service_pool.cc:224] Handling call
0709 13:01:32.339655 (+18099700us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:28.930044 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:29.019671 (+ 89627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:29.019709 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:01:29.019729 (+    20us) tablet.cc:662] Decoding operations
0709 13:01:29.020790 (+  1061us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:29.020874 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:29.020908 (+    34us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:01:29.021748 (+   840us) tablet.cc:701] Row locks acquired
0709 13:01:29.021769 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:01:29.021937 (+   168us) write_op.cc:270] Start()
0709 13:01:29.022065 (+   128us) write_op.cc:276] Timestamp: P: 1783602089021873 usec, L: 0
0709 13:01:29.022089 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:01:29.022837 (+   748us) log.cc:844] Serialized 4009 byte log entry
0709 13:01:29.717240 (+694403us) op_driver.cc:464] REPLICATION: finished
0709 13:01:29.927596 (+210356us) write_op.cc:301] APPLY: starting
0709 13:01:29.927751 (+   155us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:29.928084 (+   333us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:29.928263 (+   179us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:29.929749 (+  1486us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:29.930201 (+   452us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:01:29.930260 (+    59us) write_op.cc:312] APPLY: finished
0709 13:01:29.930717 (+   457us) log.cc:844] Serialized 77 byte log entry
0709 13:01:29.943467 (+ 12750us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:29.998712 (+ 55245us) write_op.cc:454] Released schema lock
0709 13:01:29.998815 (+   103us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:29.999406 (+   591us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:29.999446 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":209929,"apply.run_cpu_time_us":4584,"apply.run_wall_time_us":71822,"num_ops":10,"prepare.queue_time_us":362534,"prepare.run_cpu_time_us":7909,"prepare.run_wall_time_us":133371,"raft.queue_time_us":547239,"raft.run_cpu_time_us":37343,"raft.run_wall_time_us":171236,"replication_time_us":694878,"spinlock_wait_cycles":140416,"thread_start_us":857933,"threads_started":4,"wal-append.queue_time_us":25230,"wal-append.run_cpu_time_us":20563,"wal-append.run_wall_time_us":1926968}]]}
I20260709 13:01:32.456483  5891 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:32.407398  5912 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.457553  5912 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:32.457316  5891 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:32.463171  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.463889  1547 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:32.464087  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:32.464766  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:32.466288  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:32.467368  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:32.468734  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:32.469445  1538 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:01:32.471464  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 51218.1us
W20260709 13:01:32.472235  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.472385  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:32.480639  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.488962  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.489845  1547 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:32.480408  5903 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.501062  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.502192  1541 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:32.501646  1587 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:32.502441  1538 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:01:32.491673  5903 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.475983  5143 raft_consensus.cc:697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:32.510257  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:32.511029  1541 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:32.534979  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.540251  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.492988  5415 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.540376  1587 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:32.484927  5928 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:32.484391  5952 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:32.550076  1688 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:32.508286  5918 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.550814  5792 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:32.559881  1547 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:32.558678  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.556953  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 84644.1us
I20260709 13:01:32.560899  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:32.564585  2209 leader_election.cc:336] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.917s (SENT)
I20260709 13:01:32.566179  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.567318  1538 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:32.542584  5881 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:32.561594  1542 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:32.575330  1541 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:32.580214  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:32.582636  1615 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:32.584235  1691 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:32.584095  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.585227  1541 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:01:32.585417  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.586165  1540 raft_consensus.cc:2393] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:32.586025  1694 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:32.594295  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:32.568895  5792 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:01:32.617221  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.595717  1691 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:32.595956  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:32.619580  1615 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:32.596374  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:32.596680  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:32.597739  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:32.598541  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:32.620847  1695 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:32.620903  1688 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:32.600179  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:32.622284  1693 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:32.600457  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:32.623149  1696 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:32.601202  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:32.600210  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:32.624224  1687 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:32.552083  5415 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:32.610512  5951 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:32.610980  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.628265  1540 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
W20260709 13:01:32.611956  1585 leader_election.cc:336] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.227s (SENT)
I20260709 13:01:32.616200  1545 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:32.625250  1622 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:32.625610  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:01:32.607113  5956 log.cc:927] Time spent T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:01:32.623993  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:32.630712  1543 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:32.633134  1689 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:32.634660  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:32.634935  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:32.637583  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:32.637794  2243 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:32.638283  1689 raft_consensus.cc:2368] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 11. Current term is 12.
I20260709 13:01:32.638461  1541 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:32.639075  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:32.639338  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:32.639678  1689 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:01:32.640029  1687 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 9: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:32.642567  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:32.643162  1538 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:32.644425  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:32.648895  5415 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:32.653455  5837 raft_consensus.cc:2955] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:01:32.622151  5792 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:32.635685  5143 consensus_queue.cc:237] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.565907  5918 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.674381  1545 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:01:32.637123  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:32.663946  1585 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.278s (SENT) [suppressed 84 similar messages]
I20260709 13:01:32.676465  1543 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 13: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:01:32.677207  1585 leader_election.cc:336] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.532s (SENT)
I20260709 13:01:32.667681  1620 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:32.669500  1688 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:32.665478  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:32.673740  1587 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:32.679394  1691 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:01:32.665964  1689 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:01:32.680811  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.646677  5908 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:32.634653  5928 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.689076  1691 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:32.683357  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.626667  5891 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:32.684610  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.691416  1541 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:32.684746  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:32.677696  1585 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:32.697556  1545 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
W20260709 13:01:32.698873  5958 log.cc:927] Time spent T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:01:32.699380  5934 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.702323  5912 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.705046  5918 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:32.678789  1622 raft_consensus.cc:2955] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:01:32.677290  5892 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:01:32.707639  5903 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:32.711869  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:32.713769  1546 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:32.716377  1615 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:32.717638  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:32.717739  1696 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:32.699143  5957 ts_tablet_manager.cc:933] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 13:01:32.684199  5953 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:32.718562  1694 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:32.719388  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.720944  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:32.727803  5902 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.732782  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:32.737851  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:32.744099  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:32.751724  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.681417  5806 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:01:32.736526  5892 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:01:32.760660  1538 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:32.699970  5934 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:32.774379  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 97175.4us
I20260709 13:01:32.737111  5881 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:32.568552  5952 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.734587  5953 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.778137  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:32.708702  5928 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:32.781519  1538 raft_consensus.cc:2376] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13. Re-sending same reply.
I20260709 13:01:32.782519  1546 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:32.782538  1543 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:32.784080  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:32.786479  1545 raft_consensus.cc:2376] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11. Re-sending same reply.
I20260709 13:01:32.787941  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:32.794524  2211 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:32.795205  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:32.797036  1585 leader_election.cc:336] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.601s (SENT)
I20260709 13:01:32.797821  1585 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:32.799427  1620 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:32.799461  1619 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:32.785682  5953 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:32.805047  1695 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:32.803443  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:32.806411  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:32.808648  1543 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:32.758982  5902 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:32.809576  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.815004  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:32.818183  1585 leader_election.cc:336] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.617s (SENT)
I20260709 13:01:32.818608  1585 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:32.817148  2239 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:01:32.819746  1660 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:32.820151  2239 pending_rounds.cc:85] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: Aborting all ops after (but not including) 10
I20260709 13:01:32.820436  2239 pending_rounds.cc:107] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:01:32.820703  2239 raft_consensus.cc:2889] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:32.821786  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:32.822513  1543 raft_consensus.cc:2376] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14. Re-sending same reply.
I20260709 13:01:32.827471  5945 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:32.829500  5952 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:32.804502  5905 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.830693  5905 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:32.833261  5908 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:32.816792  5967 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:32.835035  5912 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:32.841163  5928 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:32.843578  5965 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:32.844936  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.845894  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:32.846953  2242 raft_consensus.cc:2393] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:32.848147  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:32.849295  5964 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:32.849612  1660 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:32.855674  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 61219.1us
I20260709 13:01:32.803915  5143 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:32.876914  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.877342  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.877784  1547 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:32.877867  1543 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:32.878816  1540 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:32.879063  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.879729  1546 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:32.879868  1542 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:32.880108  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.880585  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.880883  1544 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:32.881215  1538 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:32.881623  5934 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:32.882417  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 64254.7us
I20260709 13:01:32.882853  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:32.883432  5967 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:32.883447  5937 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:32.812506  5831 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:32.888607  5831 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:32.889009  5831 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:32.877938  1541 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:32.891870  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.892683  1545 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 7: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:32.894958  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:32.895627  5902 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:32.897300  1585 leader_election.cc:336] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.676s (SENT)
I20260709 13:01:32.897970  1585 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:32.898159  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:32.898799  2242 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:32.899591  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:32.899891  5964 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:32.900112  5905 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:32.900240  1613 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:32.897358  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:32.901090  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:32.900413  1660 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:32.901701  1539 raft_consensus.cc:2376] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8. Re-sending same reply.
I20260709 13:01:32.895641  1620 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:32.902897  5908 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:32.903323  5908 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.903672  5908 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:32.903896  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.904459  1539 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:32.899940  5906 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:32.905440  5906 raft_consensus.cc:697] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:32.906476  5906 consensus_queue.cc:237] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.908041  1541 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:01:32.909605  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 57697.2us
I20260709 13:01:32.911155  5523 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:01:32.911551  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 646909798f0047ef9e8073d28a784525: Illegal state: Replica dcc91bf6e3bd468bbbbfc26e3a7c5e01 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:32.912149  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.912716  1539 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:32.913475  1544 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:32.910379  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.917724  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.919106  1541 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:01:32.920123  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:32.920730  1545 raft_consensus.cc:2376] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12. Re-sending same reply.
I20260709 13:01:32.900552  5964 raft_consensus.cc:697] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:32.922535  5964 consensus_queue.cc:237] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:32.923406  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.925467  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.899646  5383 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:32.926769  1541 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
W20260709 13:01:32.899184  1585 leader_election.cc:336] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.694s (SENT)
I20260709 13:01:32.932865  1585 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:32.934139  2211 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:32.935405  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.936324  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:32.937690  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.938338  1541 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:32.939937  1691 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:01:32.942092  5967 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:32.939924  2211 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:32.944696  2210 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:32.941344  5905 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:32.957119  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 57958.9us
I20260709 13:01:32.957665  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:32.958393  1691 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 13: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:32.941847  5383 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.959558  1511 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:32.978858  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.971994  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:32.969535  1619 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:32.982455  1691 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:32.989267  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:32.990193  1541 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:32.949203  5905 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:32.964224  5881 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:32.987048  5935 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:33.001751  5720 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:33.015868  5720 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.016325  5720 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:33.033284  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 53047.8us
I20260709 13:01:32.992751  5383 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:33.045819  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:33.071982  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:33.014350  5935 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.075819  1613 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:01:33.013473  5905 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:33.083819  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 47887.3us
I20260709 13:01:33.085474  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:33.086381  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:33.087046  1615 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:33.087471  1617 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:33.068071  5957 tablet_copy_client.cc:323] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:41871
I20260709 13:01:33.094228  1660 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:33.100152  1615 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:33.105356  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:33.083343  5415 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:33.084000  5935 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:33.037528  5792 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:33.092381  5806 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:01:33.119602  5980 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.132339  5980 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:33.134550  5980 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:33.120040  5792 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:33.125636  5908 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:33.139734  5908 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:33.140175  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:33.143924  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:33.145015  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 205136us
I20260709 13:01:33.101678  5920 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:33.146718  1538 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
W20260709 13:01:33.116564  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet ded1641387fd4fd4be29caddb22781fb: Illegal state: Replica dcc91bf6e3bd468bbbbfc26e3a7c5e01 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
W20260709 13:01:33.131460  1659 leader_election.cc:336] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.512s (SENT)
I20260709 13:01:33.148376  1621 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:33.151578  1541 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 10: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:33.156982  1659 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:33.159173  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:33.160053  1621 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:01:33.146133  2211 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:33.162576  1538 raft_consensus.cc:1240] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:33.112674  5979 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:33.168725  2211 leader_election.cc:400] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 11. Current term is 12.
I20260709 13:01:33.172936  1511 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:33.174777  2210 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:33.176692  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:33.177397  2243 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:33.108191  5415 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:33.185295  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 53848.7us
I20260709 13:01:33.175974  5980 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:33.130102  5720 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:33.181216  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:33.171409  5934 consensus_queue.cc:1059] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 13:01:33.196722  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.168216  5979 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.200165  1660 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:33.171409  5891 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:33.205015  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:33.174423  5920 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:33.180174  5903 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:33.126642  5831 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:33.163656  5964 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:01:33.220724  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 52116.6us
I20260709 13:01:33.221648  2211 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:33.192355  5980 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:33.203521  5928 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:33.182163  5953 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:33.240195  2211 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:33.218726  5902 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:33.249197  5902 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.249763  5902 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:33.250151  5975 log.cc:927] Time spent T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:01:33.219103  5903 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.205484  5979 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:33.220808  5906 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:33.238101  5934 consensus_queue.cc:1243] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:33.246527  5980 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:33.273303  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:33.247879  5970 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:33.255543  5903 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:33.309855  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:33.319842  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.287529  5970 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:33.322045  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 99520.2us
I20260709 13:01:33.324121  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:33.328243  1538 raft_consensus.cc:2393] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 10: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:33.291393  5906 raft_consensus.cc:697] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:33.329159  2211 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:33.330760  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 156037us
I20260709 13:01:33.302948  5928 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:33.332986  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:33.340260  5978 log.cc:927] Time spent T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:01:33.341747  5831 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:33.343365  5720 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:33.320184  5967 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:33.348518  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.349326  1689 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:33.349507  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:33.354349  1613 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:33.352250  5928 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:33.359309  5971 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:33.321499  5908 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:33.326695  5383 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:33.329568  5970 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:33.373914  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:33.374800  1541 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
W20260709 13:01:33.382272  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 927e42de9e944ae8a2d45f30be59d5df: Illegal state: Replica dcc91bf6e3bd468bbbbfc26e3a7c5e01 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:33.392103  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:33.393170  1538 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
W20260709 13:01:33.417073  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 116411us
I20260709 13:01:33.321960  5920 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:33.425302   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:33.426198  1659 leader_election.cc:336] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.820s (SENT)
I20260709 13:01:33.364264  5967 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:33.386649  5908 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:33.453456  1587 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:33.471302  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:33.481424  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:33.482131  1688 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:33.494313  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:33.494999  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:33.495285  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:33.498186  2243 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
W20260709 13:01:33.499612  5983 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:01:33.503435  5143 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.503971  5143 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:33.505388  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:33.506048  5143 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:33.507614  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:33.507984  1695 raft_consensus.cc:1275] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:33.509569  1688 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:33.495018  1538 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:33.452224  5992 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:33.514614  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 76374.3us
W20260709 13:01:33.449918  1430 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 479456ab418d44c4983d2bb37eb0e700 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica dcc91bf6e3bd468bbbbfc26e3a7c5e01 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:33.466302  5415 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:33.516568  1691 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:33.472884  5945 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:33.536399  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 82922.9us
I20260709 13:01:33.473162  5928 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:33.475646  5953 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:33.444985  5906 consensus_queue.cc:237] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:33.562947  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:33.566550  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:33.567701  1693 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:33.567526  1538 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:33.573951  1691 raft_consensus.cc:1240] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:33.541002  5918 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:33.574868  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 245702us
I20260709 13:01:33.541548  5992 raft_consensus.cc:697] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:01:33.542194  1430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 95034.5us
I20260709 13:01:33.582175  2211 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:33.589018  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:33.589851  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:33.590571  1541 raft_consensus.cc:2368] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10.
I20260709 13:01:33.591200  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:33.591387  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:33.594847  2211 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:33.599681  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:33.600925  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:33.601665  1544 raft_consensus.cc:2393] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:33.602382  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:33.603502  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:33.604246  1540 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 12: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:33.604957  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:33.605394  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:33.605830  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:33.605446  1540 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:33.577893  5945 raft_consensus.cc:697] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:33.597325  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:33.607851  1695 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:33.608965  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:33.609433  1585 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:33.608971  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:33.612282  1613 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:33.613327  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:33.614351  1539 raft_consensus.cc:2393] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 10: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:33.615520  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:33.619565  5826 raft_consensus.cc:3055] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:33.583079  5918 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:33.620054  5826 raft_consensus.cc:740] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:01:33.620796  5994 log.cc:927] Time spent T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:01:33.585438  5935 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:33.621767  5918 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:33.615548  6004 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:33.622624  1540 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:33.622848  6004 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:33.606269  1541 pending_rounds.cc:85] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 6
I20260709 13:01:33.626173  1541 pending_rounds.cc:107] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:01:33.626523  1541 raft_consensus.cc:2889] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:33.572301  5937 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 13:01:33.668290  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 58957.9us
I20260709 13:01:33.669196  1585 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:33.675840  1545 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:33.682554  1547 raft_consensus.cc:2393] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 13: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:01:33.622004  5988 log.cc:927] Time spent T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:01:33.693408  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:33.692540  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 122457us
I20260709 13:01:33.694202  1615 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
W20260709 13:01:33.696465  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 135088us
I20260709 13:01:33.623227  6004 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:33.704671  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:33.705803  1621 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:33.683073  5892 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:33.596176  1557 tablet_copy_service.cc:140] P d7158d6c3b634dc7abb69eac58eba291: Received BeginTabletCopySession request for tablet 5ee97fe9eef14f818a1f9178885dfc31 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:42858)
I20260709 13:01:33.706928  1615 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:33.709745  1585 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:01:33.715037  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 91143.1us
I20260709 13:01:33.716410  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:33.720887  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.717365  2209 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:33.699461  5143 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:33.737941  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:33.715548  5953 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:01:33.739099  1546 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 7: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:33.742367  1512 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:33.715040  5986 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:33.745852  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:33.695782  5902 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:33.752852  2211 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:33.753608  1585 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:33.761210  1585 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:33.764055  1585 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:33.708169  5523 consensus_queue.cc:1059] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:01:33.745738  5990 log.cc:927] Time spent T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 13:01:33.741982  5953 consensus_queue.cc:1243] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:33.712428  5720 consensus_queue.cc:1059] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:01:33.779590  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:33.786095  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.043967  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:33.832984  1546 raft_consensus.cc:2368] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10.
I20260709 13:01:34.020012  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:34.021512  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:33.848650  5720 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:33.858903  5979 consensus_meta.cc:287] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.571s	user 0.000s	sys 0.011s
I20260709 13:01:33.852131  6010 raft_consensus.cc:2764] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:01:33.849552  5905 consensus_meta.cc:287] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.002s
I20260709 13:01:34.041266  5826 consensus_queue.cc:260] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:34.006574  5970 consensus_meta.cc:287] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.000s
I20260709 13:01:33.852599  5902 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:33.749222  5918 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:33.969388  5980 consensus_meta.cc:287] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.672s	user 0.005s	sys 0.004s
I20260709 13:01:33.969928  5934 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:33.935424  5995 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:33.958670  5935 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:33.925771  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:33.767345  5908 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:33.844760  5383 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:33.755820  5903 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:33.859180  5971 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:33.924288  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:33.712685  5992 consensus_queue.cc:237] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:33.921044  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:33.778010  5967 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:33.955819  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:33.759516  5945 consensus_queue.cc:237] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.014007  5523 raft_consensus.cc:3055] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:34.010996  6017 raft_consensus.cc:3055] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:33.971352  5891 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.969614  5965 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.004226  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:33.911072  1544 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:33.938814  1660 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:34.382102  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 443284us
I20260709 13:01:33.965649  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:33.928974  6004 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:33.930867  6020 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:33.958251  6008 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.739156  1557 tablet_copy_service.cc:161] P d7158d6c3b634dc7abb69eac58eba291: Beginning new tablet copy session on tablet 5ee97fe9eef14f818a1f9178885dfc31 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:42858: session id = e8a64798e5f94de8909707bcbd11804a-5ee97fe9eef14f818a1f9178885dfc31
I20260709 13:01:33.961997  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:34.386049  1690 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:34.070756  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 306779us
W20260709 13:01:33.805902  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 98875.8us
W20260709 13:01:34.113521  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 396155us
W20260709 13:01:34.120652  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 367855us
I20260709 13:01:33.716087  6013 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:01:33.781471  5770 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:34.392822  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:34.393181  1660 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:34.393436  1543 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:34.124403  1542 raft_consensus.cc:2393] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 13: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:34.130463  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:34.074571  5912 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:34.135046  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:34.175453  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.146198  1545 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:34.143460  5918 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:34.221920  6009 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.233132  6018 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.137096  5905 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:34.204401  5986 raft_consensus.cc:697] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:34.175045  5980 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:34.133255  5979 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:34.387138  5995 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:34.431859  1539 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:34.432103  5995 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.432752  5979 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:34.347151  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 601294us
I20260709 13:01:34.173744  5892 raft_consensus.cc:697] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:34.433786  1512 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:34.434079  5892 consensus_queue.cc:237] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.435328  5920 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:34.435767  5920 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.436125  5920 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:34.347267  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.437053  5905 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:34.391999  5770 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.438783  5770 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.439136  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:34.439507  6007 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:34.440047  6007 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.378911  6017 raft_consensus.cc:740] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:34.441314  6017 consensus_queue.cc:260] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:34.442165  6007 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:34.442551  6017 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.144023  5826 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:34.443682  5986 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:34.444311  5903 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:34.444980  5903 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:34.384640  5891 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.446156  6018 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.139052  5720 raft_consensus.cc:697] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:34.447964  5891 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:34.447886  5720 consensus_queue.cc:237] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:34.448398  6018 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:34.355955  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:34.449100  1620 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:34.140583  5970 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:34.374445  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 418673us
I20260709 13:01:34.451483  5970 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:34.451746  1659 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:34.444341  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 57017.9us
I20260709 13:01:34.452930  1659 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:34.453233  5806 consensus_queue.cc:1048] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:34.381501  1538 raft_consensus.cc:2368] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15.
I20260709 13:01:34.347188  5934 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.456521  5934 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.398031  1585 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:01:34.457973  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 60021.5us
I20260709 13:01:34.458705  5934 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:34.458094  6009 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.459015  1585 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:34.392336  1544 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 12. Ops: []
I20260709 13:01:34.400123  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:34.416510  1542 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:34.371888  5523 raft_consensus.cc:740] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:34.377419  5967 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:34.421795  6027 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:34.423599  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:34.424117  5912 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:34.424703  6024 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:34.500495  6007 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:01:34.522927  6007 consensus_queue.cc:1243] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:34.425159  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:34.392403  5908 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:34.525624  5908 raft_consensus.cc:697] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:34.526659  5908 consensus_queue.cc:237] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:34.460137  5953 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:01:34.391691  5965 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.418323  5935 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:34.529241  5935 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.529399  5770 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:34.530151  5965 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:34.506018  5970 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:34.395303  6008 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.531471  5970 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:34.533375  6008 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:34.533645  5970 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:34.435223  1512 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:34.459411  5964 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:34.449831  1547 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 13: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:34.437848  2242 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:34.535281  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 100083us
I20260709 13:01:34.536342  1512 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:34.538335  1512 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:34.401871  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:34.539425  1691 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:34.540093  6023 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:34.540257  5935 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:34.460846  1545 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:34.470182  1659 leader_election.cc:336] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.685s (SENT)
I20260709 13:01:34.426556  1546 raft_consensus.cc:1275] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:34.459923  5999 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:34.445556  5903 consensus_queue.cc:1059] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:34.499454  2245 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:34.500607  2246 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:34.505985  1690 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:34.437001  6004 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:34.418617  5918 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:34.549871  5770 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:34.521747  5523 consensus_queue.cc:260] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.553124  5523 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:34.461187  5928 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:34.392313  5937 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:34.467490  1692 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
W20260709 13:01:34.541940  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 71834.4us
W20260709 13:01:34.561231  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.392190  6020 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:34.540262  1445 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58806 (request call id 178) took 5990 ms. Trace:
I20260709 13:01:34.499198  6033 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.548250  2243 raft_consensus.cc:1240] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:34.549394  5912 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:34.508459  5891 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:01:34.617887  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:34.618799  2243 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.562112  1694 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:34.518146  1620 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
W20260709 13:01:34.621443  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.592123  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:34.428164  5143 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
W20260709 13:01:34.594280  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 135308us
I20260709 13:01:34.623773  2210 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:34.544037  5999 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:34.556305  5934 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:34.631386  1585 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:34.562064  1445 rpcz_store.cc:276] 0709 13:01:28.550051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.550220 (+   169us) service_pool.cc:224] Handling call
0709 13:01:34.540173 (+5989953us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:32.750631 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:32.816850 (+ 66219us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:32.835330 (+ 18480us) write_op.cc:435] Acquired schema lock
0709 13:01:32.835359 (+    29us) tablet.cc:662] Decoding operations
0709 13:01:32.837137 (+  1778us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:32.837235 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:32.837277 (+    42us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:01:32.839013 (+  1736us) tablet.cc:701] Row locks acquired
0709 13:01:32.839084 (+    71us) write_op.cc:260] PREPARE: finished
0709 13:01:32.981178 (+142094us) write_op.cc:270] Start()
0709 13:01:33.049888 (+ 68710us) write_op.cc:276] Timestamp: P: 1783602092855737 usec, L: 0
0709 13:01:33.056397 (+  6509us) op_driver.cc:348] REPLICATION: starting
0709 13:01:33.176306 (+119909us) log.cc:844] Serialized 5196 byte log entry
0709 13:01:33.508504 (+332198us) op_driver.cc:464] REPLICATION: finished
0709 13:01:33.585593 (+ 77089us) write_op.cc:301] APPLY: starting
0709 13:01:33.591643 (+  6050us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:33.859902 (+268259us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:33.860025 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:33.953588 (+ 93563us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:33.953967 (+   379us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=26
0709 13:01:33.954040 (+    73us) write_op.cc:312] APPLY: finished
0709 13:01:33.954498 (+   458us) log.cc:844] Serialized 95 byte log entry
0709 13:01:33.954695 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:33.954843 (+   148us) write_op.cc:454] Released schema lock
0709 13:01:33.954892 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:34.004548 (+ 49656us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:34.004578 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1135193,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":58598,"apply.run_cpu_time_us":6500,"apply.run_wall_time_us":377067,"num_ops":13,"prepare.queue_time_us":234120,"prepare.run_cpu_time_us":19209,"prepare.run_wall_time_us":561406,"raft.queue_time_us":129357,"raft.run_cpu_time_us":6602,"raft.run_wall_time_us":26737,"replication_time_us":451712,"thread_start_us":241521,"threads_started":4,"wal-append.queue_time_us":188539}]]}
I20260709 13:01:34.575937  5770 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:34.663156  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 193179us
I20260709 13:01:34.563469  6020 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:34.666622  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 74913.4us
I20260709 13:01:34.662956  5953 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:34.671083  5953 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.673286  5953 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:34.650975  5999 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:34.675806  6029 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:34.676376  6029 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:34.677094  5795 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.677595  5795 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:34.678617  6029 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:34.679322  6032 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:34.660676  6018 raft_consensus.cc:3055] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:34.680161  6018 raft_consensus.cc:740] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:34.680433  5383 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:34.681022  5383 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.683182  5383 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:34.691485  5770 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.692278  5383 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:34.692054  5770 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.652055  5970 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:34.692900  5383 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:34.693384  5383 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:34.693398  5970 raft_consensus.cc:697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:34.694474  5770 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:34.691597  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:34.557822  6027 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:34.696401  5934 consensus_queue.cc:1059] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:34.697739  5934 raft_consensus.cc:3055] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:34.698011  6027 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:34.698159  5934 raft_consensus.cc:740] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:34.680194  6026 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:34.681037  6018 consensus_queue.cc:260] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:01:34.699931  6026 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:34.699784  5970 consensus_queue.cc:237] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:34.684804  5795 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:34.702564  6026 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:34.704523  6021 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:01:34.690912  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 59580.3us
I20260709 13:01:34.705358  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:34.705758  1585 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:34.706118  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2731) took 1115 ms. Trace:
I20260709 13:01:34.706969  1585 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:34.706703  1541 rpcz_store.cc:276] 0709 13:01:33.591106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.593516 (+  2410us) service_pool.cc:224] Handling call
0709 13:01:33.593828 (+   312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:33.690955 (+ 97127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.691009 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:33.696229 (+  5220us) log.cc:844] Serialized 52 byte log entry
0709 13:01:34.071775 (+375546us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:34.394087 (+322312us) log.cc:844] Serialized 14 byte log entry
0709 13:01:34.394937 (+   850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.471287 (+ 76350us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:34.705860 (+234573us) raft_consensus.cc:1685] finished
0709 13:01:34.705879 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.706009 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":490738,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":49203,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":37996,"thread_start_us":616906,"threads_started":2,"wal-append.queue_time_us":800864}
I20260709 13:01:34.708962  6030 raft_consensus.cc:2764] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:01:34.709609  6030 raft_consensus.cc:2764] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:01:34.710791  6009 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:34.715883  5980 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:34.700729  6018 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:34.632558  6033 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:34.668994  6034 log.cc:927] Time spent T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:01:34.721009  6033 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:34.723412  5795 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.723932  5795 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.725414  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2747) took 1126 ms. Trace:
I20260709 13:01:34.725917  1545 rpcz_store.cc:276] 0709 13:01:33.598524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.397296 (+798772us) service_pool.cc:224] Handling call
0709 13:01:34.460669 (+ 63373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.541433 (+ 80764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.725166 (+183733us) spinlock_profiling.cc:243] Waited 63.1 ms on lock 0x7b5400123750. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:34.725340 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145095424}
I20260709 13:01:34.727033  2242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 925) took 1671 ms. Trace:
W20260709 13:01:34.688714  6035 log.cc:927] Time spent T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:01:34.725917  5795 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:34.727417  2242 rpcz_store.cc:276] 0709 13:01:33.055936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.056139 (+   203us) service_pool.cc:224] Handling call
0709 13:01:33.056710 (+   571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.535595 (+1478885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.726813 (+191218us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400700654. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:34.726962 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3175576960}
I20260709 13:01:34.732884  5881 consensus_queue.cc:1059] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:34.734174  5792 raft_consensus.cc:3055] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:34.734535  5792 raft_consensus.cc:740] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:34.735330  5792 consensus_queue.cc:260] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:34.736505  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:34.705715  5995 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.739267  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:34.737234  6032 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:34.763687  1540 raft_consensus.cc:2410] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:01:34.752592  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:34.755060  1621 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:34.755499  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:34.765847  1659 leader_election.cc:336] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.694s (SENT)
I20260709 13:01:34.748119  1694 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:34.766250  1659 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:34.737948  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:34.737468  5792 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.739899  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:34.741115  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 73504.1us
I20260709 13:01:34.741658  2243 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:34.742646  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:34.767081  1615 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
W20260709 13:01:34.771893  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.745844  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:34.772454  1693 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:34.743749  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:34.766281  1687 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
W20260709 13:01:34.774123  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 305179us
I20260709 13:01:34.779379  2211 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:34.784616  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00924ae4c66740e59de627a44de33c38"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:34.785197  1613 raft_consensus.cc:606] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:34.785629  1613 raft_consensus.cc:614] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:34.787663  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:34.788277  1692 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.789749  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:34.790302  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:34.791200  1615 raft_consensus.cc:2393] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:34.791136  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:34.794366  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:34.794461  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:34.795982  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:34.796859  1620 raft_consensus.cc:2410] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:01:34.710724  5920 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.797609  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:34.806075  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:34.706398  5935 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:34.806769  1690 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:34.806914  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:34.799340  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 261032us
I20260709 13:01:34.795039  1617 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:34.807616  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:34.668072  6023 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:34.809296  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:34.763728  6033 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:01:34.811187  1687 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:34.811400  1543 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:34.811182  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:34.839471  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:34.768953  5967 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:34.811318  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1610) took 1200 ms. Trace:
I20260709 13:01:34.840675  1547 rpcz_store.cc:276] 0709 13:01:33.611004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.923939 (+312935us) service_pool.cc:224] Handling call
0709 13:01:34.811105 (+887166us) spinlock_profiling.cc:243] Waited 86 ms on lock 0x7b54000b6154. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:34.811264 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197779200}
I20260709 13:01:34.829385  1621 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14. Ops: [9.6-13.8]
I20260709 13:01:34.830305  2211 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:34.824926  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:34.833652  1587 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:34.835219  1690 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:34.842501  1587 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:34.843370  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:34.788816  5881 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:34.810635  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2740) took 1215 ms. Trace:
I20260709 13:01:34.805148  6026 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:34.839603  1622 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:34.779282  6009 consensus_queue.cc:1059] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:01:34.808447  5937 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:34.825536  5971 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:34.846660  1587 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:34.866268  1690 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:01:34.846284  1540 rpcz_store.cc:276] 0709 13:01:33.594730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.021232 (+426502us) service_pool.cc:224] Handling call
0709 13:01:34.810448 (+789216us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b54002e9354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:34.810585 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1467047808}
I20260709 13:01:34.832705  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:34.847486  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:34.857960  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:34.774529  5918 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:34.874529  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:34.876645  2211 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:34.871387  6023 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:34.876809  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.881145  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:34.881759  1614 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:34.699220  5934 consensus_queue.cc:260] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:34.869501  1613 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.881104  1621 pending_rounds.cc:85] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 5
I20260709 13:01:34.823659  5935 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:34.902287  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:34.848815  6030 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:34.848974  5143 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:34.883400  1622 raft_consensus.cc:2410] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:01:34.848198  5970 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:34.996452  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 153491us
I20260709 13:01:34.865885  5937 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:35.012378  5998 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:34.866945  6026 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:35.017154  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 136105us
W20260709 13:01:35.018572  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.019403  2210 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:34.866132  5971 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:35.020927  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 142250us
W20260709 13:01:35.020984  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 144388us
I20260709 13:01:34.883756  1621 pending_rounds.cc:107] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:01:35.022360  2211 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:34.788560  6032 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:01:35.026886  1621 raft_consensus.cc:2889] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:35.026513  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:35.030484  1660 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:34.860178  5881 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.048969  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2738) took 1454 ms. Trace:
I20260709 13:01:35.069643  1613 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:35.044751  1619 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:35.061064  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:35.076615  1617 raft_consensus.cc:2368] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:35.071543  1543 rpcz_store.cc:276] 0709 13:01:33.594261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.394008 (+799747us) service_pool.cc:224] Handling call
0709 13:01:34.811223 (+417215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.839228 (+ 28005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.048506 (+209278us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54000b6150. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:35.048742 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798914432}
I20260709 13:01:34.994733  5143 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.965114  6027 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:35.087148  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:35.019670  6026 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:35.093189  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 64638.6us
I20260709 13:01:35.093677  1613 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:35.091192  1660 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:34.884629  5892 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:35.102360  1613 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:35.026628  5903 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.029021  5971 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:35.040544  6049 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:35.031018  6029 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:35.031517  6013 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:35.018908  6020 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.078745  6046 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.088981  5143 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:35.092437  5912 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:35.092489  5831 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:35.089897  6027 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:35.058503  5906 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:01:35.108590  5892 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:35.113914  5967 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:35.158448  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 390727us
I20260709 13:01:35.052934  5999 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:35.146188  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:35.187407  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:35.195554  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.165620  5912 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.196626  1618 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:35.120085  5903 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:35.178192  6027 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:35.185220  5892 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:35.180974  5831 raft_consensus.cc:697] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:01:35.247978  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 148198us
I20260709 13:01:35.185570  5967 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.142144  6049 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:35.250758  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 147594us
I20260709 13:01:35.196410  5928 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:35.255460  1660 leader_election.cc:400] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:35.266784  1660 leader_election.cc:403] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:35.262993  1692 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:01:35.204994  5912 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:35.164893  6046 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:35.264175  5967 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:35.272926  6062 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:35.265981  5920 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:35.288053  1619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:35.293550  1619 raft_consensus.cc:606] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:35.294062  1619 raft_consensus.cc:614] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:35.273655  5806 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:35.295713  6062 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:35.314635  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 46380.9us
I20260709 13:01:35.318569  1619 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:35.273649  5928 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:35.324383  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:35.325053  1615 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:01:35.308555  6039 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.276s	user 0.001s	sys 0.001s
I20260709 13:01:35.296482  5935 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:35.324471  2211 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:35.306325  5918 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:35.309525  6009 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.308749  6066 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.309682  5906 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
W20260709 13:01:35.325169  5523 consensus_meta.cc:287] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.769s	user 0.012s	sys 0.000s
I20260709 13:01:35.336535  1615 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:35.341106  6062 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:35.341447  5928 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:35.336285  5996 consensus_queue.cc:1059] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
W20260709 13:01:35.348583  5383 consensus_meta.cc:287] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.001s
I20260709 13:01:35.349079  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:35.456348  1617 raft_consensus.cc:606] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:35.456725  1617 raft_consensus.cc:614] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:35.349351  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:35.352363  6056 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:01:35.353000  6040 log.cc:927] Time spent T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
W20260709 13:01:35.353740  6061 log.cc:927] Time spent T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:01:35.354512  6051 log.cc:927] Time spent T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 13:01:35.355196  6055 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
W20260709 13:01:35.356086  6064 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:01:35.363942  6058 log.cc:927] Time spent T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:01:35.368252  6049 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:35.368831  6038 log.cc:927] Time spent T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:01:35.370775  6036 raft_consensus.cc:3055] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:35.371683  6059 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:01:35.372030  6046 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:35.337028  6013 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:35.374580  5881 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:35.421689  5415 consensus_queue.cc:1059] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:01:35.378599  1694 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:35.416420  6009 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:35.374962  5971 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.384047  6048 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:35.388659  6020 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:35.418823  1620 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
W20260709 13:01:35.451464  1585 leader_election.cc:336] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.965s (SENT)
I20260709 13:01:35.457511  1614 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:35.502501  1585 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:35.317279  5920 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:01:35.313766  5806 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.335355  5935 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.392421  6032 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:35.418602  5908 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:35.462950  5383 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.476456  1692 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:01:35.478641  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 149615us
I20260709 13:01:35.455591  5891 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:35.466164  5928 raft_consensus.cc:3055] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:01:35.480959  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 483654us
I20260709 13:01:35.517632  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:35.496760  5903 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:35.326545  5831 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.378268  6069 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:35.380107  5792 consensus_meta.cc:287] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.604s	user 0.004s	sys 0.006s
I20260709 13:01:35.501171  6048 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:35.481652  6036 raft_consensus.cc:740] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:35.491609  5906 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.425872  6066 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.514384  2239 raft_consensus.cc:2368] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
W20260709 13:01:35.514870  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 63464.1us
W20260709 13:01:35.537117  1585 leader_election.cc:336] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.971s (SENT)
I20260709 13:01:35.537541  1585 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:35.496611  6013 raft_consensus.cc:697] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:35.546717  6013 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.547586  1690 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:35.524734  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:35.493899  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 496588us
W20260709 13:01:35.550763  6054 log.cc:927] Time spent T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
W20260709 13:01:35.552500  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:35.553010  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.557219  6009 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:35.557763  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:35.560184  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1708) took 1088 ms. Trace:
W20260709 13:01:35.560564  1585 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.032s (SENT)
I20260709 13:01:35.561120  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:35.561462  6066 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:35.561802  5806 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:35.562048  6074 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:35.562359  5806 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:35.562472  1585 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:35.563802  5792 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:35.523821  6032 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:35.569797  5892 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.570437  5971 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:35.572184  5383 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:35.572041  5906 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:35.573077  6048 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.574159  5906 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:35.574288  6048 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:35.575553  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:35.576013  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:35.576159  2238 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:35.531886  6069 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.509601  6001 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:01:35.567534  5912 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:35.578336  6069 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:35.579316  5912 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:35.531399  5415 raft_consensus.cc:3055] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:35.580073  5415 raft_consensus.cc:740] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:35.581030  5415 consensus_queue.cc:260] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:35.582134  5415 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:35.582494  5143 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:35.518273  1694 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:35.512617  5934 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:35.584656  5143 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:35.524195  5891 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.585523  1622 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 15: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:35.586752  5891 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:35.528525  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:35.543047  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:35.587934  1691 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:01:35.588049  6036 consensus_queue.cc:260] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.589612  6036 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:35.498121  6030 raft_consensus.cc:697] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:35.535068  1617 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:35.540197  1614 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:35.517005  5908 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:35.594842  5908 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:35.541857  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:35.514124  5935 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:35.592597  6030 consensus_queue.cc:237] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:35.596918  5935 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:35.542313  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:35.598111  1687 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 14: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:35.543908  2246 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:35.598340  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:35.537205  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:35.598984  1614 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:35.600325  1619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:35.560632  1689 rpcz_store.cc:276] 0709 13:01:34.472289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.472463 (+   174us) service_pool.cc:224] Handling call
0709 13:01:34.501221 (+ 28758us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.501561 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:34.868505 (+366944us) log.cc:844] Serialized 14 byte log entry
0709 13:01:35.513179 (+644674us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:35.525114 (+ 11935us) log.cc:844] Serialized 26 byte log entry
0709 13:01:35.525388 (+   274us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:35.525424 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.525487 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:35.559987 (+ 34500us) raft_consensus.cc:1685] finished
0709 13:01:35.560005 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.560129 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3326,"prepare.queue_time_us":128990,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":86,"raft.queue_time_us":46088,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":7019,"thread_start_us":984814,"threads_started":3,"wal-append.queue_time_us":370509}
I20260709 13:01:35.600883  1619 raft_consensus.cc:606] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:35.602077  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:35.603227  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:35.603933  1619 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 9: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:35.605515  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:35.607795  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:35.517876  5928 raft_consensus.cc:740] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:35.608608  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:35.612988  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 58531.2us
I20260709 13:01:35.613397  1691 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:35.615311  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:35.609762  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:35.610196  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:35.612433  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:35.618779  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:35.619626  2244 raft_consensus.cc:2393] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 12: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:35.619520  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:35.617028  2243 raft_consensus.cc:2393] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 10: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
W20260709 13:01:35.628403  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.629565  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:35.630317  1614 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:35.614380  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:35.612816  6049 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.638226  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:35.638881  2238 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:35.642395  1586 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:35.657989  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:35.654031  1511 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:35.663791  5881 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:35.664475  1441 catalog_manager.cc:5697] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 9 to 12, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:35.623492  5992 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:01:35.647202  5970 consensus_queue.cc:1059] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:01:35.706682  1619 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:35.675659  5928 consensus_queue.cc:260] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:35.639834  6009 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.679762  5920 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:35.684216  6027 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:35.686323  5937 consensus_meta.cc:287] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.000s
I20260709 13:01:35.686385  5967 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:35.715298  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:35.689544  1691 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:35.690038  5903 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:35.690636  5953 consensus_queue.cc:1048] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:01:35.691366  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 50154.8us
I20260709 13:01:35.694217  1614 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:35.699126  1621 raft_consensus.cc:1240] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:35.702211  5995 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:35.644331  6049 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:35.703977  6018 consensus_meta.cc:287] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.987s	user 0.011s	sys 0.000s
I20260709 13:01:35.727571  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:35.679831  6080 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:35.709116  6046 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.734769  2237 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:35.733980  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:35.736370  1621 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:35.719892  5903 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.720009  1441 catalog_manager.cc:5697] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 9 to 10, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:35.724622  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:35.739802  1614 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:35.726037  1618 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:35.726552  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:35.650434  5998 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:01:35.711113  6062 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:35.714330  1619 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:35.694991  5881 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:35.721166  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:35.740738  1622 raft_consensus.cc:606] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:35.745880  1622 raft_consensus.cc:614] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:35.740262  6046 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.734928  6080 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.719467  5937 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:35.750844  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.751632  1441 catalog_manager.cc:5697] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 4 to 7, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:35.732520  6077 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:35.732952  5892 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:35.712882  6009 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.741020  5903 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:35.759953  6001 raft_consensus.cc:3055] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:35.761706  5967 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:35.795877  1617 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:35.794803  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 73959.2us
I20260709 13:01:35.748742  5881 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:35.750136  6018 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.803840  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:35.767181  5826 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:35.747865  5770 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:35.749837  6062 raft_consensus.cc:697] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:35.749574  6081 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:35.753034  6072 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:35.816388  6027 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:35.816999  5970 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:35.817696  6027 consensus_queue.cc:1059] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:35.795069  5937 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:35.802788  1441 catalog_manager.cc:5697] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:35.753484  6080 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:35.811085  2238 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:35.793542  6023 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.820618  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:35.876175  1687 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:35.797190  6001 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:35.881353  1441 catalog_manager.cc:5697] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:35.767504  5935 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:35.805013  6077 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:35.860627  5970 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:35.814039  5770 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.867166  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2396) took 1020 ms. Trace:
I20260709 13:01:35.744591  6049 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:35.891523  1620 rpcz_store.cc:276] 0709 13:01:34.857256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.857634 (+   378us) service_pool.cc:224] Handling call
0709 13:01:35.866942 (+1009308us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54003fff54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:35.867097 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261605248}
I20260709 13:01:35.900940  5770 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:35.812067  5826 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:35.809870  6018 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.822468  6081 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:35.891968  6023 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:36.009243  1615 raft_consensus.cc:1240] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:35.915834  1511 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:35.919922  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:35.907653  6049 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.919265  1687 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:01:35.948414  1441 catalog_manager.cc:5697] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 10 to 12, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.027396  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:36.035907  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 120122us
I20260709 13:01:35.858511  6072 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:35.980791  6084 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:01:35.964169  6001 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:36.040359  1557 tablet_copy_source_session.cc:215] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:36.041644  6089 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:36.042023  6036 consensus_queue.cc:1059] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:36.042543  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:36.020772  6090 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:36.044554  6033 consensus_queue.cc:1059] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:35.962112  5770 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:36.045701  6088 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:01:35.913821  6027 raft_consensus.cc:3055] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:36.064842  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:36.065100  1557 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:42858 (request call id 600) took 2661 ms. Trace:
I20260709 13:01:35.896106  5935 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:36.067303  5908 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:36.007288  5999 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:35.962704  6046 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:35.964339  5934 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.043977  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:36.055109  1441 catalog_manager.cc:5697] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:36.036423  5937 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.035589  5980 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:36.068423  6089 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.038479  6049 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:36.088608  6009 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:36.089025  5928 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:36.089653  6057 log.cc:927] Time spent T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.835s	user 0.001s	sys 0.004s
I20260709 13:01:36.101454  6036 raft_consensus.cc:3055] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:36.093526  1620 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:36.044021  5826 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:36.133106  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:36.099098  1621 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:36.133546  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:36.133845  1540 raft_consensus.cc:2376] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9. Re-sending same reply.
W20260709 13:01:35.980952  1430 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 479456ab418d44c4983d2bb37eb0e700 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e8a64798e5f94de8909707bcbd11804a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:36.101294  1586 leader_election.cc:400] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:01:36.140604  1586 leader_election.cc:403] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:36.038343  5971 consensus_queue.cc:1059] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:01:36.107889  1441 catalog_manager.cc:5697] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 5 to 6, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.092199  6027 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:36.114437  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:36.090857  6033 consensus_queue.cc:1243] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer e8a64798e5f94de8909707bcbd11804a log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:36.117812  1541 pending_rounds.cc:85] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 5
I20260709 13:01:36.147217  1541 pending_rounds.cc:107] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:01:36.147531  1541 raft_consensus.cc:2889] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:36.147938  1541 pending_rounds.cc:107] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:01:36.148283  1541 raft_consensus.cc:2889] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:36.144563  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 44431.4us
W20260709 13:01:36.119869  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.130236  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:36.118595  6036 raft_consensus.cc:740] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:36.130887  1689 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:35.957080  6062 consensus_queue.cc:237] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:36.134145  1543 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:36.103056  5992 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.133162  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:36.135466  2210 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:36.139297  1660 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:36.134824  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:36.104841  5920 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:36.143698  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:36.157596  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.168977  1694 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 15: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:36.146003  1615 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:36.107678  6089 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:36.156085  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:36.146723   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:36.171891   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:36.094365  5770 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:36.151921  1691 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:36.151446  1441 catalog_manager.cc:5697] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 7 to 10, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.162855  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:36.101493  5881 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:36.117740  6009 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:36.181596  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 140393us
I20260709 13:01:36.167367  1660 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:36.163183  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:36.168035  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:36.140301  5908 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:36.135025  5980 raft_consensus.cc:697] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:36.081327  6090 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:36.151008  5967 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:36.109570  5934 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:36.177933  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:36.196815  1547 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:36.177790  1441 catalog_manager.cc:5697] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 10 to 12, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.198082  1615 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:36.161499  1687 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:36.094722  1557 rpcz_store.cc:276] 0709 13:01:33.430761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.523169 (+ 92408us) service_pool.cc:224] Handling call
0709 13:01:36.039990 (+2516821us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003d90d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4917353f7 00007fc4966cb036 00007fc4966d4a3e 00007fc48df9827b 00007fc4966d49ba 00007fc4966cfacc 00007fc4966cac7b 00007fc4966bf8d1 00007fc4957734b4 00007fc495773442
0709 13:01:36.064956 (+ 24966us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2445485440}
I20260709 13:01:36.153421  5383 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:01:36.113569  5937 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:36.204918  5937 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:36.189119  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:36.190452  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:36.191942  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:36.155558  6096 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:36.192282  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:36.207583  1540 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:36.207522  6096 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:36.209846  6096 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:36.153803  5826 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:36.147559  1430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 168338us
I20260709 13:01:36.217370  5967 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:36.228502  5770 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:36.144315  5970 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:01:36.182129  6018 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:36.231361  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:36.206480  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:36.232414  2242 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:36.168512  5920 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:36.175069  6072 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:36.174580  1544 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:36.214910  1540 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:01:36.145234  5415 consensus_queue.cc:1059] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:01:36.181674  6070 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:36.179032  6022 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:36.218519  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 79921.5us
W20260709 13:01:36.242354  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.242715  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.222321  1691 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:36.179165  5992 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:36.225961  6036 consensus_queue.cc:260] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:36.227563  6023 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:36.227352  5826 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:36.232527  1441 catalog_manager.cc:5697] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 10 to 11, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:36.244421  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:36.234056  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:36.235476  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:36.246052  1687 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:36.238128  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:36.254778  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:36.255636  1544 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:36.260021  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:36.235556  5967 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:36.271673  1441 catalog_manager.cc:5697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.189687  6009 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:36.273571  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:36.192588  5908 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:36.274991  2243 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:36.275287  1544 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 7.
I20260709 13:01:36.276893  5826 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:36.277872  1538 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:36.270025  1687 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:01:36.259471  6072 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:36.316745  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:36.324293  1544 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
W20260709 13:01:36.331082  1512 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:42858 dropped due to backpressure: service queue is full with 50 items
I20260709 13:01:36.334576  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:36.334805  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:36.336076  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 168721us
I20260709 13:01:36.319553  1540 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:36.271059  6049 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:36.337082  1441 catalog_manager.cc:5697] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:01:36.331374  6048 consensus_meta.cc:287] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.757s	user 0.011s	sys 0.001s
I20260709 13:01:36.281998  6023 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.322170  6036 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:36.293766  5383 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:36.353247  1547 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:36.323196  6072 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:36.351648  1660 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:36.410562  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 59210.9us
I20260709 13:01:36.410614  1441 catalog_manager.cc:5697] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 8 to 9, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.345263  5935 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:36.422917  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 98625.6us
W20260709 13:01:36.435611  2209 leader_election.cc:336] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.988s (SENT)
I20260709 13:01:36.349472  6009 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:36.277518  5920 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:36.331671  1512 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:42858 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2755)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1635)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1639)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2775)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1634)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1636)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1640)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1630)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2756)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2762)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1626)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1631)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 611)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1628)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1633)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1638)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2757)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2764)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2772)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 605)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 606)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 607)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 608)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 612)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 615)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 616)
I20260709 13:01:36.417819  6070 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:36.456277  6070 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:36.415619  6072 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:36.460734  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 97676.7us
I20260709 13:01:36.505096  1511 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:36.462517  1441 catalog_manager.cc:5697] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.491778  6022 raft_consensus.cc:697] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:36.410410  5415 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:36.333050  5980 consensus_queue.cc:237] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:36.520612  1441 catalog_manager.cc:5697] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 7 to 10, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.514156  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:36.509855  6048 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:36.521184  6092 log.cc:927] Time spent T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.353s	user 0.001s	sys 0.000s
W20260709 13:01:36.606837  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.414697  5383 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:36.374316  6023 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:01:36.523849  6049 consensus_queue.cc:1059] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.149s
I20260709 13:01:36.586923  6022 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:36.728422  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 292808us
W20260709 13:01:36.651048  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.624713  1441 catalog_manager.cc:5697] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 5 to 8, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.689888  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:36.780895  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 266780us
I20260709 13:01:36.796181  1546 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:36.781138  1512 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:36.781509  6101 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:36.800348  1512 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:36.781857  6049 raft_consensus.cc:3055] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:36.802680  1693 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:01:36.702348  6109 log.cc:927] Time spent T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.353s	user 0.000s	sys 0.001s
I20260709 13:01:36.805121  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:36.805688  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:36.805740  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:36.806504  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:36.808343  1512 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:36.814424  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:36.827996  1693 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:01:36.809703  1441 catalog_manager.cc:5697] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 6 to 9, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.827998  1690 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:36.828943  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:36.827637  1688 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:36.592039  6048 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.789263  5920 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:36.591742  5881 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:36.832633  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:36.861357  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:36.708797  6090 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:36.659351  5934 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:36.701522  6085 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:01:36.862072  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 51738.8us
W20260709 13:01:36.866042  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.872373  1441 catalog_manager.cc:5697] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 8 to 12, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.536908  5415 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:36.880362  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:36.809435  5992 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:36.892668  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 481059us
I20260709 13:01:36.808145  6102 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:36.861876  6106 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:36.802911  6049 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:01:36.872432  5903 consensus_meta.cc:287] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 1.070s	user 0.006s	sys 0.006s
I20260709 13:01:36.831182  6095 raft_consensus.cc:2764] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:01:36.895855  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:36.907567  1690 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:36.862360  5826 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.911123  1441 catalog_manager.cc:5697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 8 to 11, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.863081  6048 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:36.902792  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:36.888255  5831 raft_consensus.cc:3055] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:36.917590  1546 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:36.918978  1691 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:36.920408  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:36.888695  6090 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.939064  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:36.939719  1696 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:36.944599  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:36.945374  1441 catalog_manager.cc:5697] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.945380  1546 raft_consensus.cc:2393] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 15: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:36.949045  1613 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:36.949419  1696 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:36.946821  1441 catalog_manager.cc:5697] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.951897  5881 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.975885  5881 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:36.978785  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:36.979323  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:36.980629  1547 raft_consensus.cc:2376] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11. Re-sending same reply.
I20260709 13:01:36.974203  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:36.981858  1538 raft_consensus.cc:2376] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13. Re-sending same reply.
I20260709 13:01:36.966182  1441 catalog_manager.cc:5697] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.982667  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:36.990345  1538 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 7: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:01:36.994248  6089 consensus_meta.cc:287] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.808s	user 0.010s	sys 0.000s
I20260709 13:01:36.932119  6115 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:37.009039  6046 raft_consensus.cc:3055] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:37.009528  6115 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:37.011029  5383 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:36.972354  5415 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:36.952137  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:36.991581  5970 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:01:36.946446  6090 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:37.007697  6049 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:37.051602  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.016191  1546 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:36.995843  6020 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:37.035454  6115 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:36.935710  5831 raft_consensus.cc:740] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:36.931813  5903 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:36.939347  5826 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:36.994851  6089 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:36.996064  6112 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:37.009557  6046 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:37.126103  1546 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:37.115514  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:37.114979  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:37.093210  6104 log.cc:927] Time spent T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.572s	user 0.001s	sys 0.000s
W20260709 13:01:37.101152  6080 consensus_meta.cc:287] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 1.206s	user 0.010s	sys 0.003s
I20260709 13:01:37.114426  5831 consensus_queue.cc:260] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:37.128659  1547 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:01:37.136106  1659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.000s	sys 0.012s
W20260709 13:01:37.136559  1659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.000s	sys 0.012s
I20260709 13:01:37.132661  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:37.144681  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:37.145404  1687 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:37.145579  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:37.146508  1546 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:37.150108  1659 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:37.103988  5908 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:37.102151  6081 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:37.156761  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:37.105806  5881 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:37.132956  6049 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:37.224779  2211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.019s	sys 0.010s
W20260709 13:01:37.226541  2211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.019s	sys 0.011s
I20260709 13:01:37.232697  1546 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 7.
I20260709 13:01:37.233456  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1636) took 1079 ms. Trace:
I20260709 13:01:37.233786  1546 rpcz_store.cc:276] 0709 13:01:36.154451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.145245 (+990794us) service_pool.cc:224] Handling call
0709 13:01:37.233387 (+ 88142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.100970  6020 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:37.134168  6072 consensus_meta.cc:287] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.000s
I20260709 13:01:37.262339  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:37.263391  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2777) took 1041 ms. Trace:
I20260709 13:01:37.263784  1547 rpcz_store.cc:276] 0709 13:01:36.221995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.151549 (+929554us) service_pool.cc:224] Handling call
0709 13:01:37.263316 (+111767us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:37.221036  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 305350us
I20260709 13:01:37.279711  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:37.280864  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:37.281373   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:37.281563  1546 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:37.283623  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:37.260414  6077 consensus_meta.cc:287] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 1.350s	user 0.004s	sys 0.008s
I20260709 13:01:37.288071  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:37.291502  1546 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:37.137609  6023 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:37.297964  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1627) took 1145 ms. Trace:
I20260709 13:01:37.298499  1546 rpcz_store.cc:276] 0709 13:01:36.152297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.280649 (+1128352us) service_pool.cc:224] Handling call
0709 13:01:37.297888 (+ 17239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.314359  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:37.315804  1547 raft_consensus.cc:2410] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:01:37.316505  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:37.145323  6080 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:37.134588  6112 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:37.320082  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:38.177059  1690 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:38.200444  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:37.496275  6090 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:38.209105  1546 raft_consensus.cc:2376] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9. Re-sending same reply.
I20260709 13:01:38.210407  1694 raft_consensus.cc:2368] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10.
I20260709 13:01:38.211133  6129 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.336256  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:38.212263  5920 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.212188  6129 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:37.640417  6138 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:37.419430  2243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45866 (request call id 912) took 1203 ms. Trace:
I20260709 13:01:38.213644  6138 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:38.213934  2243 rpcz_store.cc:276] 0709 13:01:36.189983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.190142 (+   159us) service_pool.cc:224] Handling call
0709 13:01:37.393349 (+1203207us) spinlock_profiling.cc:243] Waited 67.7 ms on lock 0x7b54007012d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:37.393518 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155723648}
I20260709 13:01:38.214972  6129 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:37.546353  6136 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:38.215765  6138 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:38.212919  5920 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:38.216720  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 1.06651e+06us
I20260709 13:01:37.877606  6113 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:37.333160  6110 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:38.217155  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:38.217878  6062 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.003s	sys 0.012s
I20260709 13:01:37.335791  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:37.320567  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2767) took 1108 ms. Trace:
I20260709 13:01:37.326937  2246 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:37.483736  6133 consensus_queue.cc:1059] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.735s
W20260709 13:01:38.217890  1546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 604) took 1979 ms (client timeout 1988 ms). Trace:
I20260709 13:01:38.266881  1547 rpcz_store.cc:276] 0709 13:01:36.212322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.276435 (+1064113us) service_pool.cc:224] Handling call
0709 13:01:37.320498 (+ 44063us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:37.778698  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 480182us
W20260709 13:01:38.267736  1546 rpcz_store.cc:269] 0709 13:01:36.238421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.200084 (+1961663us) service_pool.cc:224] Handling call
0709 13:01:38.217821 (+ 17737us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.646031  6141 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:38.141695  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:38.140897  2209 leader_election.cc:336] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 3.046s (SENT)
I20260709 13:01:38.269196  2209 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:37.326733  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:37.659755  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:37.432026  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 158269us
I20260709 13:01:37.279263  6072 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:37.529958  5928 consensus_meta.cc:287] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 1.412s	user 0.012s	sys 0.000s
I20260709 13:01:38.212481  1696 raft_consensus.cc:2410] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:01:38.276832  1587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:34459 timed out after 1.730s (SENT) [suppressed 24 similar messages]
I20260709 13:01:37.331799  5908 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.285399  6085 raft_consensus.cc:697] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:38.265242  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 866) took 1325 ms. Trace:
I20260709 13:01:38.282860  1622 rpcz_store.cc:276] 0709 13:01:36.923414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.923572 (+   158us) service_pool.cc:224] Handling call
0709 13:01:36.923833 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.924026 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:37.287626 (+363600us) log.cc:844] Serialized 14 byte log entry
0709 13:01:38.248524 (+960898us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:38.248584 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:38.248641 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.248709 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.248846 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8770,"prepare.queue_time_us":556222,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":23,"raft.queue_time_us":930661,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":16293,"thread_start_us":365165,"threads_started":2}
I20260709 13:01:37.364292  5957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee97fe9eef14f818a1f9178885dfc31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.286882  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:38.287438  1688 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:38.288066  6094 log.cc:927] Time spent T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 2.198s	user 0.009s	sys 0.021s
I20260709 13:01:38.291226  5908 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.291920  6033 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.292486  6033 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:37.392822  5415 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.488619  6020 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:37.714169  6118 log.cc:927] Time spent T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.984s	user 0.000s	sys 0.001s
W20260709 13:01:37.398145  6104 log.cc:927] Time spent T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:01:38.304876  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1640) took 2100 ms (client timeout 2039 ms). Trace:
W20260709 13:01:38.305327  1547 rpcz_store.cc:269] 0709 13:01:36.204440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.304666 (+2100226us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:38.304801 (+   135us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:38.266089  1695 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
W20260709 13:01:37.495221  6036 consensus_meta.cc:287] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 1.131s	user 0.009s	sys 0.000s
W20260709 13:01:37.700284  6119 log.cc:927] Time spent T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.691s	user 0.003s	sys 0.000s
W20260709 13:01:37.390712  6143 log.cc:927] Time spent T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:01:38.275410  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:37.878785  6124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.009s	sys 0.021s
I20260709 13:01:37.357326  6134 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.297724  6081 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:37.316888  6077 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:38.281594  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:37.755206  5967 raft_consensus.cc:3055] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:37.419705  6022 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.270902  1660 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:37.685911  6131 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 13:01:38.273322  6062 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.003s	sys 0.013s
I20260709 13:01:38.276894  6113 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:37.698381  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:38.346180  1538 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 15: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:38.308597  1692 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:38.282276  5892 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.301148  6133 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:01:38.313169  1659 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:38.316004  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2776) took 2086 ms (client timeout 2029 ms). Trace:
I20260709 13:01:37.286235  6046 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.317500  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1619) took 2196 ms. Trace:
I20260709 13:01:38.315819  6020 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:38.318382  1687 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:38.318346  1544 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:01:38.216172  6136 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.297753  5881 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:38.302446  6110 raft_consensus.cc:3055] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:38.338436  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1616) took 2227 ms. Trace:
I20260709 13:01:38.371286  1511 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:38.321342  6124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.009s	sys 0.041s
I20260709 13:01:37.696892  6027 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.280977  6141 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.303681  5415 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.342005  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:38.343986  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 73199.6us
I20260709 13:01:38.266142  6138 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:38.338740  6048 consensus_meta.cc:287] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 1.390s	user 0.006s	sys 0.007s
W20260709 13:01:38.350423  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2763) took 2139 ms (client timeout 1955 ms). Trace:
I20260709 13:01:38.357455  6090 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.340548  6080 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:38.353168  1547 rpcz_store.cc:269] 0709 13:01:36.221470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.307577 (+2086107us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:38.307700 (+   123us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:38.354542  6046 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:38.358650  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 45575.6us
I20260709 13:01:38.343506  5967 raft_consensus.cc:740] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:38.338279  6081 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.347337  6070 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:38.375494  1543 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:38.371371  1545 rpcz_store.cc:276] 0709 13:01:36.111311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.111799 (+   488us) service_pool.cc:224] Handling call
0709 13:01:36.112251 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:36.112744 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:36.112792 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:36.116104 (+  3312us) log.cc:844] Serialized 26 byte log entry
0709 13:01:36.240111 (+124007us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:36.284593 (+ 44482us) log.cc:844] Serialized 14 byte log entry
0709 13:01:36.318079 (+ 33486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.318179 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.327741 (+2009562us) raft_consensus.cc:1685] finished
0709 13:01:38.338133 (+ 10392us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.338337 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":153200,"prepare.queue_time_us":218875,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":121424,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":44380,"spinlock_wait_cycles":1508608,"thread_start_us":90421,"threads_started":2,"wal-append.queue_time_us":213178}
W20260709 13:01:38.427832  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.428150  1545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2771) took 2215 ms (client timeout 2053 ms). Trace:
W20260709 13:01:38.428639  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.428586  1545 rpcz_store.cc:269] 0709 13:01:36.213211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.427985 (+2214774us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:38.428092 (+   107us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:38.429257  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 288360us
I20260709 13:01:38.340884  6033 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:38.412709  1538 rpcz_store.cc:269] 0709 13:01:36.211426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.698034 (+1486608us) service_pool.cc:224] Handling call
0709 13:01:38.350355 (+652321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.438361  5967 consensus_queue.cc:260] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:38.355674  5892 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:38.378278  6062 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:38.407207  6124 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:38.449009  6159 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:38.449545  6159 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:38.451599  6159 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:38.452059  6159 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:38.452471  6159 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.421061  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:38.422371  1689 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:38.454309  6159 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:38.423712  2237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45882 (request call id 833) took 2597 ms. Trace:
I20260709 13:01:38.455737  2237 rpcz_store.cc:276] 0709 13:01:35.820053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.820158 (+   105us) service_pool.cc:224] Handling call
0709 13:01:35.860914 (+ 40756us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:35.867647 (+  6733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.867687 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:36.642673 (+774986us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b2c00012be8. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc490024a11 00007fc490034372 00007fc491766a01 00007fc49172b43a 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2
0709 13:01:36.676807 (+ 34134us) log.cc:844] Serialized 26 byte log entry
0709 13:01:37.030072 (+353265us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:37.030132 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.030238 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.417156 (+1386918us) raft_consensus.cc:1685] finished
0709 13:01:38.417179 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.417367 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6351,"raft.queue_time_us":14616,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6642,"spinlock_wait_cycles":8767232,"thread_start_us":221692,"threads_started":1,"wal-append.queue_time_us":628629}
W20260709 13:01:38.425241  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2766) took 2213 ms (client timeout 2045 ms). Trace:
W20260709 13:01:38.457610  1547 rpcz_store.cc:269] 0709 13:01:36.212097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.425002 (+2212905us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:38.425165 (+   163us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:38.458640  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2768) took 2246 ms (client timeout 2170 ms). Trace:
W20260709 13:01:38.459076  1547 rpcz_store.cc:269] 0709 13:01:36.212539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.458412 (+2245873us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:38.458575 (+   163us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:38.459987  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2756) took 2254 ms (client timeout 2196 ms). Trace:
W20260709 13:01:38.460378  1547 rpcz_store.cc:269] 0709 13:01:36.205600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.459792 (+2254192us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:38.459929 (+   137us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:38.461191  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2770) took 2248 ms (client timeout 2209 ms). Trace:
W20260709 13:01:38.461596  1547 rpcz_store.cc:269] 0709 13:01:36.212993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.460987 (+2247994us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:38.461134 (+   147us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:38.462440  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2762) took 2251 ms (client timeout 2225 ms). Trace:
I20260709 13:01:38.375784  6110 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:38.464409  6110 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:38.465899  6110 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:38.345541  6022 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.373538  6144 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:38.429524  1545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1630) took 2276 ms (client timeout 2119 ms). Trace:
W20260709 13:01:38.495790  1545 rpcz_store.cc:269] 0709 13:01:36.153087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.429374 (+2276287us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:38.429476 (+   102us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:38.497047  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:38.497942  1545 raft_consensus.cc:2368] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
W20260709 13:01:38.498348  1545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1626) took 2346 ms (client timeout 2477 ms). Trace:
I20260709 13:01:38.354883  1542 rpcz_store.cc:276] 0709 13:01:36.114808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.115021 (+   213us) service_pool.cc:224] Handling call
0709 13:01:36.115347 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:36.287570 (+172223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:36.287619 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:36.288218 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:01:36.302167 (+ 13949us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:36.314908 (+ 12741us) log.cc:844] Serialized 14 byte log entry
0709 13:01:36.351669 (+ 36761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.351764 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.713531 (+1361767us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:38.311068 (+597537us) raft_consensus.cc:1685] finished
0709 13:01:38.311177 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.311333 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46888,"prepare.queue_time_us":358868,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":198485,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":27265,"spinlock_wait_cycles":144903936,"thread_start_us":197638,"threads_started":3,"wal-append.queue_time_us":252020}
W20260709 13:01:38.432318  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.351179  6129 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.438030  6077 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:38.438926  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 609) took 2198 ms (client timeout 2055 ms). Trace:
I20260709 13:01:38.369853  6020 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:38.418540  1659 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:38.462807  1547 rpcz_store.cc:269] 0709 13:01:36.211183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.462273 (+2251090us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:38.462387 (+   114us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:38.418188  5928 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:38.380043  5881 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.439723  5967 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:38.498677  1545 rpcz_store.cc:269] 0709 13:01:36.152072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.496721 (+2344649us) service_pool.cc:224] Handling call
0709 13:01:38.498291 (+  1570us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.534215  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:38.500530  1695 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:01:38.504551  1538 rpcz_store.cc:269] 0709 13:01:36.240496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.438758 (+2198262us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:38.438872 (+   114us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:38.506989  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 88554.1us
I20260709 13:01:38.536617  1659 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:38.499527  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:38.430071  6145 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:38.424667  6090 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.418042  6048 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:38.512275  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:38.542146  1547 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
W20260709 13:01:38.542588  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1631) took 2389 ms (client timeout 2804 ms). Trace:
W20260709 13:01:38.542907  1547 rpcz_store.cc:269] 0709 13:01:36.153289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.506719 (+2353430us) service_pool.cc:224] Handling call
0709 13:01:38.542534 (+ 35815us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.537401  1542 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:38.514010  6022 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:38.447002  6070 raft_consensus.cc:697] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:38.328675  6134 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.441059  6001 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:38.441767  6062 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:38.554363  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 69045.1us
I20260709 13:01:38.535888  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:38.417763  6138 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:38.501701  6144 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:38.530705  6148 log.cc:927] Time spent T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:01:38.499432  6155 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:38.546883  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 139239us
W20260709 13:01:38.543778  1542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2760) took 2333 ms (client timeout 2633 ms). Trace:
W20260709 13:01:38.563915  1542 rpcz_store.cc:269] 0709 13:01:36.210594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.499288 (+2288694us) service_pool.cc:224] Handling call
0709 13:01:38.543727 (+ 44439us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.564810  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:38.565485  1542 raft_consensus.cc:2393] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:38.532006  6080 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:38.530355  6049 consensus_meta.cc:287] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 1.270s	user 0.012s	sys 0.001s
I20260709 13:01:38.555225  1538 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 13: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:38.577523  1687 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:38.545917  6133 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:38.488047  1433 maintenance_manager.cc:643] P b9f5bb9ff31f4ba4a2568147b35a35db: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 7.564s	user 0.197s	sys 0.082s Metrics: {"bytes_written":30175,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":1067835,"dirs.run_cpu_time_us":497,"dirs.run_wall_time_us":122703,"drs_written":1,"lbm_read_time_us":398,"lbm_reads_lt_1ms":4,"lbm_write_time_us":615239,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":7,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":498816,"threads_started":2,"update_count":13,"wal-append.queue_time_us":129430}
I20260709 13:01:38.557646  6165 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:38.562117  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:38.343483  6085 consensus_queue.cc:237] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:38.498871  6124 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.550331  6110 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:38.575996  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:38.533588  5928 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:38.507750  6129 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:38.623574  1696 raft_consensus.cc:2393] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:38.624109  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:38.578788  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 135733us
I20260709 13:01:38.659332  1586 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:38.555914  6048 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:38.573837  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2759) took 2363 ms. Trace:
I20260709 13:01:38.628780  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:38.629086  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:38.629673  6136 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:38.582162  1541 raft_consensus.cc:2410] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:38.661134  1542 rpcz_store.cc:276] 0709 13:01:36.210343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.564575 (+2354232us) service_pool.cc:224] Handling call
0709 13:01:38.573777 (+  9202us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:38.663910  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.663585  1695 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:01:38.665036  1542 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:38.631722  6141 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:38.633179  6146 log.cc:927] Time spent T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
W20260709 13:01:38.633849  6154 log.cc:927] Time spent T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:01:38.545955  6145 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.636675  5826 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:38.576907  6080 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:38.645578  1544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 613) took 2403 ms (client timeout 1621 ms). Trace:
I20260709 13:01:38.649241  6129 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:38.660669  6110 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:38.686364  5908 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:38.687508  1694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 1735) took 2459 ms (client timeout 1730 ms). Trace:
W20260709 13:01:38.680313  1544 rpcz_store.cc:269] 0709 13:01:36.241865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.334571 (+ 92706us) service_pool.cc:224] Handling call
0709 13:01:38.645364 (+2310793us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b5400193054. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:38.645480 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4559642368}
W20260709 13:01:38.687907  1694 rpcz_store.cc:269] 0709 13:01:36.228500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.233776 (+  5276us) service_pool.cc:224] Handling call
0709 13:01:38.687229 (+2453453us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b5400034154. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:38.687402 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4518108416}
I20260709 13:01:38.690624  6020 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:38.692320  6124 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:38.693437  6072 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:38.515618  6077 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.696199  6077 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:38.696491  1540 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
W20260709 13:01:38.698175  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 614) took 2446 ms (client timeout 1902 ms). Trace:
W20260709 13:01:38.698751  1540 rpcz_store.cc:269] 0709 13:01:36.252162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.316273 (+1064111us) service_pool.cc:224] Handling call
0709 13:01:38.697919 (+1381646us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54003223d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:38.698056 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3144196480}
I20260709 13:01:38.700383  1540 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:38.700876  6080 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:38.701227  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2752) took 2496 ms. Trace:
I20260709 13:01:38.701822  5831 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:38.654204  6150 log.cc:927] Time spent T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
W20260709 13:01:38.582356  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2778) took 2360 ms (client timeout 3046 ms). Trace:
W20260709 13:01:38.666581  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 105259us
W20260709 13:01:38.704514  1538 rpcz_store.cc:269] 0709 13:01:36.222534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.535686 (+2313152us) service_pool.cc:224] Handling call
0709 13:01:38.582276 (+ 46590us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.705605  1587 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:38.706221  1538 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:01:38.706708  1538 pending_rounds.cc:85] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 7
I20260709 13:01:38.706974  1538 pending_rounds.cc:107] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 13.8
W20260709 13:01:38.666924  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 124180us
I20260709 13:01:38.652709  5881 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:38.667783  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:38.556352  6062 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:38.615257  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:38.576227  1585 connection.cc:256] RPC call timeout handler was delayed by -2.3812788160000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
I20260709 13:01:38.621811  1546 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:38.713078  1545 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:38.660393  5980 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:01:38.674173  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1633) took 2520 ms. Trace:
I20260709 13:01:38.675572  1434 maintenance_manager.cc:419] P b9f5bb9ff31f4ba4a2568147b35a35db: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10544 bytes on disk
I20260709 13:01:38.726645  6048 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.727164  6048 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.727989  5928 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:38.723623  6123 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.732113  1433 maintenance_manager.cc:643] P b9f5bb9ff31f4ba4a2568147b35a35db: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":345,"lbm_reads_lt_1ms":4}
I20260709 13:01:38.732373  6020 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:38.733183  6020 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:38.733806  6046 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.734272  5881 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:38.734356  6046 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:38.736593  6033 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.737380  6081 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:38.737145  6033 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:38.700341  6134 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:38.675922  6113 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:38.615157  6133 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:38.615056  6149 log.cc:927] Time spent T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
W20260709 13:01:38.707638  1659 leader_election.cc:336] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.832s (SENT)
I20260709 13:01:38.567153  6144 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:38.668231  6158 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:38.709795  1538 raft_consensus.cc:2889] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.773012  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2757) took 2567 ms. Trace:
I20260709 13:01:38.773329  1538 rpcz_store.cc:276] 0709 13:01:36.209841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.705412 (+2495571us) service_pool.cc:224] Handling call
0709 13:01:38.705796 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.772816 (+ 67020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.772969 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.774322  1538 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:38.774717  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2758) took 2564 ms. Trace:
I20260709 13:01:38.665277  5892 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:38.713362  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1628) took 2560 ms. Trace:
I20260709 13:01:38.776026  1546 rpcz_store.cc:276] 0709 13:01:36.152521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.620967 (+2468446us) service_pool.cc:224] Handling call
0709 13:01:38.621393 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.713122 (+ 91729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.713312 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.777379  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2761) took 2566 ms. Trace:
I20260709 13:01:38.777617  1546 rpcz_store.cc:276] 0709 13:01:36.210954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.776816 (+2565862us) service_pool.cc:224] Handling call
0709 13:01:38.777034 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.777165 (+   131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.777181 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:38.777210 (+    29us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:38.777234 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.777267 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.777339 (+    72us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:38.669907  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 603) took 2433 ms (client timeout 3046 ms). Trace:
I20260709 13:01:38.715461  6070 consensus_queue.cc:237] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:38.717485  6138 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:38.720990  6120 log.cc:927] Time spent T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 1.609s	user 0.013s	sys 0.000s
I20260709 13:01:38.730784  6123 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.722101  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 2467) took 1387 ms. Trace:
I20260709 13:01:38.782868  1696 rpcz_store.cc:276] 0709 13:01:37.334415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.286603 (+952188us) service_pool.cc:224] Handling call
0709 13:01:38.721878 (+435275us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54002251d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:38.722035 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754540416}
I20260709 13:01:38.783804  6123 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:38.783947  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1624) took 2632 ms. Trace:
I20260709 13:01:38.723635  1542 rpcz_store.cc:276] 0709 13:01:36.153737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.664247 (+2510510us) service_pool.cc:224] Handling call
0709 13:01:38.664612 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.666380 (+  1768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.674092 (+  7712us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.733613  6020 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:38.766789  6133 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:38.701644  1540 rpcz_store.cc:276] 0709 13:01:36.204686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.699764 (+2495078us) service_pool.cc:224] Handling call
0709 13:01:38.700064 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.700940 (+   876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.701113 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:38.756004  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.763899  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 86527.5us
I20260709 13:01:38.790170  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 605) took 2551 ms. Trace:
I20260709 13:01:38.790506  1540 rpcz_store.cc:276] 0709 13:01:36.239362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.789431 (+2550069us) service_pool.cc:224] Handling call
0709 13:01:38.789714 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.789878 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.789903 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:38.789939 (+    36us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:38.789973 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.790023 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.790122 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:38.763447  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 196702us
W20260709 13:01:38.767172  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 61623.5us
I20260709 13:01:38.792675  1587 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:38.793170  1585 connection.cc:256] RPC call timeout handler was delayed by -2.1531221179999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260709 13:01:38.793800  1585 connection.cc:256] RPC call timeout handler was delayed by -2.0176788160000569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
W20260709 13:01:38.794234  1585 connection.cc:256] RPC call timeout handler was delayed by -1.9105788160000543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
W20260709 13:01:38.767196  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 59582.9us
W20260709 13:01:38.795042  1659 connection.cc:256] RPC call timeout handler was delayed by -2.1090900169999713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
I20260709 13:01:38.768874  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:38.769325  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:38.753566  5415 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:38.725190  6077 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.774926  1538 rpcz_store.cc:276] 0709 13:01:36.210108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.773883 (+2563775us) service_pool.cc:224] Handling call
0709 13:01:38.774104 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.774555 (+   451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.774679 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.798782  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 607) took 2558 ms. Trace:
W20260709 13:01:38.778738  1547 rpcz_store.cc:269] 0709 13:01:36.237583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.543560 (+2305977us) service_pool.cc:224] Handling call
0709 13:01:38.669834 (+126274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.799028  1538 rpcz_store.cc:276] 0709 13:01:36.239937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.798096 (+2558159us) service_pool.cc:224] Handling call
0709 13:01:38.798368 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.798547 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.798571 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:38.798614 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:38.798637 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.798671 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.798741 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.799605  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:38.800648  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 608) took 2560 ms. Trace:
I20260709 13:01:38.800999  1538 rpcz_store.cc:276] 0709 13:01:36.240222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.799884 (+2559662us) service_pool.cc:224] Handling call
0709 13:01:38.800164 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.800342 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.800375 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:38.800419 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:38.800453 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.800507 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.800598 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.802294  1538 raft_consensus.cc:1240] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:38.802814  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 612) took 2561 ms. Trace:
I20260709 13:01:38.803344  5970 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.804070  5970 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.806190  6033 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:38.798148  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:38.808910  6020 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:38.815267  2244 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
W20260709 13:01:38.817785  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.780894  1546 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:38.786425  1542 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:38.679387  1695 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:38.794545  1585 connection.cc:256] RPC call timeout handler was delayed by -1.8840291399999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 13:01:38.795720  2238 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:38.772579  6158 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:38.796881  1659 connection.cc:256] RPC call timeout handler was delayed by -2.015770797000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
I20260709 13:01:38.784392  1539 rpcz_store.cc:276] 0709 13:01:36.151541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.152325 (+   784us) service_pool.cc:224] Handling call
0709 13:01:36.178756 (+ 26431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:36.295490 (+116734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:36.295535 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:36.296141 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 13:01:36.523380 (+227239us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:37.730983 (+1207603us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b180046cd80. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc4912d34bc 00007fc48e62148b 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63b455 00007fc4951233c7 00007fc4917359a7 00007fc4917450bf
0709 13:01:37.731136 (+   153us) log.cc:844] Serialized 14 byte log entry
0709 13:01:37.731375 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.731464 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.720283 (+988819us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:38.783735 (+ 63452us) raft_consensus.cc:1685] finished
0709 13:01:38.783758 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.783889 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31825,"prepare.queue_time_us":272636,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":24309,"raft.queue_time_us":32232,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":201,"spinlock_wait_cycles":434116096,"thread_start_us":575414,"threads_started":3,"wal-append.queue_time_us":815444}
I20260709 13:01:38.750650  6136 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.820396  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2772) took 2607 ms. Trace:
I20260709 13:01:38.826107  1542 rpcz_store.cc:276] 0709 13:01:36.213426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.785883 (+2572457us) service_pool.cc:224] Handling call
0709 13:01:38.786145 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.820081 (+ 33936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.820328 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.819320  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2764) took 2607 ms. Trace:
W20260709 13:01:38.820883  1585 connection.cc:256] RPC call timeout handler was delayed by -1.8592788160000282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
W20260709 13:01:38.827651  1585 connection.cc:256] RPC call timeout handler was delayed by -1.8511788160000151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
I20260709 13:01:38.827574  1546 rpcz_store.cc:276] 0709 13:01:36.211655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.778170 (+2566515us) service_pool.cc:224] Handling call
0709 13:01:38.778360 (+   190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.819035 (+ 40675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.819262 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:38.828148  1585 connection.cc:256] RPC call timeout handler was delayed by -1.7833896259999733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
W20260709 13:01:38.828454  1585 connection.cc:256] RPC call timeout handler was delayed by -1.5240291399999819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
W20260709 13:01:38.828724  1585 connection.cc:256] RPC call timeout handler was delayed by -1.51248962599999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
I20260709 13:01:38.803120  1538 rpcz_store.cc:276] 0709 13:01:36.241502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.801863 (+2560361us) service_pool.cc:224] Handling call
0709 13:01:38.802128 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.802608 (+   480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.802765 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:38.829094  1585 connection.cc:256] RPC call timeout handler was delayed by -1.5046788160000233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2621s for a response
W20260709 13:01:38.829394  1585 connection.cc:256] RPC call timeout handler was delayed by -1.4845896260000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 13:01:38.822135  1659 connection.cc:256] RPC call timeout handler was delayed by -1.772770797000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
W20260709 13:01:38.830611  1659 connection.cc:256] RPC call timeout handler was delayed by -1.7157900169999607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26330000000000003s for a response
W20260709 13:01:38.831013  1659 connection.cc:256] RPC call timeout handler was delayed by -1.7073687420000283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 13:01:38.831503  1659 connection.cc:256] RPC call timeout handler was delayed by -1.6328370219999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
W20260709 13:01:38.831941  1659 connection.cc:256] RPC call timeout handler was delayed by -1.6314808449999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:01:38.832335  1659 connection.cc:256] RPC call timeout handler was delayed by -1.4330370220000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
W20260709 13:01:38.832700  1659 connection.cc:256] RPC call timeout handler was delayed by -1.3573921219999647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
W20260709 13:01:38.833107  1659 connection.cc:256] RPC call timeout handler was delayed by -1.2215370220000068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
W20260709 13:01:38.833473  1659 connection.cc:256] RPC call timeout handler was delayed by -1.1667900169999825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32430000000000003s for a response
I20260709 13:01:38.827221  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 618) took 2371 ms. Trace:
W20260709 13:01:38.836020  1659 leader_election.cc:336] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.713s (SENT)
I20260709 13:01:38.835844  1542 rpcz_store.cc:276] 0709 13:01:36.456332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.826687 (+2370355us) service_pool.cc:224] Handling call
0709 13:01:38.826901 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.827018 (+   117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.827033 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:38.827070 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:38.827092 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.827123 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.827184 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.828727  1546 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:38.839196  1547 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:38.839838  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 615) took 2577 ms. Trace:
I20260709 13:01:38.840173  1547 rpcz_store.cc:276] 0709 13:01:36.262161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.817992 (+2555831us) service_pool.cc:224] Handling call
0709 13:01:38.838887 (+ 20895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.839593 (+   706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.839786 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:38.840813  1659 leader_election.cc:336] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.935s (SENT)
I20260709 13:01:38.798158  6165 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:38.842926  2211 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:38.818145  6138 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:38.843816  6001 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:01:38.819094  6173 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:38.854408  6001 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:38.861872  6001 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.861680  6173 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.862495  6001 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:38.863997  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:38.864476  6173 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:38.864846  1691 raft_consensus.cc:2393] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:38.857681  6159 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:38.865372  1691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 2466) took 1531 ms (client timeout 1640 ms). Trace:
I20260709 13:01:38.865613  6159 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:38.865845  1691 rpcz_store.cc:269] 0709 13:01:37.334134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.472187 (+138053us) service_pool.cc:224] Handling call
0709 13:01:38.863833 (+1391646us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b58001c3598. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc4966f10a0 00007fc4966f0984 00007fc48fc6b6d4 00007fc48fc6b662
0709 13:01:38.865287 (+  1454us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4546816}
I20260709 13:01:38.851657  6174 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:01:38.868053  1540 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:38.861687  1543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1632) took 2708 ms (client timeout 1573 ms). Trace:
I20260709 13:01:38.869029  6089 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:38.869241  6159 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:38.869181  1543 rpcz_store.cc:269] 0709 13:01:36.153498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.155719 (+  2221us) service_pool.cc:224] Handling call
0709 13:01:38.861493 (+2705774us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b54003c41d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:38.861613 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5004106112}
I20260709 13:01:38.869978  6159 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.870514  6159 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:38.858749  1546 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:38.872002  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 621) took 2414 ms. Trace:
I20260709 13:01:38.873123  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:38.875310  2246 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:38.875380  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:38.877687  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:38.878402  1691 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:38.878635  1696 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:38.879722  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:38.877023  1546 rpcz_store.cc:276] 0709 13:01:36.457131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.828359 (+2371228us) service_pool.cc:224] Handling call
0709 13:01:38.828621 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.871728 (+ 43107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.871946 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.880307  1689 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:38.877529  6159 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:38.881028  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:38.881783  1695 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:38.882768  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:38.883549  2245 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:38.841645  1659 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:38.826637  6158 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:38.830785  6175 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:01:38.901310  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.902657  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:38.818969  6077 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.893890  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:38.903784  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:38.915802  1511 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:38.870069  5920 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:38.893270  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 52711.4us
I20260709 13:01:38.925269  2211 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:38.928339  2209 leader_election.cc:336] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.592s (SENT)
I20260709 13:01:38.928670  2211 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:38.928952  2209 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:38.930621  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:38.895859  6173 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:38.838838  6171 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
W20260709 13:01:38.933902  2209 leader_election.cc:336] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.621s (SENT)
I20260709 13:01:38.929721  2211 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:38.939672  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 145209us
I20260709 13:01:38.935108  1511 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:38.936069  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:38.841892  6136 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.896533  6174 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:38.937845  1585 connection.cc:256] RPC call timeout handler was delayed by -1.3720209300000192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
I20260709 13:01:38.933495  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:38.936806  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:38.940104  1659 leader_election.cc:336] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.053s (SENT)
I20260709 13:01:38.879069  6144 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.944556  2242 raft_consensus.cc:2393] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 11: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:38.923169  6172 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:38.913563  6168 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:38.923092  6115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.648s	user 0.007s	sys 0.017s
I20260709 13:01:38.940896  1587 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:38.949967  1585 connection.cc:256] RPC call timeout handler was delayed by -1.3635682070000144s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 13:01:38.951293  1659 leader_election.cc:336] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.170s (SENT)
W20260709 13:01:38.997635  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 46448.5us
W20260709 13:01:38.998672  1659 leader_election.cc:336] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.209s (SENT)
I20260709 13:01:39.000382  2237 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
W20260709 13:01:39.001179  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.925973  6089 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:38.944540  1539 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:01:38.959301  2209 leader_election.cc:336] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.902s (SENT)
W20260709 13:01:39.003382  1585 connection.cc:256] RPC call timeout handler was delayed by -1.3205606109999621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2477s for a response
W20260709 13:01:39.003813  1585 connection.cc:256] RPC call timeout handler was delayed by -1.2451209299999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
W20260709 13:01:39.004102  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 44884.8us
I20260709 13:01:38.987015  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:38.937494  6123 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:38.992133  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:38.886418  6138 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:38.951920  6176 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:38.939388  6145 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:39.002743  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 61909us
I20260709 13:01:38.949275  5980 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:38.986263  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:39.044154  2242 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:39.013619  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.014303  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:38.952355  6157 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:39.045140  1694 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:01:38.982445  6033 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:39.043943  5980 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:39.048460  6033 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.048789  5980 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:39.049005  6001 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:39.050498  2239 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:39.052506  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:39.028779  1512 connection.cc:256] RPC call timeout handler was delayed by -1.4773763819999886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 13:01:38.994819  6115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.728s	user 0.007s	sys 0.018s
I20260709 13:01:39.002260  2243 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:39.033213  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:39.034075  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:38.936484  5831 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:01:38.939736  5881 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:39.046388  2246 raft_consensus.cc:2393] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 12: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
W20260709 13:01:39.024592  6105 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.961s	user 0.037s	sys 0.030s
I20260709 13:01:39.046767  6181 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:39.047374  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:39.053179  1689 raft_consensus.cc:2376] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13. Re-sending same reply.
I20260709 13:01:39.088544  1691 raft_consensus.cc:2410] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:01:39.088781  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:39.089011  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:39.034148  5908 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:01:39.035481  6176 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:39.048929  6033 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.089946  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:39.090159  6176 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:38.911813  6175 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:39.091060  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:39.056180  2238 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 10: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:39.091085  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:39.102957  1689 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:38.984179  6174 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:39.088730  6105 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.056s	user 0.037s	sys 0.030s
I20260709 13:01:39.127748  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:39.129153  1689 raft_consensus.cc:2368] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10.
I20260709 13:01:39.098294  1694 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:01:39.003302  6089 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.140336  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:38.986702  6080 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:39.034205  5892 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:39.110432  5986 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.169448  1617 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:38.992452  6172 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:39.112915  6001 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:39.176147  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.042863  5928 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:01:39.113632  6174 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:39.114262  5903 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:39.108664  6171 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:39.053267  6072 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:01:39.119383  6110 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:39.120739  6136 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:39.120999  6175 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:39.121907  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:39.205955  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2463) took 1872 ms. Trace:
I20260709 13:01:39.206132  1691 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:39.052183  6157 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:39.122360  6176 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:39.111335  6165 raft_consensus.cc:697] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:39.122959  6077 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:39.123507  2245 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:39.133370  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:39.141719  2242 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
W20260709 13:01:39.100484  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 67376.1us
I20260709 13:01:39.029794  5920 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:01:39.142590  1689 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:38.997962  6168 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:39.042259  6134 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
W20260709 13:01:39.168629  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 377682us
W20260709 13:01:39.096487  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.219540  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.219920  1512 connection.cc:256] RPC call timeout handler was delayed by -1.048976381999978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
I20260709 13:01:39.217275  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.221621  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:39.173091  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.173676  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1638) took 3018 ms. Trace:
I20260709 13:01:39.143117  6089 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.222776  1617 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:39.223585  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:39.223822  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:39.224267  6077 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.224764  6077 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:39.225050  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:39.225606  1542 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:39.226143  5826 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:39.226752  6077 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:39.226660  5826 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:39.118830  5980 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:39.177528  5986 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:39.194869  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.203400  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.229991  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:39.230882  1545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 611) took 2989 ms (client timeout 2912 ms). Trace:
I20260709 13:01:39.105400  5881 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:39.206607  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.206349  1688 rpcz_store.cc:276] 0709 13:01:37.333083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.336241 (+  3158us) service_pool.cc:224] Handling call
0709 13:01:37.336566 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.287893 (+951327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.205736 (+917843us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b54002242d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:39.205902 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2186115968}
I20260709 13:01:39.099885  6181 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:39.216261  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:39.256675  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 216754us
I20260709 13:01:39.257931  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2454) took 2316 ms. Trace:
I20260709 13:01:39.212965  1585 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:39.217839  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.259703  1619 raft_consensus.cc:2410] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:01:39.222318  1543 raft_consensus.cc:2368] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16.
I20260709 13:01:39.260838  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:39.261878  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.262106  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:39.262743  1543 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:39.207686  6157 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:39.229612  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:39.222793  1544 rpcz_store.cc:276] 0709 13:01:36.154913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.688522 (+2533609us) service_pool.cc:224] Handling call
0709 13:01:38.688921 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:38.729549 (+ 40628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.729580 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:38.730023 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:01:38.788342 (+ 58319us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:39.165782 (+377440us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.173358 (+  7576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.173443 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:39.173489 (+    46us) raft_consensus.cc:1685] finished
0709 13:01:39.173500 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.173623 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40149,"prepare.queue_time_us":421078,"raft.queue_time_us":53455,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":24158,"thread_start_us":432099,"threads_started":2,"wal-append.queue_time_us":76950}
I20260709 13:01:39.264092  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:39.264441  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:39.231918  2244 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45866 (request call id 914) took 1953 ms (client timeout 2057 ms). Trace:
W20260709 13:01:39.265998  2244 rpcz_store.cc:269] 0709 13:01:37.278591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.279399 (+   808us) service_pool.cc:224] Handling call
0709 13:01:39.231767 (+1952368us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400551254. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:39.231862 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3528961408}
W20260709 13:01:39.242730  1545 rpcz_store.cc:269] 0709 13:01:36.241045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.533887 (+2292842us) service_pool.cc:224] Handling call
0709 13:01:39.230732 (+696845us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54000d1454. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:39.230824 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371929472}
W20260709 13:01:39.238780  1692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 1723) took 3109 ms (client timeout 1995 ms). Trace:
I20260709 13:01:39.267527  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:39.268160  1545 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:39.268044  6113 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:39.268991  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:39.269537  1545 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
W20260709 13:01:39.267536  1692 rpcz_store.cc:269] 0709 13:01:36.129008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.132952 (+  3944us) service_pool.cc:224] Handling call
0709 13:01:39.238591 (+3105639us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54002689d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:39.238698 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4889835776}
I20260709 13:01:39.270294  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:39.270825  1545 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:39.229074  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:39.165773  5892 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.271593  1538 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:01:39.271808  5892 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:39.272641  1538 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:39.228619  1586 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:39.264649  1544 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:39.277467  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:39.243470  1512 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:39.278628  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.279215  6049 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:39.279532  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.279809  6049 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.280311  6049 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:39.283954  1512 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:39.258298  2210 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:39.285320  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.258440  1690 rpcz_store.cc:276] 0709 13:01:36.930949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.934528 (+  3579us) service_pool.cc:224] Handling call
0709 13:01:36.934881 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.208622 (+1273741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.247139 (+1038517us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400386654. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:39.247338 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2855965952}
I20260709 13:01:39.287971  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:39.291121  1622 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:39.288733  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:39.285046  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:39.271623  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:39.293677  1545 raft_consensus.cc:2410] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:39.295660  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:39.296114  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 83211us
I20260709 13:01:39.296880  1585 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:39.297181  1512 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:39.298472  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.299882  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.292199  1542 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:39.300565  1619 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:39.228564  6048 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:39.304461  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:39.305347  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 76767.5us
I20260709 13:01:39.307128  1586 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:39.307564  1690 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:01:39.309156  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.248857  6077 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.310083  1585 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:39.229715  6144 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:39.228722  5826 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:39.312389  6020 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:39.317777  1585 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:39.357789  1585 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:39.357947  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:39.359891  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:39.360525  2244 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:39.361368  1587 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:39.360543  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:39.363250  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 338962us
I20260709 13:01:39.311347  6124 raft_consensus.cc:2764] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:01:39.367465  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.306442  5903 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:39.219540  6062 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:39.381130  2209 leader_election.cc:336] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.055s (SENT)
I20260709 13:01:39.368752  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:39.368985  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:39.381915  2242 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:39.350952  1622 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:39.312914  6177 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:39.236416  6165 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:39.309886  6182 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:39.319002  6163 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:39.317445  6048 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:39.383627  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.372138  1587 leader_election.cc:400] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10.
W20260709 13:01:39.425652  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 53633us
I20260709 13:01:39.425848  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.426419  1587 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:39.385053  1511 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:39.356426  6159 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:39.370398  6175 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:39.364903  6020 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:39.383797  6138 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:39.443650  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.437137  1660 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:39.400197  6172 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:39.320328  6077 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:39.471323  6077 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:39.472023  6077 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:39.472436  6077 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.472844  6077 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:39.402204  5970 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:39.403759  6194 log.cc:927] Time spent T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:01:39.404704  6176 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:39.404953  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2765) took 3193 ms (client timeout 1830 ms). Trace:
I20260709 13:01:39.405423  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.395654  6161 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:01:39.407119  6157 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:39.408679  6046 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:39.410554  5957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45866 (request call id 895) took 7026 ms. Trace:
I20260709 13:01:39.410982  6124 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:39.414549  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:39.416208  5986 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:39.417002  6112 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:39.417073  6062 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:39.417912  1546 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 10: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:39.417021  6191 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:39.418711  6168 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:39.419658  6133 consensus_meta.cc:287] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.000s
I20260709 13:01:39.420790  5980 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:39.429330  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:39.554553  2242 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:39.431202  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:39.431799  6209 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:39.414680  6089 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:39.387552  5826 raft_consensus.cc:2764] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:01:39.442752  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 145646us
I20260709 13:01:39.569392  1512 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:39.570677  1512 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:39.398002  6080 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:39.445827  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:39.571854  1694 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:39.446983  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:39.448167  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:39.449164  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.455058  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.460431  6171 consensus_queue.cc:1059] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:39.465020  6090 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:39.406868  6158 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:39.468178  6027 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:39.616410  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 231371us
I20260709 13:01:39.473645  6181 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:39.477960  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.484079  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:39.485363  1541 rpcz_store.cc:269] 0709 13:01:36.211881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.979096 (+767215us) service_pool.cc:224] Handling call
0709 13:01:39.404760 (+2425664us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540006a4d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:39.404888 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3680530176}
W20260709 13:01:39.617969  1693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 2462) took 2285 ms (client timeout 1527 ms). Trace:
I20260709 13:01:39.512157  1618 raft_consensus.cc:2393] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:39.430892  6159 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:39.625304  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:39.626778  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.447365  6020 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:39.447703  6048 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.454746  6196 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:39.538807  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:39.576869  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.580355  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:39.593940  1512 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:39.608352  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:39.609295  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:39.607578  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 249815us
I20260709 13:01:39.674858  1585 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:39.468955  6173 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:39.623929  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:01:39.618489  1693 rpcz_store.cc:269] 0709 13:01:37.332782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.336050 (+  3268us) service_pool.cc:224] Handling call
0709 13:01:39.483930 (+2147880us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b58001c3598. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc4966f10a0 00007fc4966f0984 00007fc48fc6b6d4 00007fc48fc6b662
0709 13:01:39.617882 (+133952us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6991104}
I20260709 13:01:39.532312  1688 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:39.636164  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.673942  1691 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:39.669854  1694 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:39.675405  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:39.675720  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:39.607630  6062 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:39.725078  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 131218us
I20260709 13:01:39.725957  1512 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:39.725989  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 46960.5us
I20260709 13:01:39.727909  1585 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:39.679361  1620 raft_consensus.cc:2368] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:39.606438  6046 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:39.722595  2245 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:39.680335  1618 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
W20260709 13:01:39.719516  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 333276us
I20260709 13:01:39.670778  6159 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:39.735256  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.740880  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.724566  5415 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.737774  1585 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:39.566452  6133 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:39.678898  6194 log.cc:927] Time spent T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:01:39.746001  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.741119  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:39.677289  6173 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.735893  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:39.744103  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:39.677461  6196 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:39.749706  1585 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:39.754031  1613 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:39.735203  6080 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:39.755604  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 311073us
I20260709 13:01:39.582844  6209 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:39.764670  1687 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:39.742676  6181 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:39.742442  6195 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:39.744588  5881 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:39.770097  2242 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:39.753194  6173 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.771392  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 616) took 3500 ms. Trace:
I20260709 13:01:40.077852  1539 rpcz_store.cc:276] 0709 13:01:36.271278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.822799 (+2551521us) service_pool.cc:224] Handling call
0709 13:01:38.823140 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.003384 (+180244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.771129 (+767745us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54000b5754. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:39.771334 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268203776}
W20260709 13:01:40.073990  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 313097us
W20260709 13:01:40.083850  1430 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 479456ab418d44c4983d2bb37eb0e700 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:01:40.231078  1430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 147560us
I20260709 13:01:39.782370  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:39.745400  5415 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:39.531435  5957 rpcz_store.cc:276] 0709 13:01:32.387022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.388686 (+  1664us) service_pool.cc:224] Handling call
0709 13:01:32.737744 (+349058us) ts_tablet_manager.cc:934] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
0709 13:01:36.832021 (+4094277us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:01:39.000088 (+2168067us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:39.031694 (+ 31606us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:01:39.409809 (+378115us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:01:39.410102 (+   293us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:39.410395 (+   293us) ts_tablet_manager.cc:989] Replica registered.
0709 13:01:39.410455 (+    60us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":309,"tablet-copy.queue_time_us":184405,"thread_start_us":317154,"threads_started":2}
I20260709 13:01:40.237257  5957 tablet_copy_client.cc:806] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:40.238663  5957 tablet_copy_client.cc:670] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
W20260709 13:01:39.789836  6033 consensus_meta.cc:287] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.000s
I20260709 13:01:40.240034  6033 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.235162  5415 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:39.802544  6049 consensus_meta.cc:287] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.000s
I20260709 13:01:40.244676  6049 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:40.247751  1547 raft_consensus.cc:2368] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13.
I20260709 13:01:40.249178  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2782) took 1027 ms. Trace:
I20260709 13:01:40.249584  1547 rpcz_store.cc:276] 0709 13:01:39.221527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.223347 (+  1820us) service_pool.cc:224] Handling call
0709 13:01:40.248904 (+1025557us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002e4854. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:40.249103 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2352873216}
I20260709 13:01:39.721217  6048 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:40.252951  6048 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:39.803994  6089 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:39.809091  6133 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:39.799988  6157 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:39.777369  2242 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:39.772305  2245 raft_consensus.cc:1240] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:40.042196  6173 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:39.756640  6196 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.787025  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:40.259799  6173 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:40.262657  6159 consensus_meta.cc:287] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.018s
I20260709 13:01:39.806648  6209 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:39.768064  6080 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:40.263374  6177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.056s	sys 0.082s
W20260709 13:01:40.264775  6177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.057s	sys 0.083s
I20260709 13:01:40.265376  6177 raft_consensus.cc:697] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:40.266273  6080 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:39.812067  6158 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:39.759840  6163 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:40.269753  6163 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:40.270352  6163 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.909888  6175 raft_consensus.cc:697] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:40.272040  6049 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:40.272614  6175 consensus_queue.cc:237] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:40.273377  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 523320us
I20260709 13:01:39.907356  6181 raft_consensus.cc:697] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:01:39.917953  6189 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.561s	user 0.002s	sys 0.003s
I20260709 13:01:39.819320  6171 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:40.281090  6171 raft_consensus.cc:697] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:40.283999  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 661) took 1364 ms. Trace:
W20260709 13:01:39.788311  6206 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:01:39.797611  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:40.306077  6020 consensus_meta.cc:287] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.006s
I20260709 13:01:40.112285  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:01:40.116817  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.307567  2237 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:40.306918  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1755) took 1267 ms. Trace:
I20260709 13:01:40.276969  6181 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:40.150317  2210 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:40.152385  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 658) took 1273 ms. Trace:
I20260709 13:01:40.152173  6164 consensus_queue.cc:1059] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:40.314965  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 880) took 1002 ms. Trace:
I20260709 13:01:40.315249  6158 consensus_queue.cc:1059] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:40.284505  1696 rpcz_store.cc:276] 0709 13:01:38.919118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.919583 (+   465us) service_pool.cc:224] Handling call
0709 13:01:38.920032 (+   449us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:38.927162 (+  7130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.927212 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:38.928003 (+   791us) log.cc:844] Serialized 52 byte log entry
0709 13:01:39.144753 (+216750us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:39.182323 (+ 37570us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.182673 (+   350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.182783 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:39.917601 (+734818us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b24001f7ca8. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e4c49c4 00007fc48e4c2acb 00007fc48e67ddc9 00007fc48e67da55 00007fc48e67d09d 00007fc4912af10e 00007fc4912c688c 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221
0709 13:01:40.283333 (+365732us) raft_consensus.cc:1685] finished
0709 13:01:40.283511 (+   178us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.283769 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52819,"prepare.queue_time_us":37627,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":6823,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":26979,"spinlock_wait_cycles":49507072,"thread_start_us":149587,"threads_started":1,"wal-append.queue_time_us":289766}
I20260709 13:01:40.315936  6164 raft_consensus.cc:3055] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:01:40.154407  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 397674us
I20260709 13:01:40.155867  5826 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:40.273489  6033 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:40.159075  6046 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:40.163583  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.163678  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 606) took 3923 ms. Trace:
I20260709 13:01:40.166594  5967 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:40.167796  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 587253us
I20260709 13:01:40.184839  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:40.196581  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.735555  5892 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:39.955754  6013 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.982525  6191 raft_consensus.cc:3055] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:01:39.995412  6211 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.198s	user 0.003s	sys 0.000s
I20260709 13:01:39.832026  6214 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:01:39.972867  6215 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 13:01:39.996150  6222 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.199s	user 0.000s	sys 0.003s
I20260709 13:01:40.282586  6171 consensus_queue.cc:237] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.437651  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2791) took 1203 ms. Trace:
I20260709 13:01:40.438081  1538 rpcz_store.cc:276] 0709 13:01:39.234526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.274199 (+ 39673us) service_pool.cc:224] Handling call
0709 13:01:39.274464 (+   265us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:39.275638 (+  1174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.275667 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:39.302782 (+ 27115us) log.cc:844] Serialized 52 byte log entry
0709 13:01:39.577871 (+275089us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:39.672527 (+ 94656us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.722171 (+ 49644us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.994647 (+272476us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:40.123225 (+128578us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b1800307f00. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e5b8c0a 00007fc497cf8219 00007fc48e640a40 00007fc48e63b4e4 00007fc48e63b455 00007fc491723060 00007fc491735716 00007fc491746287 00007fc491746208
0709 13:01:40.160643 (+ 37418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.160814 (+   171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:40.437219 (+276405us) raft_consensus.cc:1685] finished
0709 13:01:40.437245 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.437466 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":419638,"prepare.queue_time_us":128905,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":6567,"raft.queue_time_us":486522,"raft.run_cpu_time_us":568,"raft.run_wall_time_us":8172,"spinlock_wait_cycles":44424320,"thread_start_us":199787,"threads_started":1,"wal-append.queue_time_us":414236}
I20260709 13:01:40.444922  6214 raft_consensus.cc:697] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:40.157788  5903 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:40.316550  6158 raft_consensus.cc:3055] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:40.459100  6158 raft_consensus.cc:740] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:40.460451  6158 consensus_queue.cc:260] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.462141  6158 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:40.315009  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 165126us
I20260709 13:01:40.315140  1687 rpcz_store.cc:276] 0709 13:01:38.878583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.893538 (+ 14955us) service_pool.cc:224] Handling call
0709 13:01:40.151915 (+1258377us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b540044b454. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:40.152156 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1955751808}
I20260709 13:01:40.277012  6177 consensus_queue.cc:237] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.321931  5967 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:40.477178  5967 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:40.479372  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:40.480466  1690 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 16: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:40.320145  1540 rpcz_store.cc:276] 0709 13:01:36.239644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.791436 (+2551792us) service_pool.cc:224] Handling call
0709 13:01:38.867853 (+ 76417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.868507 (+   654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.163084 (+1294577us) spinlock_profiling.cc:243] Waited 75.4 ms on lock 0x7b54003c41d0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:40.163416 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173423488}
I20260709 13:01:40.482024  2246 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:40.489743  5967 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.315538  1615 rpcz_store.cc:276] 0709 13:01:39.312156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.750233 (+438077us) service_pool.cc:224] Handling call
0709 13:01:39.764279 (+ 14046us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.080344 (+316065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.080473 (+   129us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:40.081975 (+  1502us) log.cc:844] Serialized 26 byte log entry
0709 13:01:40.224402 (+142427us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:40.224438 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.227164 (+  2726us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:40.314501 (+ 87337us) raft_consensus.cc:1685] finished
0709 13:01:40.314524 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.314705 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128905,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":3706,"thread_start_us":456855,"threads_started":2,"wal-append.queue_time_us":229304}
I20260709 13:01:40.327831  6157 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:40.310514  1692 rpcz_store.cc:276] 0709 13:01:39.039521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.270594 (+231073us) service_pool.cc:224] Handling call
0709 13:01:39.270916 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:39.276090 (+  5174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.276118 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:39.276560 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:01:39.393042 (+116482us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:39.393126 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.393375 (+   249us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:40.306240 (+912865us) raft_consensus.cc:1685] finished
0709 13:01:40.306308 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.306675 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":112995,"threads_started":1,"wal-append.queue_time_us":276937}
I20260709 13:01:40.329689  6033 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:40.513145  6033 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.332469  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:40.335562  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:40.306720  6020 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.340873  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:40.316579  6164 raft_consensus.cc:740] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:40.356114  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:40.367879  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.367908  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:40.379899  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 653830us
I20260709 13:01:40.384534  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.388002  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:40.390129  1689 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:01:40.392123  6077 consensus_meta.cc:287] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.910s	user 0.011s	sys 0.012s
I20260709 13:01:40.395143  1614 raft_consensus.cc:2368] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16.
W20260709 13:01:40.404050  6234 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:40.427615  2237 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:40.403014  5892 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:40.431545  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 46769.2us
I20260709 13:01:40.404948  6165 consensus_queue.cc:1059] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:01:40.446630  6214 consensus_queue.cc:237] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:40.458104  6013 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:40.432212  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 118273us
I20260709 13:01:40.281435  6159 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:40.517068  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 241774us
I20260709 13:01:40.458087  6191 raft_consensus.cc:740] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:40.547482  6080 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:40.548082  6080 raft_consensus.cc:697] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:40.549073  6080 consensus_queue.cc:237] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.556602  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2866) took 1278 ms. Trace:
I20260709 13:01:40.556780  1512 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:40.538480  2242 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:40.559015  6020 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:40.537652  2245 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:40.545207  5967 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:40.537972  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 202488us
I20260709 13:01:40.541672  6196 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:40.544304  6033 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:40.544932  1586 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:40.545177  6165 raft_consensus.cc:3055] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:40.545305  1688 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:40.545890  1696 raft_consensus.cc:2368] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:01:40.546725  6182 consensus_queue.cc:1059] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:01:40.516060  6157 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.596236  6157 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:40.596338  5892 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:40.597050  5892 raft_consensus.cc:697] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:40.598268  5892 consensus_queue.cc:237] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.585346  5903 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:40.557087  1511 leader_election.cc:336] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 1.640s (SENT)
W20260709 13:01:40.591509  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 56813.9us
I20260709 13:01:40.583308  6165 raft_consensus.cc:740] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:40.592075  1512 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:40.592700  2239 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:40.557104  1614 rpcz_store.cc:276] 0709 13:01:39.278316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.279327 (+  1011us) service_pool.cc:224] Handling call
0709 13:01:40.556333 (+1277006us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54003fff54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:40.556507 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2562774272}
W20260709 13:01:40.618263  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 61205.5us
I20260709 13:01:40.561599  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:40.624315  2245 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:40.625067  1585 leader_election.cc:400] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:01:40.625136  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:01:40.629510  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 150562us
I20260709 13:01:40.561625  6163 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:40.561894  6077 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.622267  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:40.643334  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2871) took 1363 ms. Trace:
I20260709 13:01:40.643857  1622 rpcz_store.cc:276] 0709 13:01:39.279618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.426700 (+147082us) service_pool.cc:224] Handling call
0709 13:01:40.642884 (+1216184us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003809d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:40.643096 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2403214208}
I20260709 13:01:40.652598  1511 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:40.655838  6237 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:40.656405  6237 raft_consensus.cc:697] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:40.657004  2242 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:40.665763  1585 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:40.667701  6020 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:40.668076  6020 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:40.668437  6020 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:40.668913  6077 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:40.660539  5903 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:40.669976  5903 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.670357  5903 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:40.672669  1585 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:40.673565  6158 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:40.675050  6158 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:40.677534  6175 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:40.678194  6175 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:40.679447  6237 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.680280  6175 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.686923  6173 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:40.687434  6173 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:40.687847  6173 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:40.690855  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:40.691311  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 73207.9us
I20260709 13:01:40.692519  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:40.690912  6165 consensus_queue.cc:260] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.693903  6165 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:40.695936  6133 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:40.696447  6133 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:40.696820  6133 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:40.699853  1587 leader_election.cc:400] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:01:40.701506  6171 consensus_queue.cc:1059] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:40.704746  6159 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:40.701512  1512 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:40.699783  1511 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:40.715413  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 51167.7us
I20260709 13:01:40.715090  6033 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:40.719580  6033 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:40.719703  1659 leader_election.cc:336] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.782s (SENT)
I20260709 13:01:40.720041  6033 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:40.720247  1659 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:40.720372  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.721602  5967 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:40.722607  1613 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:01:40.723044  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.723161  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.665342  6164 consensus_queue.cc:260] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.724851  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.727779  6163 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:40.727914  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.722630  6196 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:40.730369  1512 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:40.730525  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.731359  6046 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:40.724459  6191 consensus_queue.cc:260] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:40.732460  6191 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:40.733145  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.733049  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.737443  6013 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:40.738067  5826 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:40.738905  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.733325  1512 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:40.741649  1688 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:40.758831  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:40.738626  5826 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:40.763520  6048 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:40.764509  6048 raft_consensus.cc:697] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:40.764274  5826 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.765699  6048 consensus_queue.cc:237] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:40.768944  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.770237  2211 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:40.771837  2211 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:40.771965  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.772730  1613 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:01:40.772826  6136 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:40.773535  6136 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:40.773792  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.738632  6164 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:40.775980  1615 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:40.777064  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.777107  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.778323  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.778587  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.775163  2211 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:40.775013  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:40.780020  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:40.780174  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.781008  1613 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:40.781136  1621 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
I20260709 13:01:40.781667  6136 consensus_queue.cc:1059] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:40.780121  6248 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:40.782867  6136 raft_consensus.cc:3055] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:40.779198  1615 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 11: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:40.783361  6136 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:40.784340  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:40.784832  1616 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:01:40.784426  6136 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.786105  6136 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:40.787582  6133 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.788769  2210 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:40.789671  6133 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:40.790149  6123 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:40.790558  6123 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.790868  6123 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:40.781968  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.791981  1613 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 14: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:40.791841  6020 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.794207  6020 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:40.796550  1620 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 16: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:40.785346  1615 raft_consensus.cc:1240] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:40.807607  1511 leader_election.cc:336] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 1.876s (SENT)
I20260709 13:01:40.809113  1619 raft_consensus.cc:1240] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:40.812798  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.808501  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:40.794335  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:40.816725  1620 raft_consensus.cc:2410] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:01:40.819409  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:40.822291  1622 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:40.838706  1692 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:40.842691  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 61241us
I20260709 13:01:40.848994  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.848784  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:40.865459  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 46744.2us
I20260709 13:01:40.872630  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:40.873312  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.878362  1616 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
W20260709 13:01:40.878919  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 71361.9us
I20260709 13:01:40.882063  1687 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:01:40.885273  1617 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 14: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:40.886986  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:40.891181  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.892724  2237 raft_consensus.cc:2393] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 10: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:40.894801  2211 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:40.901535  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.920176  6013 raft_consensus.cc:2764] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:01:40.924841  1660 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:40.926635  5967 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:40.911948  2239 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45882 (request call id 845) took 1808 ms (client timeout 1953 ms). Trace:
W20260709 13:01:40.927798  2239 rpcz_store.cc:269] 0709 13:01:39.087882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.088801 (+   919us) service_pool.cc:224] Handling call
0709 13:01:40.890319 (+1801518us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54005da2d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:40.895779 (+  5460us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3435817344}
I20260709 13:01:40.889794  6237 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:40.927484  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.952800  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.953313  1617 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:01:40.935959  5967 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.953994  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.931006  6133 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.955011  6133 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:40.936518  6080 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:40.956414  6080 raft_consensus.cc:697] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:40.957473  6080 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:40.957598  6033 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
W20260709 13:01:40.937654  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 125760us
I20260709 13:01:40.947250  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.947458  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.960713  1512 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:40.909160  6157 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.961596  5826 consensus_queue.cc:1059] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:40.962396  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.962744  5826 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:40.962929  6157 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:40.963276  1617 raft_consensus.cc:2410] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:01:40.963416  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2869) took 1616 ms. Trace:
I20260709 13:01:40.963485  5826 raft_consensus.cc:3055] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:40.948176  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.963941  1618 rpcz_store.cc:276] 0709 13:01:39.279106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.743888 (+464782us) service_pool.cc:224] Handling call
0709 13:01:40.890051 (+1146163us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b540024ead4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:40.895349 (+  5298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2008506240}
I20260709 13:01:40.965059  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.946719  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:40.960774  1615 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:01:40.965338  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:40.973033  1511 leader_election.cc:336] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 1.854s (SENT)
I20260709 13:01:40.973567  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:40.964071  5826 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:01:40.974189  1511 leader_election.cc:336] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 1.855s (SENT)
I20260709 13:01:40.974642  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:40.974797  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.999645  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:40.993513  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:40.988446  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:40.979521  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:40.979496  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:41.004015  6033 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:41.004887  1620 raft_consensus.cc:2410] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:01:40.981384  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:41.014387  1692 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:40.997361  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:40.982105  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:40.975564  1659 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.824s (SENT)
I20260709 13:01:40.978266  6157 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:40.983470  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.982535  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:41.006361  1541 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:40.986088  6133 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:40.976773  5826 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:40.982189  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 93861.4us
I20260709 13:01:40.991894  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:40.976423  6173 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:40.992695  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:40.976310  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:41.028983  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:41.030073  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:41.052865  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:40.904392   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:41.054472  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:41.055315  1620 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 16: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:41.033238  1619 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 13:01:41.055794  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 81628.1us
I20260709 13:01:41.056542  6173 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:41.057317  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.984540  6123 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.060092  1511 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:41.061749  1688 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:41.043996  1539 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 10: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:41.044363  1546 raft_consensus.cc:2376] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13. Re-sending same reply.
I20260709 13:01:41.062781  1613 raft_consensus.cc:2410] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:01:41.045002  6227 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:01:41.048120  2237 raft_consensus.cc:2393] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 10: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:41.048735  2211 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:41.035028  6157 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.050148  6133 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:41.047407  6048 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:41.050406  1614 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:41.051708  2242 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:41.052598  5903 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:41.053776  2209 leader_election.cc:336] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.912s (SENT)
I20260709 13:01:41.014741  5967 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:41.043598  1538 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:01:41.061522  1547 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:01:41.031622  1615 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 14: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:41.061556  6123 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:41.090281  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:41.095856  1618 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:41.095734  2209 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:41.103735  5826 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:41.103988  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.104777  1547 raft_consensus.cc:2393] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:41.105479  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.105767  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.106235  1540 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:01:41.106532  1547 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:41.106879  6046 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.107597  6046 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.111276  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:41.112267  1538 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 10: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:41.113307  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.115367  6133 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.116425  1542 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:41.118461  6133 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:41.093848  6237 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:41.110320  6046 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:41.121929  6157 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:41.123389  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 147842us
W20260709 13:01:41.134565  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.123325  1541 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:41.127449  2211 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:41.127691  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.133391  1539 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:41.146314  1542 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 10: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:41.082592  6013 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:41.149096  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 224340us
I20260709 13:01:41.150327  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:41.153105  2242 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:41.151623  1587 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:41.150759  6157 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:41.159844  6237 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:41.160048  6013 raft_consensus.cc:697] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:01:41.174587  1659 leader_election.cc:336] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.830s (SENT)
I20260709 13:01:41.164294  6136 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:01:41.175287  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 79096.7us
I20260709 13:01:41.166332  6164 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:41.171975  5967 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:41.195364  6237 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:41.232007  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.230624  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:41.256058  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 116040us
W20260709 13:01:41.231715  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 57161.1us
I20260709 13:01:41.226917  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:41.276872  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 223264us
I20260709 13:01:41.222993  6080 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.231504  1692 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:41.226121  6046 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:41.276899  6164 raft_consensus.cc:697] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:41.301433  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:41.303707  1542 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:41.305210  1511 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:41.170089  6163 consensus_queue.cc:1059] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.114s
I20260709 13:01:41.276561  6237 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:41.305410  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 78624.4us
I20260709 13:01:41.231506  1443 catalog_manager.cc:5697] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 8 to 13, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:41.310112  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 79615.1us
I20260709 13:01:41.300015  6123 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:41.313158  2239 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:41.285523  1618 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:01:41.299834  6263 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:41.315814  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.318214  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.323560  2237 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:41.309967  6173 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.327819  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.311982  5903 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:41.330994  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 105696us
I20260709 13:01:41.258927  6013 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.315544  6033 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:41.301265  5967 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.307454  6046 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:41.338006  6046 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:41.338723  2211 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:41.305030  6080 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.349915  5967 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:41.356505  6214 raft_consensus.cc:3055] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:41.356951  6214 raft_consensus.cc:740] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:41.358786  5892 consensus_queue.cc:1059] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:41.360349  6020 raft_consensus.cc:3055] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:41.360749  6020 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:41.361722  6020 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.370472  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:41.340282  6163 consensus_queue.cc:1059] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:01:41.377281  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:41.378109  6163 raft_consensus.cc:3055] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:41.378473  6163 raft_consensus.cc:740] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:41.379531  5903 consensus_queue.cc:1059] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:41.380497  5826 consensus_queue.cc:1059] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:41.380654  5903 raft_consensus.cc:3055] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:41.381147  1688 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:41.381511  5826 raft_consensus.cc:3055] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:41.382033  5826 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:41.379274  6163 consensus_queue.cc:260] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.382951  6163 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:41.381546  5903 raft_consensus.cc:740] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:41.384150  6080 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:41.384809  5967 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:41.384389  5903 consensus_queue.cc:260] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.385824  5903 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:41.385950  6196 consensus_queue.cc:1175] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "822e08445eae4a33b2f2fe92060192c6" responder_term: 10 status { last_received { term: 10 index: 10 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:41.387420  6164 consensus_queue.cc:237] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:41.388341  1659 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:41.388760  6227 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:41.389945  5967 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:41.390687  6077 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.391208  6077 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.393297  6077 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:41.382936  5826 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:41.357788  6214 consensus_queue.cc:260] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:41.394079  6264 log.cc:927] Time spent T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.111s	user 0.002s	sys 0.000s
I20260709 13:01:41.395226  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:41.395810  1695 raft_consensus.cc:2376] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9. Re-sending same reply.
I20260709 13:01:41.396148  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:41.396646  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:41.397346  1688 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 11: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:41.398114  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:41.398540  1542 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:41.399798  5826 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:41.400369  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:41.342344  6173 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:41.404106  6046 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:41.393970  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:41.405191  6173 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:41.405336  1692 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:41.394992  6214 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:41.408231  1443 catalog_manager.cc:5697] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 7 to 10, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:41.410378  1511 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:41.410012  1443 catalog_manager.cc:5697] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index -1 to 10, term changed from 12 to 14, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 14 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:01:41.411506  6077 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:41.412041  1443 catalog_manager.cc:5697] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 10 to 11, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:41.412950  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:41.414746  1511 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:41.363052  6020 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:41.415405  6077 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:41.414124  1443 catalog_manager.cc:5697] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:41.445178  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 110596us
I20260709 13:01:41.451416  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:41.451927  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:41.452358  1618 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:41.452550  1614 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:01:41.432010  6136 raft_consensus.cc:2764] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:41.476222  1614 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
W20260709 13:01:41.477401  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 62713.3us
W20260709 13:01:41.480217  1659 leader_election.cc:336] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.919s (SENT)
I20260709 13:01:41.455892  1443 catalog_manager.cc:5697] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 9 to 10, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.468461  6046 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:41.449110  6077 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.490572  1659 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:41.489327  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 125789us
I20260709 13:01:41.491925  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:41.493640  2210 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:41.495649  1618 raft_consensus.cc:1240] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:41.505477  6048 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:41.506632  6013 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:41.507218  6013 raft_consensus.cc:697] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:41.511544  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:41.512759  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:41.513531  1696 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:41.514323  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:41.514911  1695 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:41.515765  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:41.516621  1689 raft_consensus.cc:2410] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:01:41.517460  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:41.518007  1690 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:41.519685  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:41.507732  6248 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.521072  6136 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.521225  6248 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.521771  6136 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.523993  6248 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:41.531697  6013 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.541842  1690 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:41.555822  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:41.556671  1693 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:01:41.560132  1441 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42132 (request call id 241) took 18138 ms (client timeout 15000 ms). Trace:
I20260709 13:01:41.578534  6260 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:41.580494  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 111566us
I20260709 13:01:41.600246  1659 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:41.602990  1443 catalog_manager.cc:5697] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.617125  1660 leader_election.cc:400] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:41.617470  1660 leader_election.cc:403] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:41.615109  6159 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.540143  6077 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:41.621486  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 133015us
I20260709 13:01:41.624547  6159 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.624909  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:41.625773  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:41.627418  6247 log.cc:927] Time spent T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:41.628902  1659 leader_election.cc:400] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13.
I20260709 13:01:41.640367  1659 leader_election.cc:403] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:41.630411  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:41.618717  1443 catalog_manager.cc:5697] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 10 to 13, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:41.620410  6080 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:41.643086  1690 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:01:41.644055  1689 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 8: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:01:41.644693  1659 leader_election.cc:336] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.955s (SENT)
I20260709 13:01:41.645107  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:41.646311  1659 leader_election.cc:336] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.029s (SENT)
I20260709 13:01:41.646716  1659 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:41.648399  1511 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:41.649508  5826 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:41.650218  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:41.609514  6173 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:01:41.652779  6033 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:41.654268  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 52759.1us
I20260709 13:01:41.654695  6048 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:41.655565  5967 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:41.656757  1660 leader_election.cc:400] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16.
I20260709 13:01:41.657174  1660 leader_election.cc:403] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:41.601541  6237 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.665568  6237 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:41.666149  1688 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:41.670748  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:41.684262  1687 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:41.684719  1660 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:41.637303  6263 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
W20260709 13:01:41.560675  1441 rpcz_store.cc:269] 0709 13:01:23.422125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.455451 (+ 33326us) service_pool.cc:224] Handling call
0709 13:01:41.559870 (+18104419us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:38.203364 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:38.292801 (+ 89437us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:38.292844 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:01:38.292865 (+    21us) tablet.cc:662] Decoding operations
0709 13:01:38.354371 (+ 61506us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:38.354449 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:38.354478 (+    29us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:01:38.615509 (+261031us) tablet.cc:701] Row locks acquired
0709 13:01:38.624374 (+  8865us) write_op.cc:260] PREPARE: finished
0709 13:01:38.667752 (+ 43378us) write_op.cc:270] Start()
0709 13:01:38.677293 (+  9541us) write_op.cc:276] Timestamp: P: 1783602098666323 usec, L: 0
0709 13:01:38.679156 (+  1863us) op_driver.cc:348] REPLICATION: starting
0709 13:01:38.788181 (+109025us) log.cc:844] Serialized 9059 byte log entry
0709 13:01:39.107718 (+319537us) op_driver.cc:464] REPLICATION: finished
0709 13:01:39.276650 (+168932us) write_op.cc:301] APPLY: starting
0709 13:01:39.276746 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:39.969462 (+692716us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:39.969591 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:40.181971 (+212380us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:40.182938 (+   967us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:01:40.183006 (+    68us) write_op.cc:312] APPLY: finished
0709 13:01:40.211838 (+ 28832us) log.cc:844] Serialized 204 byte log entry
0709 13:01:40.511305 (+299467us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:40.511752 (+   447us) write_op.cc:454] Released schema lock
0709 13:01:40.511847 (+    95us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:40.512556 (+   709us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:40.512598 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":594,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":141784,"apply.run_cpu_time_us":61084,"apply.run_wall_time_us":1235757,"cfile_cache_hit":90,"cfile_cache_hit_bytes":94230,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6221,"cfile_init":2,"lbm_read_time_us":63611,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":10,"num_ops":23,"prepare.queue_time_us":773864,"prepare.run_cpu_time_us":10570,"prepare.run_wall_time_us":592240,"replication_time_us":409093,"thread_start_us":502349,"threads_started":3,"wal-append.queue_time_us":295145,"wal-append.run_cpu_time_us":1521,"wal-append.run_wall_time_us":1026192}]]}
W20260709 13:01:41.710966  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 51012.9us
I20260709 13:01:41.706878  1443 catalog_manager.cc:5697] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:41.710283  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:41.720587  1443 catalog_manager.cc:5697] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:41.726192  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:41.669844  5826 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:41.727489  2239 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:41.727943  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:41.733489  1618 raft_consensus.cc:2410] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:01:41.731190  1690 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:41.726263  6237 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:01:41.740772  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 94486.5us
I20260709 13:01:41.726794  6260 consensus_queue.cc:1059] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:01:41.741536  1659 leader_election.cc:336] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.045s (SENT)
I20260709 13:01:41.731873  6227 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
W20260709 13:01:41.742429  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.717839  6173 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16.
I20260709 13:01:41.734354  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:41.744100  5903 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:41.744479  6286 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:41.744750  5903 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:41.745215  6286 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:41.745674  6286 raft_consensus.cc:697] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:41.746861  5903 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:41.737893  6271 consensus_queue.cc:1059] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:01:41.748013  6260 raft_consensus.cc:3055] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:41.748395  6260 raft_consensus.cc:740] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:41.749202  6260 consensus_queue.cc:260] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:41.744128  6262 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:41.750393  6262 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.750468  6260 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:41.750810  6262 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:41.746529  6286 consensus_queue.cc:237] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:41.751821  6276 log.cc:927] Time spent T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:01:41.752245  6227 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:41.717020  5967 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:01:41.743176  1659 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.196s (SENT)
I20260709 13:01:41.756574  2209 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:41.757356  2238 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:41.757894  6077 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:41.729197  6020 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:01:41.759441  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:41.759711  6273 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:41.760044  2242 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 7.
W20260709 13:01:41.756505  1659 leader_election.cc:336] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.225s (SENT)
I20260709 13:01:41.738039  1443 catalog_manager.cc:5697] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 7 to 8, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:41.763651  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.766072  6157 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:41.725569  6046 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:41.766496  6157 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:41.766530  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.768949  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.771960  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.756423  6159 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:41.769711  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:41.770538  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.772142  1542 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:41.769647  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.772637  1538 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:41.772490  1443 catalog_manager.cc:5697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 6 to 9, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:41.771445  1544 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:41.780150  1546 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:41.780535  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.779664  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.786586  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.786842  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.787303  1547 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:41.788353  1443 catalog_manager.cc:5697] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.790110  1541 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:41.774032  6157 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:41.793322  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.794188  1542 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:41.799965  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:41.802492  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.805596  1693 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
W20260709 13:01:41.814996  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.816049  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.816443  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:41.863694  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.816124  1443 catalog_manager.cc:5697] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 12 to 13, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 13 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:41.816915  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:41.817920  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 107697us
I20260709 13:01:41.819265  1540 raft_consensus.cc:2410] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:41.819296  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:41.820639  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 64170.3us
I20260709 13:01:41.819640  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:41.864046  1543 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:41.822397  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:41.825140  1545 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:41.835948  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:41.836633  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:41.837313  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.837477  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:41.839998  6283 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:01:41.843091  6280 raft_consensus.cc:3055] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:41.846196  6136 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:41.879842  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.850015  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:41.897926  1690 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:41.849792  6273 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:41.850749  6290 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:41.851589  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:41.851650  6271 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:41.855618  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:41.856194  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.855595  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:41.819614  6214 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:41.911190  1696 raft_consensus.cc:2410] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:01:41.860687  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:41.880375  1539 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:41.880635  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:41.912276  2242 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:41.881093  1544 raft_consensus.cc:2368] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16.
I20260709 13:01:41.883543  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.884160  6286 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:41.887388  6280 raft_consensus.cc:740] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:41.888612  6262 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:41.922523  1443 catalog_manager.cc:5697] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:41.847303  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:41.895025  1692 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:41.875344  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.902165  1693 raft_consensus.cc:1275] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:41.902580  1688 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:41.902243  1547 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:41.913328  1540 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
W20260709 13:01:41.912186  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 133948us
I20260709 13:01:41.916661  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.929136  1443 catalog_manager.cc:5697] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:41.931080  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:41.933743  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.940778  2242 raft_consensus.cc:1275] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:41.944253  1547 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 15: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:41.944854  1586 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:41.926091  6157 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.949189  6157 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:41.950348  6214 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:41.953356  6214 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:41.955006  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:41.955490  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.955675  1694 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:41.956040  1540 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:41.956938  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.957497  1540 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:41.958320  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.958840  1540 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:41.959954  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:41.961033  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.962097  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.962745  1544 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:41.963569  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:41.964167  1696 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:41.967377  1693 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:41.968392  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:41.982834  1541 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:41.983469  1690 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
W20260709 13:01:41.984577  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 68466.1us
I20260709 13:01:41.986414  1511 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:41.987187  1539 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:41.928239  6080 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13.
I20260709 13:01:41.987862  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:41.989375  1690 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:41.990116  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:41.991861  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.992266  1547 raft_consensus.cc:1240] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:01:41.992450  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.992797  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:41.995668  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:41.916443  6286 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:42.001595  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:42.002252  2242 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:42.003626  2211 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:42.001658  1443 catalog_manager.cc:5697] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 10 to 11, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:42.006708  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:42.005764  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:41.982834  1660 connection.cc:256] RPC call timeout handler was delayed by -1.2662233600000263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
I20260709 13:01:42.010020  1615 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:42.010164  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:42.011055  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:42.011938  1547 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:42.012768  1544 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 13: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:42.016472  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:42.019454  6280 consensus_queue.cc:260] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:42.037384  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:42.038239  1543 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:42.038589  6280 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:42.038815  1443 catalog_manager.cc:5697] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 6 to 7, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:42.041463  1443 catalog_manager.cc:5697] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.043483  6048 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:42.044005  6048 raft_consensus.cc:697] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:42.044590  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:42.044899  6048 consensus_queue.cc:237] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:42.046373  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:42.047605  6123 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:41.981206  6164 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:01:42.049387  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:41.998037  6196 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.021615  6262 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:42.022631  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:42.023116  6289 log.cc:927] Time spent T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:42.052402  1547 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:42.028751  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.042903  1443 catalog_manager.cc:5697] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 6 to 10, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:42.053462  1546 raft_consensus.cc:2410] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:42.054503  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:42.053977  1443 catalog_manager.cc:5697] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 7 to 8, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:42.030777  1688 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
W20260709 13:01:42.056363  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 52892.3us
I20260709 13:01:42.056587  1688 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:42.033464  1542 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:42.011888  1622 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:42.020844  6286 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:42.050804  1543 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:42.038255  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.051533  6196 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:41.982522  6191 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:42.059486  1692 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:42.050676  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:42.062520  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:42.031453  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 45112us
I20260709 13:01:42.064459  1538 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:42.065148  1539 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:01:42.009123  1541 raft_consensus.cc:2368] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15.
I20260709 13:01:42.087338  1540 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:01:42.086404  1545 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:42.096386  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:42.092357  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.103700  1542 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:42.097441  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:42.107647  2239 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:42.110023  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:42.110389  2237 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:42.112141  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:42.113237  1545 raft_consensus.cc:1275] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:42.112283  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:42.088871  6191 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.119686  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.125029  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:42.125584  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:42.125908  1614 raft_consensus.cc:2410] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:01:42.126860  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.128333  2237 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:42.131079  6046 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:42.131587  6046 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.131954  6046 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:42.132421  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:42.136730  1613 raft_consensus.cc:1275] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:42.128364  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.142326  1539 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 10: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:42.122812  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:01:42.137512  1659 leader_election.cc:336] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.597s (SENT)
I20260709 13:01:42.143785  1659 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:42.146785  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:42.151072  1542 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:42.151728  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:42.152957  1696 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:01:42.154973  1622 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 16: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:42.155853  1541 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:42.157177  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.159300  1542 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:01:42.091598  6165 consensus_queue.cc:1059] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:01:42.137075  6191 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:42.164428  1613 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:42.181075  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:42.173710  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 50964.2us
W20260709 13:01:42.173853  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 61791.1us
I20260709 13:01:42.122711  6196 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:42.162192  1542 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:42.174044  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.184878  1539 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:42.185129  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.159850  6033 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:42.186767  1547 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:01:42.182159  1511 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:42.159719  6173 raft_consensus.cc:2764] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:01:42.194308  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:42.198544  1543 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:42.204627  1546 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:42.207063  1542 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:01:42.208058  1547 raft_consensus.cc:1240] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:42.173508  6020 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.181139  6227 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:42.212036  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 74544.2us
I20260709 13:01:42.211787  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.195397  6033 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.228391  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:42.198230  5903 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:42.229197  2237 raft_consensus.cc:2393] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 11: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:42.231577  2211 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:42.258863  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.255749  1659 leader_election.cc:336] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.633s (SENT)
I20260709 13:01:42.268289  1659 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:42.233955  6033 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:42.260460  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.272470  1543 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
W20260709 13:01:42.260924  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.255555  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.263393  1696 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:42.264739  1690 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:42.264663  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:42.251466  6287 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.116s
I20260709 13:01:42.269125  1614 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:42.232164  6077 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:42.269860  6123 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:42.263679  6196 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.278831  6260 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:42.271281  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.310132  1541 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
W20260709 13:01:42.283506  6293 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:01:42.284227  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 90019.8us
I20260709 13:01:42.220088  6262 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:01:42.284577  6214 consensus_queue.cc:1059] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:42.286342  1587 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:42.286590  6288 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:42.290462  2239 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:42.253089  6271 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
W20260709 13:01:42.299866  6297 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:01:42.231930  6020 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:42.361752  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 75463.8us
I20260709 13:01:42.303073  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:42.354713  2237 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:42.308706  1615 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:42.362735  1690 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:42.305836  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:42.350406  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:42.312021  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:42.364382  1543 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:01:42.336774  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.352937  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.226720  6227 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:42.364463  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 58702.1us
I20260709 13:01:42.365638  1660 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:42.368862  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:42.308530  6080 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:42.387773  1541 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:42.311812  6173 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:01:42.390738  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:42.408106  1543 raft_consensus.cc:2376] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11. Re-sending same reply.
W20260709 13:01:42.393360  1659 leader_election.cc:336] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.801s (SENT)
I20260709 13:01:42.370142  5967 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:42.377118  6286 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:42.377616  6159 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:42.370359  6077 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:42.312029  6013 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
W20260709 13:01:42.428766  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 55641.5us
I20260709 13:01:42.377427  6214 raft_consensus.cc:3055] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:42.311957  6248 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 13:01:42.312147  6196 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:42.423612  6288 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:42.465258  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:42.470527  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 77181.8us
I20260709 13:01:42.372785  6237 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:01:42.472668  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.448720  6286 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.501814  1538 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
W20260709 13:01:42.500463  1659 leader_election.cc:336] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.678s (SENT)
W20260709 13:01:42.504102  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 133541us
I20260709 13:01:42.509095  1659 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:42.469028  6300 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:01:42.477928  6298 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.217s	user 0.003s	sys 0.000s
I20260709 13:01:42.483685  6177 raft_consensus.cc:3055] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:42.472908  6214 raft_consensus.cc:740] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:01:42.503821  6282 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:01:42.426819  5903 raft_consensus.cc:697] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:42.481810  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00924ae4c66740e59de627a44de33c38"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:01:42.540113  1693 raft_consensus.cc:606] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:42.540635  1693 raft_consensus.cc:614] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:42.481112  6020 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:42.526203  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.507362  6286 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:42.548695  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 48266.4us
W20260709 13:01:42.549858  1659 leader_election.cc:336] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.816s (SENT)
I20260709 13:01:42.479825  6077 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:01:42.558326  1659 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:42.528638  6177 raft_consensus.cc:740] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:42.563694  1543 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:42.525275  6159 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:01:42.523689  6046 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:42.568496  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 199697us
I20260709 13:01:42.538270  6262 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:42.548604  6175 consensus_queue.cc:1059] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:01:42.571558  6272 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.571791  6288 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:42.577075  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 67460.1us
I20260709 13:01:42.588749  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:42.591536  2245 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:42.601750  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:42.611706  6080 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:42.612390  6080 raft_consensus.cc:697] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:42.585711  6279 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.579555  6173 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:01:42.620378  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:42.622548  1543 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:42.613374  6080 consensus_queue.cc:237] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:42.571692  6214 consensus_queue.cc:260] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:42.628010  6214 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:42.631553  6312 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:42.632200  6312 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:42.635468  6046 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:42.620999  5903 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:01:42.640147  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.640853  1538 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:42.594918  6272 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:42.715093  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.743629  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:42.745596  1546 raft_consensus.cc:2376] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12. Re-sending same reply.
I20260709 13:01:42.754098  1543 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:01:42.626164  6177 consensus_queue.cc:260] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:42.643914  6312 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:42.768016  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.743641  6280 consensus_meta.cc:287] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.705s	user 0.005s	sys 0.007s
I20260709 13:01:42.769387  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.759442  6177 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:42.774292  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:42.775317  1545 raft_consensus.cc:2393] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:42.622184  6279 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:42.779361  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 126945us
I20260709 13:01:42.759449  6310 raft_consensus.cc:3055] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:42.756553  6313 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
W20260709 13:01:42.817052  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 289574us
I20260709 13:01:42.789048  6310 raft_consensus.cc:740] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:42.861595  6319 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:42.777369  6123 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
W20260709 13:01:42.862879  6316 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:01:42.895514  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 115374us
I20260709 13:01:42.880867  6272 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:42.882817  6279 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:42.886175  6191 consensus_meta.cc:287] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.000s
I20260709 13:01:42.914031  6191 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:42.917163  6191 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:42.878536  6286 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:42.948609  6286 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:42.958029  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.958405  6033 consensus_meta.cc:287] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.000s
I20260709 13:01:42.958956  6033 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:42.960919  1540 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:42.979755  6312 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:42.980594  6312 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:42.984426  6312 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:43.000490  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:43.004925  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:43.057221  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 445628us
I20260709 13:01:43.060067  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:43.061208  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:43.061966  1690 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:01:43.064206  1587 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:43.066165  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:43.066746  1620 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:43.071538  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.060792  1689 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
W20260709 13:01:43.109160  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 78910.1us
I20260709 13:01:42.898401  6319 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:43.113125  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:43.115984  6319 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:43.119632  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:43.120919  1615 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:01:43.121325  1615 pending_rounds.cc:85] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 9
I20260709 13:01:43.121543  1615 pending_rounds.cc:107] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:01:43.121886  1615 raft_consensus.cc:2889] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:43.123476  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:43.124094  1546 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:43.125957  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:43.126622  1619 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
W20260709 13:01:43.130311  6302 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.680s	user 0.020s	sys 0.004s
I20260709 13:01:43.129966  6310 consensus_queue.cc:260] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:43.136312  6080 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:43.155154  6080 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:43.090977  2211 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:43.157029  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 66166.1us
I20260709 13:01:43.157729  2211 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:43.172130  1620 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:01:43.174782  1613 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:01:43.175806  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.131254  6310 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:43.182550  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:43.169622  6272 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:43.179113  5967 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.199628  6324 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:43.200142  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:01:43.230049  1693 raft_consensus.cc:606] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Received request to transfer leadership to TS dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:43.230579  1693 raft_consensus.cc:614] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:43.207660  6273 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:43.210249  6033 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:43.212343  1539 raft_consensus.cc:1240] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:43.213040  1619 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:43.214042  6214 consensus_meta.cc:287] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.586s	user 0.011s	sys 0.002s
I20260709 13:01:43.194995  6272 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.215206  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:43.235585  1618 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:43.217366  6294 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.966s	user 0.009s	sys 0.021s
W20260709 13:01:43.217666  6325 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.333s	user 0.002s	sys 0.000s
I20260709 13:01:43.217844  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:43.198984  6321 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:43.218194  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:43.220592  6327 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.366s	user 0.000s	sys 0.001s
I20260709 13:01:43.241611  1694 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:43.221625  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:43.242847  1692 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:01:43.227339  1689 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:43.219223  6333 log.cc:927] Time spent T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.364s	user 0.000s	sys 0.001s
W20260709 13:01:43.228591  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 75208.6us
W20260709 13:01:43.228664  1544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2818) took 1208 ms (client timeout 1507 ms). Trace:
I20260709 13:01:43.243039  6321 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:43.246729  1544 rpcz_store.cc:269] 0709 13:01:42.017777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.034982 (+ 17205us) service_pool.cc:224] Handling call
0709 13:01:43.225586 (+1190604us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b54001879d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:43.225725 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":813159808}
I20260709 13:01:43.229892  6324 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.284922  1692 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
W20260709 13:01:43.343423  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 76697.5us
I20260709 13:01:43.236137  6272 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:43.235702  6273 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:43.248315  6321 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:43.344380  2209 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.727s (SENT) [suppressed 68 similar messages]
I20260709 13:01:43.343086  1618 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:01:43.377871  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:43.378175  1585 leader_election.cc:336] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.592s (SENT)
I20260709 13:01:43.231582  5967 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:43.254884  6324 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:43.398151  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 182790us
I20260709 13:01:43.445113  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:43.420336  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2801) took 1577 ms. Trace:
I20260709 13:01:43.446257  1540 rpcz_store.cc:276] 0709 13:01:41.842801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.102954 (+260153us) service_pool.cc:224] Handling call
0709 13:01:42.192365 (+ 89411us) spinlock_profiling.cc:243] Waited 8.38 ms on lock 0x7b5800002d98. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:01:42.192553 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.961383 (+768830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.420037 (+458654us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b540006a4d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:43.420257 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1785655296}
W20260709 13:01:43.408437  6339 log.cc:927] Time spent T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.174s	user 0.001s	sys 0.001s
W20260709 13:01:43.452400  6327 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:01:43.452579  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2901) took 1238 ms. Trace:
W20260709 13:01:43.486544  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 108363us
W20260709 13:01:43.681942  6177 consensus_meta.cc:287] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.910s	user 0.010s	sys 0.002s
W20260709 13:01:43.691778  1585 leader_election.cc:336] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.595s (SENT)
I20260709 13:01:43.581529  6313 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 13:01:43.561414  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:43.653159  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.694870  1619 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:43.689240  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:43.696792  1538 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
W20260709 13:01:43.490978  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 330805us
W20260709 13:01:43.699254  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.700183  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:43.703177  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 261681us
I20260709 13:01:43.703200  1585 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:43.707129  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:43.717204  2242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 947) took 1085 ms. Trace:
I20260709 13:01:43.463357  6080 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:43.724628  1660 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:43.455361  6336 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.579118  6196 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:43.597342  6319 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:43.717864  2242 rpcz_store.cc:276] 0709 13:01:42.609051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.609201 (+   150us) service_pool.cc:224] Handling call
0709 13:01:42.621184 (+ 11983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.621400 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:42.786150 (+164750us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.256967 (+470817us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.694423 (+437456us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:43.694471 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:43.694525 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.694603 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.694724 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":234156,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":82,"thread_start_us":1052124,"threads_started":3,"wal-append.queue_time_us":677764}
I20260709 13:01:43.560050  6271 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:43.731330  6191 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:43.761796  6338 log.cc:927] Time spent T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.506s	user 0.001s	sys 0.000s
I20260709 13:01:43.488289  1622 rpcz_store.cc:276] 0709 13:01:42.206710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.206972 (+   262us) service_pool.cc:224] Handling call
0709 13:01:42.220661 (+ 13689us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.419677 (+199016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.419721 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:42.464296 (+ 44575us) log.cc:844] Serialized 26 byte log entry
0709 13:01:42.561258 (+ 96962us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:42.561313 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.419658 (+858345us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54003205d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:43.419741 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:43.419799 (+    58us) raft_consensus.cc:1685] finished
0709 13:01:43.419819 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.444666 (+ 24847us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8763,"raft.queue_time_us":9181,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":25638,"spinlock_wait_cycles":383165824,"thread_start_us":92704,"threads_started":1,"wal-append.queue_time_us":215616}
I20260709 13:01:43.767019  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:43.747685  6123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.012s	sys 0.026s
W20260709 13:01:43.783496  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 91738.2us
W20260709 13:01:43.784544  1585 leader_election.cc:336] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.039s (SENT)
I20260709 13:01:43.785017  1585 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:43.783025  6123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.012s	sys 0.026s
I20260709 13:01:43.769045  6348 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:43.812181  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 111256us
I20260709 13:01:43.776460  6319 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:43.765972  6336 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:43.799512  6191 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:43.809187  6348 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:43.776262  6271 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:43.811105  6347 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:43.849545  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 124982us
I20260709 13:01:43.889569  6353 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:01:43.890375  6346 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:01:43.890066  6343 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260709 13:01:43.856851  6273 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:43.895025  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.896031  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 111503us
W20260709 13:01:43.897114  1585 leader_election.cc:336] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.119s (SENT)
I20260709 13:01:43.897625  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:43.916407  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 149445us
W20260709 13:01:43.893157  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 128683us
I20260709 13:01:43.870415  6348 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:43.869763  6048 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:43.917727  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:43.920535  6191 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:43.926462  6227 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:43.932019  6048 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:43.947822  6363 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:43.962148  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.967772  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 46833.4us
I20260709 13:01:43.933019  6346 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:01:43.975805  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.977692  6355 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:01:43.979394  6352 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:01:43.981204  6358 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:43.984627  6319 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:43.988480  6367 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:43.989660  6350 log.cc:927] Time spent T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:01:43.969624  6353 consensus_queue.cc:1059] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:01:43.990939  2239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 946) took 1382 ms. Trace:
I20260709 13:01:43.990990  6369 raft_consensus.cc:3055] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:43.991608  6369 raft_consensus.cc:740] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:43.991441  2239 rpcz_store.cc:276] 0709 13:01:42.608660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.608808 (+   148us) service_pool.cc:224] Handling call
0709 13:01:42.609212 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.234610 (+625398us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b180032d340. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc4912d34bc 00007fc48e62148b 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63b455 00007fc491723060 00007fc491723bfb 00007fc49172e64b
0709 13:01:43.234765 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.234795 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.237736 (+  2941us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.559530 (+321794us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:43.559569 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.559640 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:43.990650 (+431010us) raft_consensus.cc:1685] finished
0709 13:01:43.990671 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.990882 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12088,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":2876,"spinlock_wait_cycles":34314496,"thread_start_us":322974,"threads_started":2,"wal-append.queue_time_us":528729}
W20260709 13:01:43.993626  6322 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 1.126s	user 0.003s	sys 0.015s
W20260709 13:01:43.994122  6356 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:01:43.994886  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 687) took 1395 ms. Trace:
I20260709 13:01:43.995283  1687 rpcz_store.cc:276] 0709 13:01:42.599486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.599601 (+   115us) service_pool.cc:224] Handling call
0709 13:01:42.599935 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.600283 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.600311 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:42.610934 (+ 10623us) log.cc:844] Serialized 26 byte log entry
0709 13:01:42.650912 (+ 39978us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:42.650968 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.651060 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:43.992882 (+1341822us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:43.994565 (+  1683us) raft_consensus.cc:1685] finished
0709 13:01:43.994593 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.994824 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10782,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":68753792,"thread_start_us":39468,"threads_started":1,"wal-append.queue_time_us":179571}
W20260709 13:01:43.997349  6310 consensus_meta.cc:287] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.811s	user 0.001s	sys 0.011s
W20260709 13:01:44.007349  1585 leader_election.cc:336] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.640s (SENT)
W20260709 13:01:44.008369  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 90847.9us
W20260709 13:01:44.014909  6344 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 13:01:43.886283  6347 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:43.981915  6358 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:44.007580  6363 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:01:44.020107  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 128224us
I20260709 13:01:43.989055  6367 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:44.023182  1660 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:43.992733  6369 consensus_queue.cc:260] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:44.026629  1660 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:43.987864  6346 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:44.030520  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:44.031337  2239 raft_consensus.cc:2393] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 12: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:44.038072  6271 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:44.044979  6367 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:44.045962  6369 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:44.112308  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:44.046341  1659 leader_election.cc:336] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 3.243s (SENT)
I20260709 13:01:44.113955  1659 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:44.048234  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2497) took 2199 ms. Trace:
I20260709 13:01:44.048573  6358 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:44.049760  6048 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:44.050556  6336 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:44.052361  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 53419.1us
I20260709 13:01:44.056185  6347 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:44.057297  6248 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:44.028167  6080 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:44.060422  6348 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:44.039009  6321 consensus_meta.cc:287] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.614s	user 0.006s	sys 0.003s
I20260709 13:01:44.069103  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:44.123805  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:44.132061  1618 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
W20260709 13:01:44.111774  6272 consensus_meta.cc:287] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.690s	user 0.007s	sys 0.003s
I20260709 13:01:44.114939  1695 rpcz_store.cc:276] 0709 13:01:41.848749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.850524 (+  1775us) service_pool.cc:224] Handling call
0709 13:01:41.850818 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:41.851053 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:41.851079 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:41.857472 (+  6393us) log.cc:844] Serialized 26 byte log entry
0709 13:01:42.154099 (+296627us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:42.154156 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.154250 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:43.108303 (+954053us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:44.039883 (+931580us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b24001f7d38. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e4c49c4 00007fc48e4c2acb 00007fc48e67ddc9 00007fc48e67da55 00007fc48e67cfb0 00007fc4912f3488 00007fc4912f3be8 00007fc4912cb398 00007fc4912c676a 00007fc4912c5bb6
0709 13:01:44.047902 (+  8019us) raft_consensus.cc:1685] finished
0709 13:01:44.047932 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.048123 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12215936,"thread_start_us":296201,"threads_started":1,"wal-append.queue_time_us":330883}
I20260709 13:01:44.097442  6363 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.104565  6310 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.119788  6313 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:44.136735  1585 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:01:44.139289  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 70321.1us
I20260709 13:01:44.137595  6374 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.134423  6248 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:44.149397  6380 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:44.137888  6318 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.292s	user 0.009s	sys 0.019s
I20260709 13:01:44.135458  6321 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:44.151715  6368 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:44.152158  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:44.121850  6365 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:44.129192  6033 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.140625  6272 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:44.168877  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:44.176331  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:44.177205  1691 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:01:44.154018  6313 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:44.168507  6318 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.331s	user 0.010s	sys 0.019s
W20260709 13:01:44.163034  6324 consensus_meta.cc:287] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.711s	user 0.010s	sys 0.000s
I20260709 13:01:44.159818  6271 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.192497  6227 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:44.243305  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 112144us
I20260709 13:01:44.161294  6310 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:44.244400  1585 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:44.193132  6380 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:44.198745  6313 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:44.153076  6363 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:44.192696  6033 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:44.243757  5957 tablet_copy_client.cc:538] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:44.242594  6227 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:44.284099  6033 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:44.168076  6374 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:44.285600  1512 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:44.289009  6362 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:44.291028  6374 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:44.209180  6324 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:44.195043  6365 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:44.328997  6324 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:44.329249  6365 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:44.331405  6165 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:44.332101  6165 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:44.336872  1587 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:44.338323  1587 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:44.340700  6164 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:44.341190  6164 raft_consensus.cc:697] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:44.342012  6164 consensus_queue.cc:237] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:44.343993  6383 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:44.344470  6383 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.344807  6383 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:44.345294  6286 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.345839  6286 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:44.349279  6378 log.cc:927] Time spent T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:01:44.267426  6380 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:44.280354  6248 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:44.301609  6020 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:44.304267  5967 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:44.355585  6380 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:44.344818  6191 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.357462  6191 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:44.305872  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 61557.6us
I20260709 13:01:44.308059  6348 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:44.309881  6363 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:44.208935  6271 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:44.311151  6272 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:44.311971  6371 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:44.314242  1512 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:44.315382  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.366317  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.296855  2209 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:44.276718  6080 raft_consensus.cc:697] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:01:44.368587  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 322242us
W20260709 13:01:44.368834  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 71987.4us
I20260709 13:01:44.293301  6227 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:44.373517  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:44.380218  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:44.380472  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:44.384253  1689 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:01:44.384980  1659 connection.cc:256] RPC call timeout handler was delayed by -1.375527810000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
I20260709 13:01:44.387852  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:44.381171  1691 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
W20260709 13:01:44.410671  1659 leader_election.cc:336] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.839s (SENT)
I20260709 13:01:44.415112  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:44.417089  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:44.417618  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:44.417922  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7803266de9984fac88726b08bee73921"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:01:44.443917  1691 raft_consensus.cc:606] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Received request to transfer leadership to TS dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:44.440893  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:44.441298  1690 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:44.441519  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:44.446391  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:44.447399  2239 raft_consensus.cc:2393] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:44.368110  6165 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:44.374500  6248 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:44.379711  6363 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:44.467545  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 153404us
W20260709 13:01:44.467751  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 82247.1us
W20260709 13:01:44.468345  1659 leader_election.cc:336] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.853s (SENT)
I20260709 13:01:44.468716  1659 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:44.470391  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:44.471160  2239 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:44.475514  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:44.475641  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 109468us
I20260709 13:01:44.410029  6272 consensus_queue.cc:1059] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:01:44.417418  6388 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:44.467378  6322 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:44.457249  6330 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:44.505704  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:44.509342  2238 raft_consensus.cc:2410] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:01:44.515661  1512 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:44.569758  2239 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:44.578305  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:44.608147  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 103048us
W20260709 13:01:44.611588  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.610845  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 458551us
W20260709 13:01:44.627911  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.656919  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.508839  6321 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:44.578971  6330 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:44.578052  6191 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:44.578352  6286 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:44.608453  6363 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:44.705551  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 237246us
I20260709 13:01:44.716518  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:44.713716  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:44.721695  2239 raft_consensus.cc:2368] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:44.713718  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:44.713958  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 50821.2us
I20260709 13:01:44.657740  6365 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.662643  6371 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:44.728940  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.736472  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.704645  6392 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:44.760346  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 291714us
I20260709 13:01:44.740725  2243 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:44.717181  6395 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:44.600468  6388 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:44.711623  6330 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.785290  6336 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:44.608938  6080 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:44.729017  6381 log.cc:927] Time spent T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.431s	user 0.000s	sys 0.001s
I20260709 13:01:44.728619  6273 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:44.734344  6310 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:44.737912  5903 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:44.731984  6394 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:44.765450  6371 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:44.794972  6392 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:44.739758  6365 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:44.725991  6321 consensus_queue.cc:1059] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:01:44.829918  1687 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:44.795217  6271 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:44.803128  6310 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.802767  6191 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:44.887738  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 410279us
W20260709 13:01:44.891995  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 109837us
W20260709 13:01:44.855482  6387 log.cc:927] Time spent T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.277s	user 0.000s	sys 0.004s
W20260709 13:01:44.951576  6401 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:01:44.951915  6392 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:44.828346  6273 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:44.952344  6393 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.210s	user 0.000s	sys 0.002s
I20260709 13:01:44.954377  6273 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:44.889300  6196 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:44.923702  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 420123us
W20260709 13:01:44.931996  6404 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.103s	user 0.001s	sys 0.001s
W20260709 13:01:44.955741  1659 connection.cc:256] RPC call timeout handler was delayed by -1.2382270530000596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 13:01:44.793147  6395 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:44.958052  1659 connection.cc:256] RPC call timeout handler was delayed by -1.171605134999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 13:01:44.958540  1659 connection.cc:256] RPC call timeout handler was delayed by -1.1415952689999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 13:01:44.959028  1659 connection.cc:256] RPC call timeout handler was delayed by -1.051409197000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
W20260709 13:01:44.959424  1659 connection.cc:256] RPC call timeout handler was delayed by -1.0448187050000683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 13:01:44.959774  1659 connection.cc:256] RPC call timeout handler was delayed by -1.019446902000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
I20260709 13:01:44.946928  1512 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:44.931537  6407 raft_consensus.cc:3055] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:01:44.965557  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.911936  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 117346us
W20260709 13:01:44.955941  6403 log.cc:927] Time spent T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
W20260709 13:01:45.015479  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 68647.2us
I20260709 13:01:45.016631  1512 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:44.917464  6310 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:44.955083  6196 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.017309  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:44.923898  6191 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.024855  6020 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:01:45.029394  6313 consensus_meta.cc:287] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.743s	user 0.008s	sys 0.000s
I20260709 13:01:45.029933  6313 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:45.035416  6405 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:45.035741  6351 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:45.036389  6351 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.040791  6395 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:45.041520  6395 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:45.042076  6395 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:45.044042  6408 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:01:45.045163  6399 log.cc:927] Time spent T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:01:45.048520  6388 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:45.049217  6388 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:45.049736  6388 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:45.051478  6330 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:45.052590  6310 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:45.053262  6310 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:45.053864  6330 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:44.969797  6165 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.962488  6407 raft_consensus.cc:740] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:44.969148  6392 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.063642  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 330557us
W20260709 13:01:45.090308  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 73775.3us
I20260709 13:01:45.093601  1512 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:45.049638  6383 consensus_meta.cc:287] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.704s	user 0.006s	sys 0.005s
W20260709 13:01:45.090746  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 73561.5us
I20260709 13:01:45.098155  6363 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:45.098632  6363 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:45.098431  6407 consensus_queue.cc:260] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:45.099073  6363 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:45.099737  6407 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:45.102351  2211 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:45.026923  6020 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:01:45.104635  6313 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:45.105314  6313 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:45.105789  6313 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:45.058079  6048 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:45.095844  6392 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:44.969345  6321 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 13:01:45.109833  5826 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.087159  6364 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.116322  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:45.086453  6353 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:45.119688  1691 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:45.122323  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:45.122763  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:45.123073  1692 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:45.096907  6405 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:45.126412  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:45.120199  1695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.004s	sys 0.012s
I20260709 13:01:45.118036  1512 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:45.167750  1695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.004s	sys 0.012s
I20260709 13:01:45.168972  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 697) took 1030 ms. Trace:
I20260709 13:01:45.169708  1695 rpcz_store.cc:276] 0709 13:01:44.138261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.138405 (+   144us) service_pool.cc:224] Handling call
0709 13:01:44.151543 (+ 13138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.151774 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:44.376893 (+225119us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.168426 (+791533us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.168523 (+    97us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:45.168598 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.168700 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.168894 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26811,"prepare.queue_time_us":110576,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"thread_start_us":973270,"threads_started":2}
I20260709 13:01:45.188325  6370 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:45.189177  1660 leader_election.cc:400] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:45.233230  1660 leader_election.cc:403] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:01:45.189435  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:45.190325  1688 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:45.234066  1693 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
W20260709 13:01:45.191133  6227 consensus_meta.cc:287] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.781s	user 0.011s	sys 0.000s
I20260709 13:01:45.192144  6348 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:45.191982  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:45.122757  6351 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:45.193050  6358 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:45.193678  6196 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:45.119103  5826 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:45.123364  6364 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.195346  2237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45882 (request call id 862) took 1431 ms. Trace:
I20260709 13:01:45.201246  1692 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:45.087142  6165 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.205515  1694 raft_consensus.cc:2393] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:45.119575  6271 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:45.225229  1691 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:45.261205  1613 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:45.116746  6374 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.229075  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.225339  1586 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:45.263409  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.264528  1621 raft_consensus.cc:2410] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:01:45.120548  6214 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.001s	sys 0.015s
I20260709 13:01:45.236297  2243 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:01:45.233825  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 44813.5us
I20260709 13:01:45.132556  6405 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:45.110621  6383 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.240401  1690 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:01:45.197615  6191 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:45.250674  2237 rpcz_store.cc:276] 0709 13:01:43.763872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.764096 (+   224us) service_pool.cc:224] Handling call
0709 13:01:43.764530 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.875223 (+110693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.875302 (+    79us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.918582 (+ 43280us) log.cc:844] Serialized 26 byte log entry
0709 13:01:44.289182 (+370600us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b180041a7c0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb0d1 00007fc4916e6a0f
0709 13:01:44.633326 (+344144us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:44.633398 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.633494 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.129404 (+495910us) raft_consensus.cc:1685] finished
0709 13:01:45.129432 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.195279 (+ 65847us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5127,"raft.queue_time_us":120987,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":39140,"spinlock_wait_cycles":3780352,"thread_start_us":440807,"threads_started":2,"wal-append.queue_time_us":860131}
I20260709 13:01:45.269412  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.134676  6363 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.130039  6353 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.270566  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:45.286484  1622 raft_consensus.cc:2368] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:45.272018  2211 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:45.288046  2211 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:45.274071  6214 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.001s	sys 0.015s
I20260709 13:01:45.259987  6419 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.241629  6227 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:45.241190  6370 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.265156  6271 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:45.265800  6365 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:45.298501  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.298591  6380 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:45.299281  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:45.300820  1588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.045s	sys 0.085s
I20260709 13:01:45.303073  5957 tablet_bootstrap.cc:492] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:01:45.304755  6383 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:45.306541  6363 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:45.314018  6165 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:45.270254  6313 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:45.330852  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:45.284394  6374 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.334149  6271 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:45.335197  1618 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:45.333938  1613 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:45.257843  6358 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.346895  1659 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:45.348356  6358 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:45.336899  1588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.046s	sys 0.085s
I20260709 13:01:45.315459  6351 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:45.296033  6373 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.316365  5826 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:45.344007  1620 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:45.284643  6164 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:45.288476  6273 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:01:45.273926  6405 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:45.344975  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 321561us
I20260709 13:01:45.349243  6392 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:45.405930  1620 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
W20260709 13:01:45.394564  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.343878  6365 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:45.340219  6280 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:45.398828  6136 raft_consensus.cc:3055] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:45.415391  6136 raft_consensus.cc:740] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:45.408248  6383 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:45.331460  6419 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.416604  6136 consensus_queue.cc:260] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.417972  6136 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.418466  6419 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:45.399416  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.419806  1616 raft_consensus.cc:2393] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 12: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:45.346527  6395 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:45.400970  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 54154.7us
I20260709 13:01:45.416182  6383 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.423264  6383 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:45.412067  6386 log.cc:927] Time spent T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.801s	user 0.012s	sys 0.004s
I20260709 13:01:45.423897  1622 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:45.426229  6227 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:45.394235  6373 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:45.429250  6373 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:45.431447  6353 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:45.432255  6364 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:45.432407  6280 raft_consensus.cc:697] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:45.433549  6388 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:45.396459  6351 raft_consensus.cc:697] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:01:45.438323  1689 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.000s	sys 0.034s
W20260709 13:01:45.438692  1689 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.000s	sys 0.034s
I20260709 13:01:45.394409  6313 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:45.440055  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.440141  1659 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:45.439126  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.442808  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.446724  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.447395  1620 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:45.450995  1622 raft_consensus.cc:2393] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 11: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:45.451392  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1842) took 1006 ms. Trace:
I20260709 13:01:45.435775  5967 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:45.434352  6370 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:45.459980  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.461491  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:01:45.451906  1689 rpcz_store.cc:276] 0709 13:01:44.445346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.450584 (+  5238us) service_pool.cc:224] Handling call
0709 13:01:44.450971 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.451257 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:44.465294 (+ 14037us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.440838 (+975544us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.450982 (+ 10144us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.451047 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:45.451103 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.451185 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.451324 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41541,"prepare.queue_time_us":59122,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":82,"raft.queue_time_us":58863,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":11839,"thread_start_us":952169,"threads_started":2,"wal-append.queue_time_us":477361}
I20260709 13:01:45.462180  1690 raft_consensus.cc:606] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:45.460585  1613 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:45.463667  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:45.465220  1613 raft_consensus.cc:2393] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 12: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:45.433512  6280 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.465953  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.431502  6405 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.469772  6271 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.470803  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.472250  2242 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:45.472651  6405 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:45.474149  6271 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:45.458709  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.451992  6395 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:01:45.502177  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.501893  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:45.503357  1696 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
W20260709 13:01:45.457899  1585 leader_election.cc:336] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.526s (SENT)
I20260709 13:01:45.482666  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:45.459674  6227 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:45.489498  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:45.497025  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:45.463558  6383 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.504906  1585 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:45.464619  6390 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:45.521272  6390 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:45.521692  6390 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:45.504492  1690 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:45.523352  6227 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:45.525000  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.526021  6227 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:45.507081  1693 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:45.520627  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:45.541337  6371 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:45.542309  6351 consensus_queue.cc:237] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.553692  2210 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:45.555408  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.555919  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.561178  1690 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
W20260709 13:01:45.566864  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 108993us
W20260709 13:01:45.567876  1585 leader_election.cc:336] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.527s (SENT)
I20260709 13:01:45.568452  1585 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:45.564602  2210 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:45.570088  2210 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:45.571560  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:45.488535  6374 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:45.545835  6398 log.cc:927] Time spent T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.827s	user 0.008s	sys 0.004s
I20260709 13:01:45.572347  1693 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:45.577298  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.583019  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:45.583591  1616 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:01:45.583774  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:45.451925  6313 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.585763  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:45.579543  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 327414us
I20260709 13:01:45.587747  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:45.578723  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 305049us
W20260709 13:01:45.585455  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 297562us
I20260709 13:01:45.589823  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:45.588407  2243 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:45.591977  1694 raft_consensus.cc:2393] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:45.593313  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:45.595577  1585 leader_election.cc:336] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.534s (SENT)
I20260709 13:01:45.596460  1585 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:45.604153  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:45.673074  2243 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:45.577042  6227 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:45.598484  6407 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:45.573153  6272 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:45.669835  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 86115.8us
I20260709 13:01:45.583173  6136 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:45.583364  6271 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:45.671161  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 80518.3us
I20260709 13:01:45.680886  1617 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:45.671779  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 553743us
I20260709 13:01:45.574501  6395 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:01:45.562393  6383 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:45.566203  6364 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:01:45.596486  2211 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:45.690768  1659 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:45.703749  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 120130us
I20260709 13:01:45.680513  6136 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.710245  1512 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:45.721668  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:45.721022  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 124591us
I20260709 13:01:45.723034  1614 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:45.727893  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:45.719719  6136 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:45.731065  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 136804us
W20260709 13:01:45.735189  1585 leader_election.cc:336] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.574s (SENT)
I20260709 13:01:45.735747  1585 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:45.731746  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.733450  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:45.733606  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:45.733629  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:45.674259  6369 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:45.739064  1585 leader_election.cc:336] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.668s (SENT)
I20260709 13:01:45.739477  1585 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:45.740152  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:45.681483  6305 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:01:45.743728  1512 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:45.689890  6214 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:45.690308  6271 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:45.747430  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 70513.8us
I20260709 13:01:45.710079  6431 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.747653  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.757066  1614 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:45.709137  6311 consensus_queue.cc:1059] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:01:45.753578  1586 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:45.729131  5903 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:45.759394  1512 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:45.729142  6272 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:45.761590  1586 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:45.762214  1659 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:45.763953  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.766516  1586 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:45.732926  6427 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:45.767951  6422 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:45.762228  6431 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:45.768347  6321 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:45.768697  6318 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:45.769024  6402 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:01:45.770689  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:45.744580  6227 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:45.776520  1585 leader_election.cc:336] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.672s (SENT)
I20260709 13:01:45.780241  1696 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
W20260709 13:01:45.780876  1585 leader_election.cc:336] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.969s (SENT)
I20260709 13:01:45.774878  1512 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:45.781571  1585 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:45.782171  1659 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:45.785593  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:45.760407  6271 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:45.792408  1660 leader_election.cc:400] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:45.766261  6272 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.765313  6405 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:45.796020  1614 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:45.789577  1512 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:45.771970  6422 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.775849  6427 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:45.777688  6321 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.821015  1660 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:45.831619  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 49497.8us
I20260709 13:01:45.788110  6311 raft_consensus.cc:3055] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:45.853374  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:45.787194  6371 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:45.872159  6371 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.872583  6371 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:45.867336  1659 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:45.859098  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 69613us
I20260709 13:01:45.790616  5903 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:45.788223  6346 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:45.788184  6370 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:45.876994  1695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:01:45.915481  1695 raft_consensus.cc:606] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Received request to transfer leadership to TS dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:45.878908  1512 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:45.787177  6424 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:45.802342  6272 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:45.887557  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:45.919852  1692 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:45.806344  6421 raft_consensus.cc:2764] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:01:45.854470  6321 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:45.894079  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:45.897866  6371 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:45.899892  6428 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:01:45.868244  6353 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:45.867903  6417 consensus_queue.cc:1059] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:01:45.948944  1660 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:45.908811  6305 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:45.914898  6080 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:45.838387  6422 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:45.893534  6433 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
W20260709 13:01:45.922320  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 141465us
I20260709 13:01:45.834602  6427 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:45.925242  1688 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:01:45.803356  6369 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
W20260709 13:01:45.928753  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 61540.5us
I20260709 13:01:45.968583  1659 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:45.969811  1659 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:45.928828  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 50012.1us
I20260709 13:01:45.873974  6405 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:45.870110  6311 raft_consensus.cc:740] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:45.817672  6214 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:45.962391  1585 leader_election.cc:336] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.969s (SENT)
I20260709 13:01:45.975876  1585 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:45.855075  6435 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 13:01:45.965554  1587 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:45.965580  1696 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:45.966799  1692 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:01:45.944142  5903 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:45.972144  1512 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:45.923506  6370 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:45.983798  1512 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:45.986370  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:45.987330  2243 raft_consensus.cc:2393] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 12: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:45.988263  1512 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:45.993999  1512 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:45.975485  6417 raft_consensus.cc:3055] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:46.006553  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:46.014302  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:46.015128  2239 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:46.016172  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:45.981144  6421 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:45.981367  6437 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:45.989208  6405 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:45.985919  6353 raft_consensus.cc:697] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:46.020849  2211 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:46.003582  6196 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:45.990553  6392 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:46.010907  6164 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:46.009732  6417 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:46.001543  6395 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:46.009425  6365 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:45.980191  6436 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:01:46.017093  6383 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:46.031452  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 126335us
I20260709 13:01:46.024542  6421 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:46.029930  6405 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:46.055454  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 331942us
I20260709 13:01:46.032451  6196 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.031878  6437 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:46.003376  6373 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:01:46.038935  6347 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:46.066680  2210 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:46.040040  6441 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:46.055043  6351 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.023s	sys 0.062s
I20260709 13:01:46.079916  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:46.064594  2209 leader_election.cc:336] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.727s (SENT)
W20260709 13:01:46.082151  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 88237.4us
I20260709 13:01:46.090166  2209 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:46.087540  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 117811us
I20260709 13:01:46.065835  6318 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.094269  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:46.095507  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.096030  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:46.107630  1541 raft_consensus.cc:2376] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11. Re-sending same reply.
I20260709 13:01:46.096655  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:46.096779  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:46.097683  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.064090  6431 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:46.098347  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.099329  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:46.068689  6405 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:46.027640  6311 consensus_queue.cc:260] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:46.108144  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 43598.3us
I20260709 13:01:46.141646  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:46.142393  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:46.117456  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.108757  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:46.143285  1543 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:46.134866  1539 raft_consensus.cc:2376] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11. Re-sending same reply.
I20260709 13:01:46.136029  1542 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:46.107630  1538 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:46.071144  6437 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:46.137220  1547 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
W20260709 13:01:46.089368  6351 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.023s	sys 0.062s
W20260709 13:01:46.138579  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 173024us
I20260709 13:01:46.139003  1544 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:01:46.147831  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 185448us
I20260709 13:01:46.067389  6421 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:46.109411  1659 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:46.142323  1540 raft_consensus.cc:2376] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13. Re-sending same reply.
I20260709 13:01:46.138783  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:46.141737  2209 leader_election.cc:336] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.904s (SENT)
I20260709 13:01:46.150727  1546 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:46.083644  6442 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:46.150689  2209 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:46.151003  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:46.071645  6196 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:46.147938  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:46.092633  6365 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:46.118405  6347 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:46.153607  1587 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:46.160593  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:46.154456  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 114755us
I20260709 13:01:46.156824  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.115506  6438 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.159090  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.164433  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:46.164935  1539 raft_consensus.cc:2376] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12. Re-sending same reply.
I20260709 13:01:46.158658  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.161239  2243 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:46.165503  1587 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:46.165607  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 56460.7us
I20260709 13:01:46.166746  1587 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:46.161851  1540 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:46.168365  1543 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:46.168684  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.169278  1546 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:46.167475  1659 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:46.171386  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.153039  6371 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:46.153100  6442 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.154753  6434 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:46.108435  6395 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:01:46.157547  6431 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:46.179204  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.203986  1546 raft_consensus.cc:2393] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:46.204783  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.205341  1546 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:46.206053  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:46.206519  1546 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:46.118768  6318 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:46.185932  1511 consensus_peers.cc:597] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:46.109558  6353 consensus_queue.cc:237] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:46.188320  6449 log.cc:927] Time spent T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:01:46.189828  6370 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:46.191653  6445 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:01:46.192327  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:46.229450  1544 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:46.193655  6459 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:46.194478  1659 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:46.195628  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.235435  1539 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:46.164053  6365 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.183046  1542 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
W20260709 13:01:46.200171  6390 consensus_meta.cc:287] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.678s	user 0.011s	sys 0.000s
W20260709 13:01:46.240798  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 45724.3us
W20260709 13:01:46.241277  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 46885.9us
I20260709 13:01:46.173916  6383 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:46.211673  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:46.184147  6442 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:46.242990  2243 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:46.224843  6227 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:46.145370  6417 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:46.185442  6463 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:46.233417  6459 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:46.262750  1545 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:01:46.246444  6426 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:46.267657  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.259759  6392 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:46.262440  6463 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.262226  6383 raft_consensus.cc:697] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:46.264578  6371 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:46.310786  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 142556us
I20260709 13:01:46.317353  1616 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:46.321425  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:46.308990  6392 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.329439  6392 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:46.329851  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:46.331283  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:46.322777  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:46.264367  6436 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.333441  2238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 956) took 1200 ms. Trace:
I20260709 13:01:46.333225  6436 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.333806  2238 rpcz_store.cc:276] 0709 13:01:45.133226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.133405 (+   179us) service_pool.cc:224] Handling call
0709 13:01:45.232493 (+ 99088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.342337 (+109844us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:45.801084 (+458747us) log.cc:844] Serialized 14 byte log entry
0709 13:01:46.060660 (+259576us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.060718 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:46.060764 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.331812 (+271048us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b18001f8ee0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e60c2a6 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419
0709 13:01:46.333220 (+  1408us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54004f1d54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:46.333267 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.333388 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":666809,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":95,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":9644,"spinlock_wait_cycles":264113280,"thread_start_us":699927,"threads_started":2,"wal-append.queue_time_us":320055}
I20260709 13:01:46.324951  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:46.173062  6438 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.267058  6435 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.328830  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:46.323685  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:46.337843  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:46.328051  1512 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:39612 dropped due to backpressure: service queue is full with 50 items
I20260709 13:01:46.390239  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:46.429574  2246 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:46.373950  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:46.430594  1622 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:46.404757  1618 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:46.380163  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:46.389055  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:46.433027  1617 raft_consensus.cc:2410] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:46.361529  6365 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:46.323134  6463 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:46.389524  6371 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:46.376662  6431 raft_consensus.cc:993] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:01:46.268510  6459 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:46.432183  6437 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:46.440248  6437 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:46.243722  6390 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:46.443373  6365 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:46.443967  6365 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:46.445173  6390 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:46.377732  6318 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:46.446069  1694 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:46.286540  6373 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.446545  6365 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:46.283377  6441 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:46.450394  6429 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.756s	user 0.005s	sys 0.000s
I20260709 13:01:46.450109  6441 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:46.452453  6441 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:46.325627  6374 consensus_queue.cc:1059] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:01:46.453480  6374 consensus_queue.cc:1243] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:46.454125  6374 raft_consensus.cc:3055] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:46.455538  6374 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:46.435873  6048 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.456272  6048 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.456350  6374 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:46.457746  6374 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:46.458420  6048 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:46.383932  6271 consensus_meta.cc:287] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.005s
I20260709 13:01:46.379638  6383 consensus_queue.cc:237] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:46.459090  6271 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.345980  6196 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:46.388901  6421 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.462252  2237 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:46.337647  6436 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:46.307735  6469 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
W20260709 13:01:46.371140  2209 leader_election.cc:336] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.188s (SENT)
W20260709 13:01:46.312721  6136 consensus_meta.cc:287] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.567s	user 0.019s	sys 0.000s
I20260709 13:01:46.304720  6321 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.465031  6136 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.465835  2209 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:46.418891  1587 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:46.316169  1546 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:01:46.409129  1544 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:46.423477  1614 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 15: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:46.401404  6272 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.434872  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:46.446980  6373 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:46.313854  6426 raft_consensus.cc:697] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:01:46.482584  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 63821us
I20260709 13:01:46.448733  6405 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:46.456548  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:46.487460  1617 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:46.336417  1539 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:46.475759  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:46.454025  6438 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:46.477591  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:46.436733  6431 raft_consensus.cc:1081] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:01:46.480655  6272 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:46.474339  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 103142us
I20260709 13:01:46.481813  2239 raft_consensus.cc:1240] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:46.475749  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:46.435672  6435 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.493119  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:46.493808  2237 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:46.494860  1586 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:46.495760  1540 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:46.496459  6318 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:46.496840  6318 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.497181  6318 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:46.497748  6421 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:46.497184  6435 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:46.479504  6196 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:46.490006  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:46.502013  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.502295  6373 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:46.482931  6280 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:46.504345   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:46.504694  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:46.505208  6390 consensus_queue.cc:1059] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:46.506054  6390 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:46.506184   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:46.506462  6390 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.506925  6390 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:46.506989  6380 raft_consensus.cc:3055] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:46.507475  6380 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:46.508085  6461 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:46.508330  6380 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:46.509505  6380 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:46.513550  2211 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:46.499713  6426 consensus_queue.cc:237] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:46.514578  2211 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:46.515901  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.515749  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:46.521776  1614 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:46.522506  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:46.523072  1690 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:46.522985  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:46.523718  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:46.523895  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:46.524792  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:46.483599  1587 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:46.525787  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:46.526470  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:46.487557  6469 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:46.527741  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:46.531165  1689 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:46.531148  1659 leader_election.cc:336] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.190s (SENT)
I20260709 13:01:46.489836  6136 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:46.538400  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:46.534899  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:46.534983  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:46.538487  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:46.540027  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:46.527166  1585 leader_election.cc:336] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.146s (SENT)
I20260709 13:01:46.429497  1512 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:39612 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2850)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 663)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2851)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2858)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 662)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 672)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2862)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 660)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1715)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1718)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2860)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2854)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2853)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 659)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2857)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2855)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2856)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2849)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1716)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 658)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 661)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2848)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2852)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1704)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1705)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1711)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1712)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1713)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1719)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 669)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 674)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 675)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 678)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2861)
I20260709 13:01:46.528132  6435 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:46.554811  1692 raft_consensus.cc:2410] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:46.553675  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:46.529446  6196 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:46.529819  6280 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:46.558807  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:46.539696  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:46.532486  6272 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:46.566038  1614 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:01:46.533627  6471 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.536209  6271 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:46.580247  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:46.582799  1512 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:39612 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2851)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2858)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 662)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 672)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2862)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 660)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1715)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1718)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2860)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2854)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2853)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 659)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2857)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2855)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2856)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2849)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1716)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 658)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 661)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2848)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2852)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1704)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1705)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1711)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1712)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1713)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1719)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 669)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 674)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 675)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 678)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2861)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2864)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2865)
I20260709 13:01:46.559352  6435 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.533372  6365 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:01:46.562224  6196 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:46.598845  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:46.601011  2243 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:46.567451  6461 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:46.566581  6280 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:46.604712  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 77608.9us
W20260709 13:01:46.605414  1585 leader_election.cc:336] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.201s (SENT)
I20260709 13:01:46.605831  1585 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:46.606056  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.592447  6474 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:46.595800  6435 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:46.604153  6196 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:46.619376  6227 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.619932  6227 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:46.622113  6227 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:46.632139  1614 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:46.635080  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:46.581722  6419 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:46.635743  1617 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:46.636014  6419 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.636454  6419 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:46.658813  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:46.661116  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:46.591630  6321 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:46.589740  6473 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:46.707796  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:46.673689  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:46.683355  6437 raft_consensus.cc:993] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:01:46.690375  6271 raft_consensus.cc:2955] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 3 to 10, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:46.695873  6405 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:46.714294  6474 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:46.722474  6474 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.722986  6474 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:46.723558  6371 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:46.724810  6392 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.715073  6437 raft_consensus.cc:1081] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Signalling peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
W20260709 13:01:46.735687  6422 consensus_meta.cc:287] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.765s	user 0.007s	sys 0.009s
I20260709 13:01:46.743492  6422 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.745801  6422 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:46.746553  1618 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 11: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:46.739789  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:46.638064  6280 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:46.749306  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:46.750752  1543 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
W20260709 13:01:46.741933  6472 log.cc:927] Time spent T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:01:46.750865  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:46.741822  6473 raft_consensus.cc:697] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:46.757027  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:46.756916  6473 consensus_queue.cc:237] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.646709  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:46.705119  6469 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.111s
I20260709 13:01:46.774744  6474 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.775782  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:46.776026  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:46.776571  2242 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:46.777877  6474 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:46.778472  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:46.741585  6427 consensus_meta.cc:287] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.766s	user 0.010s	sys 0.004s
I20260709 13:01:46.837287  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.783226  1689 raft_consensus.cc:2410] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:01:46.784585  2242 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:46.888833  6164 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:46.890127  1586 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:46.890455  1618 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:01:46.739416  6459 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:46.891126  6164 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:46.891778  6164 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:46.827495  6469 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:46.690826  6390 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.893564  6313 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:46.892923  6164 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.894196  1694 raft_consensus.cc:2368] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 10. Current term is 11.
I20260709 13:01:46.895120  6390 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:46.727185  6392 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:46.844805  6427 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:46.892954  6459 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:46.896857  6453 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.726s	user 0.012s	sys 0.002s
I20260709 13:01:46.897666  6427 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:46.847084  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:46.851527  6417 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:46.592865  6471 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:01:46.754976  6442 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.699050  6463 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.702878  6318 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:46.869205  6440 log.cc:927] Time spent T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.883s	user 0.003s	sys 0.006s
I20260709 13:01:46.869339  1687 raft_consensus.cc:2410] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:01:46.868947  6435 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:46.878748  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:46.879253  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1857) took 1295 ms. Trace:
I20260709 13:01:46.931875  2243 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:46.880115  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.596271  6272 raft_consensus.cc:697] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:46.881537  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:46.933517  2246 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:01:46.782033  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 130561us
W20260709 13:01:46.886837  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 281414us
W20260709 13:01:46.935487  1585 leader_election.cc:336] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.238s (SENT)
I20260709 13:01:46.935923  1585 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:46.592391  1512 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:39612 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2851)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2858)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 662)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 672)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2862)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 660)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1715)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1718)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2860)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2854)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2853)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 659)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2857)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2855)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2856)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2849)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1716)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 658)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 661)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2848)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2867)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2852)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1704)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1705)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1711)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1712)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1713)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1719)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 669)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 674)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 675)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 678)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2861)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2864)
I20260709 13:01:46.931820  1693 rpcz_store.cc:276] 0709 13:01:45.584053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.584433 (+   380us) service_pool.cc:224] Handling call
0709 13:01:45.593180 (+  8747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.625187 (+1032007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.625233 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.625290 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:46.625335 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.879038 (+253703us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002c5e54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:46.879081 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.879184 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2372494208}
I20260709 13:01:46.934799  1587 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:46.946513  1512 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:39612 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1715)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1718)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2860)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2854)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2853)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 659)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2857)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2855)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2856)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2849)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1716)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 658)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 661)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2871)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2848)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2870)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2867)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2876)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2872)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2852)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1704)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1705)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1711)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1712)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1713)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1719)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 669)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 674)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 675)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 678)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2861)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2864)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2868)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2869)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:39612 (request call id 2873)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2874)
W20260709 13:01:46.891121  6467 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.580s	user 0.000s	sys 0.006s
I20260709 13:01:46.903414  2210 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:46.866708  6419 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:46.896876  6444 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.906s	user 0.012s	sys 0.001s
I20260709 13:01:46.974292  1616 raft_consensus.cc:2368] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 10. Current term is 11.
I20260709 13:01:46.974092  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.927201  6407 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:46.899711  1546 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:46.971094  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.964983  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.973202  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.978434  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.963829  1660 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:46.979319  1544 raft_consensus.cc:2393] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:01:46.969601  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 66301.1us
I20260709 13:01:46.980036  2210 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:46.982420  2211 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:46.983839  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.984591  1547 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:46.985868  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.986626  1545 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:46.987818  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:46.972800  1614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:40034
I20260709 13:01:46.991173  1614 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:46.991631  1614 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:46.994349  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.893611  6469 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:46.996151  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:46.968505  6422 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:46.929194  6365 consensus_queue.cc:1059] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:01:46.977666  6362 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:46.995714  1688 raft_consensus.cc:2955] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:01:46.969089  6227 consensus_queue.cc:1059] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:01:46.993810  6438 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:46.982848  6390 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:47.000211  6421 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:47.022040  1692 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:46.977260  6427 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:01:47.000471  6136 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:47.011714  5967 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:47.007851  6280 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:47.013087  6362 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.017143  6321 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:46.993979  6279 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:01:46.984200  6407 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:47.053367  1689 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:47.005046  1696 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:47.027148  6390 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.062081  1692 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:47.056869  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 919) took 1660 ms. Trace:
I20260709 13:01:47.063323  6435 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:47.060767  6362 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:47.064023  2240 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:47.068020  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.060583  6476 log.cc:927] Time spent T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:47.071552  2244 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:01:47.042019  6422 raft_consensus.cc:3055] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:47.073220  1621 rpcz_store.cc:276] 0709 13:01:45.396840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.396971 (+   131us) service_pool.cc:224] Handling call
0709 13:01:45.398619 (+  1648us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:45.414614 (+ 15995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.414645 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:45.415089 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.785024 (+369935us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:45.785084 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.785175 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:46.896069 (+1110894us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:47.037467 (+141398us) raft_consensus.cc:1685] finished
0709 13:01:47.037489 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.056782 (+ 19293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10061,"raft.queue_time_us":10190,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":128,"spinlock_wait_cycles":13078912,"thread_start_us":358276,"threads_started":1,"wal-append.queue_time_us":541451}
I20260709 13:01:47.080235  6442 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:47.050117  6438 raft_consensus.cc:697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:47.087936  1696 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:01:46.959956  1512 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:39612 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1715)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1718)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2860)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2854)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2853)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 659)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2857)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2855)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2856)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2849)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1716)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 658)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 661)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2871)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2848)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2870)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2867)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2876)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2872)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2852)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1704)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1705)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1711)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1712)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1713)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1719)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 669)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 674)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 675)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 678)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2861)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2864)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2868)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2869)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:39612 (request call id 2873)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2874)
I20260709 13:01:47.063074  5967 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:47.050355  6421 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:47.058477  1693 raft_consensus.cc:2955] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 3 to 10, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:47.115319  1696 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:01:47.118287  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.081589  6390 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:47.130591  1572 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:43923 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:43923 timed out after 15.000s (SENT)
I20260709 13:01:47.134007  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.139510  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:47.140367  1544 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:47.140579  6280 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:47.144899  2243 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
W20260709 13:01:47.153173  1659 leader_election.cc:336] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:39612 dropped due to backpressure: service queue is full with 50 items
I20260709 13:01:47.159931  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:47.090588  6422 raft_consensus.cc:740] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:47.161068  1694 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:47.093148  6459 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:47.178165  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.178709  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:47.158275  1614 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:47.177515  1659 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:47.166882  1544 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:47.178953  1545 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:47.183703  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:47.185079  6318 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:47.052089  6272 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:47.195717  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:47.182009  1512 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:47.116825  6305 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:47.120993  6365 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:47.118762  6271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:37990 (request call id 2) took 4828 ms. Trace:
I20260709 13:01:47.198302  1512 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:47.205021  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.211445  1512 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:47.213397  1544 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:47.215293  1512 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:47.217311  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:47.215873  6383 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.010s	sys 0.055s
I20260709 13:01:47.216588  5903 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:47.201776  5967 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:47.304713  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 322318us
I20260709 13:01:47.222817  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:47.203325  6474 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:01:47.223795  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:47.185753  6426 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:47.186517  6419 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:47.208721  6473 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:47.226024  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:01:47.241966  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 306450us
I20260709 13:01:47.293620  6471 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:47.247838  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.331748  1540 raft_consensus.cc:2376] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9. Re-sending same reply.
I20260709 13:01:47.332266  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1718) took 1102 ms. Trace:
I20260709 13:01:47.191495  6459 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:47.238970  6196 consensus_meta.cc:287] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.009s
I20260709 13:01:47.201735  6305 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:47.260100  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.332708  1540 rpcz_store.cc:276] 0709 13:01:46.229514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.247488 (+1017974us) service_pool.cc:224] Handling call
0709 13:01:47.332209 (+ 84721us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.233923  6463 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:47.266054  1692 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:01:47.293834  6407 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:47.274595  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.337826  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2854) took 1014 ms. Trace:
I20260709 13:01:47.338189  1542 rpcz_store.cc:276] 0709 13:01:46.323817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.274340 (+950523us) service_pool.cc:224] Handling call
0709 13:01:47.337766 (+ 63426us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.275763  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:47.339069  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.339902  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1716) took 1111 ms. Trace:
I20260709 13:01:47.340221  1542 rpcz_store.cc:276] 0709 13:01:46.228693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.338844 (+1110151us) service_pool.cc:224] Handling call
0709 13:01:47.339851 (+  1007us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.341180  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:47.341782  1542 raft_consensus.cc:2368] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 10. Current term is 11.
I20260709 13:01:47.276629  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.342813  1546 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 16: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:01:47.278522  6478 log.cc:927] Time spent T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
W20260709 13:01:47.282362  6479 log.cc:927] Time spent T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:01:47.233042  6438 consensus_queue.cc:237] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:47.302192  2210 leader_election.cc:400] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 10. Current term is 11.
I20260709 13:01:47.304675  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:47.346657  2210 leader_election.cc:403] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:01:47.305248  1614 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:47.305622  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 327679us
I20260709 13:01:47.308204  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:47.348019  1544 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:47.348156  1689 raft_consensus.cc:2410] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:47.302879  1620 raft_consensus.cc:2955] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 3 to 10, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:47.314137  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 673) took 1029 ms. Trace:
W20260709 13:01:47.314267  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 99058.4us
I20260709 13:01:47.314358  2246 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:47.352774  1512 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:47.221131  6311 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:47.240401  6422 consensus_queue.cc:260] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:47.282724  6469 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:47.314841  6383 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.011s	sys 0.055s
I20260709 13:01:47.318203  6435 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:47.326934  2240 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:47.324364  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:47.243115  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.332178  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:47.376204  1696 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:47.333878  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.217993  6405 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:47.216765  6365 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:47.333348  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2860) took 1006 ms. Trace:
I20260709 13:01:47.380976  1539 rpcz_store.cc:276] 0709 13:01:46.326798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.243095 (+916297us) service_pool.cc:224] Handling call
0709 13:01:47.333296 (+ 90201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.339133  1541 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:47.292528  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.342239  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 658) took 1077 ms. Trace:
I20260709 13:01:47.345969  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2853) took 1022 ms. Trace:
W20260709 13:01:47.354367  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.354434  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 52386.9us
I20260709 13:01:47.352205  1545 rpcz_store.cc:276] 0709 13:01:46.284635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.204157 (+919522us) service_pool.cc:224] Handling call
0709 13:01:47.314073 (+109916us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.368587  1621 raft_consensus.cc:2393] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 14: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:47.317745  6380 consensus_queue.cc:1059] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:01:47.340312  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:47.374442  6473 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:47.371291  1512 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:47.377023  1540 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:47.414180  2211 leader_election.cc:400] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 10. Current term is 11.
I20260709 13:01:47.434326  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2859) took 1107 ms. Trace:
I20260709 13:01:47.383538  1542 rpcz_store.cc:276] 0709 13:01:46.264887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.340971 (+1076084us) service_pool.cc:224] Handling call
0709 13:01:47.342189 (+  1218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.416302  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.434782  1540 rpcz_store.cc:276] 0709 13:01:46.326446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.333632 (+1007186us) service_pool.cc:224] Handling call
0709 13:01:47.434270 (+100638us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.435953  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:47.436388  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 65231.1us
I20260709 13:01:47.413236  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1708) took 1220 ms. Trace:
I20260709 13:01:47.437196  1512 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:47.437387  1547 rpcz_store.cc:276] 0709 13:01:46.193204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.279496 (+1086292us) service_pool.cc:224] Handling call
0709 13:01:47.413141 (+133645us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.384105  1546 rpcz_store.cc:276] 0709 13:01:46.323500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.276407 (+952907us) service_pool.cc:224] Handling call
0709 13:01:47.345876 (+ 69469us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.209024  6271 rpcz_store.cc:276] 0709 13:01:42.282879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.331578 (+ 48699us) service_pool.cc:224] Handling call
0709 13:01:42.385564 (+ 53986us) log.cc:844] Serialized 501 byte log entry
0709 13:01:43.777841 (+1392277us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b54009112a0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916a4142 00007fc491684eaa 00007fc49168bd53 00007fc49168bcd9 00007fc49168bc69 00007fc49168bc31 00007fc49168adfd 000000000038f354 000000000038f199 00007fc48e63e475
0709 13:01:44.059556 (+281715us) spinlock_profiling.cc:243] Waited 8.21 ms on lock 0x7b18004940e0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e60c2a6 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916abb26 00007fc4916a549a 00007fc4916a4714
0709 13:01:44.357046 (+297490us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b54009112a0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916abb26 00007fc4916a549a 00007fc4916a4714 00007fc491684eaa 00007fc49168bd53 00007fc49168bcd9 00007fc49168bc69 00007fc49168bc31 00007fc49168adfd 000000000038f354
0709 13:01:47.093414 (+2736368us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42870,"raft.queue_time_us":24067,"raft.run_cpu_time_us":82528,"raft.run_wall_time_us":3351660,"spinlock_wait_cycles":53581824}
I20260709 13:01:47.336715  6196 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:47.419625  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:47.420463  6484 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:01:47.421142  6380 raft_consensus.cc:3055] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:47.421648  2244 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 11: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 13:01:47.424707  6482 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:01:47.425096  1541 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:47.482856  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2857) took 1157 ms. Trace:
I20260709 13:01:47.426208  1544 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:01:47.436764  1540 raft_consensus.cc:2376] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16. Re-sending same reply.
I20260709 13:01:47.484316  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2848) took 1174 ms. Trace:
I20260709 13:01:47.484704  1540 rpcz_store.cc:276] 0709 13:01:46.309403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.435558 (+1126155us) service_pool.cc:224] Handling call
0709 13:01:47.484246 (+ 48688us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.485817  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.439356  1545 raft_consensus.cc:2368] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 11. Current term is 12.
I20260709 13:01:47.440222  1512 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:47.440881  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:47.441128  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:47.487210  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 661) took 1221 ms. Trace:
I20260709 13:01:47.487399  1542 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:47.487634  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 47477.4us
I20260709 13:01:47.487612  1545 rpcz_store.cc:276] 0709 13:01:46.265803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.388923 (+1123120us) service_pool.cc:224] Handling call
0709 13:01:47.487156 (+ 98233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.487942  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.488641  1512 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:47.488760  1546 raft_consensus.cc:2376] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12. Re-sending same reply.
I20260709 13:01:47.488823  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2849) took 1179 ms. Trace:
I20260709 13:01:47.489315  1544 rpcz_store.cc:276] 0709 13:01:46.309652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.307966 (+998314us) service_pool.cc:224] Handling call
0709 13:01:47.488775 (+180809us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.489589  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:47.445947  1696 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:01:47.447044  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.447577  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:47.447686  5903 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.486536  1540 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:47.452049  6392 raft_consensus.cc:3055] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:47.454634  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:47.454960  6351 consensus_queue.cc:1059] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:47.455607  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:47.438761  6435 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:47.457067  6451 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:47.518460  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.518839  1542 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
W20260709 13:01:47.459156  6480 log.cc:927] Time spent T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:01:47.526473  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2852) took 1203 ms. Trace:
I20260709 13:01:47.526895  1547 rpcz_store.cc:276] 0709 13:01:46.323160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.493058 (+1169898us) service_pool.cc:224] Handling call
0709 13:01:47.526404 (+ 33346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.527338  1546 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:01:47.462276  6485 log.cc:927] Time spent T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:01:47.466344  6442 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:01:47.468041  6305 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:47.535852  2211 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:47.418411  6422 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:47.471024  6474 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:47.477285  6459 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:47.483333  1541 rpcz_store.cc:276] 0709 13:01:46.325935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.275549 (+949614us) service_pool.cc:224] Handling call
0709 13:01:47.482779 (+207230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.552896  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1705) took 1360 ms. Trace:
I20260709 13:01:47.553290  1541 rpcz_store.cc:276] 0709 13:01:46.192550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.552118 (+1359568us) service_pool.cc:224] Handling call
0709 13:01:47.552383 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.552567 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.552598 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.552639 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:47.552679 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.552736 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.552842 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.493204  2240 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:47.495980  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:47.495719  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:47.556213  1545 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:47.556473  2240 raft_consensus.cc:1240] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:47.556993  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:47.500193  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.557765  1540 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:01:47.555014  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:47.558225  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1720) took 1327 ms. Trace:
I20260709 13:01:47.558343  1693 raft_consensus.cc:3055] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:47.456473  6421 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:47.561618  1690 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:01:47.495373  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 168185us
I20260709 13:01:47.556847  1586 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:47.516952  1543 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:01:47.469033  6365 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:47.519901  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.564450  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:47.564584  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 666) took 1297 ms. Trace:
I20260709 13:01:47.564991  1542 rpcz_store.cc:276] 0709 13:01:46.267351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.519682 (+1252331us) service_pool.cc:224] Handling call
0709 13:01:47.564525 (+ 44843us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.566268  1542 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: [13.8-15.9]
I20260709 13:01:47.566854  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1711) took 1373 ms. Trace:
I20260709 13:01:47.500098  5903 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:47.495855  6312 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:47.495711  6392 raft_consensus.cc:740] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:47.522513  6405 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:47.492566  6426 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.524096   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:47.572686  1546 raft_consensus.cc:1240] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:01:47.572909  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 659) took 1307 ms. Trace:
I20260709 13:01:47.573310  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1712) took 1379 ms. Trace:
I20260709 13:01:47.573774  1546 rpcz_store.cc:276] 0709 13:01:46.194299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.572211 (+1377912us) service_pool.cc:224] Handling call
0709 13:01:47.572486 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.573063 (+   577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.573261 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.532585  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1704) took 1340 ms. Trace:
I20260709 13:01:47.483721  6380 raft_consensus.cc:740] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:47.581223  6468 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:47.581645  6390 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:47.561275  6273 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 10. Current term is 11.
I20260709 13:01:47.582120  6392 consensus_queue.cc:260] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:47.581871  6380 consensus_queue.cc:260] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:47.540014  6196 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:47.548461  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:47.583362  6426 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:47.584622  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:47.585012  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:47.558797  1693 raft_consensus.cc:740] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:47.558564  1540 rpcz_store.cc:276] 0709 13:01:46.230670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.499906 (+1269236us) service_pool.cc:224] Handling call
0709 13:01:47.558171 (+ 58265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.557787  1695 raft_consensus.cc:2393] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 11: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:47.559540  1614 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:01:47.587869  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:47.560254  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:47.588191  1693 consensus_queue.cc:260] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:47.589082  1693 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:47.560535  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:47.471490  2210 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:47.569522  1585 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:47.576503  1547 rpcz_store.cc:276] 0709 13:01:46.192281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.531648 (+1339367us) service_pool.cc:224] Handling call
0709 13:01:47.531984 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.532158 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.532195 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.532257 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:47.532314 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.532406 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.532512 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.580747  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:47.594491  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 123092us
I20260709 13:01:47.594833  1690 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:47.582016  1622 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:47.567183  1542 rpcz_store.cc:276] 0709 13:01:46.193916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.565715 (+1371799us) service_pool.cc:224] Handling call
0709 13:01:47.566016 (+   301us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:47.566618 (+   602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.566805 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.573566  1543 rpcz_store.cc:276] 0709 13:01:46.265235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.242850 (+977615us) service_pool.cc:224] Handling call
0709 13:01:47.572757 (+329907us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54000b5c54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:47.572855 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292546304}
W20260709 13:01:47.552299  6417 consensus_meta.cc:287] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.006s
I20260709 13:01:47.595496  1687 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:47.596361  1542 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:47.597401  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:47.607087  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 667) took 1324 ms. Trace:
I20260709 13:01:47.602635  1544 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:01:47.498113  1512 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:47.604900  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:47.608245  1542 rpcz_store.cc:276] 0709 13:01:46.283117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.595872 (+1312755us) service_pool.cc:224] Handling call
0709 13:01:47.596143 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.606849 (+ 10706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.607033 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.596705  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 669) took 1313 ms. Trace:
I20260709 13:01:47.612819  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:47.665953  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:47.581857  6468 raft_consensus.cc:697] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:47.662298  1693 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
W20260709 13:01:47.672606  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 59857.6us
I20260709 13:01:47.674412  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:47.675855  1620 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:01:47.670924  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 670) took 1387 ms. Trace:
I20260709 13:01:47.676997  1542 rpcz_store.cc:276] 0709 13:01:46.283909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.609133 (+1325224us) service_pool.cc:224] Handling call
0709 13:01:47.670225 (+ 61092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.670475 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.670523 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.670582 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:47.670637 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.670719 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.670852 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.615851  1539 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:47.565352  6442 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:47.615048  2238 raft_consensus.cc:2368] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9.
I20260709 13:01:47.577520  6362 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:47.610809  6365 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:47.714814  1617 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:47.683781  6495 log.cc:927] Time spent T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:01:47.668299  6435 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:47.662988  6469 raft_consensus.cc:2764] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:01:47.669040  6490 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:01:47.688788  5903 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:47.731976  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:47.691154  6486 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.253s	user 0.001s	sys 0.001s
I20260709 13:01:47.743103  1620 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:47.610468  6419 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:47.667160  6369 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.672428  6392 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:47.695119  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:47.697561  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1707) took 1504 ms. Trace:
I20260709 13:01:47.714618  6371 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:47.698320  6468 consensus_queue.cc:237] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:47.699303  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.702394  6271 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:47.786006  6271 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:47.723445  6442 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:47.787820  6442 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:47.788371  6271 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:47.703130  6499 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:47.708408  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.667289  1543 rpcz_store.cc:276] 0709 13:01:46.283673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.596015 (+1312342us) service_pool.cc:224] Handling call
0709 13:01:47.596228 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.596392 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.596417 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.596457 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:47.596494 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.596546 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.596658 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:47.712522  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 214481us
I20260709 13:01:47.791669  1512 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:47.791818  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:47.792778  1512 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:47.673995  1585 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:47.715879  1545 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
W20260709 13:01:47.719426  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.795801  1546 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:01:47.662700  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 479456ab418d44c4983d2bb37eb0e700 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 13:01:47.604279  6273 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:47.811095  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 674) took 1526 ms. Trace:
I20260709 13:01:47.690973  6426 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:47.745787  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:47.749269  1538 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:01:47.751750  2243 raft_consensus.cc:2393] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 13: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:47.751590  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:47.763330  1544 rpcz_store.cc:276] 0709 13:01:46.192979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.564452 (+1371473us) service_pool.cc:224] Handling call
0709 13:01:47.564745 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.607768 (+ 43023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.697321 (+ 89553us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b5400160654. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:47.697504 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86548224}
I20260709 13:01:47.697705  2244 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:47.779711  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2526) took 1251 ms. Trace:
I20260709 13:01:47.780169  6272 raft_consensus.cc:3055] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:47.766426  6369 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:47.865208  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:47.616430  6474 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.137s
I20260709 13:01:47.743042  6435 raft_consensus.cc:697] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:47.800957  1586 leader_election.cc:400] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9.
I20260709 13:01:47.875957  1586 leader_election.cc:403] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:47.876502  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 85722.3us
I20260709 13:01:47.876611  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:47.877202  1544 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:47.744341  6383 consensus_queue.cc:1059] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:01:47.806368  6473 consensus_queue.cc:1059] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:47.807674  5903 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:47.894729  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:47.808375  1430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 192525us
I20260709 13:01:47.809849  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 675) took 1524 ms. Trace:
I20260709 13:01:47.811892  6305 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:47.812863  1587 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:47.813692  1693 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:47.811602  1543 rpcz_store.cc:276] 0709 13:01:46.284851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.810207 (+1525356us) service_pool.cc:224] Handling call
0709 13:01:47.810486 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.810689 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.810723 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.810775 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:47.810830 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.810903 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.811034 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.736335  6365 raft_consensus.cc:697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:47.861640  1691 rpcz_store.cc:276] 0709 13:01:46.528780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.529758 (+   978us) service_pool.cc:224] Handling call
0709 13:01:46.530168 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.551794 (+ 21626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.551822 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.556181 (+  4359us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.830151 (+273970us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b180035ec00. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb0d1 00007fc4916e6a0f
0709 13:01:47.188025 (+357874us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:47.188083 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.188174 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.690570 (+502396us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:47.779477 (+ 88907us) raft_consensus.cc:1685] finished
0709 13:01:47.779501 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.779646 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21129,"raft.queue_time_us":23388,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6060,"spinlock_wait_cycles":72845952,"thread_start_us":357663,"threads_started":1,"wal-append.queue_time_us":778388}
W20260709 13:01:47.871019  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 60268.2us
I20260709 13:01:47.727322  6407 consensus_queue.cc:1059] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
W20260709 13:01:47.806399  6444 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:01:47.884348  6469 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:47.805757  1539 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:47.879594  1659 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:47.934635  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 55124us
I20260709 13:01:47.860386  6321 consensus_queue.cc:1059] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:01:47.882982  1690 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:01:47.727157  6471 consensus_queue.cc:1059] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:01:47.812104  6421 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.815685  6493 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:47.897269  1545 rpcz_store.cc:276] 0709 13:01:46.286401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.808936 (+1522535us) service_pool.cc:224] Handling call
0709 13:01:47.809345 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.809525 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.809549 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.809590 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:47.809632 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.809691 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.809793 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.891736  1544 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
W20260709 13:01:47.897789  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 84987.7us
I20260709 13:01:47.896659  1695 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
W20260709 13:01:47.905313  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 231374us
I20260709 13:01:47.771725  6460 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.113s
W20260709 13:01:47.924805  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.925576  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.800318  6499 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:47.860385  6272 raft_consensus.cc:740] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:47.866488  6363 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.936000  1659 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:47.947979  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:47.945567  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:47.946681  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:47.946867  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:47.949674  1620 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:47.928712  6478 log.cc:927] Time spent T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:47.952924  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:47.950258  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.948657  1544 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:47.953404  1659 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:47.954071  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:47.928051  6280 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:47.955152  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:47.943217  1585 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:47.960794  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.962807  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:47.965620  1544 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:47.966606  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:47.966873  1659 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:47.934671  6490 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:47.936213  5903 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:47.936731  6305 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.986040  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:47.970727  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.939419  6374 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.973999  1585 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:47.978729  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:47.941905  6459 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:47.989573  1620 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:47.993067  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:47.956779  6422 raft_consensus.cc:3055] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:48.008205  1543 raft_consensus.cc:2393] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 15: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:47.948694  6499 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:47.969974  6321 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:47.966694  6471 raft_consensus.cc:3055] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:47.971856  6427 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:47.970155  6417 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:47.939540  6468 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:01:47.965358  6363 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:48.016374  1543 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:48.036135  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2861) took 1709 ms. Trace:
I20260709 13:01:48.036525  1543 rpcz_store.cc:276] 0709 13:01:46.327092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.012754 (+1685662us) service_pool.cc:224] Handling call
0709 13:01:48.013131 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.035823 (+ 22692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.036069 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:48.037460  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:48.038422  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:48.038893  1543 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:47.948623  6421 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:47.991866  6313 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:48.024266  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.994423  6459 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:47.970047  6280 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:48.008251  6422 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:48.016754  6426 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.010008  6490 raft_consensus.cc:697] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:47.995447  6305 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.068037  6305 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:47.969626  6435 consensus_queue.cc:237] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:48.014381  6321 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:48.072628  6321 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:48.043798  2209 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:48.017419  6471 raft_consensus.cc:740] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:48.076404  6471 consensus_queue.cc:260] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.077920  6471 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:48.008908  6374 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.081388  6374 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:48.017508  6365 consensus_queue.cc:237] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:48.050886  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1713) took 1856 ms. Trace:
I20260709 13:01:48.086953  1546 rpcz_store.cc:276] 0709 13:01:46.194554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.575343 (+1380789us) service_pool.cc:224] Handling call
0709 13:01:47.795574 (+220231us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.796245 (+   671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.050672 (+254427us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54002e9850. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:48.050821 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505734912}
I20260709 13:01:48.088160  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:48.089231  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:48.089721  1546 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
W20260709 13:01:48.010064  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 101412us
I20260709 13:01:48.023823  6427 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:48.091466  6427 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:48.095780  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.083052  6374 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:48.104166  6374 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:48.121575  6374 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:48.124691  6321 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:47.995301  5903 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:48.129606  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 61966.2us
I20260709 13:01:48.130810  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:48.131332  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 87596.8us
I20260709 13:01:48.134807  1512 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:48.137107  2209 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:48.140422  1543 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:48.052891  6313 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:48.065903  6426 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.150322  6313 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:48.151986  6426 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:48.143210  6279 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:48.152807  6280 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:48.134052  6305 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:48.155149  6380 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:48.155782  6305 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.157943  6305 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:48.060029  6417 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:48.204747  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 67695.2us
I20260709 13:01:48.061458  6459 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:48.147848  5957 log.cc:927] Time spent T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:01:48.212574  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 140745us
I20260709 13:01:48.134344  6473 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:48.203425  6501 log.cc:927] Time spent T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
I20260709 13:01:48.159392  6460 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:48.239421  6460 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:48.239876  6460 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:48.241143  6507 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.285s	user 0.003s	sys 0.000s
I20260709 13:01:48.243649  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2948) took 1294 ms. Trace:
I20260709 13:01:48.244171  1618 rpcz_store.cc:276] 0709 13:01:46.949171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.949319 (+   148us) service_pool.cc:224] Handling call
0709 13:01:46.949715 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.975499 (+ 25784us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:47.318986 (+343487us) log.cc:844] Serialized 14 byte log entry
0709 13:01:47.607174 (+288188us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.662844 (+ 55670us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.662993 (+   149us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:47.663033 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.663099 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.243372 (+580273us) raft_consensus.cc:1685] finished
0709 13:01:48.243400 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.243567 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46255,"prepare.queue_time_us":303979,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":4291,"raft.queue_time_us":35412,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":72095,"thread_start_us":601098,"threads_started":2,"wal-append.queue_time_us":401465}
I20260709 13:01:48.249205  2243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45886 (request call id 1019) took 1055 ms. Trace:
I20260709 13:01:48.249698  2243 rpcz_store.cc:276] 0709 13:01:47.194111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.195367 (+  1256us) service_pool.cc:224] Handling call
0709 13:01:48.248938 (+1053571us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b54005ab754. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:48.249134 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1276321536}
I20260709 13:01:48.254732  6363 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:48.256548  6518 raft_consensus.cc:3055] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:48.257043  6518 raft_consensus.cc:740] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:48.257953  6518 consensus_queue.cc:260] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.133888  6519 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:48.222498  6513 log.cc:927] Time spent T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:01:48.223905  6321 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:48.226128  6427 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:48.227345  6510 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:01:48.218616  6521 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:48.229650  6506 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 13:01:48.236917  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1719) took 2007 ms. Trace:
I20260709 13:01:48.285056  1540 rpcz_store.cc:276] 0709 13:01:46.230319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.587273 (+1356954us) service_pool.cc:224] Handling call
0709 13:01:47.587519 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.046698 (+459179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.046731 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:48.046774 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:48.046814 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.236681 (+189867us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54003c3f54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:48.236731 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.236860 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1055451008}
I20260709 13:01:48.286875  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:48.236405  6490 consensus_queue.cc:237] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:48.260022  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 662) took 1993 ms (client timeout 1676 ms). Trace:
I20260709 13:01:48.246978  6493 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:48.030953  6272 consensus_queue.cc:260] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:48.283710  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.289356  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:01:48.290406  1538 rpcz_store.cc:269] 0709 13:01:46.266115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.970788 (+704673us) service_pool.cc:224] Handling call
0709 13:01:48.259801 (+1289013us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b54002e4854. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:48.259939 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1772457728}
I20260709 13:01:48.287530  1540 raft_consensus.cc:2376] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11. Re-sending same reply.
I20260709 13:01:48.290994  2243 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:48.259204  6518 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:48.287549  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 313591us
W20260709 13:01:48.282935  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 296948us
I20260709 13:01:48.326182  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:48.327445  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2869) took 1390 ms. Trace:
I20260709 13:01:48.328708  1659 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:48.334760  1540 rpcz_store.cc:276] 0709 13:01:46.937182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.326699 (+1389517us) service_pool.cc:224] Handling call
0709 13:01:48.326950 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.327130 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.327152 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:48.327190 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:48.327226 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.327299 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.327393 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:48.335877  1540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39612
I20260709 13:01:48.336337  1540 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:48.336653  1540 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:48.337118  1659 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:48.338792  1659 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:48.340276  1659 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:48.343034  1659 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:48.344709  1538 raft_consensus.cc:2393] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 8: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:48.285068  6311 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:48.283468  6519 raft_consensus.cc:697] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:01:48.352550  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.354628  1585 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:48.356693  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:48.358486  1659 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:48.268857  6473 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:48.361591  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:48.366724  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.392375  1690 raft_consensus.cc:2410] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:48.362412  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2874) took 1417 ms. Trace:
I20260709 13:01:48.393991  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:48.346334  6374 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:48.348690  6469 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9.
I20260709 13:01:48.347011  6426 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:01:48.395219  1588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.007s	sys 0.014s
W20260709 13:01:48.431458  1588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.008s	sys 0.014s
W20260709 13:01:48.402295  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.359333  1585 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:48.295754  6524 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:48.351496  6311 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:48.406420  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:48.437552  1690 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:01:48.393635  1538 rpcz_store.cc:276] 0709 13:01:46.945077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.361700 (+1416623us) service_pool.cc:224] Handling call
0709 13:01:48.361957 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.362119 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.362143 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:48.362180 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:48.362210 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.362274 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.362362 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:48.439409  1512 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:48.388953  6506 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:01:48.342204  6417 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:01:48.442327  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 83087.5us
I20260709 13:01:48.444867  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 671) took 2160 ms. Trace:
I20260709 13:01:48.454728  1542 rpcz_store.cc:276] 0709 13:01:46.284166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.678460 (+1394294us) service_pool.cc:224] Handling call
0709 13:01:47.723966 (+ 45506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.724200 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:47.829379 (+105179us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.444532 (+615153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:48.444581 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:48.444627 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.444700 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.444817 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104320,"prepare.queue_time_us":55019,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"thread_start_us":614823,"threads_started":3,"wal-append.queue_time_us":601173}
I20260709 13:01:48.358057  6305 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
W20260709 13:01:48.436537  6510 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:01:48.458308  1511 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 1.606s (SENT) [suppressed 25 similar messages]
I20260709 13:01:48.432734  6525 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:48.384267  6527 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:48.395661  6471 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:48.452008  6468 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:48.447856  6311 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:48.391819  6493 consensus_queue.cc:1059] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:01:48.450868  6463 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.390159  6460 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.457800  6374 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:48.452450  6426 raft_consensus.cc:697] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:48.489292  6541 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:48.476670  6421 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:48.527561  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 664) took 2260 ms. Trace:
I20260709 13:01:48.485708  6471 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:48.476323  6459 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:48.531384  1547 rpcz_store.cc:276] 0709 13:01:46.266801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.594412 (+1327611us) service_pool.cc:224] Handling call
0709 13:01:47.663313 (+ 68901us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.663785 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.663817 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.664415 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.878089 (+213674us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:47.927104 (+ 49015us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.049287 (+122183us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b1800483c40. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63b455 00007fc491723060 00007fc491735716 00007fc491746287 00007fc491746208
0709 13:01:48.284444 (+235157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.284515 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.507071 (+222556us) raft_consensus.cc:1685] finished
0709 13:01:48.527282 (+ 20211us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.527473 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48879,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":3808,"raft.queue_time_us":125769,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":38875,"spinlock_wait_cycles":4635520,"thread_start_us":379986,"threads_started":2,"wal-append.queue_time_us":218075}
I20260709 13:01:48.498620  5903 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:48.491055  6417 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 13:01:48.547377  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 93533.4us
I20260709 13:01:48.548606  1585 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:01:48.537608  6499 consensus_meta.cc:287] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.000s
W20260709 13:01:48.551982  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 155704us
I20260709 13:01:48.552951  1659 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:48.555332  1547 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:48.556056  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2882) took 1446 ms. Trace:
I20260709 13:01:48.556371  1547 rpcz_store.cc:276] 0709 13:01:47.109835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.538747 (+1428912us) service_pool.cc:224] Handling call
0709 13:01:48.546708 (+  7961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.555800 (+  9092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.555997 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:48.557740  6515 log.cc:927] Time spent T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:01:48.533354  6374 raft_consensus.cc:697] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:48.558873  1547 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:48.544247  6427 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:48.559270  6374 consensus_queue.cc:237] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.560406  6471 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.564841  6459 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:48.553817  1659 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:48.575626  1620 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:48.553679  1540 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.506377  6463 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.583009  1538 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:48.543473  6514 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 13:01:48.541087  6421 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:48.588307  1585 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:01:48.593534  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.609299  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:48.610126  1620 raft_consensus.cc:2393] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 13: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:48.487991  6519 consensus_queue.cc:237] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.621088  1540 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:48.521152  6541 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:48.607117  6540 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:48.584789  6527 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:48.611408  6421 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:48.623423  6549 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:48.636708  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1706) took 2443 ms. Trace:
W20260709 13:01:48.637491  6533 log.cc:927] Time spent T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:01:48.581763  6493 consensus_queue.cc:1059] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:01:48.616040  6547 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:48.646091  1547 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:01:48.646449  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:48.622097  6426 consensus_queue.cc:237] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:48.642567  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.648797  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:39612 (request call id 2873) took 1683 ms. Trace:
I20260709 13:01:48.660599  1540 rpcz_store.cc:276] 0709 13:01:46.944718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.335766 (+1391048us) service_pool.cc:224] Handling call
0709 13:01:48.621541 (+285775us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:48.649250  1541 rpcz_store.cc:276] 0709 13:01:46.192769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.554398 (+1361629us) service_pool.cc:224] Handling call
0709 13:01:47.554698 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.555043 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:47.731162 (+176119us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.161034 (+429872us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:48.210008 (+ 48974us) log.cc:844] Serialized 26 byte log entry
0709 13:01:48.210143 (+   135us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:48.210362 (+   219us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.214635 (+  4273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.214706 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.636415 (+421709us) raft_consensus.cc:1685] finished
0709 13:01:48.636444 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.636630 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69740,"prepare.queue_time_us":224459,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":322496,"raft.run_cpu_time_us":480,"raft.run_wall_time_us":70444,"thread_start_us":503448,"threads_started":3,"wal-append.queue_time_us":251638}
I20260709 13:01:48.662638  1541 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:48.664186  1541 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:48.582700  6499 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.666436  1547 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:48.641161  6540 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:48.614430  6529 consensus_queue.cc:1059] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:01:48.645756  6527 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:48.651638  6550 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:48.692276  6550 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:48.694427  6550 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:48.700064  6463 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:48.676645  6547 raft_consensus.cc:697] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:48.702716  6547 consensus_queue.cc:237] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.703253  6422 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.704771  6422 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:48.712086  1691 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:01:48.714584  6460 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:48.660761  6473 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:48.675297  6540 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:48.682139  6499 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:48.723162  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 2956) took 1163 ms. Trace:
I20260709 13:01:48.726176  1619 rpcz_store.cc:276] 0709 13:01:47.560224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.560336 (+   112us) service_pool.cc:224] Handling call
0709 13:01:48.722954 (+1162618us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54000ad7d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:48.723094 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783478016}
I20260709 13:01:48.668077  6374 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:48.728045  6374 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.745028  6499 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.745666  6499 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:48.686430  6313 consensus_meta.cc:287] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.536s	user 0.003s	sys 0.005s
I20260709 13:01:48.750039  6313 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:48.754233  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 314841us
I20260709 13:01:48.754812  6321 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.754894  6227 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.755457  6321 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:48.755518  6227 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:48.757359  6520 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.758037  6435 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.757849  6520 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:48.758522  6435 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.754411  6523 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:48.760201  6523 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.760623  6523 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:48.760898  6508 log.cc:927] Time spent T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.750s	user 0.004s	sys 0.000s
I20260709 13:01:48.762348  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:48.764457  6539 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:01:48.765992  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:48.766271  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.766649  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2868) took 1829 ms. Trace:
I20260709 13:01:48.767006  1543 rpcz_store.cc:276] 0709 13:01:46.936897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.141383 (+1204486us) service_pool.cc:224] Handling call
0709 13:01:48.141779 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.450761 (+308982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.450805 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:48.462571 (+ 11766us) log.cc:844] Serialized 26 byte log entry
0709 13:01:48.530474 (+ 67903us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:48.530903 (+   429us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.766373 (+235470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.766443 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.766481 (+    38us) raft_consensus.cc:1685] finished
0709 13:01:48.766493 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.766598 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":539985,"prepare.queue_time_us":3657,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":482360,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":39916,"thread_start_us":333661,"threads_started":2,"wal-append.queue_time_us":62675}
I20260709 13:01:48.773049  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:48.774171  6538 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:48.687974  6537 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:01:48.774893  6538 consensus_queue.cc:1059] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:01:48.778244  6536 raft_consensus.cc:3055] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:48.778601  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 2959) took 1168 ms. Trace:
I20260709 13:01:48.778626  6536 raft_consensus.cc:740] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:48.779991  2243 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:48.779711  6536 consensus_queue.cc:260] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:48.780052  6541 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:48.780843  6536 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:48.776221  6196 raft_consensus.cc:3055] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:48.782648  6196 raft_consensus.cc:740] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:48.783427  2242 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:48.784799  6468 raft_consensus.cc:3055] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:48.785248  6468 raft_consensus.cc:740] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:48.776643  6273 consensus_queue.cc:1059] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.012s
W20260709 13:01:48.789762  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.779115  1622 rpcz_store.cc:276] 0709 13:01:47.609980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.613724 (+  3744us) service_pool.cc:224] Handling call
0709 13:01:47.614075 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.663803 (+ 49728us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:48.150832 (+487029us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b18001467a0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e5b8c0a 00007fc497cf8219 00007fc48e640a40 00007fc48e63b4e4 00007fc48e63b455 00007fc4951233c7 00007fc4917359a7 00007fc4917450bf 00007fc491745038
0709 13:01:48.151090 (+   258us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.396736 (+245646us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:48.457019 (+ 60283us) log.cc:844] Serialized 26 byte log entry
0709 13:01:48.463281 (+  6262us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:48.463337 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.463432 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.778328 (+314896us) raft_consensus.cc:1685] finished
0709 13:01:48.778425 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.778549 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99188,"prepare.queue_time_us":486908,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":60321,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":71154,"spinlock_wait_cycles":27772288,"thread_start_us":235396,"threads_started":1,"wal-append.queue_time_us":414598}
I20260709 13:01:48.786290  6468 consensus_queue.cc:260] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.791710  6468 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:48.783447  6196 consensus_queue.cc:260] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:48.794797  6196 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:48.679062  6527 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:48.802204  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 665) took 2535 ms (client timeout 2205 ms). Trace:
I20260709 13:01:48.804133  6362 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:48.805325  1545 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:48.808781  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 678) took 2499 ms. Trace:
I20260709 13:01:48.809219  1545 rpcz_store.cc:276] 0709 13:01:46.309147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.986643 (+1677496us) service_pool.cc:224] Handling call
0709 13:01:48.804890 (+818247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.805786 (+   896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.808501 (+  2715us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b54000b5750. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:48.808708 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1880807168}
W20260709 13:01:48.815768  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.802822  1539 rpcz_store.cc:269] 0709 13:01:46.267080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.381744 (+1114664us) service_pool.cc:224] Handling call
0709 13:01:48.801937 (+1420193us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54000b5754. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:48.802109 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329422208}
I20260709 13:01:48.675503  6493 raft_consensus.cc:3055] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:48.820238  6493 raft_consensus.cc:740] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:48.821367  6493 consensus_queue.cc:260] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:48.835372  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.842180  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:48.867683  1586 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:48.869175  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2864) took 2287 ms. Trace:
W20260709 13:01:48.880347  6552 log.cc:927] Time spent T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.251s	user 0.003s	sys 0.001s
I20260709 13:01:48.882530  6383 raft_consensus.cc:3055] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:48.883060  6383 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:48.883893  6383 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:48.869656  1546 rpcz_store.cc:276] 0709 13:01:46.581990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.090266 (+1508276us) service_pool.cc:224] Handling call
0709 13:01:48.090613 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.137292 (+ 46679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.137344 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:48.148902 (+ 11558us) log.cc:844] Serialized 26 byte log entry
0709 13:01:48.352937 (+204035us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:48.396097 (+ 43160us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.750498 (+354401us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b180022f180. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e5b8c0a 00007fc497cf8219 00007fc48e640a40 00007fc48e63b4e4 00007fc48e63b455 00007fc491723060 00007fc491735716 00007fc491746287 00007fc491746208
0709 13:01:48.750710 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.750807 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.846074 (+ 95267us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b180022f180. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:01:48.868907 (+ 22833us) raft_consensus.cc:1685] finished
0709 13:01:48.868938 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.869110 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":225382,"prepare.queue_time_us":50455,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":529694,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":16682,"spinlock_wait_cycles":13462016,"thread_start_us":119909,"threads_started":1,"wal-append.queue_time_us":249945}
I20260709 13:01:48.892838  6371 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:48.893267  6371 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:48.894054  6371 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:48.895217  6371 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:48.901015  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2879) took 1792 ms. Trace:
I20260709 13:01:48.901531  1538 rpcz_store.cc:276] 0709 13:01:47.108984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.438917 (+1329933us) service_pool.cc:224] Handling call
0709 13:01:48.439315 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.584434 (+145119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.900685 (+316251us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54002e9354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:48.900936 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330045312}
I20260709 13:01:48.905052  6390 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:48.905993  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.909380  1622 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:48.914110  6272 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:48.928027  6520 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:48.929162  6374 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:48.929651  6305 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:48.931907  6305 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:01:48.933398  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.934751  2211 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:48.934981  1689 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:48.935720  6271 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:48.937096  6271 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:01:48.938104  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 70546.1us
I20260709 13:01:48.938400  5957 tablet_bootstrap.cc:492] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:48.939046  6407 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:48.939489  5957 tablet_bootstrap.cc:492] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:01:48.940246  5957 ts_tablet_manager.cc:1403] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 3.654s	user 0.059s	sys 0.049s
I20260709 13:01:48.940451  6435 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:48.946571  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:48.944787  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:48.972703  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:48.973215  1538 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:48.951288  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:48.955710  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:48.975201  1539 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:01:48.956437  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:48.957065  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:48.957726  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.958788  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:48.971026  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:48.950605  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:48.977324  1613 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:48.977591  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:48.979679  1541 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:01:48.980792  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:48.983991  2210 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:48.987483  1547 raft_consensus.cc:2393] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:48.988386  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:48.991250  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:48.991693  1585 connection.cc:256] RPC call timeout handler was delayed by -1.7300118729999667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:01:48.991844  1538 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:48.993149  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:48.993287  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:48.994294  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:48.995561  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:48.994324  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:48.997073  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:49.001693  1693 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:49.002912  1688 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:49.003765  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:49.004021  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:49.004382  1614 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:49.004968  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:49.005388  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:49.005764  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:49.005785  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:49.006243  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:49.006405  1618 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:49.006433  1542 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:49.007463  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:49.008862  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:49.009876  1613 raft_consensus.cc:2410] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:49.011482  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:49.011895  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:49.012145  1615 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:49.012362  1689 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:49.012984  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:49.013391  1659 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:49.013833  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:49.014066  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:49.014285  1659 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:49.016916  1546 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:49.017098  1618 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:49.017570  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:49.019659  1540 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:49.027046  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:49.029296  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:49.024593  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:49.030272  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.030958  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 47057.6us
I20260709 13:01:49.030337  1618 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:49.029603  1659 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:49.033164  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:49.035706   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:48.970634  6538 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:49.057090  1614 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:49.044955  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:49.058674  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:49.059128  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:48.990489  6383 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:49.045562  6459 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:49.019420  6421 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:49.071856  6459 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.050937  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:49.072299  6459 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:49.039168  1538 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:49.073901  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:49.051887  1622 raft_consensus.cc:2410] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:01:49.046284  1511 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:48.938877  6523 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:49.060390  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:49.077306  1511 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:49.078110  1545 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:49.063391  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:49.079200  1547 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:49.077545  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:49.029956  6554 consensus_queue.cc:1059] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:01:49.066332  6390 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:49.067245  6517 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:49.068259  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:49.076457  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:49.073297  2210 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:49.025553  6493 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:49.086982  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:49.090520  1617 raft_consensus.cc:2376] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9. Re-sending same reply.
I20260709 13:01:49.091789  6435 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:49.030148  6313 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:49.045706  6427 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:49.097477  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:49.105577  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:49.110575  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:49.072392  6421 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:49.087293  1615 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:49.113354  2240 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:49.113305  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:49.018400  6419 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:01:49.071549  6369 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:49.044783  6494 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:01:49.111936  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:49.011567  6374 consensus_queue.cc:1059] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:01:49.139344  6511 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.137s
W20260709 13:01:49.141240  6311 consensus_meta.cc:287] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.641s	user 0.005s	sys 0.015s
I20260709 13:01:49.141687  6311 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:49.142439  1445 catalog_manager.cc:5697] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 12 to 13, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 13 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:49.094364  6538 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:49.144169  1445 catalog_manager.cc:5697] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:49.089725  6279 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:01:49.150197  6499 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:49.149973  5957 raft_consensus.cc:359] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:01:49.150866  5957 raft_consensus.cc:740] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
W20260709 13:01:49.152077  6556 log.cc:927] Time spent T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:01:49.159492  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:49.122838  6364 consensus_queue.cc:1059] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:01:49.123924  6305 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:49.098400  6559 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:49.161742  6559 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:49.162210  6364 raft_consensus.cc:3055] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:49.162761  6364 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:49.122668  6421 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.098193  6321 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:49.119781  1443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42122 (request call id 242) took 15625 ms (client timeout 15000 ms). Trace:
I20260709 13:01:49.114904  1617 raft_consensus.cc:2410] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 13:01:49.093107  6380 consensus_meta.cc:287] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.937s	user 0.020s	sys 0.002s
I20260709 13:01:49.122159  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:49.128681  1614 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:49.111109  1620 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:49.129654  1539 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:49.132048  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:49.092701  6312 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:49.132665  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:49.097715  6535 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.141891  6551 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 13:01:49.146047  1445 catalog_manager.cc:5697] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 12 to 13, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 13 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:49.114183  1615 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:01:49.177898  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 148336us
I20260709 13:01:49.181356  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:49.182202  1539 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:49.166921  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:49.107522  6136 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:49.192698  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 142470us
W20260709 13:01:49.122435  6471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.039s	sys 0.065s
I20260709 13:01:49.107311  6549 raft_consensus.cc:697] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:49.189081  1445 catalog_manager.cc:5697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:49.195606  2242 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:49.196399  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.202083  6474 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:49.202102  6369 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.214613  6369 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:49.214015  1445 catalog_manager.cc:5697] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 8 to 9, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 9 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:49.167517  6421 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:49.216064  1445 catalog_manager.cc:5697] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 6 to 10, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 10 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:49.216945  6369 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:49.117100  6427 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:49.217644  6427 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:49.217619  1445 catalog_manager.cc:5697] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:49.167929  6280 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:01:49.219892  1445 catalog_manager.cc:5697] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:01:49.168231  1443 rpcz_store.cc:269] 0709 13:01:33.509150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.509348 (+   198us) service_pool.cc:224] Handling call
0709 13:01:49.099897 (+15590549us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:42.493529 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:42.531861 (+ 38332us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:42.542361 (+ 10500us) write_op.cc:435] Acquired schema lock
0709 13:01:42.549326 (+  6965us) tablet.cc:662] Decoding operations
0709 13:01:42.631997 (+ 82671us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:42.632110 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:42.632170 (+    60us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:01:42.634395 (+  2225us) tablet.cc:701] Row locks acquired
0709 13:01:42.634465 (+    70us) write_op.cc:260] PREPARE: finished
0709 13:01:42.634700 (+   235us) write_op.cc:270] Start()
0709 13:01:42.634883 (+   183us) write_op.cc:276] Timestamp: P: 1783602102634615 usec, L: 0
0709 13:01:42.634915 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:01:42.772601 (+137686us) log.cc:844] Serialized 8374 byte log entry
0709 13:01:44.051547 (+1278946us) op_driver.cc:464] REPLICATION: finished
0709 13:01:44.276460 (+224913us) write_op.cc:301] APPLY: starting
0709 13:01:44.286844 (+ 10384us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:46.612649 (+2325805us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b18003e1580. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc49146a0ec 00007fc49146caf7 00007fc49146dfb0 00007fc4951821bb 00007fc495182532 00007fc4951c9b93 00007fc495076de3 00007fc4950766ab 00007fc495077e77
0709 13:01:46.875356 (+262707us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:46.926242 (+ 50886us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:47.808345 (+882103us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:47.808655 (+   310us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:01:47.808699 (+    44us) write_op.cc:312] APPLY: finished
0709 13:01:47.809100 (+   401us) log.cc:844] Serialized 188 byte log entry
0709 13:01:47.972692 (+163592us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:48.016921 (+ 44229us) write_op.cc:454] Released schema lock
0709 13:01:48.018936 (+  2015us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:48.215825 (+196889us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:48.217913 (+  2088us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":425637,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":172749,"apply.run_cpu_time_us":65677,"apply.run_wall_time_us":3901509,"cfile_cache_hit":86,"cfile_cache_hit_bytes":92075,"num_ops":21,"prepare.queue_time_us":194595,"prepare.run_cpu_time_us":77317,"prepare.run_wall_time_us":729266,"raft.queue_time_us":267548,"raft.run_cpu_time_us":15373,"raft.run_wall_time_us":120000,"replication_time_us":1392676,"spinlock_wait_cycles":82738432,"thread_start_us":980421,"threads_started":5,"wal-append.queue_time_us":1085594,"wal-append.run_cpu_time_us":14936,"wal-append.run_wall_time_us":1562766}]]}
I20260709 13:01:49.167930  6305 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:49.188726  6541 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:49.232926  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.240864  1620 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:01:49.241070  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:49.242414  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:49.225443  1445 catalog_manager.cc:5697] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 8 to 11, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 11 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:49.271154  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:49.272122  1691 raft_consensus.cc:2410] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:01:49.272322  1512 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:49.272557  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.288168  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 55788.1us
I20260709 13:01:49.294440  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:49.295171  1689 raft_consensus.cc:3055] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:49.295617  1689 raft_consensus.cc:740] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:01:49.295828  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 288411us
W20260709 13:01:49.282174  6540 consensus_meta.cc:287] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.005s
I20260709 13:01:49.207816  6490 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
W20260709 13:01:49.290855  6392 consensus_meta.cc:287] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 1.524s	user 0.013s	sys 0.012s
I20260709 13:01:49.302909  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:49.302716  1585 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:01:49.357986  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 61053.7us
I20260709 13:01:49.358816  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:49.362597  6273 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:49.367080  6563 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:01:49.366741  6273 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:49.195401  6535 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:49.373528  6535 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:49.373814  6549 consensus_queue.cc:237] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:49.375694  6560 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:01:49.317437  6540 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:49.378536  6540 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:49.378787  6568 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:01:49.240509  6305 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:49.382439  6305 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:49.377543  6559 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:49.388109  6273 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:49.358764  1689 consensus_queue.cc:260] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:49.389272  1689 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:49.392861  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:49.393944  1660 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:49.395692  1660 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:49.397212  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:49.399219  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 199380us
I20260709 13:01:49.394441  6313 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:49.317538  6312 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:49.225494  5957 consensus_queue.cc:260] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:01:49.317497  6311 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:49.289947  6541 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:49.452133  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 51263.9us
I20260709 13:01:49.456457  1689 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:01:49.406952  6568 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:49.467293  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 164646us
I20260709 13:01:49.460635  6522 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:49.475816  6468 consensus_meta.cc:287] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.680s	user 0.013s	sys 0.003s
I20260709 13:01:49.469834  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:49.494107  1691 raft_consensus.cc:2410] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:01:49.470667  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:49.471522  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:49.471928  1695 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:01:49.464571  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 56207.6us
I20260709 13:01:49.498314  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:49.488076  1512 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:49.472950  6527 consensus_meta.cc:287] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.674s	user 0.012s	sys 0.004s
I20260709 13:01:49.490409  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:49.469153  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:49.477576  6471 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:49.411194  6569 consensus_queue.cc:1059] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:01:49.506465  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:49.476555  6490 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:01:49.506826  6311 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:49.512039  6471 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.516062  6569 consensus_queue.cc:1243] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:49.548312  6566 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:49.548753  6564 log.cc:927] Time spent T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:49.549003  6565 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:49.549407  6565 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:49.506654  6527 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:49.549796  6565 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:49.552637  5957 ts_tablet_manager.cc:1434] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.612s	user 0.004s	sys 0.005s
W20260709 13:01:49.553045  5957 ts_tablet_manager.cc:1467] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: Tablet startup took 612ms
I20260709 13:01:49.561146  6545 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:49.561822  6545 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:49.513742  6407 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:49.564368  1585 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:49.539603  6576 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:49.540688  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:49.536379  6536 consensus_meta.cc:287] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.755s	user 0.017s	sys 0.008s
I20260709 13:01:49.504634  6522 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:49.534225  6313 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:49.580169  1541 raft_consensus.cc:2410] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:01:49.588907  1585 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:49.565575  6471 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:49.599226  1660 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:49.600596  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:49.605209  1585 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:49.607132  1544 raft_consensus.cc:2410] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:01:49.553382  5957 ts_tablet_manager.cc:1469] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: Trace:
0709 13:01:32.387022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.388686 (+  1664us) service_pool.cc:224] Handling call
0709 13:01:32.737744 (+349058us) ts_tablet_manager.cc:934] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
0709 13:01:36.832021 (+4094277us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:01:39.000088 (+2168067us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:39.031694 (+ 31606us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:01:39.409809 (+378115us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:01:39.410102 (+   293us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:39.410395 (+   293us) ts_tablet_manager.cc:989] Replica registered.
0709 13:01:39.410455 (+    60us) inbound_call.cc:177] Queueing success response
0709 13:01:45.240121 (+5829666us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:01:48.940526 (+3700405us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:01:49.147673 (+207147us) tablet_replica.cc:261] Starting instrumentation
0709 13:01:49.148283 (+   610us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":309,"mutex_wait_us":27302,"raft.queue_time_us":13700,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":6319,"tablet-copy.queue_time_us":184405,"tablet-download-pool.queue_time_us":236,"tablet-download-pool.run_cpu_time_us":1858,"tablet-download-pool.run_wall_time_us":3985559,"thread_start_us":317154,"threads_started":2}
I20260709 13:01:49.576706  6311 raft_consensus.cc:697] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:49.612003  1585 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:49.586838  6540 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:49.610544  6562 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:49.594710  6566 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:49.638859  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:49.570474  6459 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:49.595777  6272 consensus_meta.cc:287] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.000s
W20260709 13:01:49.677858  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 255897us
I20260709 13:01:49.575829  6407 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:49.578765  6577 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.098s
W20260709 13:01:49.695138  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 56362.1us
I20260709 13:01:49.703608  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:49.704571  1546 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:49.613369  6569 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:49.699759  1511 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:49.639582  6519 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:49.710047  1545 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:49.722930  1688 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:49.723294  1542 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:49.710865  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:49.678202  6490 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:49.714427  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.715587  2242 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:01:49.716418  1511 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:49.745627  6499 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:49.757720  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:49.759390  6392 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:49.760136  6392 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:49.761255  6311 consensus_queue.cc:237] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:49.764812  6493 consensus_meta.cc:287] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.000s
I20260709 13:01:49.765808  1619 raft_consensus.cc:2410] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:49.765481  6536 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:49.757789  6499 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:49.767138  1511 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:49.768249  6392 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:49.768559  6499 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:49.770093  6392 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:49.744877  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 144358us
W20260709 13:01:49.774771  6421 consensus_meta.cc:287] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.002s
W20260709 13:01:49.775771  6586 log.cc:927] Time spent T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:01:49.777256  1616 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:49.778882  6407 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:49.780751  6569 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:49.781332  6569 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:49.716990  6519 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:49.783062  6519 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:49.783993  6569 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:49.705940  6321 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:49.639111  6313 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:49.786648  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:49.744344  6272 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.787436  1687 raft_consensus.cc:2393] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 15: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:49.787580  6272 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:49.789544  6272 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:49.790675  6273 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.791203  6273 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:49.756989  6490 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.792326  6490 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:49.794138  6528 consensus_queue.cc:1059] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:01:49.795897  6571 log.cc:927] Time spent T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
I20260709 13:01:49.795573  6557 consensus_queue.cc:1059] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:49.796101  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:49.796732  1687 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:01:49.796877  6557 raft_consensus.cc:3055] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:49.797382  6557 raft_consensus.cc:740] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:49.798661  6557 consensus_queue.cc:260] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:49.800660  6557 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:49.719570  6584 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:49.808236  6582 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:49.811575  6459 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:49.813736  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:49.747737  6545 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:49.814209  6421 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:49.845679  6421 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:49.826107  6279 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:49.831785  6136 consensus_meta.cc:287] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.002s
W20260709 13:01:49.858464  6427 consensus_meta.cc:287] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.000s
I20260709 13:01:49.861083  6519 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:49.864614  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:49.865712  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:49.866261  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:49.866940  1620 raft_consensus.cc:1813] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Handling vote request from an unknown peer d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:49.867677  1620 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:49.867569  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:49.863883  1586 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:49.868956  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:49.870128  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:49.870831  1546 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:49.872794  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:49.865170  1613 raft_consensus.cc:2376] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12. Re-sending same reply.
I20260709 13:01:49.876452  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:49.873581  2244 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:49.882594  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:49.885164  1586 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:49.891677  1511 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:49.855549  6279 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.897801  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:49.876010  6545 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.892531  6577 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:49.900028  6545 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:49.901315  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:49.902113  6545 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:49.912256  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:49.913420  6535 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:49.914089  6535 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:49.892314  6493 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:49.929066  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:49.863140  6519 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:49.937358  6227 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:49.875550  6321 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.874972  6136 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:49.859048  6427 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:49.945160  6279 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:49.961601  1546 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:49.914892  6565 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:49.966416  6427 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:49.967334  6565 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:49.967468  1695 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:49.952745  6490 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:49.987419  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1725) took 1027 ms. Trace:
I20260709 13:01:49.990101  1541 rpcz_store.cc:276] 0709 13:01:48.959533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.004680 (+ 45147us) service_pool.cc:224] Handling call
0709 13:01:49.987138 (+982458us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54003228d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:49.987339 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320562304}
I20260709 13:01:49.954500  6321 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:49.997344  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 85163.8us
I20260709 13:01:50.004103  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:50.005733  6311 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:50.009181  6321 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.009845  6311 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:50.010430  6364 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.016522  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:50.017112  1546 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:50.015556  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:50.028378  1541 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:50.031025  6490 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.030900  6364 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:50.027462  6371 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:50.031591  1546 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:50.032749  6311 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.033243  6523 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:50.034468  6554 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:50.035015  6554 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:50.039554  6426 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:01:50.039969  6471 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:50.042109  6471 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.051522  1541 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:50.052074  1540 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:50.052863  1545 raft_consensus.cc:1240] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:01:50.054768  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:50.055393  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:50.055814  1541 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:50.057801  1539 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:50.058847  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:50.060935  6554 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:50.063581  1660 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:50.066291  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:50.066403  1586 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:50.068670  1586 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:50.067209  1614 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:01:50.069717  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:50.071698  2244 raft_consensus.cc:2393] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 12: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:50.072650  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:50.073653  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:50.111222  1547 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:50.074983  6541 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:50.075568  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:50.076201  6520 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:50.076556  6570 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:50.078783  1546 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:50.077936  6554 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:50.081442  1696 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:50.084995  6527 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:50.093207  6427 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:50.093779  1615 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:50.171149  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.230945  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:50.107019  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:50.246251  2244 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:50.246766  1620 raft_consensus.cc:1240] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:50.247499  2210 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:50.234325  1541 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:01:50.239362  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:50.255138  1547 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:01:50.256923  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:50.257611  1543 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:50.242509  6570 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.266507  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:50.233716  6459 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:50.237413  6550 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:50.272732  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 44880.3us
I20260709 13:01:50.274650  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:50.268085  1547 raft_consensus.cc:2368] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16.
I20260709 13:01:50.244681  6417 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.241158  6523 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.257604  6490 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:50.277818  1543 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:01:50.262972  6271 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:50.265338  6527 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:50.270032  6570 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:50.289216  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:50.276626  6521 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:50.281620  6551 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.271595  6438 consensus_queue.cc:1059] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:01:50.280797  6426 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:50.304160  6426 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:50.280007  6550 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.306278  6426 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:50.283845  6271 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:50.306929  6271 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:50.287827  6490 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.309074  6490 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:50.310879  1541 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:01:50.262365  6427 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:01:50.313189  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:50.283663  6523 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.280992  6279 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.307003  6550 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:50.312760  6551 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:50.281860  6417 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.328820  6417 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:50.276733  6459 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:50.320664  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:50.323392  6523 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:50.328969  6551 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:50.330799  6459 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:50.332564  6273 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.303462  6521 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.324344  6522 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:50.340548  2238 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:50.343899  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:50.345619  6427 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:50.346673  6279 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.348351  6521 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:50.345769  6591 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.489s	user 0.001s	sys 0.001s
I20260709 13:01:50.346549  6390 raft_consensus.cc:3055] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:50.350971  6521 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:50.351087  6390 raft_consensus.cc:740] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:50.351601  6521 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.352078  6390 consensus_queue.cc:260] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:50.353072  6390 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:50.353335  6271 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.354558  6521 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.371145  6570 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.373788  6570 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:50.319621  1543 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
W20260709 13:01:50.404874  1544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 682) took 2486 ms (client timeout 2846 ms). Trace:
W20260709 13:01:50.405893  1544 rpcz_store.cc:269] 0709 13:01:47.835779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.966377 (+130598us) service_pool.cc:224] Handling call
0709 13:01:50.321988 (+2355611us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54001879d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:50.322120 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3769847168}
W20260709 13:01:50.408022  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 104508us
I20260709 13:01:50.410176  1511 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:50.411626  1540 raft_consensus.cc:1240] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:01:50.416023  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:01:50.417815  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.420436  1557 tablet_copy_service.cc:342] P d7158d6c3b634dc7abb69eac58eba291: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-5ee97fe9eef14f818a1f9178885dfc31 received from {username='slave'} at 127.0.0.1:42858
I20260709 13:01:50.420897  1541 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:50.421240  1557 tablet_copy_service.cc:434] P d7158d6c3b634dc7abb69eac58eba291: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-5ee97fe9eef14f818a1f9178885dfc31 on tablet 5ee97fe9eef14f818a1f9178885dfc31 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:50.411661  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:50.424511  1545 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:01:50.416126  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:50.432484  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:50.432811  1613 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:50.433377  2242 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:50.436050  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:50.438680  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:50.438876  2210 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:50.417927  1542 raft_consensus.cc:2410] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:50.446316  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:50.446352  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:50.448173  1693 raft_consensus.cc:1813] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Handling vote request from an unknown peer d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:50.448971  1693 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:50.456454  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:50.457816  6271 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.461170  6271 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:50.467881  6435 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:50.468622  6435 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.469177  6435 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:50.471621  6522 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:50.472649  6522 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:50.475831  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2503) took 1481 ms. Trace:
I20260709 13:01:50.476490  1616 rpcz_store.cc:276] 0709 13:01:48.994746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.995329 (+   583us) service_pool.cc:224] Handling call
0709 13:01:50.475431 (+1480102us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b540033c054. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:50.475629 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111922432}
I20260709 13:01:50.477438  6568 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:50.478384  6568 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.475922  6516 raft_consensus.cc:3055] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:50.462250  6271 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:50.482506  6271 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.480388  6516 raft_consensus.cc:740] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:50.489641  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:50.498431  1620 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:01:50.510020  6499 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.510946  6499 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.514528  6499 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:50.521607  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:50.527866  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:50.529244  1617 raft_consensus.cc:2410] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:01:50.530550  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:50.521780  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2512) took 1495 ms. Trace:
I20260709 13:01:50.523762  2246 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:50.531301  1618 rpcz_store.cc:276] 0709 13:01:49.026247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.102935 (+ 76688us) service_pool.cc:224] Handling call
0709 13:01:50.489135 (+1386200us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b58000f9998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc4966f10a0 00007fc4966f0984 00007fc48fc6b6d4 00007fc48fc6b662
0709 13:01:50.521720 (+ 32585us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6877568}
I20260709 13:01:50.534932  6536 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.536732  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:50.536936  6536 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:50.539594  2237 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 15 LEARNER]: Advancing to term 16
I20260709 13:01:50.542006  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:50.542027  6521 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:50.542922  6521 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.543675  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:50.545346  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:50.545784  6536 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.546078  2239 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:50.546543  1617 raft_consensus.cc:2393] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 12: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:50.547451  6521 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.554606  1586 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:50.554940  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:50.554745  6550 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.555648  6570 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:50.557675  6570 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.558033  6570 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:50.562119  6550 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:50.563562  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.564790  6550 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.565735  1614 raft_consensus.cc:1240] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:50.554622  6522 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.567034  2210 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:50.568401  6364 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:50.569118  6364 raft_consensus.cc:697] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:50.571869  6516 consensus_queue.cc:260] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.577713  6516 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:50.581399  1619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2497) took 1588 ms (client timeout 1800 ms). Trace:
W20260709 13:01:50.581918  1619 rpcz_store.cc:269] 0709 13:01:48.993097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.013574 (+ 20477us) service_pool.cc:224] Handling call
0709 13:01:50.580981 (+1567407us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54002030d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:50.581210 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1727085696}
I20260709 13:01:50.583591  6568 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:50.588840  6550 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.589713  6550 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:50.570482  6364 consensus_queue.cc:237] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.594627  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:50.599803  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:50.600751  1618 raft_consensus.cc:2393] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 17: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:50.607842  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:50.618541  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.618086  6499 consensus_queue.cc:1059] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:50.619756  6499 raft_consensus.cc:3055] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:50.620147  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:50.620216  6499 raft_consensus.cc:740] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:50.622162  6568 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:50.622598  6568 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.623004  6568 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:50.625569  6499 consensus_queue.cc:260] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.628312  6499 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:50.629925  1511 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:50.633525  6312 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:50.634336  6312 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.634743  6312 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:50.635475  1619 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:50.636996  6383 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.641180  6383 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.644852  6383 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:50.647008  2210 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:50.648159  6383 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.649148  6383 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:50.650821  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2903) took 1471 ms. Trace:
I20260709 13:01:50.651612  6383 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.619586  6468 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:50.655740  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:50.653115  6516 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:50.656837  2238 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:50.657262  6516 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:50.657936  6516 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.654585  2242 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:01:50.662900  1586 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:50.663550  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:50.664448  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1902) took 1195 ms. Trace:
W20260709 13:01:50.659107  1622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2496) took 1666 ms (client timeout 1888 ms). Trace:
I20260709 13:01:50.668458  6383 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:50.664839  1688 rpcz_store.cc:276] 0709 13:01:49.468521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.468673 (+   152us) service_pool.cc:224] Handling call
0709 13:01:49.469026 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.723531 (+254505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.663975 (+940444us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b540027b5d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:50.664275 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":583330048}
W20260709 13:01:50.666981  1622 rpcz_store.cc:269] 0709 13:01:48.992832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.993062 (+   230us) service_pool.cc:224] Handling call
0709 13:01:50.658607 (+1665545us) spinlock_profiling.cc:243] Waited 57.4 ms on lock 0x7b54001e8554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:50.658880 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132074880}
I20260709 13:01:50.673058  6383 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.673487  6383 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:50.673669  6554 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.674283  6554 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:50.676762  6554 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:50.679494  1511 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:50.681047  6536 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:50.682067  6536 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:50.682765  1586 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:50.682860  6536 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:50.684648  6597 log.cc:927] Time spent T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.827s	user 0.007s	sys 0.004s
I20260709 13:01:50.685397  6536 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.691531  6468 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:50.692329  6468 raft_consensus.cc:697] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:50.693464  6468 consensus_queue.cc:237] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.696095  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1906) took 1157 ms. Trace:
I20260709 13:01:50.696523  1695 rpcz_store.cc:276] 0709 13:01:49.538807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.539006 (+   199us) service_pool.cc:224] Handling call
0709 13:01:49.546644 (+  7638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.968268 (+421624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.695589 (+727321us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54000f2dd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:50.695895 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":967040384}
I20260709 13:01:50.700152  6550 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.705633  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 2501) took 1711 ms. Trace:
I20260709 13:01:50.706125  1621 rpcz_store.cc:276] 0709 13:01:48.994209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.994400 (+   191us) service_pool.cc:224] Handling call
0709 13:01:48.994686 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.024701 (+ 30015us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.024743 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.283988 (+1259245us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b1800320bc0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e60c2a6 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc490024a11 00007fc490034372 00007fc491766a01 00007fc49172b43a
0709 13:01:50.592554 (+308566us) spinlock_profiling.cc:243] Waited 6.94 ms on lock 0x7b2c000653e8. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc490024a11 00007fc490034372 00007fc491766a01 00007fc49172b43a 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2
0709 13:01:50.593316 (+   762us) log.cc:844] Serialized 26 byte log entry
0709 13:01:50.607776 (+ 14460us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:50.607803 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.611880 (+  4077us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.705244 (+ 93364us) raft_consensus.cc:1685] finished
0709 13:01:50.705269 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.705440 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18825,"raft.queue_time_us":24767,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":18774,"spinlock_wait_cycles":25094912,"thread_start_us":14048,"threads_started":1,"wal-append.queue_time_us":68560}
I20260709 13:01:50.710126  6271 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.716285  6511 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:50.735929  2242 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:50.716897  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:50.717229  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:50.737514  6271 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.737907  2239 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:50.739120  6568 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:50.740379  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:50.740953  1621 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.613339  6570 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.718470  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:50.743774  6570 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:50.744029  6390 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:50.744511  6390 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.744866  6390 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:50.720567  6538 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:50.721336  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:50.746385  1688 raft_consensus.cc:2393] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 14: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:50.722967  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:50.747011  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:50.747313  1695 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:01:50.747687  2239 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:50.724751  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:50.725468  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:50.748328  1690 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:50.726400  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:50.749837  6554 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:50.727540  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:50.750665  1687 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:01:50.750614  6554 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.753145  6554 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:50.726992  6536 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:50.749958  6369 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:50.753960  6369 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.741607  6568 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:50.769171  1511 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:50.651253  1538 rpcz_store.cc:276] 0709 13:01:49.179647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.195680 (+ 16033us) service_pool.cc:224] Handling call
0709 13:01:49.196101 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.412388 (+1216287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.412468 (+    80us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.413673 (+  1205us) log.cc:844] Serialized 26 byte log entry
0709 13:01:50.462229 (+ 48556us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:50.462261 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.650139 (+187878us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540011fb54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:50.650185 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.650226 (+    41us) raft_consensus.cc:1685] finished
0709 13:01:50.650237 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.650628 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53509,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":330,"spinlock_wait_cycles":2794365312,"thread_start_us":48053,"threads_started":1,"wal-append.queue_time_us":74670}
I20260709 13:01:50.756283  6312 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.818287  2239 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:50.801991  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:50.822077  6435 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:50.841930  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 81940.8us
I20260709 13:01:50.791394  6536 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.845364  1622 raft_consensus.cc:2393] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:50.866632  1445 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58806 (request call id 179) took 10070 ms. Trace:
I20260709 13:01:50.908824  6521 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:50.909682  6521 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.912784  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:50.913724  1691 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:01:50.911988  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:50.918530  2245 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:50.908056  6435 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:50.943282  6575 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.943531  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:50.944113  6575 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:50.945350  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:50.946085  1687 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:01:50.946589  6575 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.947108  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:50.909713  6522 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:50.918254  6369 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:50.962190  1690 raft_consensus.cc:2393] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 15: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:50.965883  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:50.966228  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:50.967190  1615 raft_consensus.cc:2393] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:50.967363  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:50.969246  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:50.962924  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:50.971372  1689 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:50.973220  6621 log.cc:927] Time spent T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:50.975427  6371 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:50.979903  6623 log.cc:927] Time spent T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
I20260709 13:01:50.981833  6524 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.981940  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:50.982367  6524 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:50.984714  6524 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:50.985311  1660 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:50.986227  6568 consensus_queue.cc:1059] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:50.916553  6383 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.992595  6554 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:51.000403  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.002163  6371 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:51.005820  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:51.005879  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:51.007668  1585 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:51.004245  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:51.000458  6554 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:51.018288  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.020596  6521 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:51.027786  6499 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:51.028352  6499 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.028965  6499 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:51.033983  6383 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:51.034781  6369 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:51.035627  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:51.036281  2240 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:51.043247  1586 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:51.044312  6383 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:50.995225  6522 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.045094  6383 raft_consensus.cc:697] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:51.046518  6383 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.017397  6554 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:51.048013  6312 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:51.055444  2240 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:51.056351  6522 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:51.056665  1586 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:51.057665  6540 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:51.058159  6540 raft_consensus.cc:697] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:51.059116  6540 consensus_queue.cc:237] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:50.873481  1445 rpcz_store.cc:276] 0709 13:01:40.796404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.812202 (+ 15798us) service_pool.cc:224] Handling call
0709 13:01:50.866346 (+10054144us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:49.698119 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:49.779799 (+ 81680us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:49.779832 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:01:49.779858 (+    26us) tablet.cc:662] Decoding operations
0709 13:01:49.780693 (+   835us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:49.780747 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:49.780772 (+    25us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:01:49.781463 (+   691us) tablet.cc:701] Row locks acquired
0709 13:01:49.781484 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:01:49.781637 (+   153us) write_op.cc:270] Start()
0709 13:01:49.781766 (+   129us) write_op.cc:276] Timestamp: P: 1783602109781588 usec, L: 0
0709 13:01:49.781793 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:01:49.782433 (+   640us) log.cc:844] Serialized 3664 byte log entry
0709 13:01:50.298827 (+516394us) op_driver.cc:464] REPLICATION: finished
0709 13:01:50.366836 (+ 68009us) write_op.cc:301] APPLY: starting
0709 13:01:50.366927 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:50.373482 (+  6555us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:50.373610 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:50.558701 (+185091us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:50.559148 (+   447us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:01:50.559215 (+    67us) write_op.cc:312] APPLY: finished
0709 13:01:50.559760 (+   545us) log.cc:844] Serialized 89 byte log entry
0709 13:01:50.561474 (+  1714us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:50.561993 (+   519us) write_op.cc:454] Released schema lock
0709 13:01:50.562095 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:50.639746 (+ 77651us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:50.645605 (+  5859us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":29900,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":67687,"apply.run_cpu_time_us":16219,"apply.run_wall_time_us":239300,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41819,"num_ops":9,"prepare.queue_time_us":238896,"prepare.run_cpu_time_us":39853,"prepare.run_wall_time_us":282333,"raft.queue_time_us":252845,"raft.run_cpu_time_us":11269,"raft.run_wall_time_us":90896,"replication_time_us":501836,"thread_start_us":535180,"threads_started":4,"wal-append.queue_time_us":220164}]]}
W20260709 13:01:51.061887  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 62554.1us
I20260709 13:01:51.072104  1617 raft_consensus.cc:1240] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:01:51.073062  1621 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:01:51.074280  1619 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:51.081741  1621 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:51.089120  6570 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:51.090010  1585 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:51.096556  6196 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:51.105154  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:51.106299  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:51.107791  6271 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:51.109647  6594 raft_consensus.cc:3055] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:51.110146  6594 raft_consensus.cc:740] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:51.114494  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:51.115155  1693 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:51.118374  6305 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.119068  6305 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:51.109859  2210 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:51.122938  6511 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:51.123906  6511 raft_consensus.cc:697] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:51.125244  6511 consensus_queue.cc:237] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.078773  6390 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.135427  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:51.137555  1693 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:01:51.141206  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:51.150713  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 60881.6us
I20260709 13:01:51.139410  6196 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.097409  6468 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:01:51.171761  1585 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:51.175559  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.176752  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.177881  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:51.178395  1688 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.180148  6196 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:51.184149  1619 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:51.185847  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:51.194438  1695 raft_consensus.cc:2393] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 15: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:51.195307  1689 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:51.200985  2245 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:01:51.208690  1693 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:51.154681  6516 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.111152  6594 consensus_queue.cc:260] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.202275  6364 raft_consensus.cc:2764] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:01:51.224848  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.203899  6305 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:51.231648  2238 raft_consensus.cc:1240] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:51.227488  1614 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:51.208575  6196 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:51.240691  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.242388  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:51.243886  6624 log.cc:927] Time spent T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:01:51.244055  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.244786  1692 raft_consensus.cc:2393] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 15: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:51.225961  6522 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:51.260054  1688 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:51.268798  1615 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:51.265895  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.285166  1696 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:51.288080  2245 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:01:51.289664  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.297353  1693 raft_consensus.cc:2410] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:01:51.251658  6522 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:51.299568  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 303963us
I20260709 13:01:51.305140  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:51.308483  6390 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:51.317849  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:51.334055  1615 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:51.308211  6550 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:01:51.357235  1614 raft_consensus.cc:1217] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Deduplicated request from leader. Original: 9.5->[10.6-12.7]   Dedup: 10.6->[12.7-12.7]
I20260709 13:01:51.360280  1614 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:01:51.361694  6629 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:01:51.363775  6538 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:51.364400  6538 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:51.372174  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 165997us
I20260709 13:01:51.355963  6575 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.394073  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:51.362272  6516 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:51.401742  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 231920us
I20260709 13:01:51.419616  1614 raft_consensus.cc:2368] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16.
W20260709 13:01:51.424350  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 252648us
I20260709 13:01:51.412388  6522 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:51.434324  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:51.441505  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 131481us
W20260709 13:01:51.453101  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 76331.8us
I20260709 13:01:51.430193  6538 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:51.427259  6575 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:51.459128  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:51.459772  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 71306.8us
I20260709 13:01:51.444521  6390 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.468075  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:51.469039  2245 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:51.472240  1585 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:51.472908  6536 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:51.473536  6633 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:01:51.474431  1585 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:51.475787  6635 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:51.476603  6635 raft_consensus.cc:697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:51.477958  6635 consensus_queue.cc:237] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.479314  6390 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:51.479722  6550 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:51.480185  6550 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.480580  6550 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:51.481719  6390 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:51.483433  6575 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:51.483889  1585 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:51.486222  1693 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:51.456943  6468 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:51.491971  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.493192  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:51.492853  2245 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:51.495635  6516 consensus_queue.cc:1059] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:51.496578  6516 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:51.497166  6364 raft_consensus.cc:3055] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:51.497642  6364 raft_consensus.cc:740] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:51.460472  6522 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.503341  1615 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:01:51.503626  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.506654  1538 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:51.507735  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:51.508381  1546 raft_consensus.cc:2376] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12. Re-sending same reply.
I20260709 13:01:51.508916  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:51.509414  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:51.510144  1546 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 15: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:51.511787  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:51.512789  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:51.512948  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:51.513499  1547 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:51.514070  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:51.515327  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:51.515779  1544 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:51.516633  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:51.516892  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:51.517549  1541 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:51.517752  1511 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:51.518085  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:51.518731  6538 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:51.519500  6538 raft_consensus.cc:697] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:51.520538  6538 consensus_queue.cc:237] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.521668  6522 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.518766  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:51.523409  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:51.523702  1687 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:51.524010  1543 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:01:51.518750  1540 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:51.501535  6536 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.527737  6536 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.530732  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.517755  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:51.532510  2209 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:51.523722  2240 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:51.532793  1545 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
W20260709 13:01:51.534281  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.534651  1622 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:51.534848  6511 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:51.510941  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:51.540338  6575 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:01:51.542069  6630 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:01:51.542486  1585 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:51.543430  6575 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:51.543980  6575 raft_consensus.cc:697] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:51.517685  1539 raft_consensus.cc:2393] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 15: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:51.545063  6575 consensus_queue.cc:237] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:51.550377  6499 consensus_meta.cc:287] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.521s	user 0.013s	sys 0.000s
I20260709 13:01:51.551968  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.552394  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.552703  1690 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:01:51.498680  6364 consensus_queue.cc:260] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.556330  6364 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:51.556524  6312 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:51.556670  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:51.557296  6312 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.558195  6305 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:51.558743  6305 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.561643  6522 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:51.562721  6594 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:51.564478  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.565143  1622 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:01:51.568547  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:51.569262  1542 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:51.572824  1538 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:51.574992  6550 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:51.577106  6312 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:51.577553  1512 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:51.579133  6522 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:51.579751  6305 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:51.582271  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:51.583038  6522 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:51.583516  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:51.583640  6536 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:51.584122  1692 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:51.584137  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.584860  1512 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:51.585626  6536 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:51.585706  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.586133  6536 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:51.586405  1694 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:51.586678  6536 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:51.588328  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 55938.5us
W20260709 13:01:51.588897  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 71235.3us
W20260709 13:01:51.589980  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 47581.2us
I20260709 13:01:51.601099  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.601262  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.601923  1622 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:01:51.602164  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.602548  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.603260  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.603487  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.604089  1688 raft_consensus.cc:2393] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 12: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:51.604285  1690 raft_consensus.cc:2410] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:01:51.605279  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.606550  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:51.607911  1512 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:51.607455  1442 catalog_manager.cc:5697] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:51.609378  6312 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:51.610160  1512 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:51.609998  6312 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:51.611016  6371 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:51.611433  1512 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:51.611750  6371 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:51.612434  6312 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:51.612895  1512 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:51.613009  6312 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:51.613787  6312 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:51.615584  1694 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 15: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:51.617285  1692 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:51.617276  1547 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:01:51.617808  1511 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:51.614895  1512 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:51.619086  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 195511us
W20260709 13:01:51.621011  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 50138.1us
I20260709 13:01:51.622193  1511 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:51.550822  6499 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:51.632917  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:51.618273  6540 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:51.644398  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:51.645272  2240 raft_consensus.cc:2393] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 15: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:51.649210  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.649957  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:51.655412  1615 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:51.655860  1692 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:51.652647  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.657312  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.657749  1618 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:51.665776  1694 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:01:51.651512  2209 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:51.659772  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.651101  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:51.651167  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.628573  6522 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:51.667914  1616 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:01:51.669684  2210 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:51.667567  1622 raft_consensus.cc:2376] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15. Re-sending same reply.
I20260709 13:01:51.671998  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.672715  1693 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:01:51.673432  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:51.677874  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.678872  1688 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
W20260709 13:01:51.653684  6554 consensus_meta.cc:287] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.004s
I20260709 13:01:51.679373  1688 pending_rounds.cc:85] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 11
I20260709 13:01:51.690768  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.653970  6540 raft_consensus.cc:697] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:51.656512  6499 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:51.688894  1688 pending_rounds.cc:107] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:01:51.697836  1688 raft_consensus.cc:2889] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:51.703127  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:51.704442  6383 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:51.705013  6383 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:51.689688  6305 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:51.708789  6305 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.709151  6305 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:51.711365  6637 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:51.711958  6521 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:51.714237  1660 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:51.715107  6629 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:51.716523  1442 catalog_manager.cc:5697] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 12 to 13, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:01:51.717633  6550 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:51.722133  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.725378  1659 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:51.651408  6642 consensus_queue.cc:1059] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:01:51.738976  1613 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:51.730125  1617 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:51.741520  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:51.745815  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 105137us
I20260709 13:01:51.744971  1619 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:51.730345  6383 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:51.693662  6554 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.730233  6371 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:51.749716  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.736258  6312 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:51.759030  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.725329  6521 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:01:51.761302  1585 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:51.762481  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.764809  6383 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:51.768771  6554 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:51.752775  6568 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:51.771091  6383 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:51.772130  6383 raft_consensus.cc:697] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:51.773110  1696 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 15: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:51.773238  6383 consensus_queue.cc:237] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:51.776959  6629 raft_consensus.cc:3055] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:51.777513  6629 raft_consensus.cc:740] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:51.781703  6516 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.782282  6516 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.778673  6629 consensus_queue.cc:260] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:51.732088  6499 consensus_queue.cc:1059] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:01:51.784195  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 86774.7us
I20260709 13:01:51.784993  2240 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:51.786094  1659 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:51.787360  6554 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:51.787957  6554 raft_consensus.cc:697] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:51.788414  1659 leader_election.cc:400] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16.
I20260709 13:01:51.788751  1659 leader_election.cc:403] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:01:51.789517  6641 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16.
I20260709 13:01:51.789593  1659 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:51.790601  6390 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:51.791194  6390 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:51.792718  6629 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:51.792672  6390 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:51.791385  6499 raft_consensus.cc:3055] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:51.787101  6642 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:51.795571  6499 raft_consensus.cc:740] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:51.788916  6554 consensus_queue.cc:237] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:51.796684  6499 consensus_queue.cc:260] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:51.798439  6499 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:51.742671  6468 consensus_queue.cc:1059] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:01:51.801954  6570 raft_consensus.cc:3055] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:51.802433  6570 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:51.803978  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.803778  6570 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:51.805094  6312 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.805505  6570 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:51.805594  6312 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.812655  6536 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.791496  6371 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:51.814029  6371 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:51.814447  6371 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:51.813207  6635 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:51.729856  1618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:51.817431  1618 raft_consensus.cc:606] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:51.790782  1659 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:51.830864  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.831413  6536 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:51.805794  6516 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:51.840672  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 50007.2us
I20260709 13:01:51.835326  6642 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:51.837589  6538 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.821157  6305 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:51.867429  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 245255us
W20260709 13:01:51.869242  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 254364us
I20260709 13:01:51.888347  2209 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:51.846544  6516 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.892392  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.894131  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:51.894269  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:51.892391  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:51.895224  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:51.896265  2238 raft_consensus.cc:2393] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 9: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:51.820760  6540 consensus_queue.cc:237] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:51.891441  6637 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:51.900296  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.906562  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:51.907708  6516 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:51.909193  2237 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:51.910214  6516 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:51.912583  6642 consensus_queue.cc:1059] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:51.913708  1660 leader_election.cc:400] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16.
I20260709 13:01:51.870247  6568 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:01:51.914215  6369 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:51.914669  1660 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:51.916666  6369 consensus_queue.cc:1059] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:51.916978  6656 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:51.917500  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 47291us
I20260709 13:01:51.937590  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.938144  1585 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:51.878224  6522 raft_consensus.cc:697] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:51.919864  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:51.972077  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.972077  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.890688  6312 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:51.976181  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.954344  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:51.912601  6305 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:51.995144  1587 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:51.992511  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:51.870428  6538 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:51.977154  1618 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:01:51.976121  6468 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.021950  2210 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:52.008020  6369 raft_consensus.cc:3055] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:52.017719  6383 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:52.019799  6635 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:52.044795  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 51641.2us
I20260709 13:01:51.952909  6656 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:52.051875  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 113792us
I20260709 13:01:52.036247  6369 raft_consensus.cc:740] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:52.047051  6536 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.034623  6554 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:52.056317  6651 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:01:52.056758  6660 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:52.057190  6647 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:52.057718  6659 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:52.064482  6538 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:52.042938  6575 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:52.047837  6635 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:52.066242  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 330128us
I20260709 13:01:52.066960  1618 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:52.069353  6522 consensus_queue.cc:237] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:52.075915  1511 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:52.079879  1585 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:52.023032  6468 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.040202  6371 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:52.111397  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:52.134944  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.136365  1541 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:01:52.136368  1540 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: [14.8-15.9]
W20260709 13:01:52.137847  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 62006.5us
I20260709 13:01:52.140940  1547 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:52.143224  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:52.144137  1542 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:52.142712  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 212101us
I20260709 13:01:52.120227  1512 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:52.080566  6196 consensus_queue.cc:1059] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:01:52.143106  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:52.123756  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:52.090368  6647 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.124823  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:52.155071  1538 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:52.155524  1544 raft_consensus.cc:2410] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:01:52.057133  6656 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:52.121584  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:52.155874  1512 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:52.157469  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:52.086233  6536 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:52.127182  6635 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:52.176020  1512 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:52.179519  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 264893us
I20260709 13:01:52.188756  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:52.190279  1541 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:52.189008  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:52.188238  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 108412us
I20260709 13:01:52.182379  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:52.193256  1547 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:52.193277  1585 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:52.159281  6647 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.170374  6305 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:52.146526  6673 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:52.199771  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:52.127089  6575 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:52.105895  6659 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.180693  6656 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:52.211160  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 85628.7us
I20260709 13:01:52.204165  1543 raft_consensus.cc:2410] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:01:52.188750  6540 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:52.106498  6660 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:52.215996  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 72981.1us
I20260709 13:01:52.225145  1659 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:52.226419  6678 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:52.226693  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:52.228986  6657 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.313s	user 0.004s	sys 0.000s
I20260709 13:01:52.229076  6536 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:52.183318  6369 consensus_queue.cc:260] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.230863  6536 raft_consensus.cc:1064] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:01:52.231889  6570 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:52.232347  6570 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.232729  6570 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:52.234166  6538 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:52.236243  6594 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:52.236618  6594 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:52.220722  6540 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:52.237562  6594 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.238190  6655 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:52.238755  6594 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:52.244094  1541 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:01:52.246093  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:52.251214  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.265442  6568 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:52.266103  6568 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.266607  6568 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:52.273948  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 98000.6us
I20260709 13:01:52.277024  1512 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:52.277721  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:52.277058  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:52.281093  1659 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:52.284873  2238 raft_consensus.cc:2410] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:01:52.288426  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 69818.1us
I20260709 13:01:52.267658  6632 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:52.268167  6656 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:52.305102  1512 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:52.209189  6673 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.316237  1659 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:52.317375  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:52.319128  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 67624.6us
I20260709 13:01:52.292191  6678 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.327618  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:52.332397  1622 raft_consensus.cc:606] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:52.332795  1622 raft_consensus.cc:614] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:52.297516  6632 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.335534  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:52.331054  1541 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:52.328675  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:52.303707  6656 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.337118  1620 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
I20260709 13:01:52.338171  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:52.285410  6521 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:01:52.339107  1613 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:52.339376  6656 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.339680  6632 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:52.346024  6660 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:52.347500  6672 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:52.347893  6660 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:52.348727  1660 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:52.334215  6390 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:52.378201  1587 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:52.380753  6686 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.394580  1542 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:01:52.383848  6468 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:52.373251  6312 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:52.391985  6680 log.cc:927] Time spent T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:01:52.393023  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:52.404139  1540 raft_consensus.cc:1275] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:52.309597  6196 consensus_queue.cc:1059] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:01:52.402871  6390 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.429795  6570 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.430394  6390 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:52.431574  2240 raft_consensus.cc:1275] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:52.431912  6570 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:52.433167  6679 log.cc:927] Time spent T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:01:52.425207  6676 log.cc:927] Time spent T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:01:52.426371  6660 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:52.435693  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 130788us
W20260709 13:01:52.444206  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.444554  1538 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:01:52.443452  1512 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:52.326717  6671 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.275s
I20260709 13:01:52.465224  1512 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:52.466540  1512 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:52.350039  6678 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:52.464232  6570 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:52.470034  6655 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:52.423758  6686 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:52.477257  6522 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:52.491603  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 142965us
I20260709 13:01:52.480573  6660 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:52.496358  6694 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:52.497521  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 119411us
I20260709 13:01:52.509320  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:52.509656  1542 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15. Ops: [13.8-14.9]
W20260709 13:01:52.498446  6674 log.cc:927] Time spent T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:01:52.499926  6673 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:52.500823  6678 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:52.501055  6687 raft_consensus.cc:3055] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:52.501199  6659 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:52.501910  6700 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:52.506166  6675 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:01:52.481488  6672 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:52.509975  1539 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:52.490882  6693 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:52.527865  6693 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.487887  6677 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:52.530998  6677 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:52.531481  6677 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:52.535753  1660 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:52.515604  1544 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:52.507313  6568 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.522023  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:52.543699  6703 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:01:52.546590  6390 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.535984  6700 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.548776  6390 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:52.549206  6700 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:52.550406  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:52.551359  6695 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:52.551791  6684 consensus_queue.cc:1059] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:01:52.551789  1511 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:52.516672  6305 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:52.516770  6687 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:52.557778  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:52.559844  1539 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:52.561991  1587 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:52.562320  6702 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:52.562800  6499 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:52.563059  6697 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:52.563625  1539 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15. Ops: [13.7-14.8]
I20260709 13:01:52.565331  1539 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:52.565515  6656 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:52.567637  6656 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:52.567902  6672 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.568920  6686 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:52.561451  6641 raft_consensus.cc:3055] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:52.571059  1587 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:52.570453  6686 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:52.570786  6641 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:52.572643  6686 consensus_queue.cc:1243] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer 822e08445eae4a33b2f2fe92060192c6 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:52.573922  6499 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:52.574303  6499 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.573648  6641 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.574610  6499 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:52.575958  6635 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:52.576443  1660 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:52.577996  6701 log.cc:927] Time spent T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:01:52.580340  6568 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:52.580976  1615 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:52.581928  6682 consensus_queue.cc:1059] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:52.582757  6682 raft_consensus.cc:3055] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:52.583063  6682 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:52.585222  6693 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:52.585958  6540 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:52.586385  6687 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.587788  6687 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:52.588034  6632 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.588166  6682 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.589529  6682 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:52.591672  1587 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:52.592644  6647 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:52.593502  6632 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:52.594105  6632 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:52.594458  6632 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.594797  6632 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:52.595412  6684 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:52.597051  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:52.597357  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:52.597993  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:52.598364  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:52.598800  1694 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:52.598963  1687 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:01:52.599505  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:52.600183  1688 raft_consensus.cc:2393] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:52.600859  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:52.602032  6635 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:52.603906  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:52.604489  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:52.598019  1695 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:52.607009  6635 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:52.592679  1547 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:52.608831  1540 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:52.610013  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:52.610685  2245 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:52.611991  6271 consensus_queue.cc:1059] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:52.613328  6271 raft_consensus.cc:3055] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:52.613705  6271 raft_consensus.cc:740] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:52.614540  6271 consensus_queue.cc:260] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:52.615705  6271 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:52.620832  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:52.621554  1696 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 8.
I20260709 13:01:52.622941  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:52.625397  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 73661.8us
I20260709 13:01:52.628078  1688 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:01:52.628839  1688 pending_rounds.cc:85] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 6
I20260709 13:01:52.629645  1688 pending_rounds.cc:107] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 12.7
W20260709 13:01:52.629007  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.630110  1688 raft_consensus.cc:2889] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:52.628423  1696 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 17: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:01:52.637928  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.639482  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:52.639884  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:52.640244  1692 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
W20260709 13:01:52.640960  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 79823.9us
I20260709 13:01:52.643553  1659 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:52.645766  1693 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:52.647483  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:52.650036  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 73700.5us
I20260709 13:01:52.650221  6647 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:52.650594  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:52.646749  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:52.650291  2239 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:52.653570  1587 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:52.639540  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:52.664554  1586 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:52.663966  6700 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:52.666697  6700 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:52.656200  1691 pending_rounds.cc:85] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 6
I20260709 13:01:52.667394  1691 pending_rounds.cc:107] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:01:52.667659  1691 raft_consensus.cc:2889] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:52.668207  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:52.668792  2244 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:01:52.636252  6671 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:52.671399  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:52.671617  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:52.672114  2245 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 15: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:52.667495  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:52.675483  1613 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.677639  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:52.678344  2246 raft_consensus.cc:2393] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 14: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:52.679759  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:52.680186  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:52.680451  1620 raft_consensus.cc:2393] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 9: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:52.680861  1540 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 13: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:52.681285  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:52.681731  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:52.682338  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:52.682730  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:52.628247  6499 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:52.690899  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.687170  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:52.682958  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:52.696805  1538 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:52.698818  1544 raft_consensus.cc:2393] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:52.683566  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:52.697316  1540 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:52.683888  1659 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:52.703603  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:52.677440  6681 raft_consensus.cc:3055] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:52.667062  6700 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:52.705979  1511 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:52.695086   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:01:52.706918  1620 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 17: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:52.707430  1613 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:01:52.711990  1587 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:52.713739  2210 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:52.656569  6641 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:52.663957  6686 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.722025  1511 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:52.724798  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:52.683395  6684 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:52.721232  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:01:52.726347  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.664386  6693 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.689782  6371 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:52.722652  1621 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:01:52.732080  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:52.683832  6568 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:52.707549  6540 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:52.729085  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 45252.8us
I20260709 13:01:52.651875  6554 consensus_queue.cc:1059] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:01:52.685431  6305 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.708603  6681 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:52.722272  6383 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:52.742238  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:52.736451  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:52.737095  1619 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:01:52.664127  6642 consensus_queue.cc:1059] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:01:52.744664  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:52.747990  1585 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:52.727743  6694 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:52.753749  1621 raft_consensus.cc:2393] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 14: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:52.730712  6647 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:52.730557  6678 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:52.757906  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:52.735352  6684 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.758628  1621 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:01:52.738580  6568 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.742802  6629 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:52.835733  6629 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.755867  6694 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.836159  6629 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:52.836464  6694 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:52.756737   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:52.743491  6540 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.753374  6305 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.839563  6540 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:52.841109  6305 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:52.721930  6677 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.749164  6673 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:52.826858  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 69071.4us
I20260709 13:01:52.842718  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:52.721441  6656 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:01:52.732779  6550 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:01:52.735831  6635 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:01:52.734849  6686 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.827515  6678 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.851284  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:52.753118  6390 consensus_queue.cc:1059] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:01:52.743258  6693 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:52.836053  6499 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:52.773269  6647 raft_consensus.cc:697] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:52.830044  6383 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:52.906904  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:52.849025  6684 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:52.930783  1617 raft_consensus.cc:2410] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:01:52.842700  6568 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:52.852712  6673 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:52.903110  6642 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:52.935133  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.935348  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.940429  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 92951.8us
I20260709 13:01:52.945704  1660 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:52.947520  1690 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:52.963680  6709 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:52.965276  6713 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:01:52.966333  6642 raft_consensus.cc:3055] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:52.966732  6642 raft_consensus.cc:740] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:52.967597  6642 consensus_queue.cc:260] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.968547  6678 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:52.974607  6693 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:52.910630  6681 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.976892  6647 consensus_queue.cc:237] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:52.980378  6686 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:52.947316  6690 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:52.990011  6632 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:52.933727  6673 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:52.996876  1620 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
W20260709 13:01:52.997689  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 256772us
I20260709 13:01:53.000095  1585 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:53.002895  1585 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:53.003038  6550 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:53.009521  1540 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:01:53.014003  2238 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:53.022050  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:53.024724  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:53.028791  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 83188.4us
I20260709 13:01:53.029559  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:53.030064  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.024302  1511 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:53.031208  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:53.011880  6196 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:53.008872  6702 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:53.011667  6703 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:53.015748  6550 raft_consensus.cc:697] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:53.027644  6305 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:53.033250  6312 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:53.048708  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:53.090874  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 61360.5us
I20260709 13:01:53.085526  6312 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:53.021176  6499 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:01:53.037216  6656 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:53.033969  6697 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:53.022908  6635 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:01:53.100955  6312 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.047000  6196 raft_consensus.cc:697] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:53.032922  6629 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:53.107424  1660 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:53.140204  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 400315us
I20260709 13:01:53.098814  6645 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.043169  6660 consensus_queue.cc:1059] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:01:53.046638  6703 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.145355  6721 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.143s
I20260709 13:01:53.210978  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1779) took 1094 ms. Trace:
I20260709 13:01:53.211542  1543 rpcz_store.cc:276] 0709 13:01:52.117024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.251871 (+134847us) service_pool.cc:224] Handling call
0709 13:01:52.274591 (+ 22720us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:52.624999 (+350408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.625032 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:52.651422 (+ 26390us) log.cc:844] Serialized 78 byte log entry
0709 13:01:53.042588 (+391166us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:53.042628 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.042691 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:53.210696 (+168005us) raft_consensus.cc:1685] finished
0709 13:01:53.210724 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.210905 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10691,"raft.queue_time_us":151200,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":566155,"threads_started":2,"wal-append.queue_time_us":505126}
I20260709 13:01:53.217864  1614 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:01:53.161082  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 453596us
I20260709 13:01:53.161654  6687 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:53.089049  6694 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.165117  6629 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:53.166733  6700 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:01:53.145866  6647 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:53.134929  6540 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:53.170732  1693 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:53.171516  6550 consensus_queue.cc:237] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.173460  6568 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.113193  6697 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:53.178819  2240 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:53.183271  1691 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:53.185420  6660 raft_consensus.cc:3055] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:53.187458  1511 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:53.249449  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 62078us
I20260709 13:01:53.191519  6645 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:53.196064  6196 consensus_queue.cc:237] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.197517  6632 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:53.199887  6711 log.cc:927] Time spent T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:53.094005  6702 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:53.231865  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 85794.1us
I20260709 13:01:53.175429  6673 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.268528  6645 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:53.269089  6673 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:53.256304  6371 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:53.271636  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:53.272106  6371 raft_consensus.cc:697] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:53.233433  1512 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:53.276109  6700 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:53.276656  6568 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:53.277626  6696 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:53.241050  6647 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:53.278748  6540 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:53.280074  6647 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:53.281488  6642 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:53.248963  6660 raft_consensus.cc:740] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:53.283728  1585 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:53.284042  6660 consensus_queue.cc:260] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.284642  6694 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:53.285329  6660 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.285889  6632 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:53.286446  6632 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.286922  6632 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:53.296113  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:53.297268  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:53.297865  1693 raft_consensus.cc:2368] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13.
I20260709 13:01:53.298518  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:53.273548  6371 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:53.299355  6673 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.299887  6673 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.301138  1690 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:53.287447  6696 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:53.233923  6687 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.237919  6641 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:53.289330  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:53.272357  1691 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:53.291741  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:53.292497  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:53.318416  1692 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 16: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:53.320045  1692 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:53.321681  1692 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:53.299190  1693 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:53.303160  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:53.304416  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 197061us
I20260709 13:01:53.324872  1660 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:53.322896  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:53.305487  1540 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:53.305639  1539 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15. Ops: [13.8-14.9]
I20260709 13:01:53.303160  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:53.311687  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:53.326597  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:53.331693  1545 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:53.329519  1547 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.330971  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:53.335310  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:53.340121  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:53.341274  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:53.342260  1546 raft_consensus.cc:2393] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 10: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:53.330747  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:53.346240  1660 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:53.349845  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 46739.6us
I20260709 13:01:53.301879  6673 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:53.357820  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:53.362601  1540 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 17: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:53.357831  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:53.364070  1693 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:01:53.330960  6671 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.373883  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:53.374603  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:53.374749  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:53.325907  6312 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.391139  2209 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:53.392515  2238 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:53.394043  6684 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.397696  6672 raft_consensus.cc:3055] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:53.398233  6672 raft_consensus.cc:740] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:53.401296  6687 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:53.370113  6678 consensus_queue.cc:1059] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:01:53.324041  6696 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:53.403038  6697 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:53.390331  1545 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:53.413687  6369 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:53.418443  1614 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:53.358732  6568 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:53.329464  6694 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:01:53.424957  6575 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:53.426007  6659 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.371173  6629 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:53.363323  6594 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:53.426657  6659 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:53.434899  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:53.435469  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:53.439303  1615 raft_consensus.cc:2393] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:53.444293  1614 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.439347  1585 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:53.442625  1547 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:01:53.328930  6728 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:53.447611  1691 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:53.364298  6700 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:53.446959  1511 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:53.366174  6673 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:53.466385  1585 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:53.464493  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:53.468389  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:53.429836  6671 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:53.461337  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:53.478185  1540 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 16: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:53.418757  6632 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.475765  1614 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:01:53.445952  6390 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:01:53.477542  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:53.481925  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:53.482661  1543 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:53.487524  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:53.370091  6723 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.107s
I20260709 13:01:53.444262  6642 consensus_queue.cc:1059] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:01:53.503521  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:53.471120  6700 raft_consensus.cc:697] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:53.476722  6196 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:53.514160  1543 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:53.485041  6383 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:53.493253  6516 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:53.523285  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 161500us
I20260709 13:01:53.492560  6734 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:53.504136  6723 consensus_queue.cc:1243] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:01:53.541424  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.477353  6673 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.513181  6305 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:53.525805  6516 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:53.563848  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 172755us
I20260709 13:01:53.548342  6734 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.585865  1660 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:53.587863  6697 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:53.588326  6684 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:53.588719  6737 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:53.579738  6305 raft_consensus.cc:697] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:53.574640  6516 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:53.598606  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 151662us
I20260709 13:01:53.602277  1511 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:53.599293  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:53.622107  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:53.583739  6734 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:53.588588  6697 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:53.567624  6568 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:01:53.592327  6369 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:01:53.655158  6732 log.cc:927] Time spent T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:53.662869  1694 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
W20260709 13:01:53.664657  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 90910.3us
I20260709 13:01:53.681025  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:53.683655  1547 raft_consensus.cc:2393] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 10: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:53.665431  6748 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:53.690442  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:53.673969  6632 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:53.694896  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:53.695528  1547 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:53.684865  6659 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:53.660849  6700 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.715736  6693 raft_consensus.cc:3055] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:53.721935  6696 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:53.722237  6693 raft_consensus.cc:740] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:53.723146  6693 consensus_queue.cc:260] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.724036  6703 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:53.724159  6693 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:53.717037  6673 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:53.717237  6741 log.cc:927] Time spent T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:01:53.695637  6748 raft_consensus.cc:697] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:53.718219  6671 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:53.695099  6656 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:53.721452  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1947) took 1059 ms. Trace:
I20260709 13:01:53.739571  6748 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.741168  6641 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:53.739990  1696 rpcz_store.cc:276] 0709 13:01:52.661787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.662833 (+  1046us) service_pool.cc:224] Handling call
0709 13:01:52.663266 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:52.929473 (+266207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.929513 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:52.929979 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:01:53.325560 (+395581us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:53.357469 (+ 31909us) log.cc:844] Serialized 14 byte log entry
0709 13:01:53.360373 (+  2904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.360450 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:53.721100 (+360650us) raft_consensus.cc:1685] finished
0709 13:01:53.721122 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.721384 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73567,"prepare.queue_time_us":31900,"prepare.run_wall_time_us":35,"raft.queue_time_us":82784,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":8527,"spinlock_wait_cycles":90955008,"thread_start_us":500754,"threads_started":2,"wal-append.queue_time_us":576429}
I20260709 13:01:53.741947  1692 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:53.738792  1546 raft_consensus.cc:2410] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:01:53.739279  6656 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.745335  1547 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:53.746850  1547 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:01:53.751425  6697 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:53.754436  6656 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:53.767663  1618 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:01:53.765157  6516 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:53.768556  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 3014) took 1088 ms. Trace:
I20260709 13:01:53.778059  1618 rpcz_store.cc:276] 0709 13:01:52.679651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.689667 (+ 10016us) service_pool.cc:224] Handling call
0709 13:01:53.766985 (+1077318us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b58000f9998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:01:53.767268 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:53.768207 (+   939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.768483 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9984896}
I20260709 13:01:53.782757  1692 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
W20260709 13:01:53.792358  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 101994us
I20260709 13:01:53.812136  6632 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:53.777606  6312 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:53.812764  6632 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:53.783051  6516 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:53.816465  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:53.817456  1542 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:01:53.820402  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:53.823776  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.830245  6536 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:53.788218  6594 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.831080  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2562) took 1111 ms. Trace:
I20260709 13:01:53.832008  1695 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:53.831616  6594 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:53.832580  1659 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:53.833213  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:53.833469  1659 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:53.834148  6594 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:53.834728  6594 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:53.835427  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:53.835573  2209 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:53.834622  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:53.836858  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:53.837340  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:53.837702  6736 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.836467  6693 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:53.838346  6693 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:53.838778  6693 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:53.701087  6305 consensus_queue.cc:237] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.831550  1620 rpcz_store.cc:276] 0709 13:01:52.720068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.724572 (+  4504us) service_pool.cc:224] Handling call
0709 13:01:53.830923 (+1106351us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b540033c554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:53.831026 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617530112}
I20260709 13:01:53.818892  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:53.851025  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:53.851994  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 177538us
I20260709 13:01:53.852820  1614 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:01:53.853257  1614 pending_rounds.cc:85] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 8
I20260709 13:01:53.853446  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:53.854034  2240 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:53.854383  1620 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:53.853924  1587 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:53.853483  1614 pending_rounds.cc:107] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:01:53.855329  1614 raft_consensus.cc:2889] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:53.843703  6575 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.849514  1512 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:53.856236  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:53.857406  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:53.858143  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:53.878904  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:53.858659  1587 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:53.879001  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:53.882799  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:53.883126  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:53.883671  1613 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 16: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:53.884946  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:53.842391  6594 raft_consensus.cc:697] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:53.844283  6632 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:53.894328  1616 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:01:53.907773  1616 pending_rounds.cc:85] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 8
I20260709 13:01:53.908028  1616 pending_rounds.cc:107] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:01:53.908288  1616 raft_consensus.cc:2889] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:53.895032  1693 raft_consensus.cc:1240] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:53.838366  6736 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:53.912524  2211 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:53.849144  6697 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.925906  2240 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
W20260709 13:01:53.948021  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 98553.9us
W20260709 13:01:53.980713  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 68307us
I20260709 13:01:53.879837  6499 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:53.879776  6641 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.879168  6687 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:53.981451  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.879036  6761 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:53.838788  6672 consensus_queue.cc:260] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:53.988662  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 130069us
I20260709 13:01:53.991079  1512 leader_election.cc:400] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13.
I20260709 13:01:53.858659  6686 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
I20260709 13:01:53.899652  6575 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.980729  6703 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.004143  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:53.992698  6742 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.999975  6687 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.019310  6499 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:53.993686  6697 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:54.029870  6762 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:54.034207  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:54.036437  6736 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:53.894034  6684 consensus_queue.cc:1059] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:01:54.009943  1587 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:54.042899  6677 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:53.898418  6734 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:53.995833  6761 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.994274  6632 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:53.981071  6645 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
W20260709 13:01:54.068555  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 58686.4us
W20260709 13:01:54.069650  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.066511  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 208556us
I20260709 13:01:53.998235  6641 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:54.009321  6723 consensus_queue.cc:1059] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:01:54.076663  1587 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:54.093632  1587 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:54.046540  6703 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:54.105733  1691 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:54.068313  6761 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:54.073469  1585 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:54.080775  6468 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:01:54.098481  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 217651us
I20260709 13:01:54.047617  6742 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:54.105542  6709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.004s	sys 0.031s
W20260709 13:01:54.126397  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 53014us
I20260709 13:01:54.030315   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:54.115487  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:54.115595  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:54.127769  2246 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.115805  6554 raft_consensus.cc:3055] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:54.116444  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:54.097242  6723 consensus_queue.cc:1243] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:54.117178  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:54.117802  6762 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:54.118489  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:54.119841  6754 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:54.135032  2244 raft_consensus.cc:1240] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:01:54.106101  6632 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:54.077363  6594 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:54.148685  6742 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:54.149477  6727 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:54.130707  6554 raft_consensus.cc:740] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:54.154142  6554 consensus_queue.cc:260] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.155458  6554 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:54.156308  6694 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:54.141908  6641 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:54.143409  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.144347  6697 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:54.163533  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 164471us
I20260709 13:01:54.164009  6681 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:54.165088  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:54.167402  6692 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:54.145332  6693 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.123260  6686 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:54.139333  6499 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:54.168817  6692 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:54.170442  6672 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:54.170677  6692 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:54.171046  6692 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.171425  6692 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:54.089201  6196 consensus_queue.cc:1059] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:01:54.178354  2246 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
W20260709 13:01:54.129385  6709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.004s	sys 0.032s
I20260709 13:01:54.174698  1586 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:54.189926  1512 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:54.198838  1691 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
W20260709 13:01:54.200021  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 63993.1us
I20260709 13:01:54.206480  1692 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:54.251427  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 156329us
I20260709 13:01:54.199568  6733 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:01:54.174515  6762 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.209812  6693 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:54.173774  6684 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:54.280265  6684 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.282194  6683 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:54.283166  6683 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.285794  6683 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:54.282296  6684 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:54.184087  6468 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.216346  1540 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:01:54.291917  1540 pending_rounds.cc:85] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 10
I20260709 13:01:54.292260  1540 pending_rounds.cc:107] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:01:54.292554  1540 raft_consensus.cc:2889] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:54.211856  6499 raft_consensus.cc:697] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:54.219518  6703 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:54.224416  2246 raft_consensus.cc:1240] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:54.224975  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:54.228061  6751 raft_consensus.cc:3055] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:54.227589  1443 catalog_manager.cc:5697] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 11 to 14, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 14 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.326823  6751 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:54.228825  6687 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:54.229980  6734 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:54.230695  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 56090.2us
I20260709 13:01:54.327764  6751 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.328454  6635 raft_consensus.cc:3055] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:54.328965  6751 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:54.330256  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.328985  6635 raft_consensus.cc:740] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:54.331916  6635 consensus_queue.cc:260] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:54.333103  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:54.334096  6635 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.334453  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:54.335501  6687 consensus_queue.cc:1059] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:54.337342  6687 raft_consensus.cc:3055] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:54.337687  6687 raft_consensus.cc:740] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:54.233834  1660 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:54.231788  6723 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:54.340512  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 106733us
I20260709 13:01:54.340479  6723 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.238392  1622 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:54.239001  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:54.343472  1613 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:54.343706  6554 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:54.344386  6554 raft_consensus.cc:697] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:54.344802  6723 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:54.345786  6723 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:54.345331  6554 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.346447  6723 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.242957  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:54.257539  6656 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:54.347795  6656 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.349987  6656 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:54.260102  1511 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:54.261000  6694 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:54.260922  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 71069.6us
I20260709 13:01:54.350852  6697 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:54.350947  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 90944.4us
I20260709 13:01:54.351415  6697 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:54.185341  6632 raft_consensus.cc:697] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:54.352842  6709 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:54.352622  6632 consensus_queue.cc:237] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.353514  6697 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:54.269730  1587 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:54.354466  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 84840.7us
I20260709 13:01:54.355607  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:54.300200  6499 consensus_queue.cc:237] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:54.356001  1540 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:01:54.356287  1544 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:01:54.357154  1540 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:01:54.233932  6691 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:54.311827  6468 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:54.337515  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:54.351636  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:54.350970  6694 raft_consensus.cc:697] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:54.358173  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:54.384337  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:54.384531  1541 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.305356  6575 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:54.394368  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:54.395092  1538 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:54.367205  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:54.276033  6762 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:54.370442  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:54.370604  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:54.370738  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:54.424964  1615 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:01:54.371982  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:54.372222  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:54.426371  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 57718.9us
I20260709 13:01:54.426563  1614 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
W20260709 13:01:54.427409  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 52654.7us
I20260709 13:01:54.373756  1620 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:54.383860  2244 raft_consensus.cc:2393] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 11: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:54.394002  1542 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:54.362653  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:54.338661  6687 consensus_queue.cc:260] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:54.441793  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 48662.3us
I20260709 13:01:54.405157  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:54.441838  2210 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:54.442698  1538 raft_consensus.cc:2393] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 15: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:54.443025  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:54.445878  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 60033.4us
I20260709 13:01:54.405808  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:54.380781  1443 catalog_manager.cc:5697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 7 to 9, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:54.368530  6734 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:54.450606  1660 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:54.421957  1690 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:01:54.424834  1696 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:01:54.451337  1690 pending_rounds.cc:85] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 7
W20260709 13:01:54.439378  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 80453.4us
I20260709 13:01:54.295614  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:54.451653  1690 pending_rounds.cc:107] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:01:54.393826  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:54.451939  1690 raft_consensus.cc:2889] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:54.452203  1689 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.443785  1544 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:01:54.457347  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:54.457937  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:54.458164  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:54.458855  1616 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:54.447815  1443 catalog_manager.cc:5697] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 3 to 10, term changed from 12 to 14, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to <none>, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New cstate: current_term: 14 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:54.458971  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:54.459514  1660 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:54.455413  6767 consensus_queue.cc:1059] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:01:54.466202  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:54.467401  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:54.467510  6742 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:54.385133  6703 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:54.422888  6671 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:54.470046  1544 pending_rounds.cc:85] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 8
I20260709 13:01:54.487481  1544 pending_rounds.cc:107] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:01:54.487870  1544 raft_consensus.cc:2889] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:54.470790  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:54.456012  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:54.472014  1546 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:54.474114  1585 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:54.493973  1540 raft_consensus.cc:2393] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 11: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:54.446738  6754 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.497239  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:54.498054  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:54.500401  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:54.481868  1541 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:54.501247  1693 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:01:54.501771  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:54.473013  2244 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:54.502306  1541 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:54.472594  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:54.477941  1443 catalog_manager.cc:5697] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.513111  6721 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:54.513237  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:54.514478  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:54.505436  6369 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:01:54.515435  6777 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.516089  6777 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:54.516489  6733 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:54.518990  1621 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:01:54.519550  6735 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:01:54.520006  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2571) took 1217 ms. Trace:
I20260709 13:01:54.520401  1621 rpcz_store.cc:276] 0709 13:01:53.302788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.302941 (+   153us) service_pool.cc:224] Handling call
0709 13:01:54.519866 (+1216925us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54003200d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:54.519954 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2747430144}
W20260709 13:01:54.521832  1442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42114 (request call id 271) took 22521 ms (client timeout 15000 ms). Trace:
I20260709 13:01:54.447034  6697 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:01:54.510115  1587 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:54.527918  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:54.472048  6693 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.525755  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:54.446614  6645 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:01:54.489464  6687 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.488284  6742 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:54.468387  6763 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:54.529676  1688 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:01:54.540907  1688 pending_rounds.cc:85] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 8
I20260709 13:01:54.541201  1688 pending_rounds.cc:107] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:01:54.541483  1688 raft_consensus.cc:2889] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:54.487314  6671 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:54.524919  1660 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:54.545704  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:54.546343  1693 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:01:54.537891  1546 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:54.496276  6703 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.529523  6693 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:54.543856  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:54.545049  1660 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:54.559134  6672 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:54.559667  6672 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.469070  6641 consensus_queue.cc:1059] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:01:54.554296  1659 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:54.526892  6677 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:54.522356  1442 rpcz_store.cc:269] 0709 13:01:32.000133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.000430 (+   297us) service_pool.cc:224] Handling call
0709 13:01:54.521722 (+22521292us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:52.072077 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:52.073014 (+   937us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:52.073071 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:01:52.073091 (+    20us) tablet.cc:662] Decoding operations
0709 13:01:52.073596 (+   505us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:52.073673 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:52.073699 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:01:52.074144 (+   445us) tablet.cc:701] Row locks acquired
0709 13:01:52.074214 (+    70us) write_op.cc:260] PREPARE: finished
0709 13:01:52.074406 (+   192us) write_op.cc:270] Start()
0709 13:01:52.074566 (+   160us) write_op.cc:276] Timestamp: P: 1783602112074334 usec, L: 0
0709 13:01:52.074593 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:01:52.078642 (+  4049us) log.cc:844] Serialized 929 byte log entry
0709 13:01:52.504669 (+426027us) op_driver.cc:464] REPLICATION: finished
0709 13:01:52.657976 (+153307us) write_op.cc:301] APPLY: starting
0709 13:01:52.695526 (+ 37550us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:52.982280 (+286754us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:52.982404 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:52.983929 (+  1525us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:52.984109 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:01:52.984154 (+    45us) write_op.cc:312] APPLY: finished
0709 13:01:52.984345 (+   191us) log.cc:844] Serialized 33 byte log entry
0709 13:01:52.984526 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:52.984615 (+    89us) write_op.cc:454] Released schema lock
0709 13:01:52.984726 (+   111us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:52.985114 (+   388us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:52.985141 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":75706,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":117857,"apply.run_cpu_time_us":6016,"apply.run_wall_time_us":343460,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12503,"num_ops":2,"prepare.queue_time_us":169004,"prepare.run_cpu_time_us":17683,"prepare.run_wall_time_us":151910,"raft.queue_time_us":70036,"raft.run_cpu_time_us":2909,"raft.run_wall_time_us":9925,"replication_time_us":429913,"thread_start_us":311606,"threads_started":4,"wal-append.queue_time_us":229142,"wal-append.run_cpu_time_us":25252,"wal-append.run_wall_time_us":1666845}]]}
I20260709 13:01:54.577705  1512 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:54.537257  1443 catalog_manager.cc:5697] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 10 to 12, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 12 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.588296  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 790) took 1831 ms. Trace:
I20260709 13:01:54.560091  6672 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:54.600967  1443 catalog_manager.cc:5697] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.499428  6723 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:54.530073  6678 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:54.541040  6767 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:54.604140  1443 catalog_manager.cc:5697] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:54.613446  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:54.555569  6671 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.615654  1695 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:54.562256  6686 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.640336  1443 catalog_manager.cc:5697] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:54.588785  1687 rpcz_store.cc:276] 0709 13:01:52.757440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.759842 (+  2402us) service_pool.cc:224] Handling call
0709 13:01:52.826597 (+ 66755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.880116 (+1053519us) spinlock_profiling.cc:243] Waited 6.59 ms on lock 0x7b2c00068258. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48f9db291 00007fc48f9f60ca 00007fc4917244ad 00007fc49172ae1b 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2
0709 13:01:53.880254 (+   138us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:01:53.883259 (+  3005us) log.cc:844] Serialized 14 byte log entry
0709 13:01:54.118761 (+235502us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b180044e9c0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb23a 00007fc491735a2a
0709 13:01:54.587839 (+469078us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:54.587922 (+    83us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:54.587990 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.588081 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.588233 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2737,"prepare.run_cpu_time_us":669,"prepare.run_wall_time_us":1713,"raft.queue_time_us":461,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":8427,"spinlock_wait_cycles":38174208,"thread_start_us":365438,"threads_started":1,"wal-append.queue_time_us":659439}
I20260709 13:01:54.653569  1443 catalog_manager.cc:5697] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 12 to 15, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 15 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.600317  6660 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:54.505421  6754 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.561586  6736 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:01:54.656836  1443 catalog_manager.cc:5697] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.600178  6642 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:54.586789  6369 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:54.614284  6767 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:54.644541  6594 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:54.680191  1443 catalog_manager.cc:5697] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 8 to 10, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 10 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.562413  6763 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:54.691589  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 131479us
I20260709 13:01:54.660501  6522 raft_consensus.cc:1027] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: attempt to promote peer e8a64798e5f94de8909707bcbd11804a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:01:54.691627  1443 catalog_manager.cc:5697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 8 to 11, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:54.543517  6694 consensus_queue.cc:237] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:54.675882  6540 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:54.675523  6660 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:54.729795  1443 catalog_manager.cc:5697] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:01:54.749174  1443 catalog_manager.cc:5697] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
W20260709 13:01:54.733505  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.652464  6723 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:01:54.683346  6369 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:54.691296  6761 consensus_meta.cc:287] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.565s	user 0.005s	sys 0.005s
I20260709 13:01:54.689931  6767 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:54.644773  6678 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:54.689718  6642 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.697748  1660 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:54.659578  6686 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.730811  6750 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:54.746201  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 178262us
W20260709 13:01:54.760715  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 63027.5us
I20260709 13:01:54.750211  6468 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:54.752031  6692 consensus_meta.cc:287] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.001s
I20260709 13:01:54.752522  6660 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:54.759778  6774 log.cc:927] Time spent T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 13:01:54.753245  6369 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:54.762235  6750 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.759600  6748 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:54.754469  6761 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.766703  6641 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:54.781724  6700 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:54.792707  6700 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:54.795287  6656 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.795840  6656 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:54.797989  6656 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:54.803073  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 248851us
I20260709 13:01:54.804653  1689 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:54.804944  1544 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:54.757350  6540 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
W20260709 13:01:54.809666  6786 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:01:54.810549  6784 log.cc:927] Time spent T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:01:54.812359  6678 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:54.816265  6763 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:54.819116  6734 raft_consensus.cc:3055] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:54.819372  6791 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:54.819587  6734 raft_consensus.cc:740] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:54.819864  6752 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:54.820274  6752 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:54.791433  6536 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.790031  6750 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:54.816290  1689 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:54.807356  2238 raft_consensus.cc:2393] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 16: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:54.793857  6641 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.768826  6692 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:54.864305  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.820503  6734 consensus_queue.cc:260] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:54.793994  6748 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:54.890024  1618 raft_consensus.cc:2410] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:01:54.866171  1543 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 15. Ops: []
I20260709 13:01:54.884151  2246 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:01:54.839439  6776 log.cc:927] Time spent T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260709 13:01:54.890156  6788 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:01:54.904841  6751 consensus_meta.cc:287] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.001s
I20260709 13:01:54.841984  6641 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:54.889238  6781 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:01:54.891048  6793 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:01:54.896140  6804 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:54.896997  6540 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:54.899648  6703 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:54.906551  6761 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:54.865823  6692 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:54.982771  6794 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:55.005877  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:54.986004  6686 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:55.015722  6709 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:54.836797  6536 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:55.020015  6754 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.024322  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1799) took 1587 ms. Trace:
W20260709 13:01:55.026234  6632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.016s	sys 0.014s
I20260709 13:01:55.005092  6660 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:55.040325  1545 rpcz_store.cc:276] 0709 13:01:53.436972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.821668 (+384696us) service_pool.cc:224] Handling call
0709 13:01:53.822117 (+   449us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:53.947716 (+125599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.947746 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:54.264676 (+316930us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b1800023020. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e60c2a6 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc490024a11 00007fc490034372 00007fc491766a01 00007fc49172b43a
0709 13:01:54.265642 (+   966us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b2c00000658. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc490024a11 00007fc490034372 00007fc491766a01 00007fc49172b43a 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2
0709 13:01:54.266448 (+   806us) log.cc:844] Serialized 52 byte log entry
0709 13:01:54.685704 (+419256us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:54.685744 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.685807 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:55.024085 (+338278us) raft_consensus.cc:1685] finished
0709 13:01:55.024109 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.024254 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":252953,"raft.queue_time_us":125280,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":11081,"spinlock_wait_cycles":75028608,"thread_start_us":418840,"threads_started":1,"wal-append.queue_time_us":479730}
I20260709 13:01:55.039768  6794 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:55.049580  6794 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.044680  6709 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.040345  6763 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:55.051582  6763 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:54.850703  6752 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:55.044607  6632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.016s	sys 0.014s
I20260709 13:01:55.065061  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2954) took 1469 ms. Trace:
I20260709 13:01:55.065716  1539 rpcz_store.cc:276] 0709 13:01:53.596149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.173296 (+577147us) service_pool.cc:224] Handling call
0709 13:01:54.173624 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:54.184470 (+ 10846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:54.184501 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:54.191798 (+  7297us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.330889 (+139091us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b4800002958. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc496654aa1 00007fc49664bb37 00007fc49664b9ca 00007fc49674326f 00007fc496742f37 00007fc49675755c 00007fc496757508 00007fc496757488 00007fc496757443 00007fc4967566ec 00007fc495680a96
0709 13:01:54.611896 (+281007us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:54.611937 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.612022 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:55.063773 (+451751us) raft_consensus.cc:1685] finished
0709 13:01:55.063805 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.064975 (+  1170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10466,"raft.queue_time_us":12174,"raft.run_cpu_time_us":2508,"raft.run_wall_time_us":139882,"spinlock_wait_cycles":6638464,"thread_start_us":403484,"threads_started":1,"wal-append.queue_time_us":533363}
I20260709 13:01:55.088727  6709 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.103582  6709 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.104205  6709 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.106678  6709 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.115137  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:55.091619  6641 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.120143  6641 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:55.129498  1511 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:55.131837  6692 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.157590  6692 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.160058  6692 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.131677  6709 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:55.171126  6672 consensus_meta.cc:287] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.000s
I20260709 13:01:55.171718  6672 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.174279  6672 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:55.184274  6671 consensus_meta.cc:287] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.000s
I20260709 13:01:55.184859  6671 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.186090  1538 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:01:55.190546  6369 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:55.230252  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.188552  6750 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:55.347708  6709 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:55.207641  6731 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:55.364640  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:55.353919  6767 consensus_meta.cc:287] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.000s
I20260709 13:01:55.420686  6671 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.401693  6709 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.412204  6778 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.407150  6767 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:55.450176  6694 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:55.452181  6694 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:55.403656  6731 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:55.461829  6731 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:55.465052  6709 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.445210  6778 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.468735  6778 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.469543  6709 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:55.495208  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 364052us
I20260709 13:01:55.427886  6369 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:55.517325  1511 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:55.519157  1511 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:55.455175  6694 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:55.521862  6671 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:55.528481  6671 consensus_queue.cc:1059] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:55.528753  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2961) took 1147 ms. Trace:
I20260709 13:01:55.529210  1542 rpcz_store.cc:276] 0709 13:01:54.381827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.468150 (+ 86323us) service_pool.cc:224] Handling call
0709 13:01:54.468412 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.739993 (+271581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:54.740021 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:54.740062 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:54.740095 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.528477 (+788382us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54000b5c54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:55.528574 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.528696 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":624050944}
I20260709 13:01:55.534166  1693 raft_consensus.cc:3055] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:55.534607  1693 raft_consensus.cc:740] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:55.534492  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:55.534166  1547 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:55.536980  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:55.537650  6692 raft_consensus.cc:3055] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:55.538053  6692 raft_consensus.cc:740] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:55.539306  6750 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.539377  6775 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:55.540634  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:55.541234  1539 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:55.519925  6731 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:55.537679  1545 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:01:55.542299  1693 consensus_queue.cc:260] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.495565  6709 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.555186  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:55.555846  1619 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:55.542843  6637 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.557927  1693 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:55.538843  6692 consensus_queue.cc:260] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:55.584651  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 61969.8us
I20260709 13:01:55.562331  6637 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:55.595487  1693 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:55.596896  6777 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.600350  6709 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.601199  6767 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:55.591557  6731 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:55.605042  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:55.605731  2246 raft_consensus.cc:2368] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:01:55.606801  1586 leader_election.cc:400] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:01:55.607075  1586 leader_election.cc:403] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:01:55.606984  1619 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:55.607704  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2605) took 1243 ms. Trace:
I20260709 13:01:55.608093  1693 rpcz_store.cc:276] 0709 13:01:54.364518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.613888 (+249370us) service_pool.cc:224] Handling call
0709 13:01:54.660453 (+ 46565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.534078 (+873625us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b5400341d20. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916a2dc0 00007fc49172d1c0 00007fc49172e231 00007fc49172ad8f 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c
0709 13:01:55.595878 (+ 61800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.607646 (+ 11768us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23128320}
I20260709 13:01:55.608656  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:55.609524  1613 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:01:55.592047  6815 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.610855  1539 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:01:55.611312  2210 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:55.612993  2210 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:55.610162  6815 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.603173  6637 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.612891  6678 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:55.615839  6800 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.616065  6678 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:55.616845  6750 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:55.617224  6750 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.617566  6750 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:55.613852  6751 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:55.618273  6678 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:55.618774  6678 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:55.619398  6742 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:55.619833  6815 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.620347  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1964) took 1260 ms. Trace:
I20260709 13:01:55.613946  6777 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:01:55.621708  6568 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:55.616413  6800 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:55.616394  6594 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.602945  6731 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.620710  1692 rpcz_store.cc:276] 0709 13:01:54.359996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.365018 (+  5022us) service_pool.cc:224] Handling call
0709 13:01:54.365308 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.365536 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:54.408785 (+ 43249us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.006622 (+597837us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.620017 (+613395us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:55.620067 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:55.620113 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.620185 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.620292 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":718851,"prepare.queue_time_us":79740,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":5432,"raft.queue_time_us":695015,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":10588,"thread_start_us":531800,"threads_started":2,"wal-append.queue_time_us":251953}
I20260709 13:01:55.618306  6751 raft_consensus.cc:697] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:55.627629  6369 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:55.641103  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.641878  1659 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:55.643533  6672 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:55.619230  6678 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.644929  1659 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:55.645730  6697 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:55.646855  1659 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:55.647612  6697 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:55.648828  6678 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:55.648952  1659 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:55.649783  6678 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:55.635741  6797 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:55.651386  6678 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:55.651782  6797 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:55.652992  6672 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:55.619870  6742 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.654376  6678 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:55.655458  6742 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:55.656586  6800 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:55.656678  1659 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:55.657640  6800 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:55.657603  6751 consensus_queue.cc:237] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:55.658898  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:55.659119  6700 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:55.659701  6800 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:55.656352  6369 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:55.625886  6594 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.710605  6731 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.710983  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:55.711414  6594 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:55.712212  6800 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.661288  1659 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:55.711474  6817 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:55.713843  6817 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.716648  6817 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.719688  6369 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:55.720427  6692 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:55.712776  6800 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:55.725760  6677 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:01:55.725452  6750 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:55.729188  6754 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:55.729928  6594 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:55.729718  6754 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:55.712684  6777 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:01:55.727929  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 66719.8us
I20260709 13:01:55.739704  6750 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.740885  6754 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.748783  6369 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:55.749434  6369 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:55.739006  6777 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.771960  6777 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.773933  6693 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:55.776466  6594 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:55.777218  6754 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:55.786685  6754 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:55.787484  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:55.788796  6754 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.789052  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:55.783962  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:55.785010  6797 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:55.785341  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 1969) took 1423 ms. Trace:
I20260709 13:01:55.787554  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:55.792448  1688 rpcz_store.cc:276] 0709 13:01:54.361433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.361538 (+   105us) service_pool.cc:224] Handling call
0709 13:01:54.361780 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.553686 (+191906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.785089 (+1231403us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54002251d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:55.785276 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":374826752}
I20260709 13:01:55.744557  6800 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:55.797153  6695 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.799896  6695 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.800257  6369 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:55.800407  6802 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 1.056s	user 0.023s	sys 0.022s
I20260709 13:01:55.802217  6695 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.803094  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2603) took 1439 ms. Trace:
I20260709 13:01:55.803473  6748 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.804122  6748 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.804639  6748 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:55.803727  1690 rpcz_store.cc:276] 0709 13:01:54.363976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.528383 (+164407us) service_pool.cc:224] Handling call
0709 13:01:54.550874 (+ 22491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:54.556557 (+  5683us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:54.556635 (+    78us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:54.557443 (+   808us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.673239 (+115796us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:54.673302 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.673414 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:55.799738 (+1126324us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:55.802790 (+  3052us) raft_consensus.cc:1685] finished
0709 13:01:55.802810 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.803037 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5160,"raft.queue_time_us":7478,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":11610880,"thread_start_us":15206,"threads_started":1,"wal-append.queue_time_us":60073}
I20260709 13:01:55.813571  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:55.814512  1546 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:55.818002  6642 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:55.824011  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1805) took 2053 ms. Trace:
I20260709 13:01:55.824553  1543 rpcz_store.cc:276] 0709 13:01:53.770211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.202561 (+432350us) service_pool.cc:224] Handling call
0709 13:01:54.209798 (+  7237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.995526 (+785728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.823675 (+828149us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54002fadd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:55.823916 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1508802816}
W20260709 13:01:55.827062  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50552 (request call id 1020) took 1588 ms (client timeout 2024 ms). Trace:
W20260709 13:01:55.827641  1618 rpcz_store.cc:269] 0709 13:01:54.238258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.242680 (+  4422us) service_pool.cc:224] Handling call
0709 13:01:55.826782 (+1584102us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b54000e5954. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:55.826974 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246757248}
I20260709 13:01:55.828990  1620 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:55.831655  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:55.832231  1622 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:55.833274  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:55.833978  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:55.834434  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:55.835424  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:55.835592  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:55.836242  1616 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:55.830956  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:55.840943  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:55.841797  1618 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:55.841933  2210 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:55.848682  1546 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:01:55.851187  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:55.852067  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:55.852737  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:56.455742  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 608843us
W20260709 13:01:55.880359  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.856992  1622 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:01:55.853688  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:56.459196  1587 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:55.858351  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.874013  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:56.461007  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.461165  1543 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
W20260709 13:01:56.054811  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.874460  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:55.859126  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:56.462746  1544 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
W20260709 13:01:56.039551  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.247871  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 2971) took 1704 ms (client timeout 1640 ms). Trace:
I20260709 13:01:55.876133  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:55.882468  1618 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
W20260709 13:01:56.463864  1538 rpcz_store.cc:269] 0709 13:01:54.543437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.543575 (+   138us) service_pool.cc:224] Handling call
0709 13:01:56.247613 (+1704038us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b5400187ed4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:56.247761 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1442014592}
I20260709 13:01:55.911942  1616 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:01:55.858989  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:56.465265  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:56.008661  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.465976  1621 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:56.467360  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.028367  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:55.998319  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:56.239717  2238 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45866 (request call id 1032) took 2244 ms (client timeout 2532 ms). Trace:
I20260709 13:01:56.078483  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.469050  2239 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:56.471007  1540 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:01:55.957072  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:56.463034  2246 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
W20260709 13:01:56.470062  2238 rpcz_store.cc:269] 0709 13:01:53.990314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.990439 (+   125us) service_pool.cc:224] Handling call
0709 13:01:56.234443 (+2244004us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b54006202d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:56.234652 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1762379008}
I20260709 13:01:55.926678  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:56.456198  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.480201  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.468041  1617 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
W20260709 13:01:56.004220  1659 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.640s (SENT) [suppressed 14 similar messages]
I20260709 13:01:56.507392  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.483964  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.490556  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.038421  6800 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:56.510792  1616 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:56.510964  6800 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:56.488106  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.514240  1613 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 16: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:56.080534  6660 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:55.963363  6659 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:56.484910  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.516002  6659 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.515357  6800 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:56.518409  6659 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:56.076241  6763 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:56.178097  6312 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.520195  6312 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.521389  1539 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:01:56.522469  6312 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:56.523175  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.523916  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.524194  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.524883  1546 raft_consensus.cc:2393] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 15: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:56.524920  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.527500  6769 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.527998  6769 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.530261  6769 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:56.531493  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 72361.1us
I20260709 13:01:56.532756  6369 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:56.533335  6369 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:56.534047  6797 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:56.534740  6797 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:56.423954  6568 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:56.536094  1613 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:56.535995  6568 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.537002  6797 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:56.538481  6468 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.538985  6468 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:56.539204  6813 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:56.540813  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.541364  6734 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:56.540940  6468 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:56.543469  6468 raft_consensus.cc:2764] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:01:56.503744  6778 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.544900  6778 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.546821  6778 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:56.547528  1620 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:56.550254  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:56.552685  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:56.486490  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.554859  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.551129  2243 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:56.557111  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:56.018766  6767 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:56.557763  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.475890  6632 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.867334  6748 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:55.997957  6723 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.564803  2243 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 16 LEARNER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:56.246385  6536 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:55.877079  6736 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:56.589944  6632 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.481828  6681 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.590867  1621 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
I20260709 13:01:56.559892  6792 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.482789  6775 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:55.858217  6642 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.706s
I20260709 13:01:56.503378  6522 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.482654  6752 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:56.592468  6762 consensus_queue.cc:1059] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:56.482172  6751 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:56.593376  6763 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:55.930033  6594 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:55.857344  6695 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:55.849864  6645 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:56.588672  2209 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:55.997721  6692 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:56.597826  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.557727  6369 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:56.599511  2210 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:56.604625  2246 raft_consensus.cc:2393] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:55.963932  6706 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:56.611902  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:56.593851  6767 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:56.614223  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 152920us
I20260709 13:01:56.617403  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:56.597620  6723 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.614558  6751 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:56.622264  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.639695   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:56.622426  6536 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:01:56.602778  6312 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:56.629889  1618 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:56.613104  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:56.627069  6647 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:56.625639  2209 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:56.667189  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:56.667662  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.676086  1687 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:01:56.674137  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:56.678433  1691 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:01:56.672907  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:56.673141  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.680958  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:56.673727  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 48158.3us
I20260709 13:01:56.681900  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:56.682446  2209 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:56.672873  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.672575  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.604857  6681 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.641700  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:56.644758  6632 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:56.635293  6706 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:56.627370  6645 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:56.625334  6594 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:56.602072  6792 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:56.631134  6692 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.697361  1691 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
I20260709 13:01:56.615483  6522 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.647648  1620 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:56.633723  6369 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.628139  6695 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:56.702289  1542 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:01:56.703501  6792 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:56.703663  6695 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:56.705422  6594 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:56.706014  6594 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:56.609099  6775 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.706259  6369 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:56.707985  6775 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:56.708999  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:56.650207  6751 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:56.710314  6706 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:56.651768  6767 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:56.653371  6723 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:56.655392  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.711079  6834 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:56.711439  1621 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:56.655874  6642 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.658555  6568 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:56.659861  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.714115  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:56.661809  6735 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.662114  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:56.663604  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:56.715281  1688 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:56.663924  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.665076  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.667536  6312 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:56.687472  1618 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:01:56.612468  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:56.687841  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 3041) took 1024 ms. Trace:
I20260709 13:01:56.691499  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.671402  6647 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.697341  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.623481  6763 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.687584  6832 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:56.687511  6762 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:56.759703  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.760627  1616 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:56.761669  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.762504  1616 raft_consensus.cc:2410] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:56.762738  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.763942  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.677796  6800 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.696645  1585 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:56.706020  2246 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:56.705499  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.787149  1544 raft_consensus.cc:2410] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:01:56.668880  6736 raft_consensus.cc:3055] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:56.712709  2210 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:01:56.789973  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 77337.3us
I20260709 13:01:56.713095  6834 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:56.714749  1621 raft_consensus.cc:2368] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:56.716660  1692 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:01:56.638985  6813 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:56.800253  1687 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:56.800642  6813 raft_consensus.cc:697] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:56.801296  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.801489  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:56.802106  1689 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:56.801509  6813 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:56.802641  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.673811  6752 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:56.803861  6752 raft_consensus.cc:697] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:56.794585  6681 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:56.805146  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.806262  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.806200  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:56.719146  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 106776us
I20260709 13:01:56.720824  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.808382  1687 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 17: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:56.720865  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.715708  6642 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.809151  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.723827  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.810181  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.810547  1618 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 15: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:56.719370  1615 rpcz_store.cc:276] 0709 13:01:55.663466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.663601 (+   135us) service_pool.cc:224] Handling call
0709 13:01:55.708957 (+ 45356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.713758 (+  4801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.713793 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.714342 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.083020 (+368678us) spinlock_profiling.cc:243] Waited 9 ms on lock 0x7b180034ac20. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb0d1 00007fc4916e6a0f
0709 13:01:56.552689 (+469669us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:56.552733 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.552794 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.676983 (+124189us) raft_consensus.cc:1685] finished
0709 13:01:56.677009 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.687783 (+ 10774us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4098,"raft.queue_time_us":4263,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":20697344,"thread_start_us":469430,"threads_started":1,"wal-append.queue_time_us":877018}
I20260709 13:01:56.728714  2209 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:56.755098  1696 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:56.812003  1619 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:56.709033  6692 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:56.765370  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.700718  6632 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:01:56.812901  1616 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
W20260709 13:01:56.791988  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 95392.4us
I20260709 13:01:56.813671  6271 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:56.814046  6271 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:56.814411  6271 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:56.814329  1585 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:56.751049  6647 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:56.815990  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.816128  6681 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:56.817376  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:56.817534  6681 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:56.796536  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:56.759694  6769 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.787786  6568 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:56.818713  6769 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.799815  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.819919  1622 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:56.820345  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.821671  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.750149  6792 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:56.804806  6752 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:56.716131  1690 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:01:56.818053  1693 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:56.833150  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 104522us
I20260709 13:01:56.844691  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:56.845806  6632 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:56.846426  6632 raft_consensus.cc:697] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:56.811148  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:56.847605  6632 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.850768  1687 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:56.855640  1688 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:01:56.856765  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.857366  1689 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:01:56.858006  1688 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:01:56.785123  6723 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.864058  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.794759  6594 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.788020  6844 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:56.836179  6734 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:56.819334  6568 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.875826  6734 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:56.876302  6734 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:56.877440  6568 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:56.799021  6800 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.839720  6736 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:56.823990  6834 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:56.873023  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.866979  6832 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:01:56.885800  1585 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:56.888757  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:56.889494  1694 raft_consensus.cc:2368] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:56.872234  6723 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.890281  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.890862  1694 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:56.891211  6723 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:01:56.891515  6826 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.261s	user 0.002s	sys 0.002s
I20260709 13:01:56.892493  6763 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:56.893784  6312 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:56.894873  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 67560.8us
I20260709 13:01:56.892513  1694 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:56.873471  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.879935  1690 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:01:56.835562  6516 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:56.881356  1688 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:56.754354  6735 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:56.879573  6522 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:56.916031  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.906775  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.909364  1693 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:56.875144  6642 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:56.912783  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.918056  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.921831  1544 raft_consensus.cc:2410] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:01:56.871671  6594 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.921953  1694 raft_consensus.cc:2393] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:01:56.923039  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:56.911864  6829 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.281s	user 0.001s	sys 0.001s
I20260709 13:01:56.923501  1688 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:01:56.926445  1547 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:56.927986  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.918165  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.921653  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.929908  1687 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:01:56.911777  6516 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:56.933876  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.937592  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.938673  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:56.935428  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 403194us
I20260709 13:01:56.938683  1687 raft_consensus.cc:2410] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:01:56.940645  1689 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:01:56.942080  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.944295  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.942086  1547 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:56.946771  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.948568  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:56.949236  1540 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:56.883539  6844 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:56.961331  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 3043) took 1133 ms. Trace:
I20260709 13:01:56.968966  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:56.970173  1690 raft_consensus.cc:2410] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:01:56.969281  1614 rpcz_store.cc:276] 0709 13:01:55.827504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.831323 (+  3819us) service_pool.cc:224] Handling call
0709 13:01:55.831634 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.831975 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.832004 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.832494 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.067894 (+235400us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:56.067947 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.068055 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.961120 (+893065us) raft_consensus.cc:1685] finished
0709 13:01:56.961141 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.961270 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25405,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":35807,"thread_start_us":235020,"threads_started":1,"wal-append.queue_time_us":769085}
I20260709 13:01:56.961884  6645 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:56.941756  6516 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:56.974023  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 483012us
I20260709 13:01:56.986001  6778 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:56.975499  6736 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:57.021091  1696 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:57.050094  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:57.064903  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 78323.5us
I20260709 13:01:57.068109  1587 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:56.998840  6647 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:57.074752  1511 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:57.079197  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:57.080441  1512 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:57.080683  1511 leader_election.cc:400] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:57.081096  1511 leader_election.cc:403] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 13:01:57.076011  1659 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.011s	sys 0.003s
W20260709 13:01:57.083007  1659 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.011s	sys 0.004s
W20260709 13:01:57.083889  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 1.0795e+06us
I20260709 13:01:57.083153  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2987) took 1188 ms. Trace:
I20260709 13:01:57.076661  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:57.084084  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:57.088636  6844 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:57.052223  6369 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:57.088953  6692 consensus_queue.cc:1059] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:57.085819  1694 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:01:57.081645  1512 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:57.049074  6695 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:57.089399  6305 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:56.988212  6834 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:57.067278  6522 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:57.085947  1546 rpcz_store.cc:276] 0709 13:01:55.894775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.525476 (+630701us) service_pool.cc:224] Handling call
0709 13:01:56.525744 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.724821 (+199077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.724866 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.759588 (+ 34722us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.923981 (+164393us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:56.924028 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.077476 (+153448us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54001603d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:01:57.077535 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.082881 (+  5346us) raft_consensus.cc:1685] finished
0709 13:01:57.082896 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.083099 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13099,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":6444,"spinlock_wait_cycles":437295360,"thread_start_us":97249,"threads_started":1,"wal-append.queue_time_us":133452}
W20260709 13:01:57.127777  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 58631.4us
W20260709 13:01:57.126461  1659 connection.cc:256] RPC call timeout handler was delayed by -1.0043818220000276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:01:57.092338  6748 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:57.091434  6659 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:57.134230  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:57.136286  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:57.093068  6839 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.132282  2243 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 12: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:57.093330  6671 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:57.137504  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:57.135185  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:57.134884  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:57.121542  6767 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:57.167937  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:57.073764  6312 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:01:57.165150  1691 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:57.169608  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:57.195825  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:57.234740  1619 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:01:57.132952  6832 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:57.227792  6645 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:01:57.186277  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 352609us
W20260709 13:01:57.196575  6840 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:01:57.118880  6695 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:57.249183  6800 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:57.249815  6695 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:57.250818  6846 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:01:57.131314  6271 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:57.133003  6844 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:57.140515  6659 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:57.132805  6632 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 13:01:57.168066  6767 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:01:57.231411  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 100741us
I20260709 13:01:57.196444  6735 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:57.132128  6522 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:57.272891  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:57.171448  6839 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:57.132781  6837 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
W20260709 13:01:57.283402  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 156035us
W20260709 13:01:57.238206  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 110095us
I20260709 13:01:57.260838  6659 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:57.287115  1587 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:57.266228  6767 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:57.246062  6832 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:57.261139  6844 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:57.256158  6645 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:57.290969  6706 raft_consensus.cc:3055] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:01:57.327507  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 193552us
I20260709 13:01:57.329622  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:57.330281  1659 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:57.327767  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2980) took 1458 ms. Trace:
I20260709 13:01:57.320262  6660 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:57.337939  1659 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:57.339277  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:57.339921  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 85875.9us
I20260709 13:01:57.302749  6734 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:57.332736  6861 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:57.339221  6833 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:57.328796  6706 raft_consensus.cc:740] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:57.347441  1659 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:57.347613  2238 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:57.324779  6695 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:01:57.353102  2211 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:57.346658  6660 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.349767  6800 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:57.355665  6839 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:57.383078  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 98717.4us
I20260709 13:01:57.383468  1659 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:57.392664  1622 raft_consensus.cc:1240] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:57.346455  1541 rpcz_store.cc:276] 0709 13:01:55.869566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.874612 (+  5046us) service_pool.cc:224] Handling call
0709 13:01:55.875032 (+   420us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:55.998431 (+123399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.998466 (+    35us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:56.476432 (+477966us) log.cc:844] Serialized 78 byte log entry
0709 13:01:56.985169 (+508737us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:57.073992 (+ 88823us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.090195 (+ 16203us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.280056 (+189861us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b180046c000. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e5b8c0a 00007fc497cf8219 00007fc48e640a40 00007fc48e63b4e4 00007fc48e63b455 00007fc491723060 00007fc491735716 00007fc491746287 00007fc491746208
0709 13:01:57.305074 (+ 25018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.305204 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.322657 (+ 17453us) raft_consensus.cc:1685] finished
0709 13:01:57.322719 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.327711 (+  4992us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":290467,"prepare.queue_time_us":141788,"prepare.run_cpu_time_us":4082,"prepare.run_wall_time_us":29169,"raft.queue_time_us":333214,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":8112,"spinlock_wait_cycles":55500160,"thread_start_us":474252,"threads_started":2,"wal-append.queue_time_us":407335}
I20260709 13:01:57.393304  1659 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:01:57.385679  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 100501us
I20260709 13:01:57.346891  6864 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:57.418632  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 200657us
W20260709 13:01:57.489651  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 136645us
I20260709 13:01:57.491688  2211 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:57.454780  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 167761us
I20260709 13:01:57.346977  6762 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:57.493785  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:57.395825  1511 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:57.462822  6868 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:57.506489  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:57.507637  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:57.495301  1585 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:01:57.488266  6858 log.cc:927] Time spent T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:01:57.550282  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:57.551054  1695 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
W20260709 13:01:57.501111  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 105398us
I20260709 13:01:57.500658  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:57.457620  6865 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:57.481874  6271 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:57.357872  6522 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:57.457887  6800 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:57.494395  1587 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:57.469694  6769 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:57.442694  6844 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:57.491504  6647 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:57.395866  6660 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:57.502949  6832 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:57.503935  6856 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:01:57.504738  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:57.504674  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:57.513631  1585 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:57.348191  6850 log.cc:927] Time spent T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:01:57.560276  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:57.561020  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:57.394124  6834 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:57.436079  6369 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:57.381901  6837 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:57.604122  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 109787us
I20260709 13:01:57.572500  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:57.606894  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 213634us
I20260709 13:01:57.605710  2211 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:57.608958  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:57.500597  6864 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:01:57.405772  6748 raft_consensus.cc:697] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:57.443423  6833 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:57.548573  6797 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:57.549086  6695 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:57.619360  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 105817us
I20260709 13:01:57.359632  6861 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:57.465888  6706 consensus_queue.cc:260] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:57.521193  6762 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:57.572757  6775 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:57.809962  6775 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.810443  6775 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:57.810356  1659 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:57.663370  6645 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:57.811846  1659 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:57.747853  6882 log.cc:927] Time spent T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:01:57.812601  6884 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:57.729962  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 1046) took 1187 ms. Trace:
W20260709 13:01:57.811025  6767 consensus_meta.cc:287] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.503s	user 0.004s	sys 0.005s
I20260709 13:01:57.814087  6767 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:57.814849  6864 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:57.815171  1615 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:57.737185  6845 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.937s	user 0.011s	sys 0.003s
I20260709 13:01:57.693502  6800 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:57.817440  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 2978) took 1948 ms. Trace:
I20260709 13:01:57.608582  6839 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:57.818581  6767 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:57.819368  6833 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:57.817785  1545 rpcz_store.cc:276] 0709 13:01:55.868930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.869064 (+   134us) service_pool.cc:224] Handling call
0709 13:01:56.505472 (+636408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:56.562636 (+ 57164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.562682 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:56.596534 (+ 33852us) log.cc:844] Serialized 52 byte log entry
0709 13:01:56.762075 (+165541us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:56.785185 (+ 23110us) log.cc:844] Serialized 14 byte log entry
0709 13:01:56.785881 (+   696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.785953 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.736416 (+950463us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:01:57.817149 (+ 80733us) raft_consensus.cc:1685] finished
0709 13:01:57.817252 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.817389 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4415,"prepare.queue_time_us":23144,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":39,"raft.queue_time_us":1720,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":44116,"spinlock_wait_cycles":61143424,"thread_start_us":137455,"threads_started":1,"wal-append.queue_time_us":189978}
I20260709 13:01:57.690260  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 808) took 1023 ms. Trace:
I20260709 13:01:57.819890  6833 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:57.781649  6516 consensus_meta.cc:287] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.750s	user 0.008s	sys 0.000s
W20260709 13:01:57.809104  6671 consensus_meta.cc:287] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.000s
I20260709 13:01:57.820977  6516 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:57.721156  2243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45866 (request call id 1049) took 1109 ms. Trace:
I20260709 13:01:57.735082  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:57.822317  2243 rpcz_store.cc:276] 0709 13:01:56.612116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.612798 (+   682us) service_pool.cc:224] Handling call
0709 13:01:57.720894 (+1108096us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54007012d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:57.721059 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1113866496}
I20260709 13:01:57.808676  6734 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:57.823258  1512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.018s	sys 0.033s
W20260709 13:01:57.823704  1512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.018s	sys 0.033s
I20260709 13:01:57.823789  6763 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:57.823939  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 251468us
W20260709 13:01:57.824244  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 742526us
I20260709 13:01:57.620388  6867 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:57.825307  1512 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:57.690608  1687 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:57.811928  6568 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:57.826611  6568 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.826647  6875 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:57.827145  6568 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:57.827749  6369 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:57.828040  1512 leader_election.cc:400] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:57.828274  6369 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:57.828892  1512 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:57.736037  1621 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:57.651378  6844 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.396176  6871 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:57.830611  6871 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:57.830282  6844 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:57.820117  1696 rpcz_store.cc:276] 0709 13:01:56.666851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.666959 (+   108us) service_pool.cc:224] Handling call
0709 13:01:57.690085 (+1023126us) spinlock_profiling.cc:243] Waited 75.5 ms on lock 0x7b54002c6354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:57.690207 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173692800}
I20260709 13:01:57.718048  6594 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:57.831022  6871 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:57.681526  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:57.832602  6844 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:57.744176  6792 consensus_queue.cc:1059] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:01:57.834061  6752 raft_consensus.cc:3055] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:57.834476  6752 raft_consensus.cc:740] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:01:57.835732  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 230066us
I20260709 13:01:57.835451  6752 consensus_queue.cc:260] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:57.836548  6752 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:57.836654  6855 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:57.838285  2211 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:57.839042  6855 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:57.839529  6855 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.839922  6855 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:57.813517  1613 rpcz_store.cc:276] 0709 13:01:56.542401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.542548 (+   147us) service_pool.cc:224] Handling call
0709 13:01:56.542845 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.984256 (+441411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.984304 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.984892 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.494906 (+510014us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:57.494981 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.495077 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.729676 (+234599us) raft_consensus.cc:1685] finished
0709 13:01:57.729719 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.729887 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":960,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":808512,"threads_started":2,"wal-append.queue_time_us":563770}
I20260709 13:01:57.821506  6671 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:57.842197  1585 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:57.572532  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:01:57.692086  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.735714  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:57.843933  1695 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:57.843027  1587 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:57.845433  1587 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:57.858003  1587 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:57.842089  2211 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:57.861065  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:57.738618  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:57.865877  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:57.849447  6695 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:57.872325  2241 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:57.820755  6762 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:57.865743  6735 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:57.846983  6797 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:57.879006  1512 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:57.871620  2242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 1039) took 1319 ms. Trace:
I20260709 13:01:57.875799  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:57.877213  1687 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:57.864279  6875 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:57.838904  6871 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:57.684324  6736 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:57.860422  6867 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:57.859719  6876 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:57.884619  2242 rpcz_store.cc:276] 0709 13:01:56.545610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.545766 (+   156us) service_pool.cc:224] Handling call
0709 13:01:56.546115 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.546363 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:56.875605 (+329242us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.280602 (+404997us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.549239 (+268637us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b1800331300. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:01:57.716945 (+167706us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b1800331300. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63b455 00007fc491723060 00007fc491735716 00007fc491746287 00007fc491746208
0709 13:01:57.863870 (+146925us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.863931 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:57.863996 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.864805 (+   809us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.864928 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25940,"prepare.queue_time_us":47717,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":93,"raft.queue_time_us":113614,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":39592,"spinlock_wait_cycles":21556992,"thread_start_us":779496,"threads_started":3,"wal-append.queue_time_us":402972}
I20260709 13:01:57.823163  6516 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:57.864081  6839 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:57.870776  6767 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:57.890493  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:57.859520  6734 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:01:57.873140  6695 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:57.878229  6878 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:01:57.892803  1512 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:57.930512  1512 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:57.896705  1511 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:57.931771  1512 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:57.879627  6792 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:01:57.912583  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:57.889163  6862 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.889000  6797 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:57.918395  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:57.878322  6889 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:57.892232  6875 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:57.893364  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:57.803383  6659 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:57.883447  6671 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:01:57.917937  6873 consensus_queue.cc:1059] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:01:57.905557  6872 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:57.914469  6867 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.936837  1512 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:57.936579  1511 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:57.908824  6647 consensus_queue.cc:1059] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:01:57.902931  6762 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:01:57.939883  6522 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:57.966699  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 62325us
W20260709 13:01:57.967408  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.016881  2237 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:57.919497  6369 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:58.044422  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 107636us
I20260709 13:01:58.045250  1512 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:58.045953  1660 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
W20260709 13:01:57.977535  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 56699.9us
I20260709 13:01:58.046030  2211 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:57.934926  6692 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:58.043170  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 106625us
I20260709 13:01:58.050110  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:58.051007  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:58.050607  1695 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:57.937340  6305 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:57.939874  6879 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:57.965416  6632 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:58.064589  1586 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:58.060076  1660 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:58.020761  6875 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:58.061884  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:58.055070  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:58.071846  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:58.072981  1690 raft_consensus.cc:2410] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:01:58.073290  1696 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:58.073673  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:58.064703  6305 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:58.048125  6706 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.074545  1696 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:58.074993  1687 raft_consensus.cc:2410] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:01:58.062371  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:58.075590  1688 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:01:58.072386  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:58.046185  6867 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:58.059556  6844 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:58.047896  6312 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:58.048010  6536 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:58.074676  6888 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:01:57.979699  6660 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.073776  6522 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:58.089331  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.091426  6861 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:58.077678  6763 consensus_queue.cc:1059] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:01:58.085770  6883 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:58.098237  6855 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:57.968961  6862 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.058553  6839 consensus_queue.cc:1059] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:01:58.100467  6369 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:58.078039  6832 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:58.144891  6832 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.145334  6832 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.146420  6875 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.147933  2241 raft_consensus.cc:2393] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 16: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:58.056198  6568 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.073189  6632 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.089407  6844 raft_consensus.cc:697] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:58.103996  6871 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:58.105774  6660 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:58.106264  6659 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:58.109793  6863 raft_consensus.cc:3055] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:58.109725  6833 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:57.940793  6748 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.078197  6813 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:58.130066  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:58.243960  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 89237.4us
I20260709 13:01:58.139500  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.140944  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.143128  6855 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:58.244673  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:58.144105  6797 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:58.247107  2211 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:58.075423  6305 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:58.125553  6522 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.195680  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.252687  1618 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:01:58.253782  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.195999  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.101815  6695 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.136108  6893 raft_consensus.cc:3055] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:58.240098  1692 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:01:58.139496  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.255901  1622 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:01:58.143494  6775 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:58.148692  6883 raft_consensus.cc:697] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:58.265833  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:58.266671  1696 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:58.268745  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.237066  6834 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:58.152158  6894 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:58.246945  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:01:58.250327  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 201354us
I20260709 13:01:58.250645  1619 raft_consensus.cc:2393] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 15: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:58.256659  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:58.286615  1622 raft_consensus.cc:2376] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14. Re-sending same reply.
I20260709 13:01:58.287597  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.230350  6594 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:58.255156  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.250980  6865 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:58.270641  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.272460  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:58.277599  2241 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:58.296011  1617 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:01:58.239135  6863 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:58.288239  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:58.236409  6872 raft_consensus.cc:697] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:58.298030  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:58.269991  1694 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:58.260941  6522 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:58.293355  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.294426  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.290207  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.258704  6893 raft_consensus.cc:740] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:58.302345  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:58.302992  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.270021  6870 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:58.302001  1693 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:58.309412  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:58.313992  1619 raft_consensus.cc:2376] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18. Re-sending same reply.
I20260709 13:01:58.251163  6271 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:01:58.293645  6879 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:58.339365  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:58.310672  6659 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:58.341866  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.342128  6883 consensus_queue.cc:237] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:58.342872  1615 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 16: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:58.345820  6735 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.346378  6735 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:58.352747  6632 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:58.354274  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:58.355100  6875 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:58.355268  1619 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 16: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:58.356544  6797 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:58.357630  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.316772  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.359122  6695 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:58.359575  6872 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:58.310334  6468 consensus_queue.cc:1059] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:01:58.357401  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:58.310367  6892 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:01:58.366878  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 64622.2us
I20260709 13:01:58.376909  1660 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:58.380385  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:58.381464  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.378120  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:58.350667  1587 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:58.368749  1696 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:01:58.291934  6834 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:58.241241  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 196033us
I20260709 13:01:58.304076  6898 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:58.376106  6837 consensus_meta.cc:287] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.516s	user 0.004s	sys 0.004s
I20260709 13:01:58.393572  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:58.432415  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:58.394927  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:58.433961  2237 raft_consensus.cc:2368] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16.
W20260709 13:01:58.396083  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 45526.5us
I20260709 13:01:58.435637  1587 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:58.398617  1512 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:58.422708  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:58.438911  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:58.377485  6864 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:58.297513  6594 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:58.294927  6894 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:58.439800  1622 raft_consensus.cc:2368] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:58.440050  1511 leader_election.cc:400] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16.
I20260709 13:01:58.448329  1511 leader_election.cc:403] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:58.448289  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:58.448817  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:58.396451  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:01:58.442283  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 43761.1us
I20260709 13:01:58.450291  1512 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:58.377957  6870 raft_consensus.cc:697] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:58.452768  2245 raft_consensus.cc:2393] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:58.453104  1512 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:58.442981  1587 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:58.390614  6881 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:58.392051  6369 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:58.423883  6839 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:58.458053  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:58.391176  6900 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:58.442145  6800 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:58.441915  6879 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:58.441648  6837 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:58.455668  6881 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.451894  6312 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:58.390683  6892 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:58.458567  6898 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:01:58.442927  6903 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:58.481117  1622 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:01:58.482903  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:58.494438  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 62102us
I20260709 13:01:58.495786  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05911a041e044f48bce12648b58061be"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:01:58.496254  6875 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:58.496408  1622 raft_consensus.cc:606] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
W20260709 13:01:58.497424  6905 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:58.498076  6903 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:58.498564  6903 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:58.499797  6892 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:58.502061  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:58.502818  2242 raft_consensus.cc:2393] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 13: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:58.451936  6681 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:01:58.458272  6895 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:58.458606  6692 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:58.461306  6706 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:58.459049  6369 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.463959  6864 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:58.494982  1613 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:58.484861  1587 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:58.312916  6844 consensus_queue.cc:237] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.487380  6568 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:58.491101  6881 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:58.466310  6862 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:58.513724  6706 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:58.532106  6706 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:58.518508  6369 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.538008  6877 raft_consensus.cc:3055] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:58.538552  6877 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:58.522233  1587 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:58.503185  1660 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:58.508714  6839 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:58.564471  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:58.564661  1587 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:58.565452  1618 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:01:58.503271  6734 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.539572  6877 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:58.551115  6863 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:58.551869  1613 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
I20260709 13:01:58.552672  6862 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.553580  6833 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:58.555172  6536 raft_consensus.cc:3055] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:58.551182  6369 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.557647  6706 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.558316  6832 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:58.559492  6911 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:01:58.568946  2245 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:58.489302  6879 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.590421  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:58.591924  6536 raft_consensus.cc:740] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:58.587559  6568 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:58.602095  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:58.588039  6866 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:58.591331  6895 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:58.605978  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 147979us
I20260709 13:01:58.591884  6863 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:58.588688  6775 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:58.507329  6870 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:58.593726  6864 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:58.543256  6305 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.598721  6892 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:58.650635  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 48606.4us
I20260709 13:01:58.587529  6522 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.656363  6568 raft_consensus.cc:697] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:01:58.656834  6706 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:58.657336  6568 consensus_queue.cc:237] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.659435  6800 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:58.661216  6894 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:58.601271  6873 consensus_queue.cc:1059] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:01:58.593227  6862 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:58.649034  6867 consensus_meta.cc:287] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.000s
I20260709 13:01:58.667631  1511 leader_election.cc:400] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:58.668083  1511 leader_election.cc:403] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:01:58.648644  6864 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:58.589564  6734 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.602783  6833 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:58.678918  6883 raft_consensus.cc:3055] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:58.696786  6862 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:58.664433  6834 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:58.610096  6681 consensus_queue.cc:1059] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:01:58.668931  1511 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:58.675761  6878 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:58.698560  1511 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:58.698873  6468 raft_consensus.cc:3055] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:58.699306  6468 raft_consensus.cc:740] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:58.699748  6861 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:58.700305  6861 raft_consensus.cc:697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:58.700454  6305 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:58.700202  6468 consensus_queue.cc:260] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.701156  6305 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:58.701681  6305 raft_consensus.cc:697] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 17 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:58.701362  6861 consensus_queue.cc:237] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.702517  6305 consensus_queue.cc:237] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.709452  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:58.686854  6522 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:58.684906  6734 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:58.688566  6879 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:58.697134  6883 raft_consensus.cc:740] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:58.684885  6735 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:58.662889  6775 raft_consensus.cc:993] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
W20260709 13:01:58.651479  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 196893us
I20260709 13:01:58.744282  1512 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:58.745482  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:58.671835  6867 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.706378  6878 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14.
I20260709 13:01:58.706209  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:58.685560  6913 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:58.704802  6898 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16.
I20260709 13:01:58.704666  6536 consensus_queue.cc:260] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:58.704247  6594 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:58.717916  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 123871us
I20260709 13:01:58.706928  6369 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:58.716890  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:58.757695  1622 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 15: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:58.679432  6864 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:58.754503  1512 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:58.756373  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.756501  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:58.758490  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:58.763160  2245 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:58.747172  6862 raft_consensus.cc:1081] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:01:58.759873  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:58.760878  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:58.766371  1620 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:58.766583  1512 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:58.752704  6706 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:58.771955  1512 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:58.775748  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:58.785176  1687 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:01:58.785719  1694 raft_consensus.cc:2376] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15. Re-sending same reply.
I20260709 13:01:58.779503  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:58.784729  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:58.778410  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:58.788885  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:58.789700  1694 raft_consensus.cc:2368] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11.
I20260709 13:01:58.790412  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:58.791005  1687 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:58.769096  6878 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:58.776234  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:58.788944  1695 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:58.800000  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.797406  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:58.796284  1692 raft_consensus.cc:2368] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16.
I20260709 13:01:58.801553  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:58.791915  6878 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:58.818313  6878 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:58.784938  6875 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:58.827641  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:58.837754  1690 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:01:58.833978  2245 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:58.769716  6898 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:58.760404  6913 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.856410  2242 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:58.859084  1695 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
I20260709 13:01:58.837119  6875 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.874490  2245 raft_consensus.cc:1240] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:58.855741  6914 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:01:58.910563  1696 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:58.768913  6883 consensus_queue.cc:260] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.876705  6875 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:58.925518  1622 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:01:58.947077  6922 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:01:58.947952  6522 consensus_queue.cc:1059] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:58.949366  6522 raft_consensus.cc:3055] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:58.949184  6881 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.949833  6522 raft_consensus.cc:740] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:58.950414  1689 raft_consensus.cc:2368] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16.
I20260709 13:01:58.951870  6660 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.951923  6522 consensus_queue.cc:260] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:58.952560  6660 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:58.953825  6522 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:58.965641  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.971004  1696 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
W20260709 13:01:58.971722  6923 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
W20260709 13:01:58.972323  6929 log.cc:927] Time spent T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:01:58.979003  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:58.988194  6305 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:58.981741  6932 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:58.985616  6867 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:58.993391  6305 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:58.993382  6928 log.cc:927] Time spent T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:01:59.011215  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.012030  1546 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:01:59.014066  1538 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:59.014120  1687 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:01:58.987649  6934 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.999277  6893 consensus_queue.cc:260] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:59.005154  6305 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:59.006078  6913 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:59.014880  1693 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:59.020180  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:59.023255  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.024088  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.021639  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:59.024353  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.025063  1546 raft_consensus.cc:2410] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:01:59.022369  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.022526  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:59.025635  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:59.027513  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:59.007583  6898 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.028062  1540 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:59.007771  6312 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.027985  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:59.032378  1539 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:59.002805  6932 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:59.063861  6881 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:59.064695  6893 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.065440  6932 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:01:59.050544  6903 consensus_meta.cc:287] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.002s
I20260709 13:01:59.066236  6903 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.068243  6903 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:59.070940  1539 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:01:59.080031  6864 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:59.074466  1542 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:01:59.081328  1543 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:59.082782  6864 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:59.083514  1541 raft_consensus.cc:1240] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:59.084143  1547 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:01:59.042026  6898 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:59.089385  6898 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:59.046238  6312 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:59.092674  6312 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:59.094306  6839 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.094801  6839 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:59.023705  6934 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.109615  6934 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:59.111573  1543 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:59.115590  1540 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:01:59.117120  6877 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:59.135936  1540 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:01:59.141005  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.141649  1540 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:01:59.146458  1586 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:59.147701  1547 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:59.148687  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.149391  1547 raft_consensus.cc:2368] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12.
I20260709 13:01:59.150061  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.150727  1547 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 15: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:59.151528  6863 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:59.152063  6863 raft_consensus.cc:697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:01:59.153040  6912 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.624s	user 0.006s	sys 0.013s
I20260709 13:01:59.152899  6863 consensus_queue.cc:237] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:59.155792  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.160066  1547 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:59.160938  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:59.157954  1585 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:59.161876  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.165653  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.166288  1540 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:59.166744  1512 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:59.168860  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:59.170140  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:59.167418  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.171504  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:59.179348  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.172217  1585 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:59.165683  6769 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:59.141733  6875 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.197255  6875 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:59.177801  1545 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:59.170897  1512 leader_election.cc:400] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11.
I20260709 13:01:59.185869  2237 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:59.187158  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.195385  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.201170  1540 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:59.200201  1547 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:01:59.144295  6878 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.206576  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:59.206660  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.171270  6934 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:59.168212  6706 consensus_queue.cc:1059] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:01:59.189282  6926 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:59.245584  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.183063  6734 consensus_queue.cc:1059] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:01:59.250461  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.245865  1539 raft_consensus.cc:1240] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:59.246821  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 63464.3us
I20260709 13:01:59.226197  1540 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:01:59.199209  6894 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:01:59.253476  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.246009  6926 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:01:59.261057  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 79007.5us
I20260709 13:01:59.262665  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.228915  6769 consensus_queue.cc:1059] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:01:59.272713  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.274171  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.274533  1545 raft_consensus.cc:2393] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 16: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:01:59.284406  1585 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:01:59.285498  6734 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:59.286036  6734 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:59.288328  6734 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:59.288631  1543 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:01:59.288780  6734 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:59.289346  6734 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:59.292932  6769 raft_consensus.cc:3055] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:59.293406  6769 raft_consensus.cc:740] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:59.293568  6878 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:59.294361  6769 consensus_queue.cc:260] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.289000  1543 pending_rounds.cc:85] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 10
I20260709 13:01:59.296550  1543 pending_rounds.cc:107] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:01:59.296993  1543 raft_consensus.cc:2889] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:59.264285  6926 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:59.299700  6839 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.303709  6839 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:59.305953  1538 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:01:59.309358  1512 leader_election.cc:400] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16.
I20260709 13:01:59.310217  1512 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:59.311417  6659 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:59.311777  6659 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:01:59.312127  6659 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:59.315582  6769 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:59.316473  6916 raft_consensus.cc:3055] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:59.316874  6916 raft_consensus.cc:740] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:59.317163  6734 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:59.317663  6916 consensus_queue.cc:260] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.318928  6916 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:59.324172  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 3071) took 1127 ms. Trace:
I20260709 13:01:59.325906  1512 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:59.314929  6775 raft_consensus.cc:3055] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:59.321357  6883 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:59.324877  1689 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:59.335587  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:59.335587  1620 rpcz_store.cc:276] 0709 13:01:58.197073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.288945 (+ 91872us) service_pool.cc:224] Handling call
0709 13:01:59.323994 (+1035049us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b5400087354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:59.324112 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1059930880}
I20260709 13:01:59.336522  1512 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:59.343442  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:59.343485  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:59.344368  1512 leader_election.cc:400] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16.
I20260709 13:01:59.344452  1694 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:59.344693  1512 leader_election.cc:403] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:01:59.341275  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 56991us
I20260709 13:01:59.346208  1585 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:59.346370  1541 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:59.348206  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:59.352154  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:59.324204  6941 log.cc:927] Time spent T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:59.341759  6878 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:59.345613  6839 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:59.357142  6945 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.372400  6660 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:59.375662  6468 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:59.345413  6748 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:59.380260  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:59.437589  1691 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:01:59.355860  6861 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:59.384871  1694 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:01:59.344640  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:01:59.403846  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.429116  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 244975us
I20260709 13:01:59.345952  6832 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:01:59.433907  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:59.440003  1692 raft_consensus.cc:1813] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Handling vote request from an unknown peer d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:59.340216  6775 raft_consensus.cc:740] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:59.440448  1692 raft_consensus.cc:2368] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15.
I20260709 13:01:59.441219  2209 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:59.445528  2209 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:59.430608  6839 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.427985  6871 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:59.458132  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:59.460542  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:59.461465  1688 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:01:59.462509  6942 log.cc:927] Time spent T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:01:59.463630  6870 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:59.448939  6748 raft_consensus.cc:697] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:59.471366  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:59.472195  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.472352  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:59.473923  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:59.453440  6839 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:59.472913  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:59.476018  1691 raft_consensus.cc:2393] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 11: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:01:59.476804  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.478732  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:01:59.479267  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.479627  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:59.480671  1542 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:59.479445  1539 raft_consensus.cc:2393] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:59.481484  6870 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:59.492548  6659 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.493031  1691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05911a041e044f48bce12648b58061be"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:45660
I20260709 13:01:59.494562  1691 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:59.449987  6695 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:01:59.499418  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:59.501125  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 3082) took 1207 ms. Trace:
I20260709 13:01:59.507696  1618 rpcz_store.cc:276] 0709 13:01:58.294021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.294175 (+   154us) service_pool.cc:224] Handling call
0709 13:01:59.500971 (+1206796us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b540042c054. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:59.501073 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609837440}
I20260709 13:01:59.508098  1617 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:01:59.501958  1691 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:59.504633  1587 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:59.510442  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:59.504884  1512 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:01:59.520979  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:59.521706  1539 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:01:59.522260  1696 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:59.523180  1542 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:59.525135  1696 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:59.532090  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:59.537727  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:59.539592  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:59.539937  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:59.541390  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:59.542332  1621 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 14: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:59.543407  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:59.544080  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.536432  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:59.459658  6871 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:59.540104  1622 raft_consensus.cc:1813] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Handling vote request from an unknown peer d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:59.553885  1622 raft_consensus.cc:2368] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15.
I20260709 13:01:59.554734  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:59.555747  1511 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:59.532979  1620 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:01:59.555778  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:59.556721  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:59.556933  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:01:59.557488  1620 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:01:59.558416  1621 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:01:59.558743  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:01:59.560379  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 44786.8us
I20260709 13:01:59.498378  6870 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:59.567253  1619 raft_consensus.cc:1240] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:59.571586  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:59.572464  1613 raft_consensus.cc:2393] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 11: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:01:59.575951  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:59.576543  1615 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:59.580421  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.586009  1545 raft_consensus.cc:2410] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:01:59.586555  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 107753us
I20260709 13:01:59.548209  6934 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:01:59.588742  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 143249us
I20260709 13:01:59.594691  2209 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:59.592278  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:59.589716  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:59.567633  6863 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.596607  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:59.476394  6775 consensus_queue.cc:260] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.597018  1511 leader_election.cc:400] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15.
I20260709 13:01:59.597365  1511 leader_election.cc:403] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:59.600504  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.573387  6933 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:59.600302  1511 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:59.603847  6864 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:59.604234  6660 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:59.604786  6870 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:59.608547  6775 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:59.612289  6660 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15.
I20260709 13:01:59.585203  6671 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:01:59.612787  6875 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:59.613297  6871 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:59.587392  6778 consensus_queue.cc:1059] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:01:59.614343  6778 raft_consensus.cc:3055] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:59.614686  6778 raft_consensus.cc:740] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:01:59.615664  6893 consensus_meta.cc:287] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.001s
I20260709 13:01:59.615491  6778 consensus_queue.cc:260] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.616189  6893 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:59.616848  6778 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:59.616668  6893 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:59.617995  6659 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:59.580338  6844 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:59.618659  6893 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:59.565337  6877 consensus_queue.cc:1059] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:01:59.621474  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:59.622098  1695 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:01:59.622233  6877 raft_consensus.cc:3055] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:59.622766  6877 raft_consensus.cc:740] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:59.623631  6877 consensus_queue.cc:260] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:01:59.628206  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.633279  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:59.654753  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:01:59.655067  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.657474  1512 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:01:59.661077  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 98580.6us
I20260709 13:01:59.664865  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:01:59.670162  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:59.672019  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:59.672514  1615 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:01:59.663213  1691 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:59.674358  1695 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:59.618716  6844 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:59.670459  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:59.680141  1512 leader_election.cc:400] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15.
I20260709 13:01:59.680756  1512 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:59.682047  1691 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:59.685460  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:59.685748  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:59.686904  2242 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:59.656855  6893 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:01:59.688482  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:59.692291  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:59.704177  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:01:59.705729  1694 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:59.694051  1689 raft_consensus.cc:1240] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:59.660367  6312 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:59.653986  6934 raft_consensus.cc:697] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:59.717168  1615 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:59.711447  1511 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:59.721935  1694 raft_consensus.cc:1240] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:59.723881  1690 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:59.725853  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:01:59.681473  6877 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:59.751072  1511 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:01:59.753225  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.625532  6863 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.660320  6931 consensus_queue.cc:1059] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:01:59.688306  6872 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:59.713761  6695 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:59.720297  6312 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.710474  6954 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:59.596891  6748 consensus_queue.cc:237] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.724956  6947 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:59.754055  6878 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:59.752875  6919 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:59.776084  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:59.744014  6900 consensus_queue.cc:1059] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:01:59.775876  6312 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:59.770937  6671 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:59.783932  6695 raft_consensus.cc:697] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:59.795006  6934 consensus_queue.cc:237] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.800392  6660 raft_consensus.cc:3055] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:59.776954  6898 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:01:59.780565  6769 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:59.822276  1614 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
W20260709 13:01:59.825811  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 113354us
I20260709 13:01:59.790421  6954 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:59.833628  2210 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:59.825606  6660 raft_consensus.cc:740] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:01:59.772693  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 176129us
W20260709 13:01:59.843520  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 248862us
I20260709 13:01:59.784248  6947 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:59.852995  2209 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:01:59.857046  1585 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:59.858081  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:59.859750  6866 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:59.860071  6660 consensus_queue.cc:260] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:59.860303  6866 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.861439  6660 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.862438  6866 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:01:59.852144  6883 consensus_meta.cc:287] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.502s	user 0.015s	sys 0.000s
I20260709 13:01:59.863802  6893 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:59.864329  6893 raft_consensus.cc:697] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:01:59.864208  6883 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:59.864964  6866 consensus_queue.cc:1059] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:59.865255  6893 consensus_queue.cc:237] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:59.866464  6883 raft_consensus.cc:3055] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:59.866833  6883 raft_consensus.cc:740] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:59.867056  6947 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:59.867619  6947 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:59.854801  6872 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:01:59.866124  6839 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.849081  6895 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.868969  1619 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:59.869065  6895 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:01:59.869570  6950 log.cc:927] Time spent T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:01:59.871683  6839 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:59.875458  6861 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16.
I20260709 13:01:59.877490  6695 consensus_queue.cc:237] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.878679  1622 raft_consensus.cc:2410] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:01:59.881614  6734 consensus_queue.cc:1059] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:59.882988  6839 raft_consensus.cc:3055] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:59.883379  6839 raft_consensus.cc:740] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:01:59.883757  6863 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:01:59.884250  6960 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:59.852769  6468 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:01:59.884275  6839 consensus_queue.cc:260] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.888046  6839 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:59.897187  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 46061.5us
W20260709 13:01:59.904203  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.903537  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 46527.3us
I20260709 13:01:59.905303  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:59.907640  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:01:59.910876  1546 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:01:59.834335  6775 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:01:59.913379  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:01:59.918385  1693 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:01:59.915151  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 2615) took 1494 ms. Trace:
I20260709 13:01:59.919023  1617 rpcz_store.cc:276] 0709 13:01:58.420967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.421080 (+   113us) service_pool.cc:224] Handling call
0709 13:01:59.501292 (+1080212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.508654 (+  7362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.914969 (+406315us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540042c050. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:01:59.915099 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2482880768}
I20260709 13:01:59.920569  1660 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:59.923810  1585 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:59.925603  1587 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:59.928095  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.928712  1547 raft_consensus.cc:2376] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16. Re-sending same reply.
I20260709 13:01:59.929390  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:59.894591  6895 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:59.912511  6734 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:59.933619  1585 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:01:59.935961  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:01:59.936429  1512 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:01:59.936878  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:01:59.912173  6837 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:01:59.924178  6872 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:01:59.931607  6873 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:59.928905  6878 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:59.965521  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.939869  6895 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:59.957703  6871 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:59.934249  6961 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:59.966913  1543 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:59.955739  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 98506.5us
I20260709 13:01:59.932255  6863 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.968966  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:01:59.970247  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 49736.9us
I20260709 13:01:59.867640  6883 consensus_queue.cc:260] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:01:59.969802  6873 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:01:59.923616  6775 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:00.074018  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 92393.5us
I20260709 13:01:59.955437  6875 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:59.981889  1660 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:59.969455  6844 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:01:59.959544  6659 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:01:59.967737  6692 consensus_queue.cc:1059] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.139s
I20260709 13:01:59.980562  6871 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.996713  6734 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:59.967967  6931 consensus_queue.cc:1059] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
W20260709 13:02:00.105697  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 123862us
I20260709 13:02:00.121089  1660 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:01:59.971581  6919 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.133s
I20260709 13:02:00.098697  6873 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:00.117749  6692 raft_consensus.cc:3055] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:59.977793  6878 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:01:59.971213  6872 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:00.105387  6895 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:00.116477  6871 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:00.074986  6863 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:00.109988  6976 raft_consensus.cc:2764] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:02:00.126714  6916 consensus_meta.cc:287] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.786s	user 0.017s	sys 0.000s
I20260709 13:02:00.155210  1544 raft_consensus.cc:2410] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:00.129302  6692 raft_consensus.cc:740] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:01:59.968112  6954 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:00.197958  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:00.073894  6961 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:00.134517  6870 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.138556  6834 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:00.202014  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:00.203881  2238 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:00.205248  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:00.206890  6872 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:00.218315  6965 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
W20260709 13:02:00.219386  6969 log.cc:927] Time spent T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:02:00.221302  6962 log.cc:927] Time spent T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
W20260709 13:02:00.222828  6968 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:02:00.215018  6870 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:00.225795  6870 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:00.226737  6878 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:00.232254  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 260561us
I20260709 13:02:00.153141  6832 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:02:00.135838  6312 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:00.272086  2238 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:00.138377  6895 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:00.275316  1586 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:00.278426  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 344831us
W20260709 13:02:00.281164  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 205597us
W20260709 13:02:00.284178  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 327089us
I20260709 13:02:00.287761  1512 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:00.286804  1585 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:00.266654  6834 raft_consensus.cc:697] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:00.297008  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:00.273201  6872 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:00.300437  6976 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:00.304698  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:00.305402  1690 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:02:00.308077  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:00.312050  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:00.312732  1542 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
W20260709 13:02:00.316794  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.317709  6976 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:00.318245  6976 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:00.320528  6976 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:00.321219  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:00.322772  1616 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:00.324087  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:00.298911  2211 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:00.298228  6986 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:02:00.342478  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 55739.4us
I20260709 13:02:00.302098  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:00.342482  6926 consensus_meta.cc:287] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.956s	user 0.009s	sys 0.009s
I20260709 13:02:00.350476  6926 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:00.357892  1618 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:00.363121  6926 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:00.377004  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 74992.8us
I20260709 13:02:00.378401  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:00.376987  6960 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:00.379990  6988 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:00.378123  6775 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:00.379446  6976 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:00.384207  6536 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:00.386024  6832 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:00.333159  6872 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:00.387311  6981 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:00.286895  6692 consensus_queue.cc:260] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:00.392652  6960 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.423822  6863 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:00.427420  6778 consensus_meta.cc:287] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.810s	user 0.010s	sys 0.002s
I20260709 13:02:00.428325  6312 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:00.409049  6660 consensus_meta.cc:287] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.000s
I20260709 13:02:00.570030  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:00.570726  1621 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:00.453336  6832 raft_consensus.cc:697] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:00.457934  6960 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:00.588380  6961 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:00.598443  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1858) took 1030 ms. Trace:
W20260709 13:02:00.600114  6945 consensus_meta.cc:287] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 1.153s	user 0.010s	sys 0.006s
I20260709 13:02:00.602159  6895 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:00.629367  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:00.606330  6871 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
W20260709 13:02:00.672029  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 49344.3us
W20260709 13:02:00.669612  6877 consensus_meta.cc:287] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.915s	user 0.010s	sys 0.000s
W20260709 13:02:00.671980  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 339743us
I20260709 13:02:00.673980  1543 rpcz_store.cc:276] 0709 13:01:59.568006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.568218 (+   212us) service_pool.cc:224] Handling call
0709 13:01:59.588386 (+ 20168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.977280 (+388894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.598188 (+620908us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b5400068bd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:00.598367 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":869887872}
I20260709 13:02:00.403862  6834 consensus_queue.cc:237] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:00.579720  6919 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:00.693233  2210 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:00.664572  6916 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:00.563028  6926 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:00.696357  1587 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:00.672254  6312 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:00.671804  6870 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:02:00.692224  6839 consensus_meta.cc:287] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.800s	user 0.012s	sys 0.000s
I20260709 13:02:00.693532  6945 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:00.733542  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.735602  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:00.739493  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:00.741925  1693 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:00.738940  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:00.748517  1587 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:02:00.750123  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 371708us
I20260709 13:02:00.727738  6971 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:00.769074  1690 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:00.739158  6995 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:00.703203  6916 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:00.706279  6926 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:00.728719  6312 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:00.749634  6735 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:00.701122  6919 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:00.772544  6971 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.774041  6945 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:00.730901  6870 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:00.775231  6995 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:00.786787  6872 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:00.784102  6735 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:00.779167  7010 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:00.787073  6995 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:00.796977  6926 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:00.800711  6919 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:00.784332  6971 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:00.785059  6945 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.802456  7010 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:00.799126  6990 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.105s	user 0.000s	sys 0.002s
I20260709 13:02:00.811996  7010 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:00.810649  6945 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:00.814769  6960 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:00.817682  6960 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:00.817874  6995 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:00.820106  6995 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:00.820365  6971 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:00.822547  6971 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:00.872550  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:00.874063  1689 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:02:00.872056  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:00.875780  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:00.875851  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:00.877718  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:00.872056  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:00.877893  1693 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:00.886538  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:00.887691  1689 raft_consensus.cc:2393] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:00.885097  1692 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:02:00.892726  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.006s	sys 0.005s
W20260709 13:02:00.893268  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.006s	sys 0.005s
I20260709 13:02:00.902212  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:00.906322  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 3092) took 1356 ms. Trace:
I20260709 13:02:00.903690  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:00.906764  1622 rpcz_store.cc:276] 0709 13:01:59.549531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.555584 (+  6053us) service_pool.cc:224] Handling call
0709 13:02:00.905848 (+1350264us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54000e6354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:00.906123 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":738661632}
I20260709 13:02:00.902783  7016 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:00.908195  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:00.907311  1616 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:02:00.908681  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:00.908301  7016 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:00.904680  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 2640) took 1254 ms. Trace:
I20260709 13:02:00.909660  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 3090) took 1360 ms. Trace:
I20260709 13:02:00.911312  1614 rpcz_store.cc:276] 0709 13:01:59.548911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.558544 (+  9633us) service_pool.cc:224] Handling call
0709 13:02:00.909288 (+1350744us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54003809d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:00.909485 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":580777856}
I20260709 13:02:00.917224  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 3013) took 1445 ms. Trace:
I20260709 13:02:00.917747  1544 rpcz_store.cc:276] 0709 13:01:59.471655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.472142 (+   487us) service_pool.cc:224] Handling call
0709 13:02:00.916624 (+1444482us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b54000b6654. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:00.916921 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568352000}
I20260709 13:02:00.919997  6659 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:00.920709  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:00.920959  6659 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:00.921797  6312 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:00.922123  1695 raft_consensus.cc:2393] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 11: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:00.922574  6312 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:00.924161  6468 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.924809  7016 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:00.924973  6468 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:00.933482  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.934839  6681 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:00.909605  1613 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:00.935802  6681 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:00.938409  6681 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:00.941851  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:00.942440  2210 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:00.945581  2238 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:00.948434  1546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 3016) took 1469 ms (client timeout 1660 ms). Trace:
W20260709 13:02:00.948978  1546 rpcz_store.cc:269] 0709 13:01:59.478687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.479409 (+   722us) service_pool.cc:224] Handling call
0709 13:02:00.948026 (+1468617us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b5400347e54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:00.948255 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917469440}
I20260709 13:02:00.949575  6695 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.950405  6695 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:00.953807  6660 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.954972  6660 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:00.957998  6660 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:00.953840  6695 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:00.961944  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:00.924243  6659 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:00.969444  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:00.970397  1544 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:00.797500  6735 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:00.972012  6864 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.751356  6832 consensus_queue.cc:237] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:00.973656  6870 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:00.910678  1620 rpcz_store.cc:276] 0709 13:01:59.650299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.650433 (+   134us) service_pool.cc:224] Handling call
0709 13:01:59.650771 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.781439 (+130668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.781466 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.785699 (+  4233us) log.cc:844] Serialized 26 byte log entry
0709 13:01:59.906783 (+121084us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:59.906832 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.903871 (+997039us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54003200d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:00.903931 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.904052 (+   121us) raft_consensus.cc:1685] finished
0709 13:02:00.904066 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.904457 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":4971,"spinlock_wait_cycles":299638528,"thread_start_us":74873,"threads_started":1,"wal-append.queue_time_us":249629}
I20260709 13:02:00.990031  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:00.992272  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:00.994726  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:00.821852  6945 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:00.998150  6945 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:01.007252  1688 raft_consensus.cc:1240] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:02:01.008991  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:01.010005  1690 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:01.011198  6967 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:01.011718  6967 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:01.012132  6967 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:01.014145  6468 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:01.016047  1542 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:01.016913  7006 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:01.018046  1687 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:01.017745  7006 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:00.979334  1586 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:01.019948  6988 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:01.016954  6864 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:00.970929  6312 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:01.023147  6985 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:01.037518  1613 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:02:01.045432  1531 tablet_service.cc:1558] Processing DeleteTablet for tablet 479456ab418d44c4983d2bb37eb0e700 with delete_type TABLET_DATA_TOMBSTONED (TS d7158d6c3b634dc7abb69eac58eba291 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:39608
I20260709 13:02:01.046279  6995 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.047653  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:01.049180  6839 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:01.049453  7006 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:01.054056  6985 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:01.055409  6982 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.056504  6982 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:01.057982  1443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58806 (request call id 180) took 8389 ms. Trace:
I20260709 13:02:01.059765  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.060431  1692 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:01.050102  6839 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:01.062191  1587 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:01.068631  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:01.071087  7001 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:01.071633  7001 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.071977  1621 raft_consensus.cc:1240] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:02:01.072722  6312 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:01.074136  6864 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:01.047071  6995 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:01.080313  6995 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:01.066751  6982 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:01.087845  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.094839  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.096302  6871 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:01.099401  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.058393  1443 rpcz_store.cc:276] 0709 13:01:52.668761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.669104 (+   343us) service_pool.cc:224] Handling call
0709 13:02:01.057775 (+8388671us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:55.048286 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:55.048960 (+   674us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:55.049001 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:01:55.049024 (+    23us) tablet.cc:662] Decoding operations
0709 13:01:55.050305 (+  1281us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:55.050381 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:55.050412 (+    31us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:01:55.052830 (+  2418us) tablet.cc:701] Row locks acquired
0709 13:01:55.052848 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:01:55.053013 (+   165us) write_op.cc:270] Start()
0709 13:01:55.053132 (+   119us) write_op.cc:276] Timestamp: P: 1783602115052961 usec, L: 0
0709 13:01:55.053152 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:01:55.088426 (+ 35274us) log.cc:844] Serialized 5604 byte log entry
0709 13:01:56.422227 (+1333801us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b540016e328. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497ae79e1 00007fc497ae664c 00007fc4951623bb 00007fc49516471a 00007fc4951646a8 00007fc495164628 00007fc4951645e3 00007fc4951637fc 00007fc497596626 00007fc497590dd8 00007fc491737310
0709 13:01:56.422387 (+   160us) op_driver.cc:464] REPLICATION: finished
0709 13:01:56.623895 (+201508us) write_op.cc:301] APPLY: starting
0709 13:01:56.629032 (+  5137us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:56.870528 (+241496us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:56.871827 (+  1299us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:57.661878 (+790051us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:57.743660 (+ 81782us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:01:57.743729 (+    69us) write_op.cc:312] APPLY: finished
0709 13:01:57.744088 (+   359us) log.cc:844] Serialized 129 byte log entry
0709 13:01:57.977088 (+233000us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:58.058582 (+ 81494us) write_op.cc:454] Released schema lock
0709 13:01:58.068180 (+  9598us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:58.100860 (+ 32680us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:58.100893 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":131399,"reported_tablets":24,"spinlock_wait_cycles":1996672,"child_traces":[["op",{"apply.queue_time_us":182257,"apply.run_cpu_time_us":69379,"apply.run_wall_time_us":1475328,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62759,"num_ops":14,"prepare.queue_time_us":228969,"prepare.run_cpu_time_us":93188,"prepare.run_wall_time_us":370384,"raft.queue_time_us":146764,"raft.run_cpu_time_us":16416,"raft.run_wall_time_us":877008,"replication_time_us":659410,"spinlock_wait_cycles":3917184,"thread_start_us":930080,"threads_started":5,"wal-append.queue_time_us":738198,"wal-append.run_cpu_time_us":48616,"wal-append.run_wall_time_us":2198545}]]}
I20260709 13:02:01.106828  6916 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:01.108824  2210 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:01.113466  6735 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:01.114168  6735 raft_consensus.cc:697] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:01.119360  1693 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:02:01.121389  1689 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:01.122625  1621 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:01.125172  6870 consensus_queue.cc:1059] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:01.125836  6748 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.126698  6870 raft_consensus.cc:3055] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:01.117843  1687 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:01.127372  6870 raft_consensus.cc:740] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:01.128257  2243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:55918
I20260709 13:02:01.129161  2243 raft_consensus.cc:606] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:01.129598  2243 raft_consensus.cc:614] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:01.128770  6870 consensus_queue.cc:260] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:01.130622  6870 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:01.133251  6894 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.133737  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:01.133973  6894 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:01.134469  2243 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:02:01.136307  1690 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:01.071977  7001 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:01.143690  1587 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:01.108870  6883 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:01.148682  1690 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:01.150635  2209 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:01.126689  6748 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:01.149736  6536 consensus_meta.cc:287] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.737s	user 0.005s	sys 0.013s
I20260709 13:02:01.163275  7013 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:01.155068  7009 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.380s	user 0.000s	sys 0.002s
I20260709 13:02:01.165349  1587 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:01.163528  6778 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:01.154120  6839 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:01.185288  6839 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:01.186090  6839 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:01.187800  6862 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:01.188832  6778 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.188612  6862 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:01.189342  6778 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:01.168447  1540 raft_consensus.cc:2410] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
W20260709 13:02:01.191226  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 3004) took 2039 ms (client timeout 2711 ms). Trace:
W20260709 13:02:01.191411  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 53107us
W20260709 13:02:01.191702  1540 rpcz_store.cc:269] 0709 13:01:59.151824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.259222 (+107398us) service_pool.cc:224] Handling call
0709 13:02:01.190990 (+1931768us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54003d90d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:01.191163 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4350052096}
I20260709 13:02:01.152979  6735 consensus_queue.cc:237] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:01.169328  6894 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:01.196233  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:01.197150  1620 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:01.197840  7013 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:01.200188  7013 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:01.150445  6866 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:01.202677  6866 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:01.205629  6866 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:01.206215  6866 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:01.208195  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:01.208788  6933 raft_consensus.cc:3055] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:01.209309  6933 raft_consensus.cc:740] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:01.168323  6898 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.176925  2238 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:02:01.177511  7016 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.192876  6900 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.193229  6893 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:01.172909  6985 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:01.220679  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.224371  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:01.227784  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 62548.3us
I20260709 13:02:01.257929  6893 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:01.258433  6893 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:01.260015  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:01.226449  2210 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:01.188833  6839 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:01.206874  6866 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:01.290311  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.290844  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:01.291517  7016 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:01.292234  6956 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 1.510s	user 0.003s	sys 0.008s
I20260709 13:02:01.294349  7016 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:01.296030  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.279125  6536 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:01.296957  1691 raft_consensus.cc:2393] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 14: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:01.297920  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:01.298745  1542 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:02:01.299433  6898 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:01.302520  6898 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:01.302780  1693 raft_consensus.cc:2393] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 16: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:01.304888  6769 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:01.305619  6769 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:01.305975  6536 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:01.311372  6900 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:01.312414  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:01.313091  1618 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:01.318154  7021 tablet_replica.cc:333] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:02:01.290731  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:01.319692  1544 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:01.319938  6862 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:01.321681  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:01.322351  1540 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:01.324155  6692 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:01.324719  6536 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:01.327580  6961 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:02:01.327602  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.332489  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:01.210727  6933 consensus_queue.cc:260] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:01.330745  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:01.279656  7013 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:01.340680  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:01.338302  1539 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:01.342319  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:01.343968  1545 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:01.315173  6948 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 1.824s	user 0.008s	sys 0.006s
I20260709 13:02:01.330824  6866 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:01.347990  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.344995  1615 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:01.340454  6898 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.344107  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:01.376482  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 181051us
I20260709 13:02:01.378983  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.382310  1693 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:02:01.382261  1542 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:01.385819  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:01.400068  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:01.405053  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.405112  1542 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:02:01.406109  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.407068  1691 raft_consensus.cc:2393] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 10: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:01.408250  2211 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:01.400593  1547 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:01.412904  6879 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:01.415030  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.415663  1615 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:01.416800  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:01.407691  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:01.409020  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.381075  6898 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:01.420176  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:01.398123  6873 consensus_meta.cc:287] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 1.082s	user 0.012s	sys 0.009s
W20260709 13:02:01.426879  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 190148us
I20260709 13:02:01.423758  1688 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:01.383802  6985 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:02:01.435689  1542 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:01.425714  1695 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:02:01.411711  6947 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:01.441723  1615 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:01.442351  6893 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:01.443069  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:01.443890  6671 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:01.444309  6671 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.444630  6893 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:01.438238  6873 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:01.450752  6769 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:01.453016  6769 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:01.457157  6873 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:01.461952  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:01.462780  1619 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:02:01.464216  6834 consensus_queue.cc:1059] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:02:01.469064  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:01.470930  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 48487.8us
I20260709 13:02:01.428299  6933 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:01.476704  6879 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:01.477031  6832 raft_consensus.cc:3055] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:01.477595  6832 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:01.477411  6879 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:01.478653  6832 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:01.480266  6832 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:01.480690  6879 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:01.481278  6879 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:01.481999  6919 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.481833  6879 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:01.482635  6919 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:01.484308  6879 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:01.484789  6919 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:01.485736  6900 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:01.490185  7001 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:01.444684  6671 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:01.495137  1512 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:01.496814  6900 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:01.497749  6900 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.498167  6900 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:01.502655  7013 raft_consensus.cc:697] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:01.503731  6748 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:01.503943  7013 consensus_queue.cc:237] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:01.475888  1544 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:01.508497  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.500754  1660 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:01.513221  1545 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:01.514405  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.467125  6947 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.517253  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.518002  1690 raft_consensus.cc:1813] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Handling vote request from an unknown peer d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:01.518704  1690 raft_consensus.cc:2410] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:02:01.523281  6778 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:01.525616  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 145820us
I20260709 13:02:01.525952  6778 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:01.528124  6926 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.528339  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:01.529229  1614 raft_consensus.cc:2393] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 16: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:01.528834  6926 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:01.535542  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:01.536917  1546 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
W20260709 13:02:01.544821  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 44276.9us
I20260709 13:02:01.475837  6870 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:01.517622  6947 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:01.560130  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:01.560905  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:01.565203  1619 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:02:01.565829  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.567520  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.560241  2211 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:01.555634  1587 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:01.562441  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2672) took 1207 ms. Trace:
I20260709 13:02:01.563544  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:01.578490  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:01.578739  1690 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:01.476068  6916 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:02:01.560580  6834 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:01.556183  6862 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.582013  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:01.560389  6926 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:01.502708  6985 consensus_queue.cc:1059] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
W20260709 13:02:01.598897  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 46355.7us
I20260709 13:02:01.611068  2239 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:01.612679  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.612084  1539 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:01.614640  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.614190  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:01.622295  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.623687  1614 raft_consensus.cc:2393] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 14: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:01.624467  6958 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:01.625769  2209 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:01.628175  6985 raft_consensus.cc:3055] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:01.628645  6985 raft_consensus.cc:740] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:01.629736  6985 consensus_queue.cc:260] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:01.624653  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:01.631603  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:01.632083  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:01.632851  1615 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:02:01.633882  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:01.637493  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:01.638084  6834 raft_consensus.cc:697] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:01.638548  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:01.639035  6834 consensus_queue.cc:237] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:01.639742  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:01.640892  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:01.641335  1615 raft_consensus.cc:1813] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Handling vote request from an unknown peer d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:01.641779  1615 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 16: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:01.642935  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:01.644466  1614 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:02:01.644822  1614 pending_rounds.cc:85] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 6
I20260709 13:02:01.645233  1614 pending_rounds.cc:107] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:02:01.644685  6671 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:01.645496  1614 raft_consensus.cc:2889] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:01.572597  1696 rpcz_store.cc:276] 0709 13:02:00.307197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.309271 (+  2074us) service_pool.cc:224] Handling call
0709 13:02:00.309548 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.309944 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.309971 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.310392 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.357352 (+ 46960us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:00.357393 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.357461 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:01.462998 (+1105537us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b24001f7ca8. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e4c49c4 00007fc48e4c2acb 00007fc48e67ddc9 00007fc48e67da55 00007fc48e67cfb0 00007fc4912f3488 00007fc4912f3be8 00007fc4912cb398 00007fc4912c676a 00007fc4912c5bb6
0709 13:02:01.466159 (+  3161us) raft_consensus.cc:1685] finished
0709 13:02:01.466181 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.514630 (+ 48449us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":951,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":53562624,"thread_start_us":46691,"threads_started":1,"wal-append.queue_time_us":143895}
I20260709 13:02:01.634979  6991 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:01.635690  6919 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.636122  6692 consensus_queue.cc:1059] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:01.634721  6960 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:01.646776  6985 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:01.654188  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:01.655143  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:01.670652  1687 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 18: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:01.667979  1542 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:01.616977  6883 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:01.598991  6870 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:01.672694  1618 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:01.673861  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:01.669166  1615 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:01.670902  1619 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:02:01.676211  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:01.676590  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:01.677865  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:01.681952  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:01.683779  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:01.682644  1539 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:01.690999  1547 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:01.616286  6862 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:01.673512  6671 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:01.674458  6883 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.725674  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:01.745450  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:01.753804  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:01.694911  6692 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:01.731060  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:01.736547  6883 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:01.804510  2238 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:01.805302  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.817044  1687 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:01.690811  6919 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:01.821676  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:01.826473  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 199057us
I20260709 13:02:01.834851  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:01.801851  6692 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:01.842255  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:01.842854  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:01.845453  1692 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:02:01.845597  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 167826us
I20260709 13:02:01.812273  7001 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:01.842905  1613 raft_consensus.cc:606] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:01.849159  1585 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:01.979930  1539 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:02:01.844856  6706 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:01.991501  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 144370us
I20260709 13:02:01.992619  1586 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:01.995796  1586 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:01.923024  1617 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:01.821568  6671 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.843598  6916 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:01.842904  6692 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:01.914391  6894 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:02:01.928985  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:02.013331  2241 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:01.938951  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.844694  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:01.981746  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:01.929078  6954 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.007s	sys 0.018s
I20260709 13:02:01.929464  6892 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:01.987504  1613 raft_consensus.cc:614] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:01.987361  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 403304us
W20260709 13:02:01.947392  6972 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.010s	sys 0.029s
I20260709 13:02:01.914168  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:02.014513  1541 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:02.014918  1696 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:02.005771  6967 consensus_meta.cc:287] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.984s	user 0.006s	sys 0.013s
I20260709 13:02:02.006487  6866 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:02.006300  6945 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:02.034478  6763 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:02.017640  6706 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.035712  6862 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:02.027125  7001 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:02.037407  6706 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:02.037758  7001 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:02.038405  7001 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:02.047998  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:02.049317  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:02.050446  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:02.052327  7031 log.cc:927] Time spent T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:02:02.054831  6706 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:02.020224  6954 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.243s	user 0.012s	sys 0.023s
I20260709 13:02:02.050997  1541 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:02:02.055816  6706 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.026959  6671 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:02.065224  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 44087.6us
W20260709 13:02:02.022374  6972 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.010s	sys 0.030s
I20260709 13:02:02.058876  1692 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:02.021337  6926 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.075058  6706 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:02.010411  6873 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
W20260709 13:02:02.077296  2211 leader_election.cc:336] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Timed out: RequestConsensusVote RPC to 127.0.107.195:34459 timed out after 1.636s (SENT)
I20260709 13:02:02.093448  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:02.096273  1541 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:02.099553  6832 consensus_meta.cc:287] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.619s	user 0.005s	sys 0.013s
I20260709 13:02:02.100751  1547 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:02:02.105939  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:02.107529  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:02.057053  6967 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.094623  6926 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.120183  7021 raft_consensus.cc:2243] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.121475  7021 raft_consensus.cc:2272] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.121996  6926 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:02.122984  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 282968us
I20260709 13:02:02.124720  1585 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:02.125993  6879 raft_consensus.cc:3055] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:02.126483  6879 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:02.120272  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 778) took 1150 ms. Trace:
I20260709 13:02:02.131887  1546 rpcz_store.cc:276] 0709 13:02:00.969406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.978410 (+  9004us) service_pool.cc:224] Handling call
0709 13:02:02.120035 (+1141625us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b54002f99d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:02.120208 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1255445248}
I20260709 13:02:02.133314  1546 raft_consensus.cc:1240] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:02.131497  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 62862.4us
I20260709 13:02:02.139185  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:02.067642  6916 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.126157  1585 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:02.134398  7001 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.072361  6892 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.149729  6671 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:02.150735  6870 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:02.151566  6916 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:02.152500  7001 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:02.153126  2237 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:02.154345  6967 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:02.154584  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:02.153146  2241 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:02:02.155553  6879 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.160652  1585 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:02.162155  1541 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:02.163560  6692 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.166339  2209 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:02:02.169984  6973 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 2.060s	user 0.000s	sys 0.012s
I20260709 13:02:02.176368  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:02.176975  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:02.177474  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:02.190305  1688 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:02:02.174203  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 167339us
I20260709 13:02:02.174147  6926 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:02.141180  6873 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:02.193864  1511 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:02.186244  2238 raft_consensus.cc:1240] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: [12.10-14.11]
I20260709 13:02:02.196579  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:02:02.214040  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 3101) took 1896 ms (client timeout 1631 ms). Trace:
I20260709 13:02:02.217005  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:02.204855  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:02.222887  1617 rpcz_store.cc:269] 0709 13:02:00.317606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.320987 (+  3381us) service_pool.cc:224] Handling call
0709 13:02:02.213799 (+1892812us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400086454. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:02.213938 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2805854976}
I20260709 13:02:02.210706  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 2646) took 1015 ms. Trace:
I20260709 13:02:02.229765  1620 rpcz_store.cc:276] 0709 13:02:01.212442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.228572 (+ 16130us) service_pool.cc:224] Handling call
0709 13:02:01.328114 (+ 99542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.332222 (+  4108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.332250 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.335820 (+  3570us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:01.335860 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.210449 (+874589us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b54003fff54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:02.210497 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.210644 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9027456}
I20260709 13:02:02.230634  1512 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:02.232398  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:02.234347  1695 raft_consensus.cc:2410] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:02:02.234568  1587 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:02.195655  7001 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:02.198063  6958 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:02.198396  6873 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:02.243383  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:02.219655  6879 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:02.195935  6926 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:02.246655  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:02.247886  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 58603us
I20260709 13:02:02.216754  6692 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:02.251497  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:02.251405  6763 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:02.208571  1441 catalog_manager.cc:5697] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 10 to 3, term changed from 14 to 12, leader changed from <none> to e8a64798e5f94de8909707bcbd11804a (127.0.107.196), VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) added. New cstate: current_term: 12 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:02:02.250519  6900 consensus_meta.cc:287] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.752s	user 0.013s	sys 0.000s
I20260709 13:02:02.259052  1696 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:02.253153  6873 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:02.268031  6883 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.234980  7013 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.301223  1587 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:02.259012  6947 consensus_meta.cc:287] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.679s	user 0.005s	sys 0.003s
I20260709 13:02:02.285627  1687 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
W20260709 13:02:02.259464  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 65732.7us
W20260709 13:02:02.291711  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 103153us
I20260709 13:02:02.294240  1688 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
W20260709 13:02:02.284830  1512 raft_consensus.cc:2686] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:02:02.302862  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:02.303325  1441 catalog_manager.cc:5697] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:02.309508  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 78950.6us
I20260709 13:02:02.310575  1512 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:02.286096  6926 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:02.312177  1511 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:02.328749  1512 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:02.278944  6958 raft_consensus.cc:697] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:02.295696  6916 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.295189  6870 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.335754  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:02.345368  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:02.348562  1695 raft_consensus.cc:2368] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 15. Current term is 16.
I20260709 13:02:02.350107  1441 catalog_manager.cc:5697] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 13 to 14, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:02.342063  6692 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:02.305446  6900 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.345392  6778 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:02.351053  6671 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:02.376668  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 64567us
I20260709 13:02:02.377547  1511 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:02.380213  2211 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:02.328392  6763 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:02:02.334658  7013 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.327741  6947 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.352739  6870 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.402458  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:02.404065  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.411676  1512 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:02.412741  1511 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:02.415153  2211 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:02.415560  2244 raft_consensus.cc:2393] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 14: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:02.416844  1617 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:02.393721  7012 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:02.392840  6925 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:02.370129  6916 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:02.421646  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 92256.6us
I20260709 13:02:02.382503  6961 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:02:02.420993  7047 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:02.400883  6993 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:02.425905  1587 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:02.430236  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:02.431012  1620 raft_consensus.cc:2368] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 15. Current term is 16.
W20260709 13:02:02.431046  6875 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.000s	sys 0.010s
W20260709 13:02:02.431509  6875 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.001s	sys 0.010s
I20260709 13:02:02.431835  1622 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:02:02.432257  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:02.433013  1538 raft_consensus.cc:2368] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:02:02.433513  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1873) took 1105 ms. Trace:
I20260709 13:02:02.433844  1538 rpcz_store.cc:276] 0709 13:02:01.328351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.342220 (+ 13869us) service_pool.cc:224] Handling call
0709 13:02:02.432031 (+1089811us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b5800002d98. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606eee 0000000000375939 00007fc49667a1e0 00007fc4967430c4 00007fc496743131 00007fc4966f10a0 00007fc4966f0984 00007fc48fc6b6d4 00007fc48fc6b662
0709 13:02:02.433459 (+  1428us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6723456}
I20260709 13:02:02.435688  6778 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:02.436235  6778 raft_consensus.cc:697] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:02.437176  6778 consensus_queue.cc:237] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:02.439471  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 110063us
I20260709 13:02:02.440908  1585 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:02.415516  7001 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:02.432257  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 2.76965e+06us
I20260709 13:02:02.418395  6832 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:02.422269  6834 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:02.447104  1441 catalog_manager.cc:5697] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 12 to 13, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
W20260709 13:02:02.452445  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 50070.1us
I20260709 13:02:02.424644  6925 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:02.422166  6892 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:02.439096  6919 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:02.459986  1690 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
W20260709 13:02:02.459684  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 56279.3us
I20260709 13:02:02.441169  6993 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.467453  1622 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:02.444756  7023 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:02.469483  1585 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:02.468264  6993 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:02.484349  6993 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.486765  6883 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:02.488616  6898 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:02.458120  6900 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:02.491537  1441 catalog_manager.cc:5697] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 13 to 14, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:02.493913  1441 catalog_manager.cc:5697] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 10 to 13, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:02.498086  6916 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:02.458343  6925 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:02.450984  7001 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:02.521209  7025 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 1.035s	user 0.005s	sys 0.005s
I20260709 13:02:02.520504  1441 catalog_manager.cc:5697] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 8 to 13, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:02.522554  6985 consensus_meta.cc:287] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.846s	user 0.010s	sys 0.000s
I20260709 13:02:02.524511  7021 ts_tablet_manager.cc:1916] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:02.525017  6883 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:02.429103  6958 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.539175  7060 consensus_queue.cc:1059] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:02.502542  6862 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:02.470378  7011 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 13:02:02.541966  7011 raft_consensus.cc:3055] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:02.502959  6866 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:02.542330  7011 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:02.458545  6832 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.543326  7011 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.544420  6832 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:02.545487  6947 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:02.537510  7013 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:02.538551  6870 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:02.533901  7064 log.cc:927] Time spent T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:02:02.549455  1441 catalog_manager.cc:5697] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 11 to 12, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:02.551514  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 85360.5us
I20260709 13:02:02.552419  1585 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:02.553172  1441 catalog_manager.cc:5697] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 12 to 13, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:02.554545  1585 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:02.555424  6892 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:02.555255  1441 catalog_manager.cc:5697] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:02.555938  6892 raft_consensus.cc:697] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:02.556384  6769 consensus_queue.cc:1059] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:02.557426  6769 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:02.557256  6892 consensus_queue.cc:237] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.558244  6769 raft_consensus.cc:3055] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:02.558591  6769 raft_consensus.cc:740] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:02.544533  7011 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:02.559461  6883 raft_consensus.cc:697] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:02.560429  6883 consensus_queue.cc:237] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.564028  1441 catalog_manager.cc:5697] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:02.564687  7001 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:02.565503  6832 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:02.566123  6832 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.567749  1659 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:02.568632  6832 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:02.570339  6964 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:02.573714  7013 raft_consensus.cc:3055] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:02.574185  7013 raft_consensus.cc:740] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:02.575106  7013 consensus_queue.cc:260] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.576419  7013 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.573777  2210 leader_election.cc:400] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 15. Current term is 16.
I20260709 13:02:02.577803  2210 leader_election.cc:403] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:02:02.578259  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 67362.4us
I20260709 13:02:02.579337  6870 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:02.580781  2237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45886 (request call id 1125) took 1543 ms. Trace:
I20260709 13:02:02.581200  6993 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:02.581161  2237 rpcz_store.cc:276] 0709 13:02:01.037478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.040229 (+  2751us) service_pool.cc:224] Handling call
0709 13:02:02.580573 (+1540344us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400910ad4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:02.580700 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2489110784}
I20260709 13:02:02.583662  6671 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:02.584154  6671 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:02.585103  7012 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:02:02.587350  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.589282  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:02.589850  1620 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:02.591805  1585 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:02.572705  1441 catalog_manager.cc:5697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:02.595916  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 170095us
I20260709 13:02:02.598398  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:02.601297  1585 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:02.603482  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.603830  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.601891  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:02.586966  7012 consensus_queue.cc:1059] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:02:02.610634  1585 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:02.613188  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:02.611553  1622 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:02:02.604377  6945 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:02.604312  7060 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:02.621297  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 53696.4us
I20260709 13:02:02.625588  1585 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:02.628437  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:02.629107  1618 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 16: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:02.629542  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:02.631922  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:02.632592  1613 raft_consensus.cc:2368] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13.
I20260709 13:02:02.634250  1696 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:02.587414  6769 consensus_queue.cc:260] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.634114  2210 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:02.637885  1441 catalog_manager.cc:5697] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 10 to 11, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:02.640050  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:02.640515  1695 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:02.641804  1620 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:02:02.620860  6945 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:02.608920  6926 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.643607  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:02.644757  6769 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.645576  6945 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:02.659453  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:02.660104  1696 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.659854  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:02.661579  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:02.662441  1692 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
W20260709 13:02:02.663550  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 210393us
I20260709 13:02:02.649026  6671 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.624922  6862 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:02.643208  2210 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:02.616770  6873 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:02.670912  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.638865  6866 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:02.678574  2211 leader_election.cc:400] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 15. Current term is 16.
I20260709 13:02:02.680038  1659 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:02.649499  6925 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.682126  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:02.643983  7012 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:02.686669  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:02.687516  2238 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
W20260709 13:02:02.683764  1660 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 1.631s (SENT) [suppressed 16 similar messages]
I20260709 13:02:02.684782  1616 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:02.691829  1620 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:02.671387  7023 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:02.706663  1660 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:02.709969  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:02.711062  1614 raft_consensus.cc:2393] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 12: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:02.714532  1616 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:02.688635  7012 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.724840  1660 leader_election.cc:400] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13.
I20260709 13:02:02.725559  1660 leader_election.cc:403] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:02.705307  6832 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:02.728037  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2694) took 1170 ms. Trace:
W20260709 13:02:02.728277  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 92447.9us
I20260709 13:02:02.730203  1587 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:02.724678  6883 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:02:02.742523  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 52905.9us
I20260709 13:02:02.704185  7024 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:02:02.718652  6871 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:02.752915  1696 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:02.760040  1619 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:02.749446  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:02.743155  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:02.761831  1614 raft_consensus.cc:2393] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 18: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:02.726508  7012 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:02.763487  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:02.739543  1691 rpcz_store.cc:276] 0709 13:02:01.557943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.568440 (+ 10497us) service_pool.cc:224] Handling call
0709 13:02:01.586750 (+ 18310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.656080 (+ 69330us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:01.690755 (+ 34675us) log.cc:844] Serialized 14 byte log entry
0709 13:02:02.633216 (+942461us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b180008f1a0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb23a 00007fc491735a2a
0709 13:02:02.727606 (+ 94390us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.727660 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:02.727718 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.727860 (+   142us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.727977 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23462,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":9103,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":23592704,"thread_start_us":90437,"threads_started":1}
I20260709 13:02:02.763352  7065 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:02:02.768728  7001 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.769273  7001 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.761004  6866 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:02.772722  6866 raft_consensus.cc:697] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:02.773805  6866 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.780567  6778 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:02.781276  6778 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.788532  1659 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:02.793269  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 43928.1us
I20260709 13:02:02.795209  7063 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:02.795379  6671 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:02.795972  7063 consensus_queue.cc:1059] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:02.797577  6832 raft_consensus.cc:3055] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:02.797964  6832 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:02:02.800444  7062 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.316s	user 0.003s	sys 0.000s
I20260709 13:02:02.764703  1587 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:02.808167  1587 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:02.820642  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:02.749168  6883 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.831833  2241 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:02.798907  6832 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.810107  6993 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:02.839453  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:02.845753  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:02.811002  6871 raft_consensus.cc:697] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:02.849969  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:02.806018  7023 raft_consensus.cc:697] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:02.851612  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:02.852450  1692 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:02:02.861635  6748 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:02.862102  6748 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.862459  6748 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.865428  6778 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:02.866343  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 454676us
W20260709 13:02:02.866739  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 454013us
I20260709 13:02:02.867355  6763 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:02.824070  7060 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:02.867376  1511 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:02.824242  7066 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:02.868830  1512 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:02.869278  6706 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:02.878348  6706 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.878769  6706 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:02.882380  6945 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:02.883790  7023 consensus_queue.cc:237] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.884881  7011 raft_consensus.cc:3055] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:02.885304  7011 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:02.886150  7011 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.846083  6993 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:02.887619  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 99219.8us
I20260709 13:02:02.845893  7001 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:02.887722  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.895814  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:02.896471  1618 raft_consensus.cc:2376] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16. Re-sending same reply.
I20260709 13:02:02.873291  6870 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 15. Current term is 16.
I20260709 13:02:02.906664  6671 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.888715  7060 raft_consensus.cc:697] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:02.891861  6993 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:02.919214  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 51944.9us
W20260709 13:02:02.919552  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 45181.1us
I20260709 13:02:02.920244  1511 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:02.920783  1618 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:02.923892  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 84129.7us
I20260709 13:02:02.924576  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:02.925333  1690 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.910133  6671 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:02.926112  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 67910.5us
I20260709 13:02:02.897356  6873 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:02.907086  1659 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:02.906317  6879 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:02.906152  7011 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:02.908651  6832 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:02.926421  6916 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:02.942989  1622 raft_consensus.cc:2410] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:02:02.943322  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:02.952752  7086 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:02.953365  7086 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.953542  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:02.955765  2244 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45866 (request call id 1080) took 1284 ms (client timeout 1523 ms). Trace:
W20260709 13:02:02.956182  2244 rpcz_store.cc:269] 0709 13:02:01.671503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.693387 (+ 21884us) service_pool.cc:224] Handling call
0709 13:02:02.955541 (+1262154us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b5400701f54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:02.955696 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1394242944}
W20260709 13:02:02.953006  7057 log.cc:927] Time spent T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.453s	user 0.006s	sys 0.000s
I20260709 13:02:02.935957  6879 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.936012  6839 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:02.961658  1695 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:02:02.907648  7082 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:02:02.949391  6916 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:02.986922  1690 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:02:02.977726  7066 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:02.977787  6985 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13.
I20260709 13:02:02.991784  7048 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:02.991495  7066 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.971148  6879 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:02.992460  7048 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:02.993350  6671 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:02.993841  7066 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:02.994593  7048 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:02.999589  7086 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:02.967687  7038 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.979600  6875 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:02.990873  6916 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:03.036113  7012 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:03.038162  6763 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:03.038451  7012 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:03.060088  2237 raft_consensus.cc:2368] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13.
W20260709 13:02:03.104869  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.143831  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 242650us
I20260709 13:02:03.150434  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:03.039646  6945 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:02.950510  6871 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:02.990206  6839 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:03.161306  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:03.164638  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:03.165587  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:03.167202  1541 raft_consensus.cc:2410] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:02:03.170671  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.172510  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:03.173128  1547 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:03.172353  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:03.177006  1620 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:03.178692  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:03.181301  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:03.181453  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 261235us
I20260709 13:02:03.182031  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:03.182145  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:03.182632  1545 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:03.182912  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:03.187071  2244 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:03.026057  7038 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:03.191092  1659 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:03.200367  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:03.201138  1542 raft_consensus.cc:2393] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 19: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:03.145668  7047 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:03.206521  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:03.208395  1546 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.212868  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:03.213460  1545 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:03.216974  7075 log.cc:927] Time spent T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
I20260709 13:02:03.218714  1511 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:03.221988  6875 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:03.222386  6875 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.222559  7048 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:03.222733  6875 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:03.226104  1511 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:03.227263  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:03.059427  7060 consensus_queue.cc:237] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:03.193413  7082 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:03.229265  7082 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:03.229641  7082 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:03.229848  7049 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:03.235771  7084 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:03.235770  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:03.244812  1620 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:03.248014  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:03.248894  1544 raft_consensus.cc:2410] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:02:03.254994  1547 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:02:03.150481  6706 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:03.204684  6769 consensus_meta.cc:287] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.001s
W20260709 13:02:03.264434  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 92821.6us
I20260709 13:02:03.265794  1511 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:03.272708  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:03.273792  2238 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:03.278505  1543 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:02:03.290498  6763 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:03.291115  6706 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:03.291422  6763 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:03.291778  6706 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.292259  6706 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:03.262557  6933 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.294337  6933 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:03.303891  1546 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
W20260709 13:02:03.318894  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.325109  7094 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:03.345014  1659 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:03.259414  7084 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:02:03.350734  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:03.321430  7048 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:03.377000  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:03.302157  6991 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:03.366575  1545 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:03.367264  1695 raft_consensus.cc:3055] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:03.378230  1695 raft_consensus.cc:740] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:03.369521  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:03.369079  6706 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:03.375486  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:03.371786  6748 consensus_meta.cc:287] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.001s
I20260709 13:02:03.372624  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:03.370900  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:03.383023  1693 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:03.380084  2243 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:02:03.260790  7047 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:03.379676  1695 consensus_queue.cc:260] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:03.388551  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:03.303586  6919 consensus_queue.cc:1059] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:02:03.388404  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:03.396296  1695 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:03.398229  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:03.400532  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:03.400743  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:03.401733  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:03.402211  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:03.402872  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:03.389508  7074 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:03.397274  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:03.396420  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:03.411616  7092 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:03.411947  7038 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:03.412828  6839 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:03.394683  6748 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:03.439268  7074 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:03.440420  6925 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:03.360785  7049 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:03.441275  1620 raft_consensus.cc:2393] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:03.362452  6958 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:03.415643  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:03.417542  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:03.452549  1693 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:03.374890  6879 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:03.452796  1689 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:03.452987  1695 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:03.424135  6919 raft_consensus.cc:3055] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:03.492956  6919 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:03.493878  1544 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:02:03.494072  6919 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:03.495837  6958 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:03.496428  6919 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.496701  6879 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:03.481335  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:03.498164  6958 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:03.455912  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:03.499055  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:03.499788  1620 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:03.504688  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:03.500204  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:03.508936  1621 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
W20260709 13:02:03.517443  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 132979us
I20260709 13:02:03.520227  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:03.520874  1621 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:02:03.521914  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:03.434432  7021 ts_tablet_manager.cc:1929] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 13:02:03.525326  7021 log.cc:1199] T 479456ab418d44c4983d2bb37eb0e700 P d7158d6c3b634dc7abb69eac58eba291: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root/wals/479456ab418d44c4983d2bb37eb0e700
I20260709 13:02:03.526942  7021 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39608 (request call id 77) took 2482 ms. Trace:
I20260709 13:02:03.527385  7021 rpcz_store.cc:276] 0709 13:02:01.044709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.045017 (+   308us) service_pool.cc:224] Handling call
0709 13:02:01.317550 (+272533us) ts_tablet_manager.cc:1151] Deleting tablet 479456ab418d44c4983d2bb37eb0e700
0709 13:02:01.317666 (+   116us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:02:02.998889 (+1681223us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:03.434252 (+435363us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:03.526849 (+ 92597us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":799745,"tablet-delete.queue_time_us":270819,"thread_start_us":114934,"threads_started":1}
I20260709 13:02:03.529356  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:03.530057  1613 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:02:03.529691  6875 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:03.386293  6991 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:03.532009  7084 consensus_queue.cc:1059] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:03.532526  6991 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:03.532742  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:03.533139  7084 raft_consensus.cc:3055] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:03.533556  7084 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:03.533995  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:03.530987  1546 raft_consensus.cc:2393] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:03.524739  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:03.530993  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:03.542507  7082 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:03.544719  7082 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:03.544884  6879 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:03.545555  6879 raft_consensus.cc:697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:02:03.545758  7011 consensus_meta.cc:287] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.605s	user 0.011s	sys 0.000s
I20260709 13:02:03.546921  6879 consensus_queue.cc:237] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:03.547770  7074 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:03.548897  1511 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:03.556380  2211 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:03.425985  7047 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:03.547420  6926 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:03.562455  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:03.562633  1429 catalog_manager.cc:5028] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): tablet 479456ab418d44c4983d2bb37eb0e700 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:02:03.563686  6954 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:03.564185  6954 raft_consensus.cc:697] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:03.565058  6954 consensus_queue.cc:237] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:03.560439  7092 consensus_queue.cc:1059] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:02:03.568204  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:03.568692  6832 raft_consensus.cc:3055] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:03.569089  6748 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:03.569258  7070 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.803s	user 0.002s	sys 0.005s
I20260709 13:02:03.571097  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:03.551664  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 251383us
I20260709 13:02:03.573383  1659 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:03.430914  6916 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:03.574373  1539 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:03.575763  6964 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:03.576200  7100 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:03.569034  1615 raft_consensus.cc:2393] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 18: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:03.574914  1659 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:03.577569  1617 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:03.419025  6933 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:03.549433  1620 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:02:03.522431  2245 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:02:03.560915  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:03.582360  2243 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:03.513670  7096 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:02:03.590723  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.595723  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:03.597208  1511 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:03.598618  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:03.534431  7084 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:03.611454  1585 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:03.621476  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:03.622829  1539 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:03.630563  1585 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:03.631718  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:03.632735  1547 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 17: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:03.646605  1585 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:03.646976  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 48490.7us
I20260709 13:02:03.429072  6993 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:03.647883  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:03.648141  1585 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:03.569073  6832 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:03.649569  1540 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:03.575793  6991 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:02:03.649024  2210 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:03.661568  1542 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:03.661641  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:03.662390  1538 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.598022  6875 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:03.617643  7047 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:03.659319  1585 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:03.602243  6933 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:03.660231  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 85404us
I20260709 13:02:03.601213  6748 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:03.661038  6925 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:03.583783  7082 consensus_queue.cc:1059] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:02:03.658710  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:03.678654  1695 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:03.675107  1585 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:03.610395  6964 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:03.663663  1511 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:03.617050  6883 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:03.671823  1618 raft_consensus.cc:2393] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 12: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:03.651351  7048 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.629015  7100 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:03.676708  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:03.679037  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:03.679705  1585 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:03.665946  6692 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:03.617357  7096 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:03.668311  6706 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:03.668179  7076 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:03.686012  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:03.670575  6898 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:03.670729  7106 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:03.675066  6945 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:03.690378  1693 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:02:03.690620  1545 raft_consensus.cc:2368] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:02:03.691475  1659 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:03.692677  1585 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:03.697650  7048 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:03.690449  1511 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:03.677055  6925 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.684947  6769 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:03.687378  7084 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:03.731781  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 65217.9us
I20260709 13:02:03.688783  6875 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:03.672973  7074 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:02:03.749549  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:03.751328  1545 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:03.689749  7083 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:02:03.749408  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 59061.8us
I20260709 13:02:03.704523  6926 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:03.715778  7061 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:03.758280  1511 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:03.759876  1540 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 17: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:03.706292  7076 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:02:03.762286  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 94979.3us
I20260709 13:02:03.770453  2211 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:03.741492  6925 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:03.769255  1511 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:03.776942  1614 raft_consensus.cc:606] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:03.755086  6706 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:03.775466  7076 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:03.782163  6706 raft_consensus.cc:697] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:02:03.784934  7052 log.cc:927] Time spent T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 1.293s	user 0.002s	sys 0.004s
I20260709 13:02:03.750905  6875 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.754351  6769 raft_consensus.cc:697] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:03.754482  6964 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:03.755327  7065 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:02:03.792069  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 99466.5us
I20260709 13:02:03.793853  6961 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:03.794397  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:03.794466  7061 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:03.795621  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 110015us
I20260709 13:02:03.766418  6834 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:03.802459  1545 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:03.734174  7100 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:03.740787  6898 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:03.798630  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42334 (request call id 35) took 1004 ms. Trace:
I20260709 13:02:03.803176  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:03.777982  6916 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:03.786377  6748 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:03.788967  6875 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.821121  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:03.821213  1614 rpcz_store.cc:276] 0709 13:02:02.788057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.809506 (+ 21449us) service_pool.cc:224] Handling call
0709 13:02:03.792221 (+982715us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54002017d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc491725853 00007fc4966f360a 00007fc48fc797d4 00007fc48fc79762 00007fc48fc79691 00007fc48fc7960c 00007fc48fc788c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:03.792353 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197413120}
I20260709 13:02:03.740768  6832 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:03.793802  6692 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:03.830499  1616 raft_consensus.cc:2393] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 14: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:03.831652  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:03.821659  7109 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:02:03.804028  6961 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:03.839524  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:03.840251  1545 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:03.841794  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:03.842685  1693 raft_consensus.cc:2410] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:02:03.818804  6991 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:03.822846  6834 raft_consensus.cc:697] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:03.851723  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:03.853438  1693 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:02:03.826956  7065 raft_consensus.cc:697] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:03.828375  6692 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.857910   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:02:03.858554  7048 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:03.859154  7105 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:03.855336  1659 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:03.859426  6898 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:03.864321  7061 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:03.869930  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 2082) took 1048 ms. Trace:
I20260709 13:02:03.900836  1696 rpcz_store.cc:276] 0709 13:02:02.821883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.822022 (+   139us) service_pool.cc:224] Handling call
0709 13:02:02.842345 (+ 20323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:03.543910 (+701565us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b180039ef20. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc4912d34bc 00007fc48e62148b 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63b455 00007fc491723060 00007fc491723bfb 00007fc49172e64b
0709 13:02:03.544061 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.544098 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:03.544798 (+   700us) log.cc:844] Serialized 52 byte log entry
0709 13:02:03.687750 (+142952us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:03.687796 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.687859 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.869501 (+181642us) raft_consensus.cc:1685] finished
0709 13:02:03.869531 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.869847 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2223,"raft.queue_time_us":68108,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":7393,"spinlock_wait_cycles":3230464,"thread_start_us":219333,"threads_started":2,"wal-append.queue_time_us":240746}
I20260709 13:02:03.793766  6706 consensus_queue.cc:237] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:03.839901  6961 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:03.871395  6832 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:03.895856  6692 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:03.895197  6993 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:03.918901  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:03.919742  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 94416.6us
W20260709 13:02:03.926929  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 89009.5us
I20260709 13:02:03.929754  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:03.925989  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 121534us
I20260709 13:02:03.932313  1512 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:03.932991  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 111531us
I20260709 13:02:03.933674  6748 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:03.911382  6964 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:03.856395  6991 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:03.940572  1545 raft_consensus.cc:2410] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:03.938473  1512 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:03.942567  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:03.951218  1541 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:03.955276   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:03.976238  7131 raft_consensus.cc:2764] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:03.920225  6769 consensus_queue.cc:237] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:03.967269  7096 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:04.005841  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:03.981189  6873 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.012181  1538 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
W20260709 13:02:04.016709  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 68754.2us
I20260709 13:02:04.017803  1512 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:04.018551  6706 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:04.018961  1512 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:04.019749  6706 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:04.021155  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 74536.5us
I20260709 13:02:04.003866  7011 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:02:04.022172  1659 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:04.024696  6875 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:03.981160  7065 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:04.029018  6991 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:04.030314  6919 consensus_meta.cc:287] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.533s	user 0.003s	sys 0.007s
I20260709 13:02:04.020493  6873 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:04.035003  6873 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:04.021194  1512 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:04.044186  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:04.053188  1616 raft_consensus.cc:2368] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 17. Current term is 18.
I20260709 13:02:03.963418  6834 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:04.038807  6964 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:04.049001  7048 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:04.069851  2210 leader_election.cc:400] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 17. Current term is 18.
I20260709 13:02:04.070283  2210 leader_election.cc:403] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:04.071305  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:04.076538  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:04.077102  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:04.077275  2244 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:02:04.082468  1511 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:04.088369  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:04.089098  2243 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:02:04.067628  7100 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:04.095314  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 73229.7us
I20260709 13:02:04.097285  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:04.075435  6879 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:04.105815  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:04.094519  7048 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:04.065130  7076 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:04.126636  7137 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:02:04.127792  7140 log.cc:927] Time spent T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:04.110821  7100 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:04.111348  7048 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.138116  2241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45882 (request call id 947) took 1826 ms. Trace:
I20260709 13:02:04.139029  2241 rpcz_store.cc:276] 0709 13:02:02.307508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.307715 (+   207us) service_pool.cc:224] Handling call
0709 13:02:02.332555 (+ 24840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.837753 (+505198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.134015 (+1296262us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54006b35d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:04.134206 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147550976}
W20260709 13:02:04.144636  7130 log.cc:927] Time spent T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:02:04.146600  6871 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:04.147042  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:04.156440  1659 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:04.157052  7083 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:04.134227  6961 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:04.162227  2237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45882 (request call id 949) took 1495 ms. Trace:
I20260709 13:02:04.162626  6961 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:04.164911  7038 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:04.166826  1659 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:04.170397  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:04.171180  1545 raft_consensus.cc:2368] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 17. Current term is 18.
I20260709 13:02:04.162653  2237 rpcz_store.cc:276] 0709 13:02:02.667403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.667675 (+   272us) service_pool.cc:224] Handling call
0709 13:02:04.162058 (+1494383us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54005f8554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:04.162172 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812293376}
I20260709 13:02:04.176079  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:04.176249  7061 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.179929  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:04.180462  7061 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:04.181182  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:04.181756  1547 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:02:04.182544  7061 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:04.182672  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:04.186736  1660 leader_election.cc:400] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13.
I20260709 13:02:04.187114  1660 leader_election.cc:403] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:04.179939  7038 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:04.140223  7112 log.cc:927] Time spent T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Append to log took a long time: real 0.337s	user 0.002s	sys 0.000s
I20260709 13:02:04.140753  7048 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:04.137463  7100 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:04.212881  1587 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:04.216078  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:04.224670  1620 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:02:04.281724  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 92309.6us
I20260709 13:02:04.300248  7076 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:04.303862  7146 log.cc:927] Time spent T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:02:04.178861  6925 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:04.308007  6925 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:04.313864  7137 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 17. Current term is 18.
I20260709 13:02:04.323585  2242 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:02:04.324028  2242 pending_rounds.cc:85] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: Aborting all ops after (but not including) 11
I20260709 13:02:04.324298  2242 pending_rounds.cc:107] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 16.12
I20260709 13:02:04.324653  2242 raft_consensus.cc:2917] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Aborting config change with OpId 16.12: Aborted: Op aborted by new leader
I20260709 13:02:04.325065  2242 raft_consensus.cc:2889] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 18 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:04.334686  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:04.203303  7083 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13.
I20260709 13:02:04.339073  1688 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:04.340436  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:02:04.344177  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 133847us
I20260709 13:02:04.347048  2241 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:02:04.389371  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 176549us
I20260709 13:02:04.392207  1587 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:04.393085  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 2081) took 1568 ms (client timeout 1897 ms). Trace:
I20260709 13:02:04.216099  7100 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:04.400666  1689 rpcz_store.cc:269] 0709 13:02:02.819653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.819835 (+   182us) service_pool.cc:224] Handling call
0709 13:02:04.388418 (+1568583us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54000f23d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:04.388515 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1339571456}
I20260709 13:02:04.400085  1587 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:04.414191  1587 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:04.416599  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 249822us
I20260709 13:02:04.412962  6769 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:04.396117  6925 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:04.459391  2209 leader_election.cc:400] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 17. Current term is 18.
I20260709 13:02:04.461743  2209 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:04.480782  7138 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:04.488193  7121 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:04.418797  6778 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:04.431700  7065 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:02:04.510891  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 117324us
I20260709 13:02:04.389986  6879 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:02:04.515139  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:04.517191  1547 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:04.518149  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:04.518997  1547 raft_consensus.cc:2368] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 17. Current term is 18.
I20260709 13:02:04.519937  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:04.489035  7121 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:04.521212  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:04.523592  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 109459us
W20260709 13:02:04.512161  6692 consensus_meta.cc:287] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.004s
I20260709 13:02:04.530978  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:04.534224  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:04.535405  1539 raft_consensus.cc:2410] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:02:04.536566  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:04.537983  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:04.502579  7074 consensus_queue.cc:1059] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:02:04.490736  7134 consensus_queue.cc:1059] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
W20260709 13:02:04.592944  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 131261us
I20260709 13:02:04.596498  2209 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:04.598660  2209 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:04.599906  1659 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:04.611557  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:04.612262  1541 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:02:04.560647  7061 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.560350  6933 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.531479  7038 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:04.622216  7121 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:04.611125  7113 log.cc:927] Time spent T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:02:04.634397  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:04.533147  6692 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:04.619756  7138 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:04.599257  6991 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:02:04.632973  6933 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:04.635006  7134 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:04.812846  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 212843us
I20260709 13:02:04.636837  7148 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:04.736285  6834 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.737797  7138 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:04.743362  7094 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.629097  7061 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:04.634140  7038 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:04.858717  7131 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:04.878803  7138 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:04.878204  7049 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.879058  7106 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:04.879727  6834 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:04.897533  6985 consensus_queue.cc:1059] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:02:04.943543  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 416563us
I20260709 13:02:04.888530  7094 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:04.919617  7049 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:04.967147  6985 consensus_queue.cc:1243] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:02:04.925727  7131 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:04.930048  7106 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:05.062745  7100 consensus_meta.cc:287] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.000s
I20260709 13:02:05.068270  7162 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.068979  7162 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:05.072052  7151 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 13:02:05.074947  7152 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.524s	user 0.002s	sys 0.008s
I20260709 13:02:05.075328  7100 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.071120  7162 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:05.077481  7100 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:05.090490  6916 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:05.091092  6916 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.093135  6916 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:05.096352  7094 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:05.098598  1547 raft_consensus.cc:2368] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13.
I20260709 13:02:05.102025  6967 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.089015  7078 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:05.103914  7078 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.102620  6967 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.088605  6933 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:05.116058  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 797) took 1779 ms. Trace:
I20260709 13:02:05.116438  1546 rpcz_store.cc:276] 0709 13:02:03.337139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.350492 (+ 13353us) service_pool.cc:224] Handling call
0709 13:02:05.115847 (+1765355us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b5400321ed4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:05.115997 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412573056}
I20260709 13:02:05.118017  1543 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:02:05.111842  7048 consensus_meta.cc:287] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.854s	user 0.010s	sys 0.003s
I20260709 13:02:05.109122  7038 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:05.123136   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:05.110447  7061 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:05.081555  7138 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.113241  6692 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:05.122654  6959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.044s	sys 0.129s
I20260709 13:02:05.127264  6933 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:02:05.140829  6959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.044s	sys 0.129s
I20260709 13:02:05.130098  7083 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.133390  7038 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:05.191349  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 1913) took 1560 ms (client timeout 1754 ms). Trace:
W20260709 13:02:05.191744  1540 rpcz_store.cc:269] 0709 13:02:03.631143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.674304 (+ 43161us) service_pool.cc:224] Handling call
0709 13:02:05.191114 (+1516810us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b54001603d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:05.191288 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110873856}
I20260709 13:02:05.195971  1546 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:05.126739  7048 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:05.188356  7154 log.cc:927] Time spent T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:02:05.151643  6834 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:05.201311  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 256931us
I20260709 13:02:05.154107  6778 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:05.216850  1541 raft_consensus.cc:2368] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15.
I20260709 13:02:05.216980  1621 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:05.197868  7065 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:02:05.220293  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 378095us
I20260709 13:02:05.221359  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:05.221691  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:05.207288  7078 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:05.229329  1691 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:05.230042  1659 leader_election.cc:400] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 17. Current term is 18.
I20260709 13:02:05.230109  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:05.230472  1659 leader_election.cc:403] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:05.230738  1689 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:05.189697  6933 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.233388  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:05.237692  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 795) took 1976 ms. Trace:
I20260709 13:02:05.233610  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:05.234684  1695 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:02:05.238099  1544 rpcz_store.cc:276] 0709 13:02:03.250906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.251068 (+   162us) service_pool.cc:224] Handling call
0709 13:02:03.270414 (+ 19346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:03.494383 (+223969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.227428 (+1733045us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54000d1454. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:05.227593 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":513189760}
I20260709 13:02:05.235898  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:05.212854  7049 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:05.240154  1659 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:05.189600  7083 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:05.190802  7038 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:05.212630  7131 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:05.238528  1695 pending_rounds.cc:85] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 7
I20260709 13:02:05.251921  1695 pending_rounds.cc:107] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:02:05.252316  1695 raft_consensus.cc:2889] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:05.235212  1690 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:05.253836  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:05.254086  6834 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:05.221307  7106 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:05.248023  2244 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:05.247859  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:05.248749  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:05.262794  2239 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:05.255035  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 137341us
I20260709 13:02:05.219738  6692 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.255204  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:05.255366  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:05.256412  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:05.254558  2240 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:05.266729  1540 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:02:05.264986  2238 raft_consensus.cc:1240] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:05.267472  1621 raft_consensus.cc:2410] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:02:05.267819  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:05.214994  6778 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:05.284288  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.271064  1688 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:05.285854  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:05.254856  7162 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.271777  1512 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:05.291100  1586 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:05.244130  7011 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:05.292994  1696 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:05.224546  7065 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.244427  7078 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 17. Current term is 18.
I20260709 13:02:05.305661  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:05.304543  1512 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:05.307871  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:05.310283  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 70204.1us
I20260709 13:02:05.310384  1540 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:05.262960  7164 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:05.269222  7178 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:05.313452  6933 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:05.324699  2246 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:02:05.288316  7119 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:02:05.318363  6778 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:05.281956  6692 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:05.311575  1689 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:02:05.315507  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:05.333868  1659 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:05.309324  7131 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:02:05.349912  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 58894.3us
I20260709 13:02:05.319995  6967 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:05.316205  7083 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:05.334275  6916 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:05.335039  7178 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.306145  7011 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.359828  7187 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.360260  6778 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:05.362392  2239 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:02:05.323999  6834 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.343411  7170 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:05.386550  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 75599.3us
I20260709 13:02:05.387440  1659 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:05.356371  7138 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:05.363652  7083 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:05.395202  6883 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:05.304352  7162 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.351399  7078 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:05.381588  1585 leader_election.cc:400] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:02:05.408614  1585 leader_election.cc:403] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:02:05.381754  7172 log.cc:927] Time spent T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:02:05.382084  7182 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:05.382987  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:05.383342  7166 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:02:05.383992  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:05.384688  7169 log.cc:927] Time spent T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:02:05.387970  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:05.427546  1690 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:02:05.428545  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:05.363839  7048 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:05.429999  7162 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:05.430724  2238 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:05.398874  7170 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:05.433624  7170 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:05.389258  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:05.434520  1687 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:02:05.435007  7186 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:05.435585  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:05.436357  1687 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:05.389102  6834 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:05.395224  7038 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:05.408627  6916 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:05.398775  7158 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.490s	user 0.005s	sys 0.006s
I20260709 13:02:05.438303  6834 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:05.437920  6916 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.398294  7184 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.439795  7011 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:05.439713  7184 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:05.377902  7187 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:05.396813  1659 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:05.442233  7184 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:05.442406  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 45670.6us
I20260709 13:02:05.395423  7185 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:05.443202  7187 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:05.443790  7187 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:05.396242  7065 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:05.412014  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:05.411561  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:05.446053  1691 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:05.417282  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:05.412853  1540 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:05.330062  7164 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.420128  1689 raft_consensus.cc:2368] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15.
I20260709 13:02:05.454280  1692 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:05.455188  6692 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:05.456647  7164 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:05.403496  7083 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:05.424973  1688 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:02:05.403939  6883 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:05.459187  7083 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:05.424099  7078 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:05.435774  7190 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:05.437316  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:05.363214  6925 consensus_meta.cc:287] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.887s	user 0.010s	sys 0.000s
I20260709 13:02:05.443653  7185 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:05.466673  6925 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:05.467020  6883 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:05.468073  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 809) took 1298 ms. Trace:
I20260709 13:02:05.468166  7185 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:05.470604  1690 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 8.
I20260709 13:02:05.445437  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:05.394577  7178 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:05.477116  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:05.478004  1538 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:05.376466  6778 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.446580  7038 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:05.438006  7171 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:05.483394  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:05.484118  1538 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:05.481709  7038 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.485196  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:05.486543  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:05.481328  6778 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:05.486873  7088 raft_consensus.cc:3055] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:05.487896  7088 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:05.488871  7088 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:05.491129  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:05.492763  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:05.493386  1539 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:05.497839  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:05.498663  1544 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:05.499802  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:05.500509  1544 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 8.
I20260709 13:02:05.501547  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:05.442826  7184 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12.
I20260709 13:02:05.485383  7038 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:05.506145  7153 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.518s	user 0.003s	sys 0.000s
I20260709 13:02:05.468585  1545 rpcz_store.cc:276] 0709 13:02:04.169642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.183058 (+ 13416us) service_pool.cc:224] Handling call
0709 13:02:04.183387 (+   329us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:04.183919 (+   532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.183964 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:04.194954 (+ 10990us) log.cc:844] Serialized 52 byte log entry
0709 13:02:04.582562 (+387608us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:04.616524 (+ 33962us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.616788 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.616887 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.380196 (+763309us) spinlock_profiling.cc:243] Waited 9.06 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:05.463677 (+ 83481us) raft_consensus.cc:1685] finished
0709 13:02:05.467842 (+  4165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.468006 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34307,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":4849,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":12217,"spinlock_wait_cycles":20832640,"thread_start_us":250707,"threads_started":1,"wal-append.queue_time_us":463312}
I20260709 13:02:05.507220  7012 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:05.508445  1545 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:05.508455  6961 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:05.509013  6961 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:05.509999  1545 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:05.509881  6961 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.512279  2209 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:05.514097  7164 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:05.483044  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2679) took 2091 ms (client timeout 1808 ms). Trace:
W20260709 13:02:05.517473  1618 rpcz_store.cc:269] 0709 13:02:03.391736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.415309 (+ 23573us) service_pool.cc:224] Handling call
0709 13:02:05.482849 (+2067540us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54000e4a54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:05.482972 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498022272}
I20260709 13:02:05.518139  1538 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:02:05.528970  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 3033) took 1002 ms. Trace:
I20260709 13:02:05.529366  1538 rpcz_store.cc:276] 0709 13:02:04.526586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.517574 (+990988us) service_pool.cc:224] Handling call
0709 13:02:05.517911 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.528674 (+ 10763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.528910 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.476483  6875 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:05.530942  1538 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:05.521929  6778 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.524794  7078 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:05.502157  1544 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 9.
I20260709 13:02:05.532088  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:05.559785  2241 raft_consensus.cc:2393] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 10: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:05.521759  7148 raft_consensus.cc:3055] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:05.533074  1659 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:02:05.536893  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 127261us
I20260709 13:02:05.511165  1545 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:05.540787  1691 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:02:05.557070  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 3031) took 1031 ms. Trace:
W20260709 13:02:05.560856  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 155876us
I20260709 13:02:05.562224  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:05.565107  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 3030) took 1046 ms. Trace:
I20260709 13:02:05.581390  1585 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:05.562400  1541 rpcz_store.cc:276] 0709 13:02:04.525944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.616090 (+ 90146us) service_pool.cc:224] Handling call
0709 13:02:05.550621 (+934531us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54000b5754. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:05.556981 (+  6360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1337669504}
I20260709 13:02:05.564935  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:05.599502  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:05.612323  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:05.613270  1691 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:05.616716  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:05.617856  1691 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:02:05.618144  1539 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:02:05.581836  1545 rpcz_store.cc:276] 0709 13:02:04.519113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.510724 (+991611us) service_pool.cc:224] Handling call
0709 13:02:05.510993 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.564849 (+ 53856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.565052 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.621932  1690 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:05.627743  1545 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:02:05.629230  1659 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:05.634739  1585 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:05.636041  7190 consensus_queue.cc:1059] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:02:05.664206  7190 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.664728  7190 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:05.666003  6778 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:05.565019  6875 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:05.667062  7123 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:02:05.667302  6875 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.636446  7171 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:05.669107  7171 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:05.669320  6875 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:05.669498  7171 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:05.670810  7190 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:05.677356  1541 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:05.679205  1541 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:02:05.681043  1541 pending_rounds.cc:85] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 11
I20260709 13:02:05.681388  1541 pending_rounds.cc:107] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 16.12
I20260709 13:02:05.681619  7083 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:05.682554  7083 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.685447  7083 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:05.560750  7038 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:05.688570  7038 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:05.689875  7038 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:05.564724  7148 raft_consensus.cc:740] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:05.690455  7038 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.691088  7148 consensus_queue.cc:260] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:05.692255  7148 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:05.692590  7038 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:05.631383  6769 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:02:05.580601  7100 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.697289  7100 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:05.698161  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 803) took 1530 ms. Trace:
I20260709 13:02:05.633040  6883 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:05.634321  7121 raft_consensus.cc:3055] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:05.636937  6834 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:05.691557  6925 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:05.681829  1541 raft_consensus.cc:2917] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Aborting config change with OpId 16.12: Aborted: Op aborted by new leader
I20260709 13:02:05.701709  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:05.710466  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 3024) took 1192 ms. Trace:
I20260709 13:02:05.702054  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:05.704358  1545 raft_consensus.cc:1240] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:05.714617  1622 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
I20260709 13:02:05.702139  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:05.698734  1543 rpcz_store.cc:276] 0709 13:02:04.167994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.188381 (+ 20387us) service_pool.cc:224] Handling call
0709 13:02:05.117688 (+929307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.118463 (+   775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.697907 (+579444us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b5400321ed0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:05.698087 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077339904}
I20260709 13:02:05.715518  1547 rpcz_store.cc:276] 0709 13:02:04.517565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.520991 (+  3426us) service_pool.cc:224] Handling call
0709 13:02:05.710205 (+1189214us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54002f9ed4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:05.710390 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1325761792}
I20260709 13:02:05.638599  1539 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:05.647217  1585 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:05.728824  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 81689.6us
I20260709 13:02:05.587898  7078 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:05.713707  1541 raft_consensus.cc:2889] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:05.723189  6959 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:05.785229  1539 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:05.789595  1691 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:05.724390  2210 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:02:05.786710  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 402800us
W20260709 13:02:05.792951  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 68661us
I20260709 13:02:05.797319  1587 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:05.797665  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.798890  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:05.801905  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:05.790691  7078 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.713193  6900 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.802980  1693 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:05.807519  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:05.808965  1587 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:05.842478  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:05.710842  6834 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.711028  7196 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:05.702248  7100 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:05.703513  7121 raft_consensus.cc:740] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:05.702898  6883 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:05.709707  7178 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:05.710115  7185 consensus_queue.cc:1059] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.207s
I20260709 13:02:05.844573  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:05.837337  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:05.791698  7174 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.017s	sys 0.058s
I20260709 13:02:05.778111  7038 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:05.849936  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:05.855715  1615 raft_consensus.cc:1240] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:05.952603  1617 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:05.855540  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:05.944747  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 135824us
I20260709 13:02:05.953722  1688 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:05.954061  1614 raft_consensus.cc:2410] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:02:05.844617  7078 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:05.949343  7174 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.017s	sys 0.058s
I20260709 13:02:05.955931  7174 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:05.956732  7174 raft_consensus.cc:697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:05.957908  7174 consensus_queue.cc:237] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:05.855875  6834 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:05.959508  7038 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.961687  7038 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:05.965476  6883 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:05.967636  2242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45882 (request call id 955) took 1796 ms. Trace:
I20260709 13:02:05.710070  7188 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.170s
I20260709 13:02:05.968153  2242 rpcz_store.cc:276] 0709 13:02:04.170938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.171265 (+   327us) service_pool.cc:224] Handling call
0709 13:02:04.193783 (+ 22518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.325635 (+131852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.952789 (+1627154us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400a96854. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:05.967573 (+ 14784us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297276160}
I20260709 13:02:05.942620  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:05.962998  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:05.942329  7190 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:05.990991  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:05.991284  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 3027) took 1472 ms. Trace:
I20260709 13:02:05.992151  1696 raft_consensus.cc:2393] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 16: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:05.991896  1546 rpcz_store.cc:276] 0709 13:02:04.518334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.126177 (+607843us) service_pool.cc:224] Handling call
0709 13:02:05.195740 (+ 69563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.196504 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.990965 (+794461us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b54001603d0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:05.991181 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120650624}
I20260709 13:02:05.968895  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:05.865067  1616 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:05.954092  1587 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:05.783924  7123 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:05.703049  6778 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:05.993650  1619 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:06.036190  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.033893  1617 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:05.846263  7023 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:02:06.000437  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 46501.1us
I20260709 13:02:06.002966  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:05.950941  7196 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.967686  7049 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.015359  7192 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.221s
I20260709 13:02:06.062999  7195 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:05.974651  7178 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.066040  7178 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:06.016191  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.016052  7141 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.068126  7141 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.070210  7141 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:05.845752  7170 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.166s
I20260709 13:02:06.071099  7049 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.073374  7049 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:06.042219  7023 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.074378  7023 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:06.016800  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.054325  7196 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:06.076115  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.077239  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.078118  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:05.992213  6926 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:06.054651  7173 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:02:06.080040  6926 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.080753  6834 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.081743  1695 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:06.082105  6926 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:05.996704  7038 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.082847  7038 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.083926  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.084514  2238 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:02:06.084903  7038 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:06.001907  7190 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.028014  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:05.822115  6959 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:05.856328  7065 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:05.995870  7123 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:06.034210  6961 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:05.972393  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.048710  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.102432  1615 raft_consensus.cc:2393] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 17: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:06.051164  1587 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:06.059330  7127 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:06.060565  7194 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:06.091254  1616 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:06.082752  6834 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:06.049435  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.109493  1617 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:06.105420  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.085150  7180 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:02:06.110898  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 59960.1us
I20260709 13:02:06.111802  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.112988  1587 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:05.841813  6900 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.113726  1511 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:06.066984  7078 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.104809  7038 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.049952  6778 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.106369  7123 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:06.123757  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.108458  7194 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:06.089485  7105 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:02:06.052424  7171 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:06.126348  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.131453  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.123327  7096 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:06.118515  7173 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:06.118046  7100 consensus_queue.cc:1059] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:02:06.139173  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.139462  7096 raft_consensus.cc:697] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:06.140231  7171 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:06.140491  7096 consensus_queue.cc:237] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.142586  6959 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:06.128731  6925 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:06.140937  7171 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:06.147791  1696 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:02:06.147114  1695 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:06.131011  6834 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:06.118749  7180 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.149734  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.153980  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:06.156170  1586 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:06.138561  7148 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:06.137900  7173 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.127925  7038 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.167764  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:06.168403  1541 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:06.169801  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:06.170948  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:06.172279  6778 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:06.172688  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:06.159350  6834 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.175330  6834 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:06.177292  7180 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:06.177889  7148 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.179812  1543 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:06.180820  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:06.181365  1543 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:06.181845  1512 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:06.182667  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.183789  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:06.172294  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:06.186012  1541 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:06.187076  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:06.187956  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:06.148469  7100 consensus_queue.cc:1243] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:06.183904  1512 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:06.191668  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:06.192481  1688 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:06.197216  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:06.159822  6692 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.159686  6879 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:06.202795  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:06.151623  7171 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.200567  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:06.206380  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.187455  7141 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:06.197790  1619 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:02:06.201164  1541 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:06.202056  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.185948  6925 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:06.202795  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.148337  7170 consensus_queue.cc:1059] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:02:06.183298  7173 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:06.196187  7100 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:06.215157  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:06.170791  7194 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.212198  6925 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.226156  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.211046  7141 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:06.212847  7190 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:06.234604  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.228482  6925 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:06.222481  6916 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:06.242842  7194 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:06.207353  6879 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.250336  6879 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:06.253360  6916 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:06.253865  6916 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:06.254305  6916 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:06.255980  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.271796  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:06.271886  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.272548  2238 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:06.271981  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.272972  1541 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:06.281916  1618 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:06.282366  1617 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:06.206827  6692 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.283879  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.302469  1618 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:06.303336  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.305287  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.236677  7141 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:06.316913  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:06.317679  1688 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:06.319519  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.222916  7100 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.325901  1543 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:06.285492  7123 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.333735  1544 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:02:06.301478  7074 raft_consensus.cc:3055] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:06.328737  6692 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:06.329738  7088 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:06.351397  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.288292  7148 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:06.326776  7196 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.309455  6900 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:06.305455  7078 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:06.312358  7190 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:06.355330  6879 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.364833  7038 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:06.367138  6692 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.364964  2238 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:02:06.371625  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.381168  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:06.352640  6926 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:06.446836  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.448153  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:06.449458  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.450713  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:06.451947  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.453037  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:06.341686  7074 raft_consensus.cc:740] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:06.454319  7047 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.454264  7074 consensus_queue.cc:260] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.455044  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:06.455467  7074 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:06.455615  7096 consensus_queue.cc:1059] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:06.456290  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:06.456776  7096 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:06.457315  7096 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:06.457674  1511 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:06.458228  7096 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.407317  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.408034  1696 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:02:06.409153  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.460575  7094 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:06.459880  7221 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:06.394984  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 211105us
I20260709 13:02:06.412029  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.461599  6900 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:06.462210  1512 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:06.462967  1691 raft_consensus.cc:2368] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 16. Current term is 17.
I20260709 13:02:06.463016  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:06.407087  7171 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:06.428124  6916 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.460199  6748 raft_consensus.cc:3055] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:06.464637  6748 raft_consensus.cc:740] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:06.464668  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:06.465528  7221 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:06.468236  6925 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.469035  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:06.469637  1695 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:02:06.431046  7023 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.430769  7141 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.432775  7100 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:06.432560  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:06.433293  6692 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.435273  7208 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.435343  6985 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:06.443104  7173 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.436969  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:06.437186  6879 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.437902  7190 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.500428  7023 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:06.501955  7190 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:06.438230  7205 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:06.454941  7047 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.438642  7197 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:06.406284  6871 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.504026  7047 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:06.504179  6871 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.506407  6871 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:06.440215  7178 raft_consensus.cc:3055] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:06.461097  2243 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 18 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:06.507122  7178 raft_consensus.cc:740] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:06.462191  6900 raft_consensus.cc:697] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:06.507623  2242 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:06.508119  7178 consensus_queue.cc:260] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.508489  6900 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.509476  7178 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:06.431070  7123 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:06.465909  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:06.429574  7196 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:06.487381  6925 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:06.477931  1621 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:06.479440  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:06.485827  1587 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:06.465633  6748 consensus_queue.cc:260] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.529268  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.502183  6692 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:06.410590  2241 raft_consensus.cc:1240] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:06.512164  2245 raft_consensus.cc:1240] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:06.528941  1587 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:06.471300  1512 leader_election.cc:400] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15.
I20260709 13:02:06.492764  6883 consensus_queue.cc:1059] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:02:06.519033  7208 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.525235  7192 raft_consensus.cc:3055] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:06.526319  7188 raft_consensus.cc:3055] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:06.527379  6778 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:06.533205  1512 leader_election.cc:403] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:02:06.465978  6916 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:06.536417  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:06.537672  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 225948us
W20260709 13:02:06.544291  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 73521.2us
I20260709 13:02:06.544989  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.545724  1512 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:06.541231  2243 raft_consensus.cc:2410] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:02:06.499101  7173 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:06.542454  6748 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:06.546816  1512 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:06.548725  1693 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:02:06.549408  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:06.552673  1690 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:02:06.500445  6879 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:06.561101  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:06.560074  1512 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:06.543380  6883 raft_consensus.cc:3055] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:06.544059  7001 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:06.543550  7188 raft_consensus.cc:740] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:06.540652  7192 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:06.570848  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.531792  7195 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:02:06.550078  6778 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:06.587809  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.554700  7215 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15.
I20260709 13:02:06.566955  7023 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:06.603626  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 43653.9us
I20260709 13:02:06.566633  6879 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:06.558771  7214 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:06.621342  1660 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:06.622021  1690 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:06.543941  6692 consensus_queue.cc:1059] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:02:06.581164  6883 raft_consensus.cc:740] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:06.627583  1512 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:06.627637  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.628775  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:06.585023  7001 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:06.648063  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:06.650770  1660 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:06.652316  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.622630  6778 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:06.623821  7100 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:06.660075  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:06.627393  7023 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:06.644199  6879 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:06.651335  7196 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:06.680989  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:06.653091  7001 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:06.667900  7194 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:06.694136  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.669679  7047 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:06.653411  6871 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:02:06.689765  6879 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.704000  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.678570  7100 raft_consensus.cc:697] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:06.679466  7023 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:06.698731  7171 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:06.686568  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:06.703692  7047 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:06.712594  2245 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
W20260709 13:02:06.714407  7212 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:02:06.716521  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.716847  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.722889  1621 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:06.677448  7214 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:02:06.716009  7180 consensus_queue.cc:1059] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:02:06.731062  7180 raft_consensus.cc:3055] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:06.731426  7180 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:06.732334  7180 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.733633  7180 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:06.734845  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:06.735503  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.715858  7196 consensus_queue.cc:1059] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:02:06.736626  7196 raft_consensus.cc:3055] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:06.736757  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:06.737146  7196 raft_consensus.cc:740] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:06.738036  7196 consensus_queue.cc:260] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.742561  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.743759  6985 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.744369  6985 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.723919  7047 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:06.747540  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.668581  7192 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.750324  7192 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:06.750476  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.690440  7188 consensus_queue.cc:260] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:06.727895  7228 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:02:06.735767  1695 raft_consensus.cc:2393] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 17: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:06.753343  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:06.725010  1659 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:06.754348  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:06.756031  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:06.760465  1693 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:02:06.739183  7196 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:06.767653  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:02:06.776342  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.720316  7141 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:06.787685  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:06.786845  7088 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:06.799793  7100 consensus_queue.cc:237] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.803627  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:06.831652  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:06.841594  7121 consensus_queue.cc:260] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.703315  6883 consensus_queue.cc:260] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.723675  7148 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.124s
I20260709 13:02:06.849133  7197 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:06.849856  7197 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:06.715267  7190 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:02:06.855772  6985 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:06.859834  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.860477  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:06.855305  7205 consensus_queue.cc:1175] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" responder_term: 17 status { last_received { term: 15 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:06.866593  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 817) took 1605 ms. Trace:
I20260709 13:02:06.867304  7188 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:06.867007  1538 rpcz_store.cc:276] 0709 13:02:05.261049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.586878 (+325829us) service_pool.cc:224] Handling call
0709 13:02:05.587087 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.670049 (+ 82962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.670083 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:05.670126 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:05.670157 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.866371 (+1196214us) spinlock_profiling.cc:243] Waited 82.8 ms on lock 0x7b54003c46d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:06.866416 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.866535 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190354304}
W20260709 13:02:06.876222  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 88630.9us
I20260709 13:02:06.877764  1659 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:06.878895  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:06.884689  1692 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:06.885603  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:06.885820  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:06.880424  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:06.880967  7208 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:06.881706  7088 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:06.883646  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:06.890424  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:06.883981  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:06.893005  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:06.895278  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.896756  1616 raft_consensus.cc:2410] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:06.899175  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.899359  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.899940  1617 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:06.843182  7121 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:06.911372  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 2106) took 1112 ms. Trace:
I20260709 13:02:06.911782  1691 rpcz_store.cc:276] 0709 13:02:05.798475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.798597 (+   122us) service_pool.cc:224] Handling call
0709 13:02:06.911145 (+1112548us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54000f23d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:06.911313 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1524785920}
I20260709 13:02:06.912400  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:06.913169  1617 raft_consensus.cc:2393] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 19: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:06.903201  7208 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:06.902873  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:06.891316  7205 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:06.915586  1694 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:02:06.915962  7205 raft_consensus.cc:697] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:02:06.917088  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 288354us
I20260709 13:02:06.916890  7205 consensus_queue.cc:237] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.917315  6778 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.918625  7208 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:06.919530  6778 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:06.919654  7119 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:06.919904  1660 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:06.920822  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.922823  7208 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:06.923504  7076 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.923727  7208 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:06.924005  7076 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.924644  7208 raft_consensus.cc:3055] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:06.924762  2209 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:06.925100  7208 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:06.926025  7076 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:06.926086  7208 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.908103  7088 raft_consensus.cc:697] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 19 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:06.927830  7088 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.906126  7202 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:06.901891  7194 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:06.905589  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:06.908593  1614 raft_consensus.cc:1240] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:06.931203  7194 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:06.932533  7194 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:06.922935  6879 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.937230  6879 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:06.926738  7076 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:06.937915  7076 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:06.938373  7076 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:06.920169  7119 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:06.907933  7023 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.932017  1696 raft_consensus.cc:1240] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:06.918949  2211 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:06.940544  1660 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:06.940923  1691 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:06.926798  2209 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:06.905260  7047 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.946564  1587 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:06.949069  7167 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:06.952013  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:06.945523  7119 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:06.953716  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:06.952327  6959 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:06.953730  7148 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:06.956063  7148 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:06.956488  7148 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:06.958822  7222 log.cc:927] Time spent T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.231s	user 0.001s	sys 0.002s
I20260709 13:02:06.960276  2239 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:06.948407  1587 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:06.962702  2210 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:06.964896  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:06.969200  1587 leader_election.cc:400] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 16. Current term is 17.
I20260709 13:02:06.967128  6985 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:06.975482  7182 consensus_queue.cc:1059] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:06.975425  6985 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.976589  7182 consensus_queue.cc:1059] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:06.977448  7182 raft_consensus.cc:3055] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:06.977773  7182 raft_consensus.cc:740] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:06.978039  6985 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:06.978339  7105 raft_consensus.cc:3055] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:06.978739  7105 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:06.978929  7182 consensus_queue.cc:260] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.979588  7105 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.971410  6778 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:06.980258  7182 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.980512  6959 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:06.980800  6778 raft_consensus.cc:697] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:06.980732  7105 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:06.981891  6778 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:06.969766  6958 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:06.984390  6958 raft_consensus.cc:697] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:06.985417  6958 consensus_queue.cc:237] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.986166  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:06.967500  7202 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:06.987718  1511 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:06.988610  6875 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:06.988772  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:06.989329  6875 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:06.989681  6875 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.990005  6875 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:06.990234  1511 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:06.991312  6916 raft_consensus.cc:3055] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:06.991389  7178 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:06.991873  6916 raft_consensus.cc:740] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:06.992201  7178 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:06.993399  6926 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:06.992909  6916 consensus_queue.cc:260] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:06.993831  6926 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:06.994367  6916 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:07.005829  1585 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:02:07.010326  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 45571.8us
I20260709 13:02:07.011198  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:07.012820  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:07.015784  1660 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:07.018549  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 49547.6us
I20260709 13:02:06.973773  6879 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.976500  7137 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:07.021019  2210 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:07.026219  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:07.030686  1545 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:07.001847  7208 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:07.024869  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:07.033852  1540 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 17: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:07.025573  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:07.025997  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:07.026558  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.016985  6985 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:07.073525  7164 consensus_queue.cc:1059] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:07.027875  1660 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:07.031720  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:07.037065  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:07.078938  1546 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:07.037400  1538 raft_consensus.cc:2393] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 17: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:07.037904  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:07.040354  1539 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:02:07.040889  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:07.015642  7202 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:07.026888  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:07.087334  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 49719.9us
I20260709 13:02:07.044281  1585 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:07.050429  1547 raft_consensus.cc:2393] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 17: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:07.051529  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:07.021674  7012 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.017498  6871 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:07.055598  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:07.034468  7074 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:07.032560  6879 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:07.058867  1545 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:07.060825  7047 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:07.072256  1695 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
I20260709 13:02:07.081246  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:07.102880  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 75092.7us
I20260709 13:02:07.103284  1541 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:07.023379  7182 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.082581  1696 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:07.090183  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:02:07.092110  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 47931.7us
I20260709 13:02:06.991540  7214 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:02:07.028256  7083 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:07.096683  2241 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:02:07.099393  7180 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:07.101743  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:07.115675  1542 raft_consensus.cc:2368] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13.
I20260709 13:02:07.104681  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:07.109663  1585 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:07.110391  1659 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:07.117235  1539 raft_consensus.cc:2393] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:07.041384  7184 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:07.097872  7164 raft_consensus.cc:3055] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:07.098562  7192 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:07.123844  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:07.124225  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:07.124825  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:07.126515  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:07.126694  1689 raft_consensus.cc:2393] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 9: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:07.034714  7187 consensus_queue.cc:1059] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:02:07.121230  6985 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:07.136731  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:07.137508  1546 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:07.148119  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:07.148747  1538 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:07.149760  1545 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:07.151314  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:07.147691  1546 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:07.122043  7164 raft_consensus.cc:740] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:07.115068  7180 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.149372  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:07.159629  1547 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:07.163848  1512 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:07.121708  7141 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:07.104094  7012 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:07.135344  7238 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:07.136591  7184 raft_consensus.cc:697] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:07.168989  1512 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:07.152231  7137 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:07.230198  7137 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:07.231950  6926 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:07.232606  7232 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.477s	user 0.002s	sys 0.000s
I20260709 13:02:07.232621  7137 leader_election.cc:290] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:07.169600  1585 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:07.114035  7182 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:07.237771  6985 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:07.239265  7182 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:07.241612  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 72051.2us
I20260709 13:02:07.162297  7180 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:07.246253  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:07.251444  1547 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:07.127329  7194 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:07.270807  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.136101  7076 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:07.173928  6900 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:07.299563  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 55816.3us
I20260709 13:02:07.253153  7106 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:02:07.303685  7249 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:07.305539  6875 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:07.306550  6748 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:07.299542  7214 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:07.307144  6748 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:07.309938  7001 consensus_meta.cc:287] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.003s
I20260709 13:02:07.263347  7083 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:07.310416  7001 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:07.310756  7083 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:07.311370  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.244824  7148 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:07.306972  1544 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:02:07.312672  7184 consensus_queue.cc:237] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:07.313261  7148 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:07.314306  7196 consensus_meta.cc:287] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
I20260709 13:02:07.315153  7083 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:07.317481  7012 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:07.294517  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 141381us
W20260709 13:02:07.320789  7242 log.cc:927] Time spent T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:02:07.322373  7197 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:07.168437  7240 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.141s
I20260709 13:02:07.324950  7076 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:07.328984  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:07.241220  7192 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:07.333467  1538 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:02:07.334519  1691 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:07.188514  7141 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:07.336918  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.342729  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:07.343133  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:07.344583  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:07.347934  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:07.257674  6926 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:07.157958  7164 consensus_queue.cc:260] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:07.386878  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:07.380177  1542 raft_consensus.cc:1240] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:07.383392  1619 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
I20260709 13:02:07.388695  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:02:07.299690  7228 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:02:07.383812  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:07.395768  2237 raft_consensus.cc:2393] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:07.391093  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:07.398859  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:02:07.405794  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.408326  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:07.409631  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:07.340091  7245 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.414336  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:07.415877  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:07.400686  7241 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:02:07.435621  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:07.432672  1617 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:07.433597  1613 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:02:07.438505  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 269576us
I20260709 13:02:07.381763  7233 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:07.336095  6778 consensus_queue.cc:1059] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
W20260709 13:02:07.436357  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 268773us
I20260709 13:02:07.440750  1512 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:07.444020  1512 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:07.424793  7127 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:07.439553  7188 consensus_meta.cc:287] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.002s
I20260709 13:02:07.431010  2241 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:07.455593  1660 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:07.443730  7164 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:07.457989  1512 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:07.445468  6900 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:07.452342  7096 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:07.436761  7245 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:07.463752  7119 consensus_meta.cc:287] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.004s
I20260709 13:02:07.465250  7188 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:07.443374  7233 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:07.506551  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 48659.1us
I20260709 13:02:07.510661  7258 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:07.477587  6900 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.512902  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:07.452044  7127 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:07.519043  1687 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:07.525920  1585 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:07.510792  7214 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:07.514920  1659 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:07.505505  7205 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.544152  7205 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:07.536387  6916 consensus_meta.cc:287] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.542s	user 0.013s	sys 0.000s
I20260709 13:02:07.551713  1539 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:02:07.507200  7119 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:07.554412  7119 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:07.558535  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:02:07.559784  7252 log.cc:927] Time spent T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:07.535434  7188 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:07.562278  7188 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:07.535445  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:07.500358  7096 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.564217  7096 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:07.566854  7023 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:07.537039  1659 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:07.540767  7246 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:02:07.533958  7001 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:07.568140  7194 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:07.589555  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 52592.3us
I20260709 13:02:07.589680  1621 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 9.
W20260709 13:02:07.591733  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 53455.9us
W20260709 13:02:07.534581  7218 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.920s	user 0.003s	sys 0.000s
I20260709 13:02:07.606532  1585 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:07.610832  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:07.611372  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:07.612402  1538 raft_consensus.cc:2393] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 17: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:07.615696  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:07.538936  6900 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:07.605594  1659 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:07.621491  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:07.622004  7197 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:07.621501  7255 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.622680  7167 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:07.622452  7256 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:07.631646  1659 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:07.596763  7065 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:07.618129  7094 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:07.595160  7088 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:07.664758  1687 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:02:07.629881  7253 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.127s	user 0.000s	sys 0.002s
I20260709 13:02:07.623076  7255 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:07.698596  7255 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:07.599570  7193 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:02:07.706082  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:07.625367  7141 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:07.710450  7180 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:07.715961  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:07.716207  7180 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:07.721603  7245 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:07.723455  7233 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:07.727509  7192 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:07.728559  1618 raft_consensus.cc:1240] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:07.665295  6875 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:07.730876  7127 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:07.739394  7208 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:07.742810  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:07.743712  2241 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:02:07.711112  7235 raft_consensus.cc:3055] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:07.690034  7167 raft_consensus.cc:697] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:07.689664  7094 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:07.673988  1659 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:07.752816  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 133931us
W20260709 13:02:07.755952  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 82042.1us
I20260709 13:02:07.756999  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:07.756058  1512 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:07.758548  1615 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:07.758616  1659 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:07.759081  7258 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:07.759509  7258 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.759828  7258 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:07.760892  1659 leader_election.cc:400] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 12. Current term is 13.
I20260709 13:02:07.761716  1659 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:07.765678  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:07.765380  7100 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:07.766325  1585 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:07.769446  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.763830  2210 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:07.771968  2243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45866 (request call id 1117) took 1260 ms. Trace:
I20260709 13:02:07.773463  2209 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:07.773660  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:07.772380  2243 rpcz_store.cc:276] 0709 13:02:06.512057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.512503 (+   446us) service_pool.cc:224] Handling call
0709 13:02:07.768966 (+1256463us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b54002afb54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:07.771909 (+  2943us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25305856}
I20260709 13:02:07.764659  7088 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:07.757331  7235 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:07.762779  7180 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:07.762776  7208 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:07.762814  7182 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:07.779028  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:07.780584  1687 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:07.780917  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:07.780584  1539 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:02:07.780391  1659 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:07.784556  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:07.785104  1539 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:07.788882  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:07.789654  1541 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:07.790375  6883 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:07.777894  7256 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:07.792277  1586 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:07.776948  7184 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:07.794894  7094 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:07.796202  6916 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:07.796737  6916 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:07.798789  6916 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:07.781550  1544 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:02:07.797066  7187 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:07.799731  7187 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.800103  7187 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:07.783025  7182 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:07.801311  7208 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:07.802378  7208 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:07.800058  6879 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:07.804005  7256 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:07.805214  7256 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:07.807396  7167 consensus_queue.cc:237] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:07.809579  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:07.812752  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 48961.4us
I20260709 13:02:07.816207  2209 leader_election.cc:304] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:07.816491  2241 raft_consensus.cc:1240] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:07.817644  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:07.818356  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:07.819135  1696 raft_consensus.cc:2410] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:02:07.819424  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:07.820340  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:07.820513  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:07.820884  1541 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:07.821053  1544 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:07.822991  1539 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 10.
I20260709 13:02:07.830643  1541 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:07.831601  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:07.832048  1546 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:07.856186  2209 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:07.822805  7194 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:07.833027  7255 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:07.824779  7141 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:02:07.855917  7023 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:07.824818  6958 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:07.827636  7076 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:07.896546  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 71550.2us
W20260709 13:02:07.903097  7270 log.cc:927] Time spent T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:02:07.909894  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 53777.6us
I20260709 13:02:07.911320  1659 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:07.925006  1659 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:07.834947  7190 consensus_queue.cc:1059] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:02:07.942421  7088 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:07.945359  2209 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:07.907922  7023 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:07.925762  6958 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.923952  7076 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.931790  7254 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:07.971441  7254 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.971863  7254 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:07.972095  7106 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:07.972525  7106 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:07.975514  7076 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:07.980924  7265 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:07.981649  7119 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.981462  7265 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:07.982090  7119 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:07.983014  7250 log.cc:927] Time spent T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.734s	user 0.000s	sys 0.003s
I20260709 13:02:07.983856  7265 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:07.985942  7258 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:07.987635  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:07.853170  7235 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:07.955339  7012 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:07.955144  7127 consensus_queue.cc:1059] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:07.930198  7272 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:07.908788  7255 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:07.951478  7023 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:07.965173  7164 consensus_meta.cc:287] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.003s
W20260709 13:02:07.991065  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 43975us
I20260709 13:02:07.988324  1546 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:02:07.855374  7096 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:07.969467  6900 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:07.952257  7188 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:07.990298  6958 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:08.092149  2209 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:07.998687  7272 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.001286  7134 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.020587  7235 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:08.001621  7012 raft_consensus.cc:697] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:02:08.148212  7173 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.008s	sys 0.021s
I20260709 13:02:08.142540  7164 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:07.998605  7273 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.155s
I20260709 13:02:08.144397  7188 raft_consensus.cc:697] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:08.162322  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:08.150647  7272 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:08.176533  1546 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
W20260709 13:02:08.159885  7173 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.009s	sys 0.021s
I20260709 13:02:08.180614  2209 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:08.169543  7164 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:08.175633  7256 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.152595  7134 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:08.190023  7265 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:08.199986  7164 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:08.225162  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:08.226262  1546 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 13: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:08.202986  7119 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:08.211442  7106 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:08.246150  7182 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:08.214917  7012 consensus_queue.cc:237] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:08.346786  1691 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:02:08.266638  7274 log.cc:927] Time spent T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:02:08.267132  2239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 1159) took 1342 ms. Trace:
I20260709 13:02:08.275365  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 2137) took 1266 ms. Trace:
I20260709 13:02:08.284116  7273 raft_consensus.cc:1064] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:02:08.284652  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:08.246263  7194 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:08.286369  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:08.287328  7271 log.cc:927] Time spent T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:02:08.290037  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:08.290336  1538 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:08.290635  7134 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:08.290800  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:08.291582  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:08.297902  7083 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:08.376816  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:08.302690  6883 consensus_meta.cc:287] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.003s
I20260709 13:02:08.305253  7106 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:08.314141  7141 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:02:08.320405  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:08.407896  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.228633  7188 consensus_queue.cc:237] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:08.332968  6900 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:08.203689  7256 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:08.334481  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.338008  1616 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:08.424255  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:08.338622  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:08.340169  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:08.341444  1695 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:02:08.342145  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:08.425581  1619 raft_consensus.cc:2410] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:02:08.342994  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:08.222431  7265 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.285772  1544 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:08.377614  7182 consensus_queue.cc:1059] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:02:08.353906  1691 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:08.358189  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:08.348506  1688 rpcz_store.cc:276] 0709 13:02:07.008745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.009938 (+  1193us) service_pool.cc:224] Handling call
0709 13:02:07.023973 (+ 14035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.073655 (+ 49682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.073685 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.074572 (+   887us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.100123 (+ 25551us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:07.100417 (+   294us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.100615 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.571159 (+470544us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b180040b640. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e60c2a6 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc496654aa1 00007fc49664bb37 00007fc49664b9ca 00007fc49674326f
0709 13:02:08.274902 (+703743us) spinlock_profiling.cc:243] Waited 49.3 ms on lock 0x7b54002c6d54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:08.274970 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.275034 (+    64us) raft_consensus.cc:1685] finished
0709 13:02:08.275055 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.275274 (+   219us) inbound_call.cc:177] Queueing success response
0709 13:02:08.312759 (+ 37485us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b48002502d8. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc496654aa1 00007fc49664bb37 00007fc49664b9ca 00007fc49674326f 00007fc496742f37 00007fc49675755c 00007fc496757508 00007fc496757488 00007fc496757443 00007fc4967566ec 00007fc495680a96
Metrics: {"prepare.queue_time_us":553,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":9594,"raft.run_cpu_time_us":30619,"raft.run_wall_time_us":1220508,"spinlock_wait_cycles":131888896,"thread_start_us":25180,"threads_started":1,"wal-append.queue_time_us":61183,"wal-append.run_cpu_time_us":2722,"wal-append.run_wall_time_us":1153427}
I20260709 13:02:08.360087  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:08.361111  1542 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:08.301355  7255 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:08.436401  1542 raft_consensus.cc:1240] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:08.419204  7195 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.422262  6769 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.437215  7195 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:08.437717  6769 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:08.438366  1542 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:08.439746  6879 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:08.440245  6879 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:08.440572  1690 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:02:08.440940  1690 pending_rounds.cc:85] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 8
I20260709 13:02:08.441166  1690 pending_rounds.cc:107] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:02:08.441378  1690 raft_consensus.cc:2889] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:08.376963  6866 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:02:08.442219  6879 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:08.371832  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:08.443578  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:08.372246  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:08.376820  2237 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:08.377213  1543 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:08.372473  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:08.372673  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:08.372794  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:08.446875  1545 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 19: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:08.391268  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:08.399326  1541 raft_consensus.cc:1240] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:08.370790  7273 raft_consensus.cc:1068] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: Unable to promote non-voter e8a64798e5f94de8909707bcbd11804a: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:02:08.347843  2239 rpcz_store.cc:276] 0709 13:02:06.924443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.945761 (+ 21318us) service_pool.cc:224] Handling call
0709 13:02:06.946043 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.960718 (+ 14675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.266878 (+1306160us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b54006c02d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:08.267071 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32233344}
I20260709 13:02:08.448845  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:08.430153  1511 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:08.424829  1616 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:02:08.431990  7265 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:08.432212  7173 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:08.460836  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:08.351357  7254 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:08.456063  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:08.470002  7268 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:02:08.457969  1541 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:02:08.461450  1621 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:08.462553  2239 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:08.462702  1511 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:08.467399  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:08.478607  7268 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:08.486871  1621 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:08.467535  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 2134) took 1534 ms. Trace:
I20260709 13:02:08.500569  1621 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:08.488549  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:08.488463  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:08.371814  7076 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:08.491982  1545 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:08.499797  1692 rpcz_store.cc:276] 0709 13:02:06.933166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.936411 (+  3245us) service_pool.cc:224] Handling call
0709 13:02:06.936784 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.937176 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.937201 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.146976 (+1209775us) spinlock_profiling.cc:243] Waited 8.96 ms on lock 0x7b2c00151d48. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc490024a11 00007fc490034372 00007fc491766a01 00007fc49172b43a 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2
0709 13:02:08.147720 (+   744us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.292133 (+144413us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:08.292170 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.292316 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.457128 (+164812us) raft_consensus.cc:1685] finished
0709 13:02:08.457148 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.467473 (+ 10325us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":287,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":46,"spinlock_wait_cycles":20609792,"thread_start_us":110998,"threads_started":1,"wal-append.queue_time_us":275402}
I20260709 13:02:08.427979  7096 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:08.430584  7170 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.496793  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:08.497442  1619 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:08.501477  1613 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:08.504994  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:08.501464  1543 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:08.505892  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:08.455792  7061 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.456130  6879 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.511425  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:08.457520  7195 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:08.520037  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:08.524552  1622 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:08.489915  7100 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:08.526173  1689 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:02:08.524026  1692 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:08.527093  1617 raft_consensus.cc:2393] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 16: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:08.431304  6958 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:08.423612  7141 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:08.537735  1621 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:02:08.538134  1621 pending_rounds.cc:85] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 8
I20260709 13:02:08.538604  1621 pending_rounds.cc:107] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:02:08.539196  1621 raft_consensus.cc:2889] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:08.539424  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:08.506556  7187 consensus_meta.cc:287] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.706s	user 0.011s	sys 0.000s
I20260709 13:02:08.540055  1695 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
I20260709 13:02:08.545995  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:08.541821  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:08.542449  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:08.543391  1587 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:08.554534  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:08.488056  7173 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:08.543958  7180 consensus_meta.cc:287] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.761s	user 0.010s	sys 0.003s
I20260709 13:02:08.500893  7186 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:02:08.516103  7167 consensus_queue.cc:1059] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:02:08.576272  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:08.569139  1692 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:02:08.578264  7240 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:08.570094  6778 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:08.685513  1622 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:08.686434  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:08.692871  1621 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:08.665669  7254 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:08.673074  7173 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:08.528146  7234 consensus_queue.cc:1059] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
W20260709 13:02:08.720465  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 144272us
I20260709 13:02:08.557545  7187 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:08.537034  7061 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:08.536870  6879 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:08.584002  7180 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:08.535533  7170 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:08.559363  7190 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:08.681525  7100 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.729455  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:08.846369  1543 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:08.582696  7273 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:08.848599  1615 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:08.722927  7255 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.742267  7226 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:02:08.867025  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 360757us
I20260709 13:02:08.869432  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 2726) took 1520 ms. Trace:
I20260709 13:02:08.885511  1620 rpcz_store.cc:276] 0709 13:02:07.348656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.348924 (+   268us) service_pool.cc:224] Handling call
0709 13:02:07.349149 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.591335 (+242186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.591373 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.591419 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:07.591452 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.869203 (+1277751us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54003fff54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:08.869248 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.869374 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556334848}
I20260709 13:02:08.912400  1539 raft_consensus.cc:1240] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:08.944873  1543 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:02:08.844568  7240 raft_consensus.cc:697] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:08.952461  1687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.008s	sys 0.007s
W20260709 13:02:08.954910  1687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.008s	sys 0.007s
I20260709 13:02:08.744102  6778 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:08.963140  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:08.903024  7188 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:08.964151  1543 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:08.854693  7100 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:08.862291  7273 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:08.973326  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 251387us
I20260709 13:02:08.974649  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:08.975549  1540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.010s	sys 0.009s
I20260709 13:02:08.958102  7119 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.978639  7174 raft_consensus.cc:3055] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:08.913041  7255 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:08.982306  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.007s	sys 0.032s
W20260709 13:02:08.984931  1540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.010s	sys 0.009s
W20260709 13:02:09.010097  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.007s	sys 0.032s
W20260709 13:02:09.011263  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 533777us
I20260709 13:02:08.998051  1543 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:02:09.000172  7174 raft_consensus.cc:740] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:09.015272  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 439506us
I20260709 13:02:09.013335  1511 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:09.018844  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:09.022833  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 154797us
I20260709 13:02:09.026576  2239 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:09.026822  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:09.033622  1511 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:08.970646  7188 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.035778  6870 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:09.036358  6870 raft_consensus.cc:697] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:09.036728  6769 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:09.037276  6870 consensus_queue.cc:237] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:09.040958  7272 consensus_meta.cc:287] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.841s	user 0.006s	sys 0.004s
I20260709 13:02:09.041492  7272 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.043437  7288 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:02:09.043942  7293 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:09.047942  7288 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:09.048321  7255 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:09.048431  7288 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.051332  7141 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:09.052021  6916 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:09.052848  6778 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:09.053480  7076 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:09.053756  7288 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:09.054503  7187 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:09.056022  6879 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:09.059173  7205 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:09.060323  7100 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:09.061368  7170 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:09.062667  7170 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.064682  7178 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.065162  7178 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:09.066640  7164 consensus_meta.cc:287] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.769s	user 0.003s	sys 0.006s
I20260709 13:02:09.068651  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:09.069244  1614 raft_consensus.cc:3060] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:09.074877  1696 raft_consensus.cc:2393] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 20: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:09.077965  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:09.081190  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 47692.3us
I20260709 13:02:09.082211  1511 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:09.085178  1539 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:09.086679  7272 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:09.048346  7273 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:09.075749  7235 consensus_meta.cc:287] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.921s	user 0.005s	sys 0.005s
I20260709 13:02:09.029927  7190 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.072320  7195 raft_consensus.cc:3055] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:09.071045  7178 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:09.091332  1511 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:09.167353  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 283448us
I20260709 13:02:09.007815  7119 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:09.172616  1585 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.107.254:43923, user_credentials={real_user=slave}} blocked reactor thread for 60978.9us
I20260709 13:02:09.067046  7164 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.083613  7100 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:09.063118  7170 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.172008  7190 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.090425  7141 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:09.067926  7106 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 13:02:09.245020  7190 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:09.247182  7170 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:09.248610  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:09.028775  7240 consensus_queue.cc:237] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.253782  7234 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.254341  7234 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.255417  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:09.256042  1543 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:09.256389  7234 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:09.256927  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:09.083861  7295 consensus_queue.cc:1059] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.122s
I20260709 13:02:09.236995  7188 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:09.267429  7170 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:09.268079  7170 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.271175  7119 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:09.279640  7170 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:09.220745  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 129499us
I20260709 13:02:09.338678  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1950) took 1056 ms. Trace:
I20260709 13:02:09.235854  7178 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:09.236981  7164 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:09.237514  7235 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:09.111335  6958 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:09.172467  7195 raft_consensus.cc:740] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:09.242283  7023 consensus_meta.cc:287] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 1.109s	user 0.006s	sys 0.005s
I20260709 13:02:09.286460  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:09.290205  1614 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
W20260709 13:02:09.292793  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 265630us
I20260709 13:02:09.209321  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:09.339294  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:09.361996  1688 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:09.362553  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:09.365542  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 312611us
I20260709 13:02:09.366351  1586 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:09.339272  1546 rpcz_store.cc:276] 0709 13:02:08.282708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.287573 (+  4865us) service_pool.cc:224] Handling call
0709 13:02:09.038673 (+751100us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b5800002d98. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606f8c 00007fc48e606ef6 0000000000375939 00007fc49667a1e0 00007fc4967430c4 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:02:09.038789 (+   116us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.038974 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:09.039273 (+   299us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.338215 (+298942us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.338292 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:09.338352 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.338443 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.338607 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1155,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"spinlock_wait_cycles":3107712,"thread_start_us":298461,"threads_started":1}
I20260709 13:02:09.385664  1511 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:09.396979  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:09.398053  1692 raft_consensus.cc:2410] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:02:09.402177  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:09.402961  1687 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:09.338207  7188 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:09.411525  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:09.432313  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:09.433287  2239 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 14: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:09.356282  7299 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:09.436339  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:09.442206  2239 raft_consensus.cc:2410] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
W20260709 13:02:09.444988  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 59416us
I20260709 13:02:09.458323  7141 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:09.460638  7195 consensus_queue.cc:260] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.400139  7178 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:09.466324  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:09.466946  2241 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:09.467730  1539 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:02:09.489300  1586 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:09.406319  7100 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:09.490532  7076 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.490720  7167 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.491158  7163 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.491261  7167 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.491726  7163 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.493412  7167 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:09.493896  7167 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.493950  7245 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:09.494347  7167 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.495981  7300 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.496485  7300 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.498601  7300 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:09.496735  6958 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.497025  7164 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:02:09.410650  7307 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:09.491045  7076 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.504092  6958 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.504457  7167 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:09.505748  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:09.465411  7299 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:09.507515  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 60845.9us
I20260709 13:02:09.566139  1687 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:02:09.508744  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:09.509052  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:09.566859  1540 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:02:09.511628  6862 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.511708  7294 consensus_queue.cc:1059] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:09.503304  7163 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:09.514082  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:09.494628  7245 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.368826  7235 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.512207  7312 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:09.584707  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:09.585471  2241 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 17: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:09.585776  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:09.586344  2245 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:02:09.586619  2210 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:09.587597  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:09.516853  7096 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.517241  7141 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:09.435001  7188 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.366993  7023 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.508453  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:09.570729  2211 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:09.574127  6862 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.569458  6748 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:09.575029  7299 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:09.581241  1511 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:09.581489  1692 raft_consensus.cc:2410] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:02:09.514966  7300 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:09.584461  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:09.588639  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:09.588881  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:09.591804  1616 raft_consensus.cc:2393] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 16: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:09.594756  1546 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:09.592262  7049 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.604300  2239 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:09.605223  1620 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 19.
I20260709 13:02:09.592944  7305 raft_consensus.cc:2804] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:09.611724  2243 raft_consensus.cc:1240] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:09.584190  7100 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:02:09.614217  7188 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:09.595993  7141 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:09.617926  7291 log.cc:927] Time spent T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.370s	user 0.002s	sys 0.006s
I20260709 13:02:09.618515  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:09.602126  7309 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:09.622901  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:09.593649  7312 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.624825  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 3073) took 1270 ms. Trace:
I20260709 13:02:09.625627  7299 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:09.626118  7190 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.594272  7096 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.628051  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:09.630784  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:09.636487  2245 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:09.637681  1694 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:09.648906  1543 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:09.621731  7298 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.378s	user 0.004s	sys 0.004s
I20260709 13:02:09.641633  1544 raft_consensus.cc:2393] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 18: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:09.641825  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:09.643589  1541 rpcz_store.cc:276] 0709 13:02:08.354879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.451007 (+ 96128us) service_pool.cc:224] Handling call
0709 13:02:08.457767 (+  6760us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.472746 (+ 14979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.624649 (+1151903us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b54003d90d0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:09.624773 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11158912}
I20260709 13:02:09.650373  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 842) took 1224 ms. Trace:
I20260709 13:02:09.650838  1544 rpcz_store.cc:276] 0709 13:02:08.426169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.439748 (+ 13579us) service_pool.cc:224] Handling call
0709 13:02:09.622749 (+1183001us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b5800002d98. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc4966f10a0 00007fc4966f0984 00007fc48fc6b6d4 00007fc48fc6b662
0709 13:02:09.650302 (+ 27553us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14805760}
I20260709 13:02:09.612108  7294 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:09.654067  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:09.639930  7305 raft_consensus.cc:697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:02:09.639182  7265 consensus_meta.cc:287] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 1.151s	user 0.011s	sys 0.001s
I20260709 13:02:09.610545  7300 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.647783  7190 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.606595  7049 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.645855  7299 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:09.671829  1543 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:09.672935  7255 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.654856  7235 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:09.677533  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 67279.3us
I20260709 13:02:09.677202  7255 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.671211  7294 raft_consensus.cc:697] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:09.679270  7190 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:09.680416  7312 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:09.681286  6862 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:09.648273  7100 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:02:09.670032  7265 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.666800  7300 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:09.704396  1541 raft_consensus.cc:1240] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:09.705768  7255 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:09.683555  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:09.707712  7049 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:09.683719  1540 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:02:09.713138  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:09.713501  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:09.714488  1693 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:09.674103  7299 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:09.722406  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:09.684446  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:09.731873  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:09.679003  7141 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:09.734078  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:09.686981  1511 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:09.691344  7305 consensus_queue.cc:237] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.693094  7294 consensus_queue.cc:237] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.694242  7164 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.694222  7316 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:09.669756  7302 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:02:09.698421  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 3071) took 1344 ms. Trace:
I20260709 13:02:09.699779  7096 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:09.717259  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:09.717530  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:09.717803  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:09.746799  1618 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:02:09.746968  1544 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:09.719427  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:09.720331  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:09.723353  1689 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:09.732506  1694 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:09.748358  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:09.734972  1693 raft_consensus.cc:2410] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:02:09.749172  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:09.749558  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:09.749841  1689 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:09.742910  1542 rpcz_store.cc:276] 0709 13:02:08.354430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.439077 (+ 84647us) service_pool.cc:224] Handling call
0709 13:02:08.446425 (+  7348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.446746 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:08.498135 (+ 51389us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.975482 (+477347us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.982452 (+  6970us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.009623 (+ 27171us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:09.010022 (+   399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.010465 (+   443us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.621153 (+610688us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:09.698119 (+ 76966us) raft_consensus.cc:1685] finished
0709 13:02:09.698233 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.698360 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51522,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":8924,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":7431,"spinlock_wait_cycles":35209344,"thread_start_us":416903,"threads_started":1,"wal-append.queue_time_us":576442}
I20260709 13:02:09.750347  1693 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 9.
I20260709 13:02:09.750653  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:09.735966  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:09.736665  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 49818us
I20260709 13:02:09.751709  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:09.702934  7265 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:09.751488  1621 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:02:09.741860  7309 raft_consensus.cc:697] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:09.735699  6866 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:09.757428  1511 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:09.758795  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:09.759114  1693 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:09.752580  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:09.753207  1691 raft_consensus.cc:2410] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:02:09.738790  7123 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.737361  7184 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:09.741216  7141 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:09.765348  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:09.795849  1544 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
I20260709 13:02:09.775350  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:09.799932  1587 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:09.767001  7313 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:02:09.765213  7190 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:09.802277  2245 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:09.810191  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:09.746573  7164 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.811997  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:09.813598  1619 raft_consensus.cc:2410] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:02:09.774605  7049 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:09.811385  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:09.767454  6748 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:09.749280  7316 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.765395  7255 consensus_queue.cc:1059] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:02:09.819708  1689 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:09.820093  2242 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:02:09.765188  7096 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:09.823011  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:09.802789  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:09.817377  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:09.825256  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:09.825685  2238 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:09.826282  1585 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.547s (SENT) [suppressed 6 similar messages]
I20260709 13:02:09.802752  7315 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:09.763365  7208 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:02:09.834775  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:09.797565  7100 consensus_queue.cc:1059] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:02:09.835947  2246 raft_consensus.cc:2410] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:02:09.800063  7268 consensus_queue.cc:1059] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:02:09.773137  7123 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.794824  7184 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.820107  6926 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:09.841180  2238 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:09.849848  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:09.765344  6866 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.851719  1587 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:09.852366  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:09.856362  1587 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:09.803905  7309 consensus_queue.cc:237] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.838475  7315 raft_consensus.cc:697] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:09.866218  7235 consensus_queue.cc:1059] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:09.866124  7315 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.867350  7326 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:09.867951  7326 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.868376  7326 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:09.829013  7306 consensus_queue.cc:1059] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:02:09.870294  1587 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:09.872934  6866 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:09.873833  7306 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:09.874959  7076 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:09.876660  1621 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:02:09.877022  1621 pending_rounds.cc:85] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 10
I20260709 13:02:09.877229  1621 pending_rounds.cc:107] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:02:09.877444  1621 raft_consensus.cc:2889] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:09.878101  7300 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.880460  7208 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:09.880990  7208 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:09.859045  1511 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:09.859987  7317 log.cc:927] Time spent T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:09.860615  7316 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:09.861294  7123 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:09.902855  1694 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
I20260709 13:02:09.917958  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:09.919111  7208 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:09.919696  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:09.924782  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:09.935168  1619 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:09.936256  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:09.932857  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:09.933105  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:09.858912  6926 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:09.937302  1693 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:09.956461  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:09.938604  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:09.939040  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:09.849207  7187 consensus_queue.cc:1059] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:02:09.964833  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:09.927933  7268 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:09.921804  7300 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:09.963681  1587 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:02:09.979084  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 152169us
I20260709 13:02:09.980058  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:09.967147  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:09.981710  1694 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:09.974867  7299 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:09.976441  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:09.977034  1619 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 18: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:09.964913  7245 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:09.958618  6926 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:10.152318  6926 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:10.157012  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:09.984527  7235 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:10.108520  7184 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:10.128923  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:09.964084  7076 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:10.015460  7208 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:10.039830  7301 log.cc:927] Time spent T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:09.935052  7100 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 13:02:10.041733  7292 log.cc:927] Time spent T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:09.981353  7337 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:10.046939  1687 raft_consensus.cc:2393] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 12: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:10.139040  7195 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:10.137764  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 157738us
I20260709 13:02:10.142207  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:09.936717  7096 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:02:10.000270  1694 raft_consensus.cc:2410] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:02:10.111828  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:10.143499  6958 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:10.130699  6875 raft_consensus.cc:3055] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:10.121857  7023 leader_election.cc:290] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:10.127957  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.192550  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.120100  7194 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:10.193660  7194 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:10.195663  7061 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:10.131546  7049 raft_consensus.cc:3055] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:10.135726  7338 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:10.146275  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:09.965408  7134 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:09.931388  7255 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:02:10.147637  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:10.178735  7076 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:10.202147  2242 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:10.203709  7076 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:10.147912  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 843) took 1721 ms. Trace:
I20260709 13:02:10.207388  1538 rpcz_store.cc:276] 0709 13:02:08.426455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.467951 (+ 41496us) service_pool.cc:224] Handling call
0709 13:02:08.468232 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.572344 (+104112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.572383 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:08.572438 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:08.572481 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.147627 (+1575146us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54003c46d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:10.147699 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.147859 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238891776}
I20260709 13:02:10.210254  7299 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:10.213788  7326 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:10.214970  1621 raft_consensus.cc:2393] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 10: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:10.192226  6875 raft_consensus.cc:740] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:10.216013  6875 consensus_queue.cc:260] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:10.217147  6875 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:10.218276  7190 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.218729  7190 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:10.198945  7049 raft_consensus.cc:740] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:10.220338  7049 consensus_queue.cc:260] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:10.221288  7049 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:10.224696  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:10.227325  7338 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:10.229456  7338 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:10.230660  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:10.231300  2241 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:02:10.231717  7173 raft_consensus.cc:3055] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:10.232116  7173 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:10.232988  1622 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:10.232928  7173 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:10.150442  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:10.225879  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:10.160398  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:10.171936  1544 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
I20260709 13:02:10.159991  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:10.184746  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:10.188299  1614 raft_consensus.cc:2393] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 20: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:10.171458  7235 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.160568  7164 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:10.168423  7315 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:10.198422  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:10.172977  6866 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:10.333590  2243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 1166) took 1843 ms. Trace:
I20260709 13:02:10.340968  2243 rpcz_store.cc:276] 0709 13:02:08.490714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.491098 (+   384us) service_pool.cc:224] Handling call
0709 13:02:08.506485 (+ 15387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.634675 (+1128190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.333322 (+698647us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54006a0ed4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:10.333524 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2541133184}
I20260709 13:02:10.234896  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:10.266714  2242 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 20.
I20260709 13:02:10.342263  1616 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:10.342056  1620 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 18: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:10.267970  2210 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:10.345562  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:10.347415  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:10.361315  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:10.187116  7337 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:10.361855  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:10.312674  7178 raft_consensus.cc:3055] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:02:10.282675  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 100805us
I20260709 13:02:10.234926  1586 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:10.236606  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:10.363009  1691 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
W20260709 13:02:10.337014  7334 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
W20260709 13:02:10.365098  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 97219.2us
I20260709 13:02:10.377573  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:10.378245  1620 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:10.236267  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:10.332504  6871 raft_consensus.cc:3055] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:10.341650  7235 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:10.195710  7194 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:10.311682  7256 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:10.327916  7134 raft_consensus.cc:697] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:02:10.379812  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 144938us
I20260709 13:02:10.367619  7337 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:10.366673  7164 raft_consensus.cc:2764] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:02:10.385882  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:10.387153  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:10.390969  7186 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:10.381155  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:10.436327  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:10.425499  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 82606.5us
I20260709 13:02:10.346446  7315 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:10.381349  1587 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:10.384735  2210 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:10.397444  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:10.403208  7326 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:10.379976  6871 raft_consensus.cc:740] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:10.406152  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:10.441308  1538 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:02:10.441727  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 57076.1us
I20260709 13:02:10.445832  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:10.370467  7178 raft_consensus.cc:740] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:10.405536  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 1178) took 1952 ms. Trace:
W20260709 13:02:10.442850  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 61570.1us
I20260709 13:02:10.312333  7190 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:10.449277  1540 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 19: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:10.456244  1616 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:10.458814  1617 rpcz_store.cc:276] 0709 13:02:08.453536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.533111 (+ 79575us) service_pool.cc:224] Handling call
0709 13:02:08.533437 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.685408 (+151971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.685452 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:08.685506 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:08.685553 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.405324 (+1719771us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400202bd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:10.405367 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.405481 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348924672}
I20260709 13:02:10.367256  6866 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:10.462078  6925 raft_consensus.cc:3055] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:10.462536  6925 raft_consensus.cc:740] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:10.463457  6925 consensus_queue.cc:260] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:10.464740  6925 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:10.466017  7134 consensus_queue.cc:237] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:10.468850  6871 consensus_queue.cc:260] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:10.470264  6871 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:10.470686  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.476032  7258 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:10.476341  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.494235  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.449808  1620 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:02:10.498950  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:10.499301  1616 raft_consensus.cc:1240] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:02:10.499622  1694 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:10.500192  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 202181us
I20260709 13:02:10.505961  1586 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:02:10.507093  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 57556.4us
I20260709 13:02:10.507259  1694 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:10.444623  7226 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:10.448767  6862 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:10.511768  1620 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:10.525728  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:10.526572  1690 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:10.528324  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:10.536731  1540 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:10.534189  1585 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:10.539345  7127 consensus_queue.cc:1059] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:02:10.562739  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 54025.3us
I20260709 13:02:10.542479  7127 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:02:10.542027  1585 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:10.508311  7226 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:10.574339  2244 raft_consensus.cc:1240] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:10.576905  1585 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:10.485447  6926 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:10.536563  7192 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:10.581910  7123 consensus_queue.cc:1059] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:10.583472  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:10.585057  7344 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:02:10.535743  6862 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:10.569531  6769 consensus_queue.cc:1059] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:02:10.577929  6958 consensus_queue.cc:1059] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:02:10.612918  6862 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:10.561909  7106 raft_consensus.cc:3055] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:10.541128  7061 raft_consensus.cc:2764] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:02:10.528973  7307 consensus_queue.cc:1059] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:02:10.608199  1690 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:10.624420  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:10.541410  7326 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:02:10.615091  1619 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 15: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:10.574651  7186 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:10.578017  7226 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:10.617189  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 1186) took 1028 ms. Trace:
I20260709 13:02:10.606158  7178 consensus_queue.cc:260] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:10.611563  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 44153.6us
I20260709 13:02:10.661226  2209 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:10.646601  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:10.653259  1622 rpcz_store.cc:276] 0709 13:02:09.588292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.589124 (+   832us) service_pool.cc:224] Handling call
0709 13:02:09.589358 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.233417 (+644059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.616886 (+383469us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b54000ad7d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:10.617113 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1479318784}
I20260709 13:02:10.664528  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:10.580798  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:10.653728  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:10.614643  6926 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:10.667852  2209 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:10.667371  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:10.668260  1622 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:02:10.670070  1690 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:10.670185  1622 pending_rounds.cc:85] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 9
I20260709 13:02:10.670532  1622 pending_rounds.cc:107] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:02:10.670404  2209 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:10.670894  1622 raft_consensus.cc:2889] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:10.614355  6866 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:10.632172  7315 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:10.672528  2209 leader_election.cc:304] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:10.668865  7076 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:10.676777  1622 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:02:10.645488  7106 raft_consensus.cc:740] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:10.677130  1622 pending_rounds.cc:85] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 10
I20260709 13:02:10.700960  1622 pending_rounds.cc:107] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:02:10.701263  1622 raft_consensus.cc:2889] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:10.676373  7023 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:10.684216  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:10.692844  1619 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:10.704154  1542 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
W20260709 13:02:10.695307  7311 log.cc:927] Time spent T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 1.233s	user 0.001s	sys 0.005s
I20260709 13:02:10.695513  1618 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:10.696272  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 2735) took 2361 ms. Trace:
I20260709 13:02:10.706526  1622 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:10.696492  2209 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:10.697099  6958 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:10.706355  1615 rpcz_store.cc:276] 0709 13:02:08.335019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.345920 (+ 10901us) service_pool.cc:224] Handling call
0709 13:02:08.346175 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.855578 (+509403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.695942 (+1840364us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b540042ca54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:10.696165 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154781568}
I20260709 13:02:10.671509  7178 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:10.714363  1690 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:02:10.718940  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:10.730085  7049 consensus_meta.cc:287] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
I20260709 13:02:10.731106  7190 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:10.720886  7012 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:10.734581  7012 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:10.734968  7012 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:10.735523  2239 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:10.736186  2239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 1175) took 1018 ms. Trace:
I20260709 13:02:10.736498  2239 rpcz_store.cc:276] 0709 13:02:09.717910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.718055 (+   145us) service_pool.cc:224] Handling call
0709 13:02:09.718295 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.735375 (+1017080us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b54006c0aa0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916a2dc0 00007fc49172d1c0 00007fc49172e231 00007fc49172ad8f 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c
0709 13:02:10.735948 (+   573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.736131 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87923584}
I20260709 13:02:10.721905  7023 raft_consensus.cc:697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:02:10.743930  7208 consensus_meta.cc:287] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.000s
I20260709 13:02:10.744352  7208 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:10.744217  7023 consensus_queue.cc:237] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:10.746521  6862 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:10.742609  7337 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:10.755482  6958 raft_consensus.cc:697] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:10.730940  7106 consensus_queue.cc:260] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:10.756342  1693 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:10.756662  7106 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:10.761142  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.762656  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:10.764043  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 2181) took 1022 ms. Trace:
I20260709 13:02:10.764459  1689 rpcz_store.cc:276] 0709 13:02:09.741301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.750437 (+  9136us) service_pool.cc:224] Handling call
0709 13:02:10.763884 (+1013447us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b54001b7454. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:10.763988 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157388544}
I20260709 13:02:10.765177  7255 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:10.765686  7255 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:10.767004  2211 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:10.768779  7255 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:10.768549  7235 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:10.772616  1687 raft_consensus.cc:1240] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:10.773726  7076 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:10.777267  1695 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:10.756538  6958 consensus_queue.cc:237] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:10.779517  7187 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.780054  7187 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:10.781725  6862 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:10.782447  7187 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:10.783628  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 206759us
I20260709 13:02:10.784703  1585 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:10.785790  1585 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:10.787461  7240 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:10.788125  7240 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:10.789474  7240 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:10.789837  7240 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.790161  7240 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:10.791930  7127 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:10.793064  7192 raft_consensus.cc:697] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:10.794027  7192 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:10.795688  6769 consensus_queue.cc:1243] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:10.796265  6769 raft_consensus.cc:3055] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:10.796571  6769 raft_consensus.cc:740] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:10.797376  6769 consensus_queue.cc:260] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:10.798632  6769 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:10.799378  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 165593us
I20260709 13:02:10.799882  1613 raft_consensus.cc:2368] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17.
I20260709 13:02:10.801594  7235 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:10.804893  7307 raft_consensus.cc:3055] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:10.805292  7307 raft_consensus.cc:740] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:10.806159  7307 consensus_queue.cc:260] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:10.807684  7307 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:10.808643  7325 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:10.810109  7163 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:10.812008  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:10.812603  2239 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:10.817485  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:10.818107  6778 raft_consensus.cc:3055] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:10.818511  6778 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:10.819356  1511 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:10.819288  6778 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:10.820283  7315 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:10.820575  6778 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:10.820966  7315 consensus_queue.cc:1059] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:10.822095  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:10.829681  1585 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:10.830418  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:10.832139  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:10.833437  7137 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:10.834059  6875 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:10.834592  6875 raft_consensus.cc:697] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:10.835621  6875 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:10.838734  7258 raft_consensus.cc:3055] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:10.839443  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:10.840293  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:10.843739  2244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 1173) took 1209 ms. Trace:
I20260709 13:02:10.844273  2244 rpcz_store.cc:276] 0709 13:02:09.633926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.634561 (+   635us) service_pool.cc:224] Handling call
0709 13:02:09.643116 (+  8555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.574938 (+931822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.843442 (+268504us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b5400551254. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:10.843669 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2130971520}
I20260709 13:02:10.849465  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:10.855435  1585 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:10.865041  2239 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:02:10.866221  1585 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:10.870941  7012 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:10.873803  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 156158us
W20260709 13:02:10.874809  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 112186us
I20260709 13:02:10.876674  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:10.878562  1587 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:10.874632  2209 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:10.875828  1660 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:10.891881  1695 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:10.883939  1587 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:10.839152  7258 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:10.897114  1687 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:02:10.897619  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.927717  1441 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42132 (request call id 242) took 28247 ms (client timeout 15000 ms). Trace:
W20260709 13:02:10.929988  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 45896.3us
I20260709 13:02:10.873835  7359 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:10.941474  1620 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 17. Ops: []
I20260709 13:02:10.943115  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 3185) took 1022 ms. Trace:
I20260709 13:02:10.891758  7106 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:10.943884  1613 rpcz_store.cc:276] 0709 13:02:09.920584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.361039 (+440455us) service_pool.cc:224] Handling call
0709 13:02:10.940464 (+579425us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54003205d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:10.943047 (+  2583us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1006728064}
I20260709 13:02:10.891150  7235 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:10.944777  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:10.953914  1695 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:02:10.882962  7208 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:10.927350  7255 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:10.930430  7100 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:10.936527  7195 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:02:10.954802  7356 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:10.943094  7190 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:02:10.943286  6871 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:02:10.965903  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.967224  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.972113  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.972003  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:10.977874  7254 raft_consensus.cc:3055] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:10.978382  7254 raft_consensus.cc:740] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:10.980206  7106 raft_consensus.cc:697] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:10.981241  7106 consensus_queue.cc:237] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:10.883719  7226 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:10.985239  7226 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:10.985704  1696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 2147) took 2647 ms (client timeout 2332 ms). Trace:
I20260709 13:02:10.985973  2245 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: []
W20260709 13:02:10.986166  1696 rpcz_store.cc:269] 0709 13:02:08.337959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.341857 (+  3898us) service_pool.cc:224] Handling call
0709 13:02:10.985461 (+2643604us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b5400449654. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:10.985593 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1476956032}
I20260709 13:02:10.990240  7174 consensus_queue.cc:260] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:10.931928  1441 rpcz_store.cc:269] 0709 13:01:42.635791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.651914 (+ 16123us) service_pool.cc:224] Handling call
0709 13:01:44.207831 (+1555917us) spinlock_profiling.cc:243] Waited 59.2 ms on lock 0x7b540016e4d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491695090 00007fc491733f3a 00007fc4974ea1cc 00007fc4975e837e 00007fc495aa92a4 00007fc495aa9232 00007fc495aa9161 00007fc495aa90dc 00007fc495aa8392 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:10.882757 (+26674926us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:03.293542 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:03.294217 (+   675us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:03.294275 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:02:03.294295 (+    20us) tablet.cc:662] Decoding operations
0709 13:02:03.295464 (+  1169us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:03.295541 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:03.295576 (+    35us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:02:03.296828 (+  1252us) tablet.cc:701] Row locks acquired
0709 13:02:03.296880 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:02:03.297066 (+   186us) write_op.cc:270] Start()
0709 13:02:03.297218 (+   152us) write_op.cc:276] Timestamp: P: 1783602123297003 usec, L: 0
0709 13:02:03.297250 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:02:03.370713 (+ 73463us) log.cc:844] Serialized 5252 byte log entry
0709 13:02:04.495498 (+1124785us) op_driver.cc:464] REPLICATION: finished
0709 13:02:04.995562 (+500064us) write_op.cc:301] APPLY: starting
0709 13:02:05.008643 (+ 13081us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:05.095150 (+ 86507us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:05.106836 (+ 11686us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:05.441626 (+334790us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:05.441997 (+   371us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:02:05.442058 (+    61us) write_op.cc:312] APPLY: finished
0709 13:02:05.442453 (+   395us) log.cc:844] Serialized 121 byte log entry
0709 13:02:05.442634 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:05.442788 (+   154us) write_op.cc:454] Released schema lock
0709 13:02:05.442859 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:05.445995 (+  3136us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:05.446029 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":655502,"reported_tablets":50,"spinlock_wait_cycles":136230656,"child_traces":[["op",{"apply.queue_time_us":494770,"apply.run_cpu_time_us":21550,"apply.run_wall_time_us":447747,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58571,"num_ops":13,"prepare.queue_time_us":305417,"prepare.run_cpu_time_us":12733,"prepare.run_wall_time_us":194170,"raft.queue_time_us":236670,"raft.run_cpu_time_us":166249,"raft.run_wall_time_us":414157,"replication_time_us":1193336,"thread_start_us":786332,"threads_started":4,"wal-append.queue_time_us":244779,"wal-append.run_cpu_time_us":24440,"wal-append.run_wall_time_us":2840621}]]}
W20260709 13:02:10.993356  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 107731us
I20260709 13:02:10.998440  7174 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:11.008066  1512 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:10.956468  7235 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.013130  1585 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:11.014515  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:11.015527  1620 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:10.961663  6900 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.025658  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:11.030326  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.037122  1585 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:11.051424  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:11.068730  1585 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:11.073541  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:11.076205  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:11.077292  1694 raft_consensus.cc:2393] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 13: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:11.080889  1620 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
I20260709 13:02:10.965188  7195 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:11.092757  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 218216us
I20260709 13:02:10.954512  7083 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:02:10.967854  7255 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:11.102998  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:11.099858  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:10.955111  7171 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
W20260709 13:02:11.111778  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 176731us
I20260709 13:02:11.059777  7235 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:11.126350  1585 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:02:11.096563  7358 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:02:11.091379  7304 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:11.061470  6958 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.127676  7123 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:11.127930  6958 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.129907  2210 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:11.131294  6958 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:11.132933  7134 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:11.133432  7134 raft_consensus.cc:697] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:11.135057  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:11.136906  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:11.134299  7134 consensus_queue.cc:237] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.139642  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:11.141744  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:11.144927  1586 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:11.087895  7049 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:11.098791  7359 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:11.117076  7356 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:02:11.149310  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 141291us
I20260709 13:02:11.102255  7163 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:11.090530  7208 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:11.101557  7307 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:11.102386  7192 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:11.148672  1585 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:11.099076  7195 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:11.023801  6862 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 13:02:11.158584  1512 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:11.212750  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 2749) took 1058 ms. Trace:
W20260709 13:02:11.213253  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 64652us
I20260709 13:02:11.026757  6871 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.160466  7163 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:11.154434  7338 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:11.162276  7255 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:11.162919  7360 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 13:02:11.165932  7327 log.cc:927] Time spent T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 1.058s	user 0.004s	sys 0.000s
W20260709 13:02:11.167598  7357 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:02:11.059330  7254 consensus_queue.cc:260] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.097007  6900 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.148191  7012 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:11.010937  7258 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.155179  6866 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:11.160517  7290 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:02:11.228766  7163 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:11.213222  1614 rpcz_store.cc:276] 0709 13:02:10.154428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.488394 (+333966us) service_pool.cc:224] Handling call
0709 13:02:10.729342 (+240948us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b58000f9998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc496704fc0 00007fc4966ef929 00007fc4966ef3d2 00007fc48fc66bd4
0709 13:02:10.729516 (+   174us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:10.812469 (+ 82953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:10.812501 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:10.813020 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.890853 (+ 77833us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:11.086176 (+195323us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.100513 (+ 14337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.100617 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.185541 (+ 84924us) raft_consensus.cc:1685] finished
0709 13:02:11.212490 (+ 26949us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.212690 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96514,"prepare.queue_time_us":66781,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":103009,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":16594,"spinlock_wait_cycles":17982848,"thread_start_us":270319,"threads_started":2,"wal-append.queue_time_us":303798}
I20260709 13:02:11.226182  7127 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:02:11.230893  7363 log.cc:927] Time spent T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:02:11.258215  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:11.222334  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 63931.3us
I20260709 13:02:11.271270  1512 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:11.210969  7208 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.262823  7368 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:11.261202  7315 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:11.285054  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:11.286211  1616 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
I20260709 13:02:11.287256  1512 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:11.262501  6866 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:11.295284  1694 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
I20260709 13:02:11.296880  1512 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:11.251767  7338 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.299427  7374 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:11.308099  7374 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:11.308413  6871 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:11.308741  7374 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:11.309324  7374 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.279665  7127 raft_consensus.cc:697] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:11.274021  7369 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.314373  1694 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:11.296200  6866 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:11.291519  7371 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:11.296267  7304 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:11.335105  1694 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:11.344537  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 2162) took 1632 ms. Trace:
I20260709 13:02:11.317142  7368 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:11.345362  1692 rpcz_store.cc:276] 0709 13:02:09.711662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.713991 (+  2329us) service_pool.cc:224] Handling call
0709 13:02:09.714309 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.714690 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:09.764649 (+ 49959us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.972533 (+207884us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.973202 (+   669us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.973371 (+   169us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:09.973421 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.973507 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.165400 (+1191893us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:11.327133 (+161733us) raft_consensus.cc:1685] finished
0709 13:02:11.344283 (+ 17150us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.344451 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2261,"prepare.queue_time_us":90942,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":35174,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":14131,"spinlock_wait_cycles":12962176,"thread_start_us":252897,"threads_started":3,"wal-append.queue_time_us":276671}
W20260709 13:02:11.342870  7076 consensus_meta.cc:287] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.000s
I20260709 13:02:11.296986  7315 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.375164  6900 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:11.352900  7374 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:11.323773  7369 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.338832  7195 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.361012  6862 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.364777  7076 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:11.399159  7369 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:11.395375  7373 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:02:11.402632  7208 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:11.409965  7240 consensus_meta.cc:287] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.619s	user 0.011s	sys 0.000s
I20260709 13:02:11.410648  7240 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.411553  7195 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:11.412906  7178 consensus_meta.cc:287] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.691s	user 0.010s	sys 0.000s
I20260709 13:02:11.413623  7240 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:11.416618  7338 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:11.452410   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:11.455492  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 1955) took 3170 ms. Trace:
I20260709 13:02:11.471845  1547 rpcz_store.cc:276] 0709 13:02:08.284297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.287009 (+  2712us) service_pool.cc:224] Handling call
0709 13:02:08.288082 (+  1073us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:08.289929 (+  1847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.289976 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:08.290537 (+   561us) log.cc:844] Serialized 52 byte log entry
0709 13:02:08.574775 (+284238us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:08.931983 (+357208us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.935029 (+  3046us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.935318 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.935413 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.680959 (+745546us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b18002e3d20. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:02:10.834516 (+1153557us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b18002e3d20. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:02:10.956290 (+121774us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b18002e3d20. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:02:11.454433 (+498143us) raft_consensus.cc:1685] finished
0709 13:02:11.454518 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.455114 (+   596us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1380,"prepare.queue_time_us":373626,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":95,"raft.queue_time_us":3022,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":14617,"spinlock_wait_cycles":52371328,"thread_start_us":283790,"threads_started":1,"wal-append.queue_time_us":662067}
W20260709 13:02:11.459846  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 159499us
I20260709 13:02:11.476894  1512 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:11.480118  6778 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.481508  6778 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.487366  6862 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:11.462384  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.496393  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.462556  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:11.365708  7127 consensus_queue.cc:237] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.499980  2239 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:11.504141  2239 raft_consensus.cc:1240] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:11.503690  7123 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:11.507210  7123 consensus_queue.cc:1059] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:11.508724  7123 raft_consensus.cc:3055] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:11.508852  6871 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:11.509291  7123 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:11.509825  6871 raft_consensus.cc:697] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 21 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:11.511744  7061 raft_consensus.cc:3055] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:02:11.512200  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.512372  7061 raft_consensus.cc:740] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:11.515763  7123 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.514406  7061 consensus_queue.cc:260] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.518170  7061 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:11.518339  7123 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:11.516162  6871 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.520133  7255 consensus_queue.cc:1059] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:11.522271  7255 raft_consensus.cc:3055] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:11.522807  7255 raft_consensus.cc:740] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:11.524781  7235 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.525020  7255 consensus_queue.cc:260] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.528640  7255 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:11.537029  7371 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:11.534690  7384 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:11.538347  7235 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:11.538811  7384 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.542716  7384 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:11.550140  7383 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.551517  7383 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.561517  7383 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:11.554524  7254 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:11.557065  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.557710  6778 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:11.558414  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 82047.4us
W20260709 13:02:11.558630  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.571871  7378 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.572803  7378 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:11.575330  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.578986  7378 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:11.595757  7383 consensus_queue.cc:1059] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:11.598145  7383 raft_consensus.cc:3055] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:11.598714  7383 raft_consensus.cc:740] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:11.616564  1622 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:02:11.616792  2238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45882 (request call id 986) took 1735 ms. Trace:
I20260709 13:02:11.617151  2238 rpcz_store.cc:276] 0709 13:02:09.881151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.916064 (+ 34913us) service_pool.cc:224] Handling call
0709 13:02:10.697287 (+781223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:10.697651 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:10.697679 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:10.705842 (+  8163us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.821889 (+116047us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:10.821926 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.821986 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.167095 (+345109us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:11.291829 (+124734us) raft_consensus.cc:1685] finished
0709 13:02:11.291849 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.616404 (+324555us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b54004f1d50. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:11.616604 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10725,"raft.queue_time_us":2009,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":11117,"spinlock_wait_cycles":1828288640,"thread_start_us":115758,"threads_started":1,"wal-append.queue_time_us":249466}
I20260709 13:02:11.610740  1444 catalog_manager.cc:5697] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.634594  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:11.622992  6769 consensus_meta.cc:287] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.824s	user 0.011s	sys 0.011s
I20260709 13:02:11.641144  7178 consensus_queue.cc:1059] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:11.643929  7369 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:11.644732  7369 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.645870  7383 consensus_queue.cc:260] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.642517  7371 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:11.647305  7337 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:11.656183  7106 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:11.636013  1444 catalog_manager.cc:5697] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.664796  7163 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.667934  6862 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:11.670951  1614 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:11.648224  7371 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.681874  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:11.671636  7369 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:11.685030  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:11.682977  7049 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.698407  7379 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:11.695588  7106 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.699996  7315 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:11.700897  7364 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.543s	user 0.000s	sys 0.007s
I20260709 13:02:11.694063  7049 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.694480  7383 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:11.710268  7342 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.711042  7342 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.712097  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:11.707679  1512 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:11.719798  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.720399  7379 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:11.714455  7295 consensus_queue.cc:1059] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:11.720337  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.722087  1540 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:11.723166  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:11.723852  1538 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:11.724135  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.724651  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.724851  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.725492  1544 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:11.726763  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.727128  1543 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:11.727610  1539 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:11.728091  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:11.728829  1539 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:11.729764  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:11.731106  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.731599  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.732110  1545 raft_consensus.cc:2393] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 13: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:11.732962  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.733703  1547 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 9.
I20260709 13:02:11.734772  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.735692  1546 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:11.735790  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:11.737102  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.737756  1546 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:02:11.738245  1659 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:11.740078  1691 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:11.740789  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:11.741708  1696 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:11.741916  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:11.744854  7378 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:11.707199  7106 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:11.747463  1659 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:11.748155  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.748528  7178 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.748848  1544 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:11.749331  7208 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:11.749401  7178 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.721977  7379 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:11.752028  7379 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:11.720496  1542 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:02:11.739718  7190 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:11.749990  7208 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:11.751055  6871 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:11.713860  1622 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:02:11.730939  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.729219  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.716586  7371 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:11.751113  1659 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:11.752205  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 53976.7us
I20260709 13:02:11.713673  7342 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:11.732934  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.763015  1539 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:02:11.724236  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.770386  1547 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 13: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:11.773351  7342 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:11.774071  7389 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:02:11.774214  7342 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:11.774875  7342 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:11.777465  7285 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:11.779515  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:11.779764  7315 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.780359  1545 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:02:11.782186  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 1199) took 1158 ms. Trace:
I20260709 13:02:11.782352  1659 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:11.783385  1618 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:11.783720  1540 raft_consensus.cc:2393] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 19: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:11.780402  7315 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.756640  7178 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:11.764683  7208 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:11.785893  6871 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:11.773543  7049 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:11.801247  7371 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.834600  7371 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.787853  2211 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:11.788102  7190 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:11.787205  7163 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:11.789155  7385 raft_consensus.cc:3055] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:11.837616  7385 raft_consensus.cc:740] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:11.837831  7163 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:11.838658  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.788942  1622 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:11.790902  1615 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:11.839071  7385 consensus_queue.cc:260] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.827312  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:11.804746  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.802701  7342 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.804805  7374 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:11.804885  7369 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:11.782652  1619 rpcz_store.cc:276] 0709 13:02:10.623945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.704371 (+ 80426us) service_pool.cc:224] Handling call
0709 13:02:10.704626 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.492187 (+787561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.492246 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.492335 (+    89us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:11.492378 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.781774 (+289396us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b54002030d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:11.781814 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.781991 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4550,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":260,"spinlock_wait_cycles":1809116544}
I20260709 13:02:11.805365  7367 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.831576  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:11.832331  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:11.833128  7173 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:11.805128  7100 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.839321  1545 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:11.870368  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:11.872028  7385 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:11.872144  1545 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:11.872416  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:11.872906  7100 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.873504  7369 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:11.837970  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 50293.9us
I20260709 13:02:11.813476  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:11.814493  1691 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:11.816717  1694 raft_consensus.cc:1240] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:11.813076  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:11.821990  1660 leader_election.cc:400] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17.
I20260709 13:02:11.812896  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:11.819988  1539 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:11.770080  1444 catalog_manager.cc:5697] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 13 to 14, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.819783  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:11.814332  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:11.815171  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:11.900255  1587 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:11.906293  1538 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:11.905872  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.820654  7258 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:11.816342  7384 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:02:11.923717  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.924114  7384 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.926885  7384 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:11.914029  7374 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.927356  7371 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:11.928232  2210 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:11.928933  7374 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:11.914031  7170 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:02:11.930003  7303 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:11.930266  6958 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:11.914285  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:11.919922  1541 raft_consensus.cc:2410] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:11.932255  1539 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:11.933651  7100 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:11.918934  7378 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:11.920207  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 98539.9us
I20260709 13:02:11.935570  1688 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:11.935938  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:11.937378  7342 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:11.937690  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:11.938158  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:11.938786  1541 raft_consensus.cc:3060] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:11.939388  7337 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:11.940136  7190 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:11.940223  7337 consensus_queue.cc:1059] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:11.941578  7337 raft_consensus.cc:3055] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:11.941773  1689 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:11.941978  7337 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:11.943992  7309 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:11.944218  7254 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:11.888206  7369 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:11.924543  7315 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:11.945509  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 54389.6us
I20260709 13:02:11.948196  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.930998  6958 consensus_queue.cc:1243] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:11.919413  1444 catalog_manager.cc:5697] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 14 to 16, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:11.950436  1587 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:11.952844  1545 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:11.811079  6866 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.865535  7379 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.930437  7303 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.959692  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:11.961670  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:11.950121  7170 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:11.967478  7170 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.967859  7170 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:11.943008  7337 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.969615  7337 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:11.973161  6866 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:11.974152  7192 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.975193  7208 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:11.974944  7192 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.978471  7192 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:11.978895  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:11.979521  1538 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:11.982712  1539 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:11.985659  1614 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:11.986847  1544 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:02:11.988143  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:11.989578  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:11.990181  1687 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:02:11.993000  7137 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:11.995338  7184 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:11.996712  7184 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.997169  7184 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:11.998248  1618 raft_consensus.cc:1217] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 9.8->[11.9-16.12]   Dedup: 12.10->[15.11-16.12]
I20260709 13:02:11.998767  1618 pending_rounds.cc:85] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 10
I20260709 13:02:11.999048  1618 pending_rounds.cc:107] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:02:11.999375  1618 raft_consensus.cc:2889] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:11.997193  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:12.004839  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:12.005885  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:12.006830  1659 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:12.007665  7378 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:12.007943  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:12.008443  1659 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:12.008325  7378 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:12.009898  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:12.010615  7378 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:12.011121  1695 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:12.007035  2245 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:11.987185  1544 pending_rounds.cc:85] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 6
I20260709 13:02:12.016059  1544 pending_rounds.cc:107] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:02:12.016326  1544 raft_consensus.cc:2889] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:12.018097  7342 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:12.019539  7338 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:12.019976  7338 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:12.020363  7338 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:12.006873  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:12.005780  2238 raft_consensus.cc:1240] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:12.024205  1541 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:02:12.026227  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:12.026842  1545 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:11.890007  7367 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:12.032061  1547 raft_consensus.cc:1240] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:02:12.037432  1538 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
I20260709 13:02:12.042932  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:12.044353  7190 consensus_queue.cc:1059] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:12.049912  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:12.021313  7303 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:12.051620  1695 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:12.052747  1543 raft_consensus.cc:2393] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:12.044410  1541 raft_consensus.cc:1275] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:12.058240  1659 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:12.064719  7367 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:12.039132  7378 consensus_queue.cc:1059] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:02:12.068039  7170 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:12.070226  7170 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:12.071350  1659 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:12.071990  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.072240  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:12.077600  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:12.079541  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.080283  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.081523  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.082276  1621 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 19: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:12.082998  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.084252  2209 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:12.084575  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.085682  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.086318  7254 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:12.086818  7379 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:12.087723  1539 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:12.089948  1539 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:12.091900  1541 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:12.092693  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.093441  1616 raft_consensus.cc:2393] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 20: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:12.053803  1587 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:12.083735  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:12.086838  1621 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:12.058370  7184 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:12.101248  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.083746  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.102428  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.102555  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.102826  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.103462  1613 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:12.109752  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.115880  1689 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:12.126861  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:12.129087  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.098469  7170 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:12.096030  7123 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.136119  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:12.136883  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.136119  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:12.140456  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:12.141757  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:12.142427  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:12.136066  7383 consensus_queue.cc:1059] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:02:12.143996  7367 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:12.144580  7379 consensus_queue.cc:1059] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:12.146368  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:02:12.149820  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.150626  1688 raft_consensus.cc:1240] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:12.150846  1542 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 17. Current term is 18. Ops: [16.12-17.13]
I20260709 13:02:12.151273  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.155665  1614 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:12.157944  1511 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:12.199039  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:12.199100  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.191676  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:12.202371  1543 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:12.199811  1546 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:02:12.207566  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:12.169840  7170 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.160360  1585 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:12.169094  1547 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:12.172111  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:12.171646  1444 catalog_manager.cc:5697] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 13 to 14, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.170954  2245 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:02:12.172559  6871 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:12.225826  1622 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:12.225767  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:12.190798  7208 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:12.232290  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:12.233860  1695 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:02:12.236294  1617 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:02:12.236855  7208 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.236856  1444 catalog_manager.cc:5697] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.203054  6769 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:02:12.238153  7208 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:12.238238  6866 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:12.239411  6866 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:12.239799  6866 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:12.241217  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 81089us
I20260709 13:02:12.241789  7385 consensus_queue.cc:1059] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:12.242268  1585 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:12.244771  1444 catalog_manager.cc:5697] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 6 to 9, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:12.246826  1444 catalog_manager.cc:5697] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 11 to 12, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:12.241320  7342 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:12.186487  7123 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:12.211658  7163 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:12.247529  7106 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:12.229771  2209 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:12.237295  6958 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.225770  7170 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:12.300802  7208 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:12.300968  6871 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:12.301559  6871 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.302064  6871 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:12.304391  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 146524us
I20260709 13:02:12.305585  1511 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:12.306396  7385 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:12.307839  2239 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:02:12.308441  7184 consensus_queue.cc:1059] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:12.309655  7184 raft_consensus.cc:3055] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:12.275269  7258 consensus_queue.cc:1059] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:02:12.310154  7184 raft_consensus.cc:740] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:12.307024  1511 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:12.312227  1613 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:02:12.297726  6866 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:12.276952  1542 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:02:12.289494  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 88499.8us
I20260709 13:02:12.290081  7309 raft_consensus.cc:2804] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:12.285660  1512 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:12.293910  7384 raft_consensus.cc:3055] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:12.159978  1545 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:12.317001  1547 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:12.311661  7100 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:12.246976  7303 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:12.327642  1511 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:12.301532  7208 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:12.328142  1512 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:12.333438  1622 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:12.335616  1511 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:12.344038  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 101886us
I20260709 13:02:12.344081  2209 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:12.318301  7384 raft_consensus.cc:740] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:12.324009  1444 catalog_manager.cc:5697] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index 3 to 10, term changed from 12 to 14, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194), VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New cstate: current_term: 14 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.337221  7379 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:12.334649  7309 raft_consensus.cc:697] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:12.343024  7385 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:12.335068  7208 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:12.343252  7315 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:12.314980  6958 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:12.368201  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:12.350626  7378 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.371681  7385 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:12.376906  7384 consensus_queue.cc:260] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:12.378590  7245 consensus_queue.cc:1048] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:02:12.388340  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 317089us
I20260709 13:02:12.313334  7184 consensus_queue.cc:260] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:12.379997  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:12.360314  7137 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:12.356810  7258 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:12.360036  7379 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.388552  7385 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:12.418917  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 50787.4us
I20260709 13:02:12.385326  7208 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:12.416977  7378 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:12.428249  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:12.417577  7384 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:12.430378  6875 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:12.437644  1444 catalog_manager.cc:5697] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:12.373353  7338 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:12.424474  7100 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:12.454881  1689 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:12.457335  1659 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:12.459355  1585 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:12.409777  7106 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:02:12.462088  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:12.469795  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:12.444470  7315 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:12.427040  7379 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:12.481736  7307 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:12.459522  7184 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:12.471740  7190 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:12.472564  7106 consensus_queue.cc:1243] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:02:12.475445  1444 catalog_manager.cc:5697] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 14 to 15, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:12.519583  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 94176us
I20260709 13:02:12.520365  1585 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:12.521612  1585 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:02:12.524418  7402 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:02:12.527633  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 96151.4us
I20260709 13:02:12.528626  1659 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:12.537328  1543 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:12.467113  7309 consensus_queue.cc:237] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:12.539651  1659 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:12.543279  7369 raft_consensus.cc:3055] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:12.530169  1444 catalog_manager.cc:5697] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 9 to 10, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:12.509321  6875 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.544425  7408 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:12.502722  6866 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:12.554322  1538 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:02:12.503043  7190 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:12.529209  7303 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:12.583580  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 47941.2us
W20260709 13:02:12.591400  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.592718  7405 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:12.583547  7190 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:12.600136  7378 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:12.570281  7408 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:12.601166  7408 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:12.603158  7385 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:12.607748  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:12.572672  6875 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:12.571061  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 197005us
I20260709 13:02:12.559264  7369 raft_consensus.cc:740] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:12.651213  1660 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:12.677129  1444 catalog_manager.cc:5697] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 6 to 9, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.681951  7406 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:12.683286  7385 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:12.684226  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 144679us
W20260709 13:02:12.684693  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 44755.8us
I20260709 13:02:12.685034  1659 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:12.602957  7379 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:12.612473  6866 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:12.684744  7342 raft_consensus.cc:3055] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:12.701575  1444 catalog_manager.cc:5697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 9 to 12, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:12.702575  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 335925us
I20260709 13:02:12.708782  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:12.706573  6958 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:12.704016  7342 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:12.723138  7106 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:12.732892  7338 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:12.738214  7378 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:12.754669  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 233213us
W20260709 13:02:12.724745  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 223864us
W20260709 13:02:12.779198  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 70399.5us
I20260709 13:02:12.780390  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:12.802333  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:12.758440  7385 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:12.762573  7399 log.cc:927] Time spent T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:02:12.756078  7378 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:12.753832  7170 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:12.758273  7106 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:12.807619  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 122839us
I20260709 13:02:12.811223  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.819085  1622 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:02:12.813529  7255 raft_consensus.cc:3055] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:12.820930  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:12.802429  7414 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:12.822886  1613 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:12.822463  1511 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:12.816756  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 111720us
I20260709 13:02:12.822422  1585 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:12.832743  7190 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:12.835172  7420 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:02:12.831043  7404 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:02:12.846027  7385 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:12.847074  7170 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:12.830192  7417 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.848357  6875 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:12.842350  1616 raft_consensus.cc:2393] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:12.814922  7384 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:12.848429  7417 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:12.822880  7418 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 13:02:12.851029  7190 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:12.823846  7106 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:12.855547  6866 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:12.851125  7417 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:12.858541  7405 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:12.859992  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:12.861411  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:12.816665  7378 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:12.839084  6871 consensus_meta.cc:287] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.536s	user 0.013s	sys 0.000s
I20260709 13:02:12.802552  7302 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.191s
I20260709 13:02:12.845187  7420 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:12.845705  7422 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:02:12.845376  7436 consensus_queue.cc:1059] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:02:12.807845  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 121264us
I20260709 13:02:12.873847  1511 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:12.820927  7255 raft_consensus.cc:740] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:12.930469  1613 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
I20260709 13:02:12.936424  1585 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:02:12.938030  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.840801  7414 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:02:12.939625  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 65862.5us
W20260709 13:02:12.942140  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 86289.7us
I20260709 13:02:12.945643  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:12.827559  7383 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.114s
I20260709 13:02:12.805599  7342 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:12.944262  7315 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:12.803189  7369 consensus_queue.cc:260] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:12.929711  7384 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:12.930122  7385 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:12.958559  1622 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:02:12.958372  7315 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.964586  7315 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:12.963958  7255 consensus_queue.cc:260] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:12.965338  7255 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:12.972095  2246 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:02:12.973271  7421 log.cc:927] Time spent T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:02:12.982956  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 297958us
I20260709 13:02:12.983862  1613 raft_consensus.cc:2368] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17.
I20260709 13:02:12.949092  7414 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:12.960777  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:12.949285  7379 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:12.875286  6871 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:12.988466  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:13.001799  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:02:13.005614  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 69283.4us
I20260709 13:02:12.945030  7163 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
W20260709 13:02:13.007510  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 45113.7us
W20260709 13:02:13.010311  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 52879.1us
I20260709 13:02:12.985486  7369 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.011315  1618 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:13.013643  7385 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.987556  7170 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:13.021564  1659 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:13.003141  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 48600.2us
I20260709 13:02:13.022773  1660 leader_election.cc:400] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17.
I20260709 13:02:13.027585  1660 leader_election.cc:403] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:02:13.035353  7425 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:02:13.037370  7432 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:02:13.040387  1585 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:13.000397  7436 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:02:13.055462  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:13.058764  7434 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:13.063834  7428 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:02:13.097903  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:13.044221  7379 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.051977  7405 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:13.072741  7137 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.012s	sys 0.017s
W20260709 13:02:13.103752  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 75176.6us
I20260709 13:02:13.098950  2244 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:02:13.051442  7170 raft_consensus.cc:697] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:13.043709  7385 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.051636  7432 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.057s
W20260709 13:02:13.109203  7137 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.013s	sys 0.017s
I20260709 13:02:13.101424  7258 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.110996  7123 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:13.120829  7137 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:13.131487  7170 consensus_queue.cc:237] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.132306  7137 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:13.135478  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 124695us
I20260709 13:02:13.116925  7423 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:13.122175  7432 consensus_queue.cc:1243] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:02:13.163663  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40034 (request call id 3207) took 1019 ms. Trace:
I20260709 13:02:13.169437  1511 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:13.152158  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 1223) took 1355 ms. Trace:
I20260709 13:02:13.169440  1616 rpcz_store.cc:276] 0709 13:02:12.144639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.150977 (+  6338us) service_pool.cc:224] Handling call
0709 13:02:13.163445 (+1012468us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b5400087854. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:13.163602 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1489269504}
I20260709 13:02:13.174686  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:13.168540  2210 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:13.180752  1660 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:02:13.158495  7419 log.cc:927] Time spent T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
W20260709 13:02:13.150259  7208 consensus_meta.cc:287] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.687s	user 0.006s	sys 0.002s
I20260709 13:02:13.194505  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:13.195676  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:13.115077  7379 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:13.199548  1691 raft_consensus.cc:1240] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:13.200256  1511 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:13.124344  7258 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.121025  7315 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:13.182847  6875 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:13.172683  1620 rpcz_store.cc:276] 0709 13:02:11.796817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.796944 (+   127us) service_pool.cc:224] Handling call
0709 13:02:11.875504 (+ 78560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.876000 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.876027 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.922861 (+ 46834us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.355466 (+432605us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:12.355505 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.355567 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.597688 (+242121us) raft_consensus.cc:1685] finished
0709 13:02:12.597719 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.151773 (+554054us) spinlock_profiling.cc:243] Waited 78.2 ms on lock 0x7b5400086450. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:13.151989 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":13827,"spinlock_wait_cycles":179896576,"thread_start_us":329159,"threads_started":1,"wal-append.queue_time_us":643719}
I20260709 13:02:13.160750  7383 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.201900  1695 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:13.202731  1615 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:13.202984  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:13.139290  7423 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:13.167768  7420 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:13.208354  7417 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:13.209504  7379 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:13.204402  7437 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.213477  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:13.238008  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.196091  7440 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:13.239778  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:13.240564  1618 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.203751  7100 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:13.211385  7423 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:13.214375  7417 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.253528  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:13.266420  1691 raft_consensus.cc:2393] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 15: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:13.201877  7208 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.244379  7440 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:13.263378  7408 consensus_meta.cc:287] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.662s	user 0.011s	sys 0.001s
I20260709 13:02:13.259150  7190 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:13.215185  7383 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.278417  1695 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
W20260709 13:02:13.273207  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 86681.8us
I20260709 13:02:13.268069  7417 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.279265  1616 pending_rounds.cc:85] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 14
I20260709 13:02:13.286237  1616 pending_rounds.cc:107] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:02:13.286628  1616 raft_consensus.cc:2889] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:13.284071  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:13.288594  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:13.273296  7440 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:13.284372  7123 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:13.308004  7123 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.312037  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:13.254395  7437 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:13.321617  7184 consensus_meta.cc:287] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.818s	user 0.010s	sys 0.000s
W20260709 13:02:13.323010  7447 log.cc:927] Time spent T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:02:13.323944  7258 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:13.282009  7408 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:13.332211  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.368214  1659 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:13.379558  7400 log.cc:927] Time spent T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:13.379822  1690 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:13.380755  7408 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:13.382215  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 73034.9us
I20260709 13:02:13.382019  7338 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:13.400974  1659 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:13.367611  7049 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:02:13.408209  7401 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:13.382055  7437 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:13.425971  7453 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:13.428469  7208 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:13.440963  7446 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.328s	user 0.002s	sys 0.002s
I20260709 13:02:13.443358  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:13.493294  1695 raft_consensus.cc:2410] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:02:13.493898  2245 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:13.494006  7409 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:13.495841  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 108441us
I20260709 13:02:13.328627  7414 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:13.497125  1693 raft_consensus.cc:1240] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:13.492624  7258 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:13.498272  7414 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:13.498183  7258 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.487895  7049 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.500248  7258 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:13.454352  7342 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:13.456490  7315 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:13.456804  7454 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:02:13.382670  7385 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:13.490978  7378 consensus_meta.cc:287] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.002s
I20260709 13:02:13.462414  7405 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17.
W20260709 13:02:13.464962  7452 log.cc:927] Time spent T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:02:13.487778  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:13.447500  7383 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:13.501547  1659 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:13.505156  1618 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
W20260709 13:02:13.506028  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 293748us
I20260709 13:02:13.512351  7434 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:13.535660  7406 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.540314  7406 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.542631  7406 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:13.521950  7369 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:13.543391  7049 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:13.543663  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:13.543603  7369 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.535358  7405 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.544569  1538 raft_consensus.cc:2368] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17.
I20260709 13:02:13.544834  7123 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:13.544780  7405 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.545542  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:13.546135  7369 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:13.546411  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:13.546945  7405 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:13.549229  1660 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:13.549336  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:13.549978  6871 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:13.550225  1694 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:13.550087  7190 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:13.550599  6871 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:13.550773  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:13.551261  6871 raft_consensus.cc:697] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:13.551398  1618 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:13.550092  1620 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:13.552682  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:13.546131  1541 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:13.523423  7258 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:13.525453  7208 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:13.558496  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:13.563735  1544 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.560722  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:13.564605  1545 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:13.562240  1659 leader_election.cc:400] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17.
W20260709 13:02:13.557214  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.024s	sys 0.025s
W20260709 13:02:13.567389  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.024s	sys 0.025s
W20260709 13:02:13.568135  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 527833us
I20260709 13:02:13.568996  1585 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:13.522723  7378 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.538059  7383 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.571764  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:13.573469  1660 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:13.574920  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:13.579859  1542 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:13.575799  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:13.574379  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:13.581825  1543 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:13.560707  7190 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:13.584618  1540 raft_consensus.cc:2368] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19.
I20260709 13:02:13.533927  7338 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:02:13.552175  6871 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.592085  1696 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:13.593113  1585 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:13.589197  7190 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:13.599443  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 452155us
W20260709 13:02:13.600314  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 431783us
I20260709 13:02:13.587905  7405 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:13.606103  1689 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:13.610845  1544 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:13.613247  7416 consensus_queue.cc:1059] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:02:13.597630  7074 raft_consensus.cc:3055] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:13.614283  7074 raft_consensus.cc:740] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:13.602414  7418 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:13.595443  7049 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:13.619700  7418 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.620225  7415 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.620005  7049 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:13.620873  7415 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:13.620234  7418 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.622579  7049 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:13.595193  7439 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.113s
I20260709 13:02:13.626271  7439 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:13.626642  7439 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:13.627492  7439 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:13.628381  1585 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:13.628571  7106 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:13.629033  7465 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:13.629817  7465 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:13.629910  1511 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:13.630476  7465 raft_consensus.cc:697] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:13.631340  7405 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.631641  7462 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:13.632025  7405 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:13.608515  7190 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:13.620000  7468 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:02:13.600436  7369 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:13.636241  7369 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:13.638654  7369 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:13.628394  7417 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:13.629341  7184 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:02:13.628727  7439 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:13.631440  7465 consensus_queue.cc:237] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.632261  7462 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:13.635489  7049 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:13.642271  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 453626us
I20260709 13:02:13.641463  7417 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:13.644907  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:13.631297  1511 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:13.646445  2210 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:13.585018  7383 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.628914  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:13.647672  1544 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:13.563267  7258 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:13.656834  1659 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:13.657862  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:13.659850  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:13.672252  1659 leader_election.cc:400] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19.
I20260709 13:02:13.672727  1659 leader_election.cc:403] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:02:13.656913  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:13.673493  1538 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:13.657990  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:13.629215  7106 raft_consensus.cc:697] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:13.659574  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:13.687342  1693 raft_consensus.cc:2410] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:13.685497  1694 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
I20260709 13:02:13.673840  1659 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:13.694819  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:13.695737  1544 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 15: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:13.696092  1543 raft_consensus.cc:1240] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:02:13.696019  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:13.700304  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 69088.8us
I20260709 13:02:13.701341  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:13.701604  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:13.702171  1692 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:13.703325  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:13.702126  2237 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:13.712652  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:13.713389  1546 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:13.648924  7245 raft_consensus.cc:3055] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:13.652179  7409 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:13.716629  1547 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:13.717415  2244 raft_consensus.cc:2410] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:02:13.719215  7443 consensus_queue.cc:1059] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:13.720057  7163 consensus_queue.cc:1059] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:13.722487  7442 consensus_queue.cc:1059] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:13.724614  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:13.743036  1541 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:13.743207  2242 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:13.653743  7378 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:13.725131  7245 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:13.725704  7385 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:13.727133  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:13.658247  7255 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.737419  1538 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:02:13.686676  7414 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:13.653427  7367 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:13.684656  7208 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:13.741235  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:13.652626  7415 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:13.746681  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:13.690747  7254 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:13.726214  6875 consensus_queue.cc:1059] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:02:13.703449  7406 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:13.752671  7255 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.760833  7245 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:13.767903  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:13.715687  7192 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.716708  7302 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:13.717110  7462 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:13.769347  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:13.647199  7440 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:13.776211  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:13.815945  1695 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:02:13.798450  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:13.817587  1538 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:13.799057  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:13.818738  1620 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:13.821465  1541 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:02:13.801122  1693 raft_consensus.cc:2393] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 18: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:13.802448  1543 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.762578  7173 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:13.769732  7170 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:13.811362  7254 raft_consensus.cc:697] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:13.814527  7258 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:13.859120  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:13.746682  7369 consensus_queue.cc:1059] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:02:13.827620  2242 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:02:13.826954  1692 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:02:13.829383  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:13.749210  7414 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:13.865113  1538 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:02:13.769624  7184 consensus_queue.cc:1059] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:02:13.800308  7417 raft_consensus.cc:3055] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:13.876886  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:13.866760  1543 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:13.799948  7406 raft_consensus.cc:697] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:13.847849  7415 raft_consensus.cc:3055] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:13.863862  7245 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:13.870661  1691 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 20: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:13.762159  7367 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.888635  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:13.869663  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:13.879326  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 160532us
I20260709 13:02:13.712765  7423 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:13.919504  1538 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:13.920539  1543 raft_consensus.cc:2410] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:02:13.921499  1618 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:13.878211  7414 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:13.924885  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:13.925041  1511 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:13.817184  7302 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:13.802090  7192 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.928373  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:13.882254  7417 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:13.930222  1693 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:02:13.932786  1693 pending_rounds.cc:85] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 9
I20260709 13:02:13.933060  1693 pending_rounds.cc:107] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:02:13.933332  1693 raft_consensus.cc:2889] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:13.847190  7173 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.929339  7462 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.934782  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:13.936579  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:13.937319  1618 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:13.900274  7420 raft_consensus.cc:3055] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:13.899708  7307 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:13.899737  7415 raft_consensus.cc:740] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:13.947510  1614 raft_consensus.cc:1240] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:13.918746  7184 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:13.948982  1543 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:13.950248  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:13.864442  7170 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:13.946954  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:13.971750  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 277574us
I20260709 13:02:13.955834  1618 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
W20260709 13:02:13.946410  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 253760us
W20260709 13:02:13.973678  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.972662  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 278208us
I20260709 13:02:13.982432  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:13.969863  1622 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:02:13.939385  7369 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:13.999481  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:14.000331  1621 raft_consensus.cc:2410] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:02:14.000423  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:13.926404  7190 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:13.875887  7106 consensus_queue.cc:237] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:14.004652  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:13.972918  7449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.007s	sys 0.015s
I20260709 13:02:14.008157  1511 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:13.947531  7420 raft_consensus.cc:740] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:14.012377  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 86581.5us
I20260709 13:02:14.013041  2209 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:14.015826  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:14.017128  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:14.018208  7315 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:14.018958  7315 raft_consensus.cc:697] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:14.020215  7315 consensus_queue.cc:237] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:14.022784  7477 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:14.023615  7477 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:14.027968  7474 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:02:14.028849  7469 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.305s	user 0.004s	sys 0.000s
I20260709 13:02:14.029735  7173 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:14.030534  7173 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:14.030989  7472 log.cc:927] Time spent T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:14.018246  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:14.039156  1690 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 18: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:02:14.008613  7449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.008s	sys 0.015s
I20260709 13:02:14.026474  7477 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:13.965560  7307 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.010661  7369 raft_consensus.cc:697] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:14.072471  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:13.998339  7405 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:14.074548  1543 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:13.976415  7184 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.000859  7254 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:13.948146  7462 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:14.075953  1619 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:14.031086  7173 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.076922  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:14.090121  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 89765.5us
I20260709 13:02:14.070675  7436 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:14.124504  1543 raft_consensus.cc:1240] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:14.093928  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:14.126175  1585 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:14.111789  1547 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:02:14.002605  7417 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:14.125942  1586 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:14.131320  1619 raft_consensus.cc:2410] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:14.014736  7406 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.124863  7436 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.129647  7440 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:14.130656  7479 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.169593  7478 consensus_queue.cc:1059] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 13:02:14.170352  7367 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:14.170539  7476 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:14.135270  7491 raft_consensus.cc:2764] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:02:14.171101  7423 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:14.172333  7190 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:14.166462  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:14.173413  1619 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:14.143568  7432 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:02:14.243609  2237 consensus_meta.cc:287] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
W20260709 13:02:14.175671  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 49798.1us
I20260709 13:02:14.244071  2237 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:14.160305  7436 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:14.168346  7417 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:14.309401  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:14.079870  7415 consensus_queue.cc:260] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.342734  1620 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:02:14.343454  1613 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:14.128525  7420 consensus_queue.cc:260] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:14.257937  7476 raft_consensus.cc:697] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:14.297320  7423 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:14.317498  7418 consensus_meta.cc:287] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.002s
I20260709 13:02:14.259900  7494 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.310727  7192 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:14.356221  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:14.316608  7465 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:14.361057  7170 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:14.366191  7416 raft_consensus.cc:3055] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:14.178139  7479 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:14.361094  7482 log.cc:927] Time spent T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Append to log took a long time: real 0.188s	user 0.001s	sys 0.001s
W20260709 13:02:14.411404  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.372264  7462 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:14.366348  7173 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:14.259711  7369 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.378340  1619 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:02:14.423974  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:14.248827  7432 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.346028  7302 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:14.373500  7476 consensus_queue.cc:237] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.397445  7416 raft_consensus.cc:740] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:14.358304  7423 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:02:14.375162  7488 log.cc:927] Time spent T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:02:14.338770  7473 consensus_queue.cc:1059] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.352s
W20260709 13:02:14.421945  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.422649  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:14.430608  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:14.398833  7184 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:14.480543  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:14.388217  7418 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.488384  1620 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:14.488029  1619 raft_consensus.cc:2393] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 15: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:02:14.446899  7245 consensus_meta.cc:287] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.000s
I20260709 13:02:14.529663  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:14.432545  7462 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:14.422137  7420 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:14.496786  7481 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:14.399377  7494 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:14.537664  7307 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:14.538239  7494 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:14.478798  7498 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.539124  7498 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:14.513906  7496 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:02:14.531170  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:14.542258  1619 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:02:14.543519  7405 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:14.530987  2245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45882 (request call id 998) took 1719 ms. Trace:
I20260709 13:02:14.551254  2245 rpcz_store.cc:276] 0709 13:02:12.811543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.815896 (+  4353us) service_pool.cc:224] Handling call
0709 13:02:12.821058 (+  5162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.494461 (+673403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.530705 (+1036244us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b54004f1d54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:14.530917 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546728064}
I20260709 13:02:14.533499  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 2833) took 1274 ms. Trace:
I20260709 13:02:14.534790  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:14.553231  1691 rpcz_store.cc:276] 0709 13:02:13.210924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.293903 (+ 82979us) service_pool.cc:224] Handling call
0709 13:02:14.485124 (+1191221us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b5400033754. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:14.485313 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280556416}
I20260709 13:02:14.553838  1539 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:14.558117  1619 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:14.534487  7462 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:14.560923  7462 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:14.560849  7416 consensus_queue.cc:260] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:14.564720  7208 consensus_meta.cc:287] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.802s	user 0.008s	sys 0.003s
I20260709 13:02:14.565274  7208 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19.
I20260709 13:02:14.564734  1539 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:14.574612  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 3112) took 1017 ms. Trace:
W20260709 13:02:14.431620  7439 consensus_meta.cc:287] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.778s	user 0.006s	sys 0.005s
I20260709 13:02:14.575181  1539 rpcz_store.cc:276] 0709 13:02:13.557426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.534550 (+977124us) service_pool.cc:224] Handling call
0709 13:02:14.574531 (+ 39981us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:14.468701  7475 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.402s	user 0.000s	sys 0.001s
W20260709 13:02:14.532742  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 2243) took 1279 ms (client timeout 1558 ms). Trace:
W20260709 13:02:14.594940  1689 rpcz_store.cc:269] 0709 13:02:13.209428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.272589 (+ 63161us) service_pool.cc:224] Handling call
0709 13:02:14.488351 (+1215762us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b5400133b54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:14.488449 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606026496}
I20260709 13:02:14.586975  7462 consensus_queue.cc:1059] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:14.597127  7462 raft_consensus.cc:3055] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:14.609809  7462 raft_consensus.cc:740] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:14.610980  7462 consensus_queue.cc:260] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:14.612577  7462 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:14.468921  7484 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:14.616392  7484 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:14.475754  7465 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:14.640301  7465 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.643080  7439 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:14.643704  7439 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.648983  7418 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:14.652091  1687 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:14.519305  7423 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:14.638816  2238 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 15: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:14.477802  7173 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:14.669063  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 3115) took 1109 ms. Trace:
I20260709 13:02:14.690415  1547 rpcz_store.cc:276] 0709 13:02:13.559446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.559595 (+   149us) service_pool.cc:224] Handling call
0709 13:02:14.668811 (+1109216us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54000b5c54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:14.668952 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309717888}
I20260709 13:02:14.674536  1613 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:14.675743  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 1243) took 1470 ms. Trace:
I20260709 13:02:14.695182  7379 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:14.695947  7379 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:14.698644  7379 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:14.693094  1614 rpcz_store.cc:276] 0709 13:02:13.205732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.205864 (+   132us) service_pool.cc:224] Handling call
0709 13:02:13.206108 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.956482 (+750374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.675466 (+718984us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b54003813d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:14.675671 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1692629248}
I20260709 13:02:14.749540  7500 raft_consensus.cc:3055] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:14.752660  7500 raft_consensus.cc:740] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:14.478698  7074 consensus_queue.cc:260] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.772858  7074 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:14.778004  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:14.779966  7479 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:14.756978  7495 log.cc:927] Time spent T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.385s	user 0.003s	sys 0.000s
I20260709 13:02:14.760259  7443 raft_consensus.cc:3055] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:14.793092  7479 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.827641  7443 raft_consensus.cc:740] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:14.827965  7479 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.828959  7443 consensus_queue.cc:260] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.830406  7443 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:14.793092  7408 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.832001  7408 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:14.796949  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:14.585548  7432 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:14.705905  7173 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.840186  7173 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:14.794204  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:14.841782  1619 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:14.844812  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:14.866513  1688 raft_consensus.cc:2393] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:14.847662  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:14.868160  1620 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:14.852036  7498 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:14.852252  7479 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:14.844188  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.860987  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:14.875205  2241 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
W20260709 13:02:14.813786  7487 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:02:14.883141  7414 consensus_meta.cc:287] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.947s	user 0.012s	sys 0.000s
W20260709 13:02:14.889271  7417 consensus_meta.cc:287] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.000s
I20260709 13:02:14.892131  7500 consensus_queue.cc:260] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.894038  7500 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:14.815795  7465 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:14.619092  7484 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:14.910288  7258 raft_consensus.cc:3055] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:14.910876  7258 raft_consensus.cc:740] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:14.911904  7258 consensus_queue.cc:260] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:14.913347  7258 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:14.915932  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:14.916759  1622 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:02:14.920202  1511 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:14.921475  7255 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:14.922137  7255 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:14.925671  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 2019) took 1235 ms. Trace:
W20260709 13:02:14.635017  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 52691.9us
I20260709 13:02:14.922711  7255 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.926046  1538 rpcz_store.cc:276] 0709 13:02:13.690243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.550527 (+860284us) service_pool.cc:224] Handling call
0709 13:02:14.550874 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.561930 (+ 11056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.561978 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:14.562036 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:14.562103 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.925437 (+363334us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5400187ed4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:14.925485 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.925615 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24897408}
I20260709 13:02:14.927987  7309 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:14.929437  7484 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:14.929817  7484 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.930145  7484 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:14.931761  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 2830) took 1754 ms. Trace:
I20260709 13:02:14.931952  7255 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:14.932157  1694 rpcz_store.cc:276] 0709 13:02:13.176972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.177100 (+   128us) service_pool.cc:224] Handling call
0709 13:02:14.931602 (+1754502us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b5400034654. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:14.931705 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":805942528}
I20260709 13:02:14.933674  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45652 (request call id 2835) took 1274 ms. Trace:
I20260709 13:02:14.934013  1690 rpcz_store.cc:276] 0709 13:02:13.658940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.659623 (+   683us) service_pool.cc:224] Handling call
0709 13:02:14.933481 (+1273858us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54001b6f54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:14.933617 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837776128}
I20260709 13:02:14.936607  2238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45866 (request call id 1154) took 1008 ms. Trace:
I20260709 13:02:14.936875  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:14.936965  2238 rpcz_store.cc:276] 0709 13:02:13.927850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.928090 (+   240us) service_pool.cc:224] Handling call
0709 13:02:14.936415 (+1008325us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b54002aeed4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:14.936536 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588239744}
I20260709 13:02:14.949769  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:14.954252  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:14.955075  1616 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:14.957100  7408 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:14.959064  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 3111) took 1402 ms. Trace:
I20260709 13:02:14.959404  1545 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 12. Current term is 13. Ops: [11.8-12.9]
I20260709 13:02:14.959615  1541 rpcz_store.cc:276] 0709 13:02:13.557145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.657607 (+100462us) service_pool.cc:224] Handling call
0709 13:02:14.958863 (+1301256us) spinlock_profiling.cc:243] Waited 71.2 ms on lock 0x7b54001883d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:14.958996 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163851136}
I20260709 13:02:14.961220  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 2012) took 1279 ms. Trace:
I20260709 13:02:14.961565  2239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 1151) took 1266 ms. Trace:
I20260709 13:02:14.962203  2239 rpcz_store.cc:276] 0709 13:02:13.694688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.716577 (+ 21889us) service_pool.cc:224] Handling call
0709 13:02:13.745842 (+ 29265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.956814 (+210972us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.956851 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.956892 (+    41us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:13.956929 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.961320 (+1004391us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54006d01d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:14.961375 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.961501 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484644224}
I20260709 13:02:14.974447  1690 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:14.961643  1545 rpcz_store.cc:276] 0709 13:02:13.682146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.363197 (+681051us) service_pool.cc:224] Handling call
0709 13:02:14.959027 (+595830us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:14.959932 (+   905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.961000 (+  1068us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b54001883d0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:14.961156 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1369051008}
I20260709 13:02:14.976922  7439 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:14.978411  7506 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.606s	user 0.000s	sys 0.003s
I20260709 13:02:14.975181  7416 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:14.987838  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 877) took 1312 ms. Trace:
I20260709 13:02:14.984723  7383 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:14.989837  7440 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.988293  1540 rpcz_store.cc:276] 0709 13:02:13.675936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.687921 (+ 11985us) service_pool.cc:224] Handling call
0709 13:02:13.712249 (+ 24328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.071181 (+358932us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:14.169863 (+ 98682us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.347958 (+178095us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.355514 (+  7556us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.355609 (+    95us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.373508 (+ 17899us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.373649 (+   141us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:14.373685 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.373750 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.724163 (+350413us) spinlock_profiling.cc:243] Waited 5.07 ms on lock 0x7b4800002958. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc496654aa1 00007fc49664bb37 00007fc49664b9ca 00007fc49674326f 00007fc496742f37 00007fc49675755c 00007fc496757508 00007fc496757488 00007fc496757443 00007fc4967566ec 00007fc495680a96
0709 13:02:14.977592 (+253429us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:14.987583 (+  9991us) raft_consensus.cc:1685] finished
0709 13:02:14.987611 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.987743 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39207,"prepare.queue_time_us":241261,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":7416,"raft.queue_time_us":8514,"raft.run_cpu_time_us":3785,"raft.run_wall_time_us":410560,"spinlock_wait_cycles":22492672,"thread_start_us":524698,"threads_started":3,"wal-append.queue_time_us":201955}
I20260709 13:02:14.990326  7440 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:14.992424  7440 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:14.992726  1694 raft_consensus.cc:1240] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:14.992882  7440 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:14.993425  7440 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:14.977910  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:14.995973  7480 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:14.996865  1659 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:14.997417  7477 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:14.998044  7477 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:14.996613  7480 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:14.999528  7439 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:15.000092  7439 raft_consensus.cc:697] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:15.003670  7477 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:15.003775  7415 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:15.005138  7480 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:15.008690  7478 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:15.011822  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:15.011713  7439 consensus_queue.cc:237] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:14.883795  7414 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:15.041816  1547 raft_consensus.cc:1240] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:15.045727  1543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.067s	sys 0.166s
W20260709 13:02:15.046231  1543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.067s	sys 0.166s
W20260709 13:02:15.047314  1586 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.068s	sys 0.105s
W20260709 13:02:15.048444  1586 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.068s	sys 0.105s
W20260709 13:02:15.048754  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 732371us
I20260709 13:02:15.050401  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:15.053941  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 887) took 1374 ms. Trace:
W20260709 13:02:15.019326  1511 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 2.065s (SENT) [suppressed 10 similar messages]
I20260709 13:02:15.056058  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:15.056089  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:15.058085  1538 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 15: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:15.056228  7440 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:15.059367  7338 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:15.059900  7338 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:15.060415  1689 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:15.061443  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:15.061893  7338 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:15.063163  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:15.063362  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:15.063552  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:15.063879  1693 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:15.043642  7258 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:15.061121  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:15.054548  1543 rpcz_store.cc:276] 0709 13:02:13.679195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.131596 (+452401us) service_pool.cc:224] Handling call
0709 13:02:14.151537 (+ 19941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.151813 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:14.377672 (+225859us) log.cc:844] Serialized 14 byte log entry
0709 13:02:15.049718 (+672046us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:15.049793 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:15.049870 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.049966 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.053876 (+  3910us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24400,"prepare.queue_time_us":197894,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":9433,"thread_start_us":874794,"threads_started":2}
W20260709 13:02:15.067885  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.069870  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:15.070533  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:15.072425  1540 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:15.073565  1695 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:15.074117  1660 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:15.074680  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:15.075423  1696 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:15.068902  1688 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:02:15.085933  1616 raft_consensus.cc:1275] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:15.086139  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:15.087853  1586 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:15.091665  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:15.126463  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 52422.7us
I20260709 13:02:15.127790  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:15.087061  1617 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:15.128988  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:15.129810  1696 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
I20260709 13:02:15.130851  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:15.133000  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:15.133016  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:15.134388  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:15.137077  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:15.135437  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:15.141570  1614 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 15: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:02:15.130033  7406 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.037s	sys 0.153s
I20260709 13:02:15.147696  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:15.160486  7406 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.038s	sys 0.153s
I20260709 13:02:15.151576  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 994) took 1475 ms. Trace:
I20260709 13:02:15.161229  1687 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:15.143312  7173 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:15.161829  7173 raft_consensus.cc:697] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:15.161391  1695 rpcz_store.cc:276] 0709 13:02:13.665284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.821303 (+156019us) service_pool.cc:224] Handling call
0709 13:02:13.821548 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:15.076424 (+1254876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.140836 (+ 64412us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540014f854. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:15.141054 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2878462720}
I20260709 13:02:15.143797  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:15.163327  7173 consensus_queue.cc:237] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:15.149621  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:15.157296  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:15.153889  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:15.152381  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:02:15.159418  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.159354  7501 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:15.168856  7501 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:15.142998  7342 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:15.086935  7295 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:15.172886  1587 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:15.165971  1615 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:02:15.168095  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:15.174211  1689 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:15.174582  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:15.171077  7420 consensus_meta.cc:287] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.002s
W20260709 13:02:15.193188  2237 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.063s	sys 0.122s
W20260709 13:02:15.215507  2237 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.063s	sys 0.122s
I20260709 13:02:15.076176  1620 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:15.065603  7258 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:15.242676  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.175287  1696 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:02:15.236923  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:15.244647  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:15.143774  7378 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:15.250667  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:15.252699  1689 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
W20260709 13:02:15.254972  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 102664us
I20260709 13:02:15.255604  1619 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:15.256002  1660 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:15.257489  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:15.258033  1547 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:15.258456  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:15.259001  1541 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:15.260111  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:15.260807  1546 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:15.173326  7477 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:15.269121  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:15.270000  1545 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
W20260709 13:02:15.281284  1618 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.000s	sys 0.012s
W20260709 13:02:15.281770  1618 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.001s	sys 0.012s
W20260709 13:02:15.271409  7254 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.000s	sys 0.017s
W20260709 13:02:15.282836  7254 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.000s	sys 0.017s
I20260709 13:02:15.295567  1547 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:15.248122  7192 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:15.264981  7436 consensus_meta.cc:287] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.927s	user 0.012s	sys 0.000s
W20260709 13:02:15.279589  1542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.000s	sys 0.012s
I20260709 13:02:15.210902  7465 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:02:15.171748  7295 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:15.264755  7406 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:15.311861  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 55907.1us
W20260709 13:02:15.312232  1542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.001s	sys 0.012s
I20260709 13:02:15.264372  7383 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:15.308548  7378 raft_consensus.cc:697] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:15.329356  1541 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:15.305152  7342 raft_consensus.cc:697] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:02:15.327018  7369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.032s	sys 0.063s
I20260709 13:02:15.375031  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:15.375906  1541 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:15.323851  7208 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:15.380214  1543 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:15.319993  7406 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:15.378227  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:15.282124  7445 consensus_queue.cc:1059] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.079s
W20260709 13:02:15.383982  7315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.006s	sys 0.009s
W20260709 13:02:15.370128  7443 consensus_meta.cc:287] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.534s	user 0.004s	sys 0.005s
W20260709 13:02:15.375495  7369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.032s	sys 0.063s
I20260709 13:02:15.380514  7208 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.367547  7417 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.388090  7378 consensus_queue.cc:237] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:15.393882  7432 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:02:15.394601  2243 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.040s	sys 0.089s
W20260709 13:02:15.429204  2243 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.040s	sys 0.089s
I20260709 13:02:15.376737  7255 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:15.376035  7493 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:15.405246  7295 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:15.414649  7501 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:15.318408  7436 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:15.387965  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:15.439306  1547 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:15.329030  7383 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:15.383581  7406 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:15.427008  7208 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:15.435686  6870 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.007s	sys 0.006s
I20260709 13:02:15.424690  7414 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:15.410435  7315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.006s	sys 0.009s
I20260709 13:02:15.455566  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:15.462709  1543 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
W20260709 13:02:15.448654  6870 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.007s	sys 0.007s
I20260709 13:02:15.472072  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:15.448014  7295 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.473529  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:15.479857  1547 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:02:15.477928  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:15.480974  1545 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:02:15.432170  7417 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:15.451964  7482 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.040s	user 0.009s	sys 0.010s
I20260709 13:02:15.433755  7432 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:15.461329  7123 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:15.498858  7512 log.cc:927] Time spent T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:02:15.489571  7074 consensus_meta.cc:287] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.000s
W20260709 13:02:15.511224  7509 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:02:15.446420  7342 consensus_queue.cc:237] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:15.511821  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:15.537743  1541 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:02:15.513216  7369 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.514917  7432 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:15.526048  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:15.443353  7493 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:15.491647  7482 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.009s	sys 0.010s
W20260709 13:02:15.510377  7415 consensus_meta.cc:287] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.000s
I20260709 13:02:15.533215  1546 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:15.534053  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:15.450332  7255 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:15.532013  7423 consensus_meta.cc:287] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.826s	user 0.011s	sys 0.000s
I20260709 13:02:15.531306  7258 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:15.574589  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:15.576229  1545 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
W20260709 13:02:15.561916  7106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.041s	sys 0.050s
I20260709 13:02:15.586853  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:15.589871  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.496448  7295 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:15.598011  7255 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:15.598330  7417 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:15.541777  7369 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:15.561486  7432 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:15.599388  7432 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:15.601222  7436 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:15.601594  7432 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:15.575131  7423 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:15.534559  7123 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:15.604585  1690 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.035s	sys 0.041s
W20260709 13:02:15.605656  1690 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.036s	sys 0.041s
I20260709 13:02:15.609035  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:15.602284  7383 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:15.594647  7106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.042s	sys 0.050s
W20260709 13:02:15.613183  1691 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.042s	sys 0.064s
W20260709 13:02:15.613528  1691 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.042s	sys 0.064s
W20260709 13:02:15.609138  7476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.003s	sys 0.018s
W20260709 13:02:15.628837  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 609434us
I20260709 13:02:15.631726  2209 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:15.638007  7462 consensus_meta.cc:287] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 1.025s	user 0.012s	sys 0.000s
W20260709 13:02:15.626835  7476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.003s	sys 0.019s
I20260709 13:02:15.663141  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:15.626456  7309 raft_consensus.cc:3055] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:15.664487  1694 raft_consensus.cc:1240] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:15.615466  7208 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:15.665877  7309 raft_consensus.cc:740] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:15.668653  7123 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:15.672827  7484 consensus_meta.cc:287] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.742s	user 0.010s	sys 0.000s
W20260709 13:02:15.680399  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.707799  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.657363  7473 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:15.726583  1512 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:15.731767  1512 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:15.728645  7123 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.723124  7245 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:02:15.733790  7123 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:15.735955  7123 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:15.736332  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.602s	user 0.006s	sys 0.020s
W20260709 13:02:15.739605  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.605s	user 0.006s	sys 0.020s
W20260709 13:02:15.740206  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 1.61406e+06us
I20260709 13:02:15.678119  7406 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:15.741981  1585 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:15.730217  7383 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:15.778692  1512 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:15.736817  7258 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.723721  7192 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.800606  2246 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:15.728474  7484 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:15.737278  7462 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:15.856094  7518 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:02:15.850256  7418 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.864223  7418 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:15.850514  7383 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:15.877650  1696 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:15.812621  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 70680.5us
I20260709 13:02:15.851639  7417 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:15.854307  7315 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:15.884016  1585 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:02:15.887847  7517 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:02:15.889945  7519 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:02:15.877040  7420 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:15.894553  7465 raft_consensus.cc:2764] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:02:15.899101  7369 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:15.899899  7295 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:15.900151  7406 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:15.901064  7423 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:15.882022  7493 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:15.868659  7192 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:15.919073  1692 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.023s	sys 0.034s
I20260709 13:02:15.867882  7258 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:15.903023  7484 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:15.892549  7315 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:02:15.935041  1692 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.024s	sys 0.034s
W20260709 13:02:15.917619  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.028s	sys 0.051s
W20260709 13:02:15.943120  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.029s	sys 0.052s
I20260709 13:02:15.931843  7383 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:15.945845  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 732202us
I20260709 13:02:15.894492  7309 consensus_queue.cc:260] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:15.962953  2246 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45886 (request call id 1190) took 2319 ms (client timeout 1625 ms). Trace:
I20260709 13:02:15.933004  7420 raft_consensus.cc:697] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:15.940850  7315 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:15.970289  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:15.974756  2237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.011s	sys 0.049s
W20260709 13:02:15.975515  1618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.016s	sys 0.028s
W20260709 13:02:15.975850  1618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.016s	sys 0.028s
W20260709 13:02:15.975204  2237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.011s	sys 0.049s
I20260709 13:02:15.976557  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 1252) took 1481 ms. Trace:
W20260709 13:02:15.971429  7173 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.007s	sys 0.039s
W20260709 13:02:15.971711  2246 rpcz_store.cc:269] 0709 13:02:13.657658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.657793 (+   135us) service_pool.cc:224] Handling call
0709 13:02:15.957458 (+2299665us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54005ab754. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:15.957614 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4282231552}
I20260709 13:02:15.977383  1587 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:15.977340  2237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 1157) took 1612 ms. Trace:
I20260709 13:02:15.976998  1618 rpcz_store.cc:276] 0709 13:02:14.494728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.684378 (+189650us) service_pool.cc:224] Handling call
0709 13:02:14.684769 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.685021 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:02:15.282363 (+597342us) log.cc:844] Serialized 14 byte log entry
0709 13:02:15.976181 (+693818us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:15.976230 (+    49us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:15.976279 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.976350 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.976490 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":977230,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":1852,"thread_start_us":1290441,"threads_started":2}
W20260709 13:02:16.011359  2210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.016s	sys 0.023s
W20260709 13:02:16.011834  2210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.016s	sys 0.023s
W20260709 13:02:16.012140  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 731558us
W20260709 13:02:16.012907  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.012781  1587 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:16.015221  1511 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:16.011073  1540 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.013s	sys 0.038s
W20260709 13:02:15.988792  7173 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.007s	sys 0.039s
I20260709 13:02:16.039971  1511 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:16.014667  7309 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:16.040932  1538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.006s	sys 0.036s
W20260709 13:02:16.030120  1540 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.014s	sys 0.038s
W20260709 13:02:16.048568  1538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.007s	sys 0.036s
I20260709 13:02:16.031524  7383 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:16.048255  2211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.006s	sys 0.031s
W20260709 13:02:16.050649  2211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.007s	sys 0.031s
W20260709 13:02:16.051060  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.013264  2210 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:16.055636  1544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.030s	sys 0.013s
W20260709 13:02:16.058585  1689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.016s	sys 0.032s
W20260709 13:02:16.059821  1689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.017s	sys 0.033s
W20260709 13:02:16.058794  1544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.031s	sys 0.013s
I20260709 13:02:16.050976  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 1005) took 1055 ms. Trace:
I20260709 13:02:16.062943  1690 rpcz_store.cc:276] 0709 13:02:14.995247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.999813 (+  4566us) service_pool.cc:224] Handling call
0709 13:02:15.000207 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:15.000457 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:15.606138 (+605681us) log.cc:844] Serialized 14 byte log entry
0709 13:02:16.050610 (+444472us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:16.050663 (+    53us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:16.050711 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.050811 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.050924 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1029793,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":89,"thread_start_us":1049344,"threads_started":2}
W20260709 13:02:16.046422  7439 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.018s	sys 0.022s
I20260709 13:02:16.029282  7245 consensus_queue.cc:1048] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:02:16.046382  7484 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:16.049795  7417 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:16.046945  7295 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:02:16.071600  1542 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.004s	sys 0.023s
W20260709 13:02:16.069413  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 56224.5us
W20260709 13:02:16.078809  1542 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.004s	sys 0.024s
I20260709 13:02:16.079813  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 2014) took 2397 ms. Trace:
I20260709 13:02:16.083259  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:16.083853  1688 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:16.058420  7369 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:16.090955  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:16.099033  1619 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:16.080206  1542 rpcz_store.cc:276] 0709 13:02:13.682768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.515815 (+833047us) service_pool.cc:224] Handling call
0709 13:02:14.516202 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.516722 (+   520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.516765 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.517323 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:02:15.314278 (+796955us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:16.079309 (+765031us) log.cc:844] Serialized 14 byte log entry
0709 13:02:16.079511 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.079586 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:16.079627 (+    41us) raft_consensus.cc:1685] finished
0709 13:02:16.079639 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.079759 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4685,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":51958,"thread_start_us":1488107,"threads_started":2,"wal-append.queue_time_us":1148282}
I20260709 13:02:16.072407  7478 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:02:16.107002  1622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.004s	sys 0.021s
I20260709 13:02:16.115188  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:16.115473  1622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.004s	sys 0.021s
I20260709 13:02:16.084875  1618 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:02:16.116014  2243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.018s	sys 0.019s
W20260709 13:02:16.117071  2243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.019s	sys 0.019s
I20260709 13:02:16.118518  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 1255) took 1149 ms. Trace:
W20260709 13:02:16.075779  7439 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.018s	sys 0.022s
I20260709 13:02:16.081885  7295 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.058225  7383 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:16.121857  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:16.129518  2244 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:16.123601  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:16.130915  2239 raft_consensus.cc:2410] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:02:16.081157  7500 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:16.082055  7423 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:16.148146  7378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.016s	sys 0.012s
I20260709 13:02:16.070827  7420 consensus_queue.cc:237] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:16.127269  1622 rpcz_store.cc:276] 0709 13:02:14.969397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.970004 (+   607us) service_pool.cc:224] Handling call
0709 13:02:14.970320 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.970539 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:15.463852 (+493313us) log.cc:844] Serialized 14 byte log entry
0709 13:02:16.118001 (+654149us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:16.118088 (+    87us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:16.118196 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.118293 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.118444 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1668,"prepare.queue_time_us":758117,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2649,"raft.queue_time_us":4831,"thread_start_us":1144958,"threads_started":2}
I20260709 13:02:16.184885  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:16.156121  6870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.013s	sys 0.015s
W20260709 13:02:16.165247  7342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.003s	sys 0.021s
I20260709 13:02:16.157745  7423 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.155951  7295 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:16.194325  7378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.016s	sys 0.013s
I20260709 13:02:16.105865  7369 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:16.198953  1619 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:16.178530  7417 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.199954  7423 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:16.204880  7417 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:16.198858  7342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.003s	sys 0.021s
W20260709 13:02:16.207671  1546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.011s	sys 0.020s
W20260709 13:02:16.209290  1546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.011s	sys 0.020s
W20260709 13:02:16.195080  6870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.014s	sys 0.015s
I20260709 13:02:16.186466  7258 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:16.189682  7192 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:16.165630  7500 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:16.238809  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 460096us
I20260709 13:02:16.239729  1512 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:02:16.252337  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 239604us
I20260709 13:02:16.253710  1587 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:16.214735  7535 consensus_queue.cc:1059] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.032s
W20260709 13:02:16.263339  1659 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.024s	sys 0.044s
W20260709 13:02:16.264652  1659 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.024s	sys 0.044s
W20260709 13:02:16.265681  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 689483us
I20260709 13:02:16.259793  6866 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:16.256860  1512 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:16.236609  7418 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:16.283403  1587 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:16.260191  7258 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:16.290138  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2848) took 1226 ms. Trace:
I20260709 13:02:16.290755  1692 rpcz_store.cc:276] 0709 13:02:15.067049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.069480 (+  2431us) service_pool.cc:224] Handling call
0709 13:02:15.128236 (+ 58756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:15.128447 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:15.941877 (+813430us) log.cc:844] Serialized 14 byte log entry
0709 13:02:16.289327 (+347450us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:16.289404 (+    77us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:16.289462 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.289552 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.290063 (+   511us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1654,"prepare.queue_time_us":927098,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"thread_start_us":1115304,"threads_started":2}
I20260709 13:02:16.295809  1587 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:16.303642  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:16.305749  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:16.286201  1659 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:16.263741  7208 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:16.299647  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:16.314174  1660 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:16.315006  1660 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:16.316232  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:16.305013  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:16.317277  1695 raft_consensus.cc:2376] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14. Re-sending same reply.
I20260709 13:02:16.318468  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:16.320083  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:16.319199  1695 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:02:16.332008  1687 raft_consensus.cc:2410] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:02:16.333635  1690 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:02:16.337353  7526 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:02:16.331548  7476 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:16.339740  7476 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.340133  7476 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:16.341105  7538 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:02:16.326311  7439 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:16.347867  7539 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:02:16.311658  7529 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:16.349236  7533 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:02:16.307343  7418 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.350827  7418 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:16.351670  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 2263) took 1289 ms. Trace:
I20260709 13:02:16.352041  1691 rpcz_store.cc:276] 0709 13:02:15.062180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.064012 (+  1832us) service_pool.cc:224] Handling call
0709 13:02:15.064345 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:15.064683 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.064708 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:15.065290 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:02:15.626632 (+561342us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:15.626685 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.626774 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:16.351441 (+724667us) raft_consensus.cc:1685] finished
0709 13:02:16.351463 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.351613 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5208,"raft.queue_time_us":1078,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":13194,"thread_start_us":548196,"threads_started":1,"wal-append.queue_time_us":991500}
I20260709 13:02:16.353861  7423 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:16.294073  7338 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:16.299342  7192 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.299556  7258 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.352990  7418 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:16.309587  7537 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:16.363914  1688 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:16.364694  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:16.355583  7338 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:16.356519  7378 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:02:16.373435  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 242797us
I20260709 13:02:16.362016  7208 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:16.364020  7439 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:16.363106  7258 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:16.361188  7552 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:16.368569  7537 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.379482  1693 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:16.373265  7418 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.372973  7514 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:02:16.379172  7531 log.cc:927] Time spent T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:02:16.394702  2244 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:02:16.407884  7462 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:15.989727  2237 rpcz_store.cc:276] 0709 13:02:14.365444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.365606 (+   162us) service_pool.cc:224] Handling call
0709 13:02:14.365898 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.366203 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:15.246867 (+880664us) log.cc:844] Serialized 14 byte log entry
0709 13:02:15.976961 (+730094us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:15.977028 (+    67us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:15.977083 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.977162 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.977286 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7749,"prepare.queue_time_us":1261293,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":87,"raft.queue_time_us":11357,"thread_start_us":1579001,"threads_started":2}
I20260709 13:02:16.414991  6866 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:16.375150  7553 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:16.542593  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:16.382138  7439 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:16.381976  7378 raft_consensus.cc:697] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:16.363803  7192 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:16.396618  7500 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:16.382795  7552 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:02:16.584187  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 269195us
I20260709 13:02:16.388279  7537 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:16.388782  7208 raft_consensus.cc:697] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:16.570530  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:16.605996  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 322641us
I20260709 13:02:16.606290  2239 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:16.396679  7369 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:16.567124  7547 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:02:16.543819  7493 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:16.612627  1617 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:16.602347  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:16.572213  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 894) took 1337 ms. Trace:
W20260709 13:02:16.614758  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 298549us
I20260709 13:02:16.617662  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:16.584478  7439 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:16.395653  7534 consensus_queue.cc:1059] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.205s
I20260709 13:02:16.627120  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:16.591872  7529 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.624558  1659 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:16.623533  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:16.633631  1660 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:16.620218  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:16.624362  1545 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:16.635795  2241 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:16.419952  7418 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:16.632408  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:16.632797  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:16.632983  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:16.543820  7514 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:16.608764  7123 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:16.636375  1543 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:02:16.639688  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:16.568857  6866 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:16.641395  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:16.545082  7476 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:16.642745  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:16.568953  7462 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:16.614199  1540 rpcz_store.cc:276] 0709 13:02:15.235187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.235513 (+   326us) service_pool.cc:224] Handling call
0709 13:02:15.257703 (+ 22190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:15.257897 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:16.048907 (+791010us) log.cc:844] Serialized 14 byte log entry
0709 13:02:16.571525 (+522618us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:16.571590 (+    65us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:16.571932 (+   342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.572050 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.572162 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3104,"prepare.queue_time_us":954797,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":38,"raft.queue_time_us":84559,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":7518,"thread_start_us":1304682,"threads_started":3,"wal-append.queue_time_us":306155}
I20260709 13:02:16.606042  7552 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:16.677054  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:16.677660  1615 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:16.678261  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:16.609218  7420 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:16.638053  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:16.648489  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:16.685143  1692 raft_consensus.cc:2410] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:02:16.685915  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:16.659636  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:16.686709  1688 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:16.660168  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:16.687559  1694 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:16.641209  7369 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.660562  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:16.689276  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:16.661234  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:16.690114  1616 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:16.664409  1622 raft_consensus.cc:2393] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:16.667428  7436 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:16.667601  2243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45882 (request call id 1005) took 2169 ms. Trace:
I20260709 13:02:16.669860  7462 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:16.670374  7551 log.cc:927] Time spent T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.265s	user 0.000s	sys 0.000s
W20260709 13:02:16.670961  7556 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
W20260709 13:02:16.671442  7541 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
I20260709 13:02:16.671448  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:16.724408  1543 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:16.725939  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:16.669898  7514 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:16.672587  7378 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:16.663409  6866 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:16.572705  7553 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:16.633926  7423 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:16.705567  1545 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:16.733389  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:16.734190  1545 raft_consensus.cc:2393] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 16: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:16.711787  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:16.713275  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:16.698304  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 289776us
I20260709 13:02:16.737068  1511 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:16.625373  7493 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:16.738368  7462 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:16.738946  7462 raft_consensus.cc:697] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:16.739967  7462 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:16.740588  7493 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:16.683511  7568 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:16.747562  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:16.748270  1622 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 19: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:16.722533  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:16.721637  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:16.744534  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:16.691536  2243 rpcz_store.cc:276] 0709 13:02:14.498616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.499223 (+   607us) service_pool.cc:224] Handling call
0709 13:02:14.499689 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.499956 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:02:15.429713 (+929757us) log.cc:844] Serialized 14 byte log entry
0709 13:02:16.647122 (+1217409us) log.cc:844] Serialized 14 byte log entry
0709 13:02:16.667168 (+ 20046us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:16.667218 (+    50us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:02:16.667297 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.667369 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.667507 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24916,"prepare.queue_time_us":1137170,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":86469,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":11749,"thread_start_us":2145963,"threads_started":4,"wal-append.queue_time_us":852104}
I20260709 13:02:16.749820  2246 raft_consensus.cc:2393] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:16.749799  1694 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:02:16.750582  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:16.752122  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:16.751891  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:16.752708  1512 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:16.753110  1694 raft_consensus.cc:2393] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 14: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:16.751924  1543 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:16.751181  2209 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:16.756510  1690 raft_consensus.cc:2393] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 13: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
W20260709 13:02:16.755041  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 86239.3us
I20260709 13:02:16.644081  7529 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:16.755717  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:16.758509  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:16.762622  1545 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
W20260709 13:02:16.761039  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 44235.6us
I20260709 13:02:16.688891  7123 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:16.766036  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:16.760093  2209 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:16.768051  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:16.768426  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:16.765650  1587 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:16.770462  1540 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:16.770543  1613 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:16.711596  7420 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:16.712471  7369 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:16.773020  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:16.746954  7568 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:16.717023  7436 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:16.760362  7523 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.720s	user 0.011s	sys 0.000s
I20260709 13:02:16.782945  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:16.792423  1620 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:16.792531  1545 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 10.
I20260709 13:02:16.765058  6870 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:16.760955  7550 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.758267  7571 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:16.767982  7514 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:16.791224  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:16.795182  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:16.809293  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:16.808081  1543 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:02:16.776221  7338 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:16.804570  1541 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
W20260709 13:02:16.799201  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 46552.8us
W20260709 13:02:16.793740  7315 consensus_meta.cc:287] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.805s	user 0.014s	sys 0.000s
I20260709 13:02:16.813649  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:16.787885  7549 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:16.794947  7579 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:02:16.745606  7208 consensus_queue.cc:237] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:16.855717  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:16.863560  7192 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:16.864380  7529 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:16.787042  7568 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:16.875042  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:16.844820  1545 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:16.875960  1543 raft_consensus.cc:2410] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:02:16.876493  1615 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:16.780714  7534 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:02:16.813809  1512 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:02:16.922694  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 109036us
I20260709 13:02:16.923629  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:16.913475  7561 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:02:16.867955  7315 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:16.800211  7574 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:16.914568  7565 log.cc:927] Time spent T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:02:16.916052  7420 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:16.916702  7417 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:16.918076  7369 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:16.810909  7550 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:16.851732  7553 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:16.794973  6870 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.935456  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:16.978850  2246 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21.
I20260709 13:02:16.806859  7571 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.953065  7549 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:16.858170  7258 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:16.954205  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:16.954703  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:16.955730  7295 consensus_meta.cc:287] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.002s
W20260709 13:02:16.956373  7309 consensus_meta.cc:287] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.907s	user 0.011s	sys 0.000s
W20260709 13:02:17.056421  7536 log.cc:927] Time spent T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.747s	user 0.001s	sys 0.007s
I20260709 13:02:17.059882  7383 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:16.987861  7571 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:17.063863  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.064445  7383 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:17.064980  1622 raft_consensus.cc:2393] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 14: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:17.065107  7383 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:17.066030  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.067950  7383 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:17.068215  7577 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.068728  7577 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:17.070704  7577 leader_election.cc:290] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:17.071919  7123 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:17.072693  7563 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:17.073215  7563 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:16.814375  7514 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:17.076687  7550 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:17.077081  7514 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:17.079025  7315 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:17.081409  7522 log.cc:927] Time spent T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 1.026s	user 0.006s	sys 0.004s
I20260709 13:02:16.851382  7338 consensus_queue.cc:1059] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 13:02:17.087693  2242 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:02:17.090163  2242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45866 (request call id 1161) took 1005 ms. Trace:
I20260709 13:02:17.090517  2242 rpcz_store.cc:276] 0709 13:02:16.084861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.086237 (+  1376us) service_pool.cc:224] Handling call
0709 13:02:17.089949 (+1003712us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54006a0ed4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:17.090094 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2234596736}
I20260709 13:02:17.091708  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 893) took 1857 ms. Trace:
I20260709 13:02:17.092072  1538 rpcz_store.cc:276] 0709 13:02:15.234712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.234944 (+   232us) service_pool.cc:224] Handling call
0709 13:02:15.262077 (+ 27133us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:15.288939 (+ 26862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.288971 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:15.311769 (+ 22798us) log.cc:844] Serialized 52 byte log entry
0709 13:02:16.049124 (+737355us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:16.265058 (+215934us) log.cc:844] Serialized 14 byte log entry
0709 13:02:16.265379 (+   321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.265481 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.055669 (+790188us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:17.091449 (+ 35780us) raft_consensus.cc:1685] finished
0709 13:02:17.091530 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.091659 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":349,"prepare.queue_time_us":184406,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":25562,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":21897,"spinlock_wait_cycles":16078720,"thread_start_us":880807,"threads_started":2,"wal-append.queue_time_us":921214}
I20260709 13:02:16.958470  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.095474  7258 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:17.096552  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:17.097429  1615 raft_consensus.cc:606] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:17.097812  1615 raft_consensus.cc:614] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:16.871428  1613 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:17.100605  1613 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:17.101945  1613 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:16.974262  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:16.800068  7552 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:17.105954  7552 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:16.873966  1540 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:16.980189  1586 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:16.980526  1539 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:16.933312  7573 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:17.107784  7573 raft_consensus.cc:697] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:17.109038  7573 consensus_queue.cc:237] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:16.990619  1511 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:17.115319  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 124752us
I20260709 13:02:17.116240  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:16.965667  7574 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.117981  7574 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:17.123522  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:17.124467  7462 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:17.125169  7462 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:17.125350  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 3126) took 1884 ms. Trace:
I20260709 13:02:17.125728  7462 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:17.130597  7418 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:17.135960  7439 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:17.137434  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 157287us
I20260709 13:02:17.138221  7439 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:17.138919  7439 raft_consensus.cc:3055] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:17.008560  7254 raft_consensus.cc:3055] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:17.142187  7254 raft_consensus.cc:740] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:17.034883  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.148239  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:17.036994  7342 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:17.037055  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:17.039134  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:17.042665  7478 raft_consensus.cc:3055] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:17.156955  1693 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:16.959918  7564 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:16.983187  6870 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:17.043453  7476 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:17.181619  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:17.183516  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:16.988986  7549 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:17.054136  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.053927  7295 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:17.189055  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:17.154754  1615 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:17.067066  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.165941  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:17.169768  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:17.156289  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 378923us
W20260709 13:02:17.170413  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 502307us
I20260709 13:02:17.200304  1659 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:17.125861  1544 rpcz_store.cc:276] 0709 13:02:15.240817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.374479 (+133662us) service_pool.cc:224] Handling call
0709 13:02:15.374812 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:16.062313 (+687501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.062350 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:16.070404 (+  8054us) log.cc:844] Serialized 52 byte log entry
0709 13:02:16.373204 (+302800us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:16.543369 (+170165us) log.cc:844] Serialized 14 byte log entry
0709 13:02:16.572277 (+ 28908us) log.cc:844] Serialized 14 byte log entry
0709 13:02:16.572454 (+   177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.572521 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.123311 (+550790us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b18001e38e0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e522 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:02:17.125105 (+  1794us) raft_consensus.cc:1685] finished
0709 13:02:17.125133 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.125284 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3846,"prepare.queue_time_us":595297,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":88,"raft.queue_time_us":97650,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":12448,"spinlock_wait_cycles":9463680,"thread_start_us":932877,"threads_started":2,"wal-append.queue_time_us":716307}
W20260709 13:02:17.143469  7537 consensus_meta.cc:287] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.000s
I20260709 13:02:17.176995  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:17.075138  7563 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:17.185916  1620 raft_consensus.cc:2376] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15. Re-sending same reply.
I20260709 13:02:17.144138  7439 raft_consensus.cc:740] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:17.169378  7478 raft_consensus.cc:740] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:02:17.208817  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 448781us
I20260709 13:02:17.208989  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.203878  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.205308  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.195515  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:17.171636  7564 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.216044  1587 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:17.192377  7383 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.219161  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.172184  7342 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:17.224097  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.194049  7552 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:17.212085  1615 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:02:17.201001  7580 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:17.226334  1539 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
W20260709 13:02:17.211459  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 493514us
W20260709 13:02:17.222906  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.229176  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:17.143534  7254 consensus_queue.cc:260] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:17.307709  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.309801  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.312566  1618 raft_consensus.cc:2368] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19.
I20260709 13:02:17.315562  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.317245  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.318773  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.319475  1615 raft_consensus.cc:2368] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19.
I20260709 13:02:17.319561  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:17.320150  1617 raft_consensus.cc:2376] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15. Re-sending same reply.
I20260709 13:02:17.309082  1692 raft_consensus.cc:2368] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19.
I20260709 13:02:17.216845  7564 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:17.323661  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:17.324301  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 124080us
I20260709 13:02:17.325515  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.325804  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.210543  7106 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:02:17.331712  1618 raft_consensus.cc:2393] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 14: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:17.332135  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:17.320768  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 80919.2us
I20260709 13:02:17.335459  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:17.335843  1659 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:17.208642  7537 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:17.343849  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.332990  1512 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:02:17.326112  7074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.011s	sys 0.002s
I20260709 13:02:17.240569  7580 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:17.363579  1615 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:17.321173  7258 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.369194  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:17.313092  7436 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:17.368762  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:17.332465  7378 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:17.368681  1587 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:17.326891  7476 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:17.368539  7208 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:17.240253  7383 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:17.307585  7589 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:17.365370  7074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.012s	sys 0.002s
I20260709 13:02:17.331712  7417 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:17.374199  1692 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 18. Current term is 19. Ops: []
W20260709 13:02:17.566062  7591 log.cc:927] Time spent T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
W20260709 13:02:17.435359  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 61981.7us
I20260709 13:02:17.437758  1546 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:17.314000  7552 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:17.567490  7587 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:02:17.512035  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.371783  7254 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:17.372906  1659 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:17.368898  7369 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:17.434881  7569 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:17.375097  7580 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:17.568322  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.565680  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:02:17.596364  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 227746us
I20260709 13:02:17.572927  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:02:17.600909  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 236268us
I20260709 13:02:17.576083  1585 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:17.441319  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.623500  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 900) took 1005 ms. Trace:
I20260709 13:02:17.665364  1622 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 17: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:17.666213  1614 raft_consensus.cc:2368] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19.
W20260709 13:02:17.667558  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 93612.4us
I20260709 13:02:17.667611  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:17.668648  1585 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:17.668970  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:17.628983  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:17.569094  7571 consensus_meta.cc:287] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.505s	user 0.004s	sys 0.006s
I20260709 13:02:17.685132  7571 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:17.607049  7476 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:17.564145  7258 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:17.506742  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:17.651098  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 278225us
I20260709 13:02:17.698282  1659 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:17.672000  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:17.663892  1542 rpcz_store.cc:276] 0709 13:02:16.618128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.620533 (+  2405us) service_pool.cc:224] Handling call
0709 13:02:16.620849 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.686356 (+ 65507us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:02:16.686647 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.187879 (+501232us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:17.187929 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:17.187994 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.623281 (+435287us) spinlock_profiling.cc:243] Waited 65.3 ms on lock 0x7b54001874d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:17.623327 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.623437 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8602,"prepare.queue_time_us":3212,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":8902,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":8029,"spinlock_wait_cycles":150124800,"thread_start_us":492201,"threads_started":1,"wal-append.queue_time_us":648880}
I20260709 13:02:17.660247  7569 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:17.635654  7417 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:17.660074  7406 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:17.659935  7369 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.669548  1512 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:17.683864  7342 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:17.684540  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:17.335777  7439 consensus_queue.cc:260] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:17.689203  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:17.694937  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:17.688375  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:17.606578  7192 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:17.699879  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 64841.1us
I20260709 13:02:17.612010  7208 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:17.700680  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:17.705595  1585 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:17.724869  1693 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 18. Current term is 19. Ops: []
W20260709 13:02:17.726652  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 57168.3us
W20260709 13:02:17.688030  7592 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:02:17.734853  1659 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:17.740933  1512 leader_election.cc:400] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19.
I20260709 13:02:17.732687  1696 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:02:17.741276  1512 leader_election.cc:403] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:02:17.688748  7476 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:17.696911  7589 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:17.737532  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.706063  7569 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:17.753180  1615 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:02:17.687209  7571 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:17.757198  1542 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:17.726827  7406 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:17.729583  7493 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:17.742671  1614 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:17.746709  1659 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:02:17.749878  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 44347.6us
I20260709 13:02:17.769605  1585 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:17.729763  7588 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:17.770987  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:17.772282  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:17.772886  1541 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:17.768865  1659 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:17.775460  7476 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:17.733982  7484 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:17.776762  1659 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:02:17.777643  7599 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:02:17.778606  7571 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:17.779055  7580 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:17.753572  7603 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:17.781916  7603 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19.
I20260709 13:02:17.730233  7369 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.779429  7571 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:17.730566  2237 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:17.785655  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:17.786386  1585 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:17.794978  1540 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:17.743109  7192 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.799882  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:17.752749  6866 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:17.882257  7536 log.cc:927] Time spent T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:02:17.776907  7484 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:17.798959  7537 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:17.874984  1692 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:17.861742  7383 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:17.873090  7106 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:17.838111  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:17.861482  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:17.766422  7595 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:18.079003  7595 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:02:18.079131  7600 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:02:17.862372  7585 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:17.799248  7589 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:18.082226  7585 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:17.896054  7581 log.cc:927] Time spent T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:02:17.873562  7295 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:18.084450  7585 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:18.085543  7484 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:17.862378  7478 consensus_queue.cc:260] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:17.915566  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 149035us
W20260709 13:02:18.087934  7568 consensus_meta.cc:287] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 1.155s	user 0.008s	sys 0.003s
I20260709 13:02:18.088423  7568 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.090380  7568 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:18.091205  1691 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:18.091712  7574 consensus_meta.cc:287] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.973s	user 0.011s	sys 0.000s
I20260709 13:02:18.092221  7574 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:17.871529  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 1271) took 1240 ms. Trace:
I20260709 13:02:18.098145  1613 rpcz_store.cc:276] 0709 13:02:16.630925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.102813 (+471888us) service_pool.cc:224] Handling call
0709 13:02:17.103195 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.189630 (+ 86435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.189806 (+   176us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.190371 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:02:17.520791 (+330420us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:17.520853 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.520947 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.871299 (+350352us) raft_consensus.cc:1685] finished
0709 13:02:17.871320 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.871465 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41711,"raft.queue_time_us":35005,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":12581,"thread_start_us":302198,"threads_started":1,"wal-append.queue_time_us":573426}
I20260709 13:02:18.077847  1688 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 19: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:18.109690  7595 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:18.094910  7574 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:17.796011  7342 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:18.077591  7106 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.086069  7258 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:17.909420  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 123128us
I20260709 13:02:18.146888  1585 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:18.141723  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 318820us
I20260709 13:02:17.784301  7406 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:18.121768  6870 consensus_meta.cc:287] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.931s	user 0.011s	sys 0.000s
I20260709 13:02:17.843542  7571 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:17.800050  7549 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:17.837754  7192 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.927961  7514 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:18.160106  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:18.163828  7607 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:17.927872  7584 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:18.168643  1585 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:18.171802  7580 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:18.172996  7417 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:18.146539  7603 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.087960  7478 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:18.182763  7614 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.207545  7614 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:18.185161  7564 consensus_meta.cc:287] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.843s	user 0.011s	sys 0.000s
I20260709 13:02:18.195639  2237 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:02:18.211822  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:18.212635  1615 raft_consensus.cc:2393] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:18.213536  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:17.915485  7569 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.144490  7342 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:18.198822  7378 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:18.201637  7514 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.201773  7607 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.196844  7574 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:18.203373  7383 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:18.203727  7603 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.217582  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:18.219944  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:18.167027  6870 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.223136  1585 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:18.226287  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:18.231832  1688 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:18.201867  7617 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:18.232772  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:18.229732  1620 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:18.220847  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:18.217787  7550 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.217974  7588 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:18.220564  7342 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:18.219740  7378 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.253508  7378 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:18.254081  7550 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:18.255558  7617 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.256345  7550 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:18.256914  7550 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:18.257679  7617 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:18.259948  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:18.260526  1690 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:18.245504  7569 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:18.267465  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.274864  7254 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:18.275719  2239 raft_consensus.cc:2393] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 16: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:18.275501  7254 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.276703  6870 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:18.277570  7254 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:18.280323  7342 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.283941  7614 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:18.285660  7342 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:18.286224  1690 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:18.216044  7564 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.293465  7564 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:18.299053  7106 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:18.299896  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 174918us
I20260709 13:02:18.307211  1688 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:18.228899  7574 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:18.317996  2238 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:02:18.319783  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 2037) took 1626 ms. Trace:
I20260709 13:02:18.320148  1546 rpcz_store.cc:276] 0709 13:02:16.693434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.871282 (+177848us) service_pool.cc:224] Handling call
0709 13:02:16.954890 (+ 83608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.636044 (+681154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.319611 (+683567us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54002e9354. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:18.319740 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109960960}
I20260709 13:02:18.322762  7607 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:18.226055  7295 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:02:18.326186  7553 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:18.327549  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:18.328181  2243 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:02:18.333552  7369 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.337602  7192 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.339049  1617 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 18: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:18.316103  7574 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:18.355544  1511 leader_election.cc:336] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Timed out: RequestConsensusVote RPC to 127.0.107.194:39981 timed out after 2.065s (SENT)
W20260709 13:02:18.364136  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 141032us
I20260709 13:02:18.374258  2242 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:18.380605  1585 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:02:18.388613  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 164199us
I20260709 13:02:18.389722  1587 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:18.394876  1511 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:18.411213  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:18.415580  7383 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:18.416436  7607 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:18.418474  7614 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.420861  1511 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:18.421305  7369 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:18.421738  7564 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:18.422008  7369 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:18.422135  1511 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:18.422585  7369 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.422988  7564 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:18.416425  7603 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:18.428220  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:18.428653  7478 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.429463  7478 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.431205  7607 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.432859  1511 leader_election.cc:400] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19.
I20260709 13:02:18.433215  1511 leader_election.cc:403] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:18.398056  7571 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.436836  7571 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:18.437517  7607 raft_consensus.cc:3060] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:02:18.419209  7614 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.440675  7614 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:18.443451  7588 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:18.443640  1511 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:18.444490  7603 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:18.445732  1511 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:18.392819  6866 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:18.482228  6866 raft_consensus.cc:697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:18.458626  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:18.483279  6866 consensus_queue.cc:237] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.484885  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2870) took 1321 ms. Trace:
I20260709 13:02:18.460618  7406 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.468845  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 3248) took 1857 ms. Trace:
I20260709 13:02:18.473311  7192 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:18.475694  7588 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:18.476322  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 61142.2us
I20260709 13:02:18.496730  1587 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:18.442929  7595 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.488545  1621 rpcz_store.cc:276] 0709 13:02:16.611452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.611591 (+   139us) service_pool.cc:224] Handling call
0709 13:02:16.611877 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.799935 (+188058us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:02:17.176527 (+376592us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.324592 (+1148065us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b18002afd60. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e5b8c0a 00007fc497cf8219 00007fc48e640a40 00007fc48e63b4e4 00007fc48e63b455 00007fc4951233c7 00007fc4917359a7 00007fc4917450bf 00007fc491745038
0709 13:02:18.324881 (+   289us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.325090 (+   209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:18.325145 (+    55us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:02:18.325205 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.468607 (+143402us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b540033ac54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:18.468653 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.468787 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":239826,"prepare.queue_time_us":1291476,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":101,"raft.queue_time_us":193950,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":10449,"spinlock_wait_cycles":457786368,"thread_start_us":538489,"threads_started":2,"wal-append.queue_time_us":548508}
I20260709 13:02:18.478801  7607 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19.
I20260709 13:02:18.403038  7550 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:02:18.422991  7369 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:18.481621  7478 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:18.485311  1691 rpcz_store.cc:276] 0709 13:02:17.163884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.164084 (+   200us) service_pool.cc:224] Handling call
0709 13:02:17.176821 (+ 12737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.091622 (+914801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.483204 (+391582us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b54002c5454. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:18.484818 (+  1614us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102229760}
I20260709 13:02:18.520191  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:18.487771  1511 leader_election.cc:400] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19.
I20260709 13:02:18.514585  1690 raft_consensus.cc:1240] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:18.485344  7603 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:18.522680  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:18.530726  1511 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:18.533324  1511 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:18.534402  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:18.536108  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:18.536947  1613 raft_consensus.cc:2393] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 14: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:18.537969  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:18.538368  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:18.539609  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:18.540841  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:18.541694  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:18.542335  1622 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:18.543303  7631 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:18.543908  7631 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.546449  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:18.546977  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:18.548061  1511 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:18.550606  1622 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
I20260709 13:02:18.507371  7588 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.534834  7607 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:18.559147  7607 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:18.560236  7607 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.537112  7383 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:18.551985  7603 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:18.553330  1619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:18.566051  1619 raft_consensus.cc:606] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:18.535498  7567 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:18.552553  7564 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:18.555858  7406 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:18.557235  1614 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:18.558481  7588 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:18.554111  1511 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:18.566463  1619 raft_consensus.cc:614] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:18.566462  7595 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:18.572007  7631 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:18.534986  7574 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.573556  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2824) took 1062 ms. Trace:
I20260709 13:02:18.573223  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:18.574072  1617 rpcz_store.cc:276] 0709 13:02:17.511534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.511766 (+   232us) service_pool.cc:224] Handling call
0709 13:02:18.573343 (+1061577us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b54001e7154. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:18.573474 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1614778112}
I20260709 13:02:18.574682  7603 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:18.575383  1511 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:18.576407  7383 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:18.575477  7574 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:18.576992  1511 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:18.581346  1511 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:18.581694  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 85044.5us
W20260709 13:02:18.581815  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 3146) took 1959 ms (client timeout 1670 ms). Trace:
W20260709 13:02:18.582278  1539 rpcz_store.cc:269] 0709 13:02:16.622025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.642530 (+ 20505us) service_pool.cc:224] Handling call
0709 13:02:18.581632 (+1939102us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b540006a4d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:18.581725 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667838336}
I20260709 13:02:18.580667  7564 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:18.575503  7603 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:18.587809  7603 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:18.588249  7603 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:18.591408  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:18.592657  7439 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:18.593765  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:18.603986  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:18.604894  1695 raft_consensus.cc:2393] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 17: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:18.605400  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:18.606041  1615 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:02:18.583418  7574 consensus_queue.cc:1059] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:18.609619  1621 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:18.610786  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:18.610880  1587 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:18.608566  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:18.613516  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:18.618248  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:18.618407  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:18.619040  1539 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:18.621500  1511 leader_election.cc:400] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19.
I20260709 13:02:18.617273  2210 leader_election.cc:304] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:18.622476  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:18.623560  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:18.624359  1688 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:18.624858  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:18.626807  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:18.627403  1545 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:18.629194  7623 raft_consensus.cc:3055] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:18.629576  7623 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:18.630299  7623 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.632063  1546 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:18.633265  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:18.636229  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 1.01105e+06us
I20260709 13:02:18.637987  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:18.638718  7254 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:18.639180  7254 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.639597  7254 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:18.621639  7563 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:18.641875  7563 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.639315  7588 consensus_queue.cc:1059] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:18.645449  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:18.645982  1540 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:18.647576  1660 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:18.651505  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:18.654265  1541 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 18: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:18.651680  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:18.652292  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:18.655587  1546 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 20.
I20260709 13:02:18.655768  7563 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:18.616444  7580 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:18.658121  7406 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:18.658622  7406 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 19 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:18.659502  7406 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.667490  7574 raft_consensus.cc:3055] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:18.667943  7574 raft_consensus.cc:740] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:18.669056  7553 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:18.668743  7574 consensus_queue.cc:260] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.669512  7553 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:18.669983  7574 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:18.670722  7383 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:18.671685  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 60929.2us
I20260709 13:02:18.671846  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:18.673615  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:18.623629  7417 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:18.679606  1511 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:18.682405  1587 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:18.690615  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:18.685003  1545 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:18.682188  7123 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:18.739410  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 47124us
W20260709 13:02:18.739717  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 47109.8us
I20260709 13:02:18.741176  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:18.741765  1694 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:02:18.746243  1688 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
W20260709 13:02:18.740161  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 51270.7us
I20260709 13:02:18.610287  7369 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.747366  2211 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:18.612792  7603 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.759470  7603 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:18.759846  7549 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:18.756982  7633 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:18.753479  1660 connection.cc:256] RPC call timeout handler was delayed by -1.352050193000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260709 13:02:18.763825  7535 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:18.761415  2211 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:18.692374  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:18.793421  1691 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 19: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:02:18.756325  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 73982.9us
I20260709 13:02:18.794140  1587 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:18.763890  2210 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:18.705015  7383 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:18.769016  7632 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:02:18.772063  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.776930  7208 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:18.692621  7595 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:18.789113  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 1016) took 1464 ms. Trace:
I20260709 13:02:18.804517  1689 rpcz_store.cc:276] 0709 13:02:17.324803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.324926 (+   123us) service_pool.cc:224] Handling call
0709 13:02:17.360379 (+ 35453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.689980 (+329601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.690026 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.700692 (+ 10666us) log.cc:844] Serialized 26 byte log entry
0709 13:02:17.898250 (+197558us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:17.898304 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.780727 (+882423us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54002c6d54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:18.780793 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.780847 (+    54us) raft_consensus.cc:1685] finished
0709 13:02:18.780860 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.789043 (+  8183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757384448,"thread_start_us":132210,"threads_started":1,"wal-append.queue_time_us":328622}
I20260709 13:02:18.789362  1660 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:18.688222  7560 consensus_queue.cc:1059] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:02:18.770058  7611 consensus_queue.cc:1059] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:02:18.812391  7611 raft_consensus.cc:3055] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:18.812768  7611 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:18.796871  1539 raft_consensus.cc:2393] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:02:18.813570  7594 log.cc:927] Time spent T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 1.254s	user 0.003s	sys 0.010s
I20260709 13:02:18.815900  7369 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:18.789958  1694 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:18.688488  7617 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 13:02:18.688362  7563 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 13:02:18.801795  7549 raft_consensus.cc:697] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:18.793033  7633 raft_consensus.cc:697] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:18.823688  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:18.673993  7586 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:18.803292  7631 raft_consensus.cc:2804] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:18.796519  7383 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:18.828728  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:18.830435  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:18.839843  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:18.853924  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:18.824877  7623 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:18.824345  7569 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:18.805738  7632 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:18.864494  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 100662us
I20260709 13:02:18.861837  1613 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:18.866026  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:18.866808  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:18.860041  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:18.830610  7383 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:18.868808  7478 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:18.863816  7569 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:18.871526  7633 consensus_queue.cc:237] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:18.860502  7500 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:18.888612  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:18.878769  7553 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.827986  7595 raft_consensus.cc:697] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:18.881491  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:02:18.882968  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 192436us
I20260709 13:02:18.882920  1613 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:02:18.884495  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 144085us
I20260709 13:02:18.813594  7611 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.853336  7580 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.854429  7631 raft_consensus.cc:697] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:18.887370  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:18.896623  1512 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:18.874363  7549 consensus_queue.cc:237] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.888378  7569 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:18.888002  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:18.961782  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:18.890287  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 68424.6us
I20260709 13:02:18.956534  1622 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:02:18.960958  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:18.992103  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.024307  1694 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:18.949509  2239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45866 (request call id 1168) took 1801 ms. Trace:
I20260709 13:02:18.946854  1615 raft_consensus.cc:2410] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:02:19.025103  2239 rpcz_store.cc:276] 0709 13:02:17.147725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.147903 (+   178us) service_pool.cc:224] Handling call
0709 13:02:18.949275 (+1801372us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54005ab754. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:18.949421 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2590211840}
I20260709 13:02:18.950867  2238 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:18.986171  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:19.027032  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:19.027709  1691 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 18: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:18.977659  1689 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:19.028378  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:18.979267  1692 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:19.029037  1688 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:02:18.943493  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:19.030193  2241 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:18.957870  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:19.030862  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:18.896226  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:02:18.989312  7635 log.cc:927] Time spent T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.054s	user 0.003s	sys 0.000s
I20260709 13:02:18.896847  1511 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:18.889864  7500 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.063964  2241 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 22.
I20260709 13:02:19.033330  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:18.981956  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:18.920397  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:18.959786  1443 catalog_manager.cc:5697] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 15 to 16, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:18.943607  7595 consensus_queue.cc:237] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.970424  7514 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:19.049539  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 152752us
I20260709 13:02:19.062980  1613 raft_consensus.cc:2368] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 19. Current term is 20.
I20260709 13:02:19.066138  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:19.066484  1511 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:02:19.033015  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 240033us
I20260709 13:02:19.064913  1696 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:19.067658  2211 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:18.989521  7636 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.052s	user 0.000s	sys 0.003s
I20260709 13:02:19.071722  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:19.000576  7586 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.910025  7462 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:19.095829  1586 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:19.065861  7500 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:19.110052  1443 catalog_manager.cc:5697] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:18.954102  7552 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:18.936966  7632 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:18.941190  7553 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:19.009868  7295 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.119930  7295 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:19.121366  7642 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.121899  7642 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.910367  7580 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:19.065757  7637 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:19.085078  1689 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:19.123044  7637 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:19.087795  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:19.123467  7637 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:19.125471  7580 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:19.089154  1616 raft_consensus.cc:1240] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:19.108188  7563 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.127099  7563 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:19.127704  7573 raft_consensus.cc:3055] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:19.128106  7573 raft_consensus.cc:740] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:19.128649  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:19.128916  7573 consensus_queue.cc:260] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:18.938072  7631 consensus_queue.cc:237] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:19.130146  7573 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:19.078122  7417 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:19.095356  7586 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:19.144729  1587 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:19.111698  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:19.122493  7295 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:19.083722  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.125733  7640 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:02:19.129334  2238 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:19.108793  7611 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:19.100780  7589 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:19.006552  7383 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:19.147758  1586 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:19.076042  7644 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:18.940110  7254 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:19.167207  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 267901us
I20260709 13:02:19.168255  7637 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:19.172379  1511 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:19.077196  2211 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:19.061517  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:19.189973  1587 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:19.192930  1512 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:19.193531  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:19.194471  1512 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:19.194563  1511 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:02:19.197960  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 50280.2us
W20260709 13:02:19.195212  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 133760us
I20260709 13:02:19.201589  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:19.201792  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:19.202327  1542 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:02:19.203195  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:19.204048  1542 raft_consensus.cc:2368] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 17. Current term is 18.
I20260709 13:02:19.204126  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:19.204826  1545 raft_consensus.cc:2368] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14.
I20260709 13:02:19.205477  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:19.206115  1545 raft_consensus.cc:2393] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:19.139510  7417 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:02:19.209808  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 132757us
I20260709 13:02:19.211633  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:19.214359  1547 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:19.216521  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:19.217710  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:19.221470  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:19.222069  1541 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:02:19.177114  7632 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:19.210074  7638 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:19.221083  7577 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:19.228749  1538 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:19.233253  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.233310  1547 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:02:19.238509  1540 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:19.240850  1546 raft_consensus.cc:1240] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:19.241513  1660 leader_election.cc:400] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 19. Current term is 20.
I20260709 13:02:19.241851  1660 leader_election.cc:403] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:02:19.197105  7607 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:19.188108  7563 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:19.208950  7564 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:19.213286  7369 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:19.250190  1586 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:19.209901  7208 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:19.171519  7553 consensus_queue.cc:1059] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:02:19.224999  7603 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:19.216282  7417 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:19.254896  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:19.213538  7106 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:19.189002  7295 consensus_queue.cc:1059] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:02:19.265615  1547 raft_consensus.cc:1240] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:02:19.263517  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:19.234300  7630 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:19.197517  7552 consensus_queue.cc:1059] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:02:19.227468  7378 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:02:19.249912  1443 catalog_manager.cc:5697] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 11 to 14, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 14 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:19.230365  7632 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:19.253113  7476 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 19. Current term is 20.
I20260709 13:02:19.209996  7560 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:02:19.308842  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:19.311013  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 60904.3us
I20260709 13:02:19.248780  7577 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:19.266563  7563 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:19.269418  1541 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:19.326326  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:19.258374  7571 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:19.249320  7514 consensus_queue.cc:1059] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:02:19.237980  7493 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:02:19.261847  7633 consensus_queue.cc:1059] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 13:02:19.265808  7208 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:02:19.313297  7636 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:19.271974  6866 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:19.327446  7632 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:19.309305  7630 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:19.356294  7584 raft_consensus.cc:3055] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:19.314256  7564 raft_consensus.cc:697] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:19.412401  7564 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:19.270790  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 244456us
I20260709 13:02:19.314724  7642 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:19.260489  7369 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.323185  7603 raft_consensus.cc:697] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:19.354632  7567 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:19.354912  7577 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:19.313117  7617 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:19.405936  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:19.439903  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:19.440243  1540 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:19.410100  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:19.439601  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 223159us
I20260709 13:02:19.441141  1546 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 10.
I20260709 13:02:19.442226  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:19.441175  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:19.359418  7106 raft_consensus.cc:697] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:19.430547  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 157983us
I20260709 13:02:19.405448  6866 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:19.434921  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:19.435005  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:19.444731  1691 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:02:19.437837  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:19.447613  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 219577us
W20260709 13:02:19.451260  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.452380  1621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:19.452806  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:19.452922  1621 raft_consensus.cc:606] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:19.453337  1621 raft_consensus.cc:614] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:19.453589  1619 raft_consensus.cc:2410] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:02:19.455154  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:19.448766  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:19.460335  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:19.462337  1546 raft_consensus.cc:2376] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19. Re-sending same reply.
I20260709 13:02:19.467406  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:19.463374  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:19.470441  1615 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
I20260709 13:02:19.464783  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:19.471716  1619 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 18: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:19.465006  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:19.465548  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:19.473321  1618 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:02:19.441838  2209 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:19.349361  7500 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:19.477546  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 907) took 2151 ms. Trace:
I20260709 13:02:19.479570  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:19.480167  1541 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:19.398710  7208 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:19.476176  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:19.486938  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:19.465936  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:19.457819  1659 leader_election.cc:400] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14.
I20260709 13:02:19.512184  1659 leader_election.cc:403] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:02:19.469480  1693 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:19.465831  1585 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:19.477927  1544 rpcz_store.cc:276] 0709 13:02:17.326217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.326376 (+   159us) service_pool.cc:224] Handling call
0709 13:02:17.326667 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.326885 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:18.968409 (+1641524us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b18002b4380. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc4912d34bc 00007fc48e62148b 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63b455 00007fc4951233c7 00007fc4917359a7 00007fc4917450bf
0709 13:02:18.968579 (+   170us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.447423 (+478844us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.477212 (+ 29789us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.477265 (+    53us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:19.477318 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.477390 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.477493 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42933,"prepare.queue_time_us":194957,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":70,"raft.queue_time_us":75,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":13151,"spinlock_wait_cycles":57902976,"thread_start_us":575244,"threads_started":3,"wal-append.queue_time_us":365708}
I20260709 13:02:19.514941  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:19.515204  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:19.512153  1616 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:19.407054  7646 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:19.415311  7630 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:19.427431  7369 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:19.517311  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:19.516268  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:19.518611  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 60801.4us
I20260709 13:02:19.417742  7584 raft_consensus.cc:740] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:19.478296  7588 raft_consensus.cc:3055] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:19.408458  7476 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:02:19.398119  7571 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:19.533888  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:19.538924  1540 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:19.607461  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:19.540627  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 74869.1us
I20260709 13:02:19.511396  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:19.609655  1546 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:19.440928  7567 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.547098  1543 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
W20260709 13:02:19.519809  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 43714.1us
I20260709 13:02:19.610589  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:19.548604  1659 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:19.548183  1544 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:19.581758  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:19.588181  1541 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:19.510322  7615 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:19.514302  7637 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:19.523218  7406 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14.
W20260709 13:02:19.622010  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 73695.1us
I20260709 13:02:19.622815  1659 leader_election.cc:400] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 17. Current term is 18.
I20260709 13:02:19.622973  1543 raft_consensus.cc:1240] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:02:19.615691  2241 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 18 LEARNER]: Advancing to term 20
I20260709 13:02:19.624451  1543 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:19.625854  1543 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:19.619508  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:19.614602  7652 log.cc:927] Time spent T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:02:19.548666  7378 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:19.480928  7535 consensus_queue.cc:1059] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.138s
W20260709 13:02:19.615407  7648 log.cc:927] Time spent T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:02:19.639053  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:19.530759  7514 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:02:19.623092  1659 leader_election.cc:403] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:19.587847  7588 raft_consensus.cc:740] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:19.481336  7617 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:19.595208  7383 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:19.552810  7586 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:19.657409  2211 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:19.616672  7615 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.617420  7567 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:19.665515  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 154687us
W20260709 13:02:19.677868  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.697109  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 88097.9us
I20260709 13:02:19.702353  2209 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:02:19.684991  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 62312.9us
I20260709 13:02:19.635564  7493 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:19.703809  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:19.707528  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:19.705590  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:19.710170  1544 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:02:19.634007  7571 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:19.547211  7646 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:19.707470  7639 log.cc:927] Time spent T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.446s	user 0.001s	sys 0.001s
I20260709 13:02:19.667677  7254 leader_election.cc:290] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:19.712085  7615 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:19.714118  7660 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.672099  7553 consensus_queue.cc:1059] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:02:19.704710  7378 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 17. Current term is 18.
I20260709 13:02:19.719264  7342 consensus_queue.cc:1059] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:02:19.961879  7342 raft_consensus.cc:3055] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:19.962260  7646 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:19.962327  7342 raft_consensus.cc:740] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:19.703917  7584 consensus_queue.cc:260] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:19.963562  7573 consensus_meta.cc:287] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.833s	user 0.009s	sys 0.016s
I20260709 13:02:19.963402  7342 consensus_queue.cc:260] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:19.964768  7342 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:19.647763  7106 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:19.916893  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 259531us
I20260709 13:02:19.633656  7666 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:19.969940  1616 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
W20260709 13:02:19.919018  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 367747us
I20260709 13:02:19.971177  1620 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:02:19.971697  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:19.698678  7406 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:19.920801  2241 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 20 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:19.972476  1616 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:19.704113  1546 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:02:19.953022  1544 raft_consensus.cc:1240] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:19.956235  7657 log.cc:927] Time spent T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.339s	user 0.003s	sys 0.012s
W20260709 13:02:19.957573  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 252029us
I20260709 13:02:19.959412  7631 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:19.960466  6866 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:19.961053  7667 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:02:19.961181  7638 consensus_meta.cc:287] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.721s	user 0.007s	sys 0.012s
I20260709 13:02:19.964046  7584 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:19.715441  7633 consensus_queue.cc:1059] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:02:19.968025  1617 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:19.647925  7603 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:19.973361  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:19.974666  1695 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:19.980006  1546 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:19.941249  7552 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:19.966274  7649 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.547s	user 0.007s	sys 0.000s
I20260709 13:02:19.941527  7571 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:19.988036  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:19.997216  7514 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.002012  7661 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:20.003813  7638 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:19.954918  7534 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:19.955458  7660 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:19.975214  7650 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.360s	user 0.005s	sys 0.002s
I20260709 13:02:19.789592  7588 consensus_queue.cc:260] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:20.014511  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:20.086215  1617 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:20.027253  7653 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.510s	user 0.000s	sys 0.001s
I20260709 13:02:19.986622  7631 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:19.989037  1544 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:19.979509  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 264710us
I20260709 13:02:20.091672  2241 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:20.094681  7631 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:20.103430  7571 consensus_queue.cc:1059] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:20.106194  1659 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:20.009027  7667 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:19.984812  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 277958us
I20260709 13:02:20.125952  2209 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:20.080598  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 3275) took 1025 ms. Trace:
I20260709 13:02:19.986830  7406 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:20.084394  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 43740.9us
W20260709 13:02:20.071415  7208 consensus_meta.cc:287] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.549s	user 0.007s	sys 0.003s
I20260709 13:02:20.126655  1614 rpcz_store.cc:276] 0709 13:02:19.055657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.055833 (+   176us) service_pool.cc:224] Handling call
0709 13:02:19.056196 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.056606 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.056646 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.070724 (+ 14078us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.260257 (+189533us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:19.260308 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.260384 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.080370 (+819986us) raft_consensus.cc:1685] finished
0709 13:02:20.080389 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.080535 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5843,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":17507,"thread_start_us":157723,"threads_started":1,"wal-append.queue_time_us":386286}
W20260709 13:02:20.119318  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 133186us
I20260709 13:02:20.068555  7633 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.161856  1585 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:20.173323  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 67232.7us
I20260709 13:02:20.043742  7684 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.105s
I20260709 13:02:20.174381  1659 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:20.094848  7500 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:20.177403  1538 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:20.071579  7514 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:20.175544  1660 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:02:20.166401  7649 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:02:20.186915  1659 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.625s (SENT) [suppressed 22 similar messages]
W20260709 13:02:20.190379  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 64404.1us
I20260709 13:02:20.159838  7383 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:20.177707  6866 raft_consensus.cc:3055] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:20.182058  7571 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:20.182440  7692 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.188488  7666 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:20.173327  7478 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:02:20.209120  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:02:20.202342  7611 consensus_meta.cc:287] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 1.011s	user 0.010s	sys 0.005s
I20260709 13:02:20.213538  1585 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:20.174078  7208 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:20.177117  7633 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:20.198113  7617 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:20.206492  7569 consensus_meta.cc:287] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 1.144s	user 0.007s	sys 0.011s
I20260709 13:02:20.203770  7500 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:02:20.236507  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 61055.7us
I20260709 13:02:20.201895  6866 raft_consensus.cc:740] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:20.249217  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:20.262059  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 3156) took 1021 ms. Trace:
I20260709 13:02:20.262616  1538 rpcz_store.cc:276] 0709 13:02:19.240754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.240883 (+   129us) service_pool.cc:224] Handling call
0709 13:02:20.261787 (+1020904us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b5400186fd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:20.261944 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1784528128}
I20260709 13:02:20.265112  7642 raft_consensus.cc:3055] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:20.265630  7642 raft_consensus.cc:740] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:20.267872  1543 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 16. Current term is 17. Ops: [15.9-16.10]
I20260709 13:02:20.271453  7622 raft_consensus.cc:3055] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:20.271929  7622 raft_consensus.cc:740] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:20.272927  7622 consensus_queue.cc:260] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:20.274201  7622 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:20.275303  7623 raft_consensus.cc:3055] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:20.275789  7623 raft_consensus.cc:740] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:20.276685  7623 consensus_queue.cc:260] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:20.277910  7623 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:20.204293  7571 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:20.281108  7571 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:20.192647  7662 consensus_queue.cc:1059] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:02:20.287339  7574 raft_consensus.cc:3055] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:20.288139  7574 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:20.266597  7642 consensus_queue.cc:260] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:20.289309  7574 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:20.290699  7642 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:20.290807  7574 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:20.250082  1614 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:20.293195  7661 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:20.293736  7661 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:20.307349  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:20.312162  7660 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:20.217216  7378 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:20.211603  7553 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:02:20.328681  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 82517.7us
I20260709 13:02:20.200028  7383 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:20.236811  7698 raft_consensus.cc:3055] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:20.340725  7552 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:02:20.367182  7676 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.146s	user 0.004s	sys 0.000s
I20260709 13:02:20.217599  7683 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.172s
W20260709 13:02:20.384276  7674 log.cc:927] Time spent T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:02:20.384454  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:20.384792  7500 raft_consensus.cc:697] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:20.215091  7692 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:20.329484  7378 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.392616  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:20.395175  1687 raft_consensus.cc:1240] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:20.409257  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.393922  1693 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18. Ops: []
W20260709 13:02:20.414619  7567 consensus_meta.cc:287] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.691s	user 0.011s	sys 0.000s
I20260709 13:02:20.393121  7679 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.423153  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:20.396359  7687 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:20.427731  7684 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:20.395146  7666 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.429364  7245 raft_consensus.cc:3055] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:20.391063  7439 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 13:02:20.430017  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 45652.7us
I20260709 13:02:20.431747  1691 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:20.433375  1617 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:02:20.461165  2210 leader_election.cc:304] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:20.439388  7378 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:20.440548  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 253630us
I20260709 13:02:20.386982  7681 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:20.314783  7569 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:20.369868  7698 raft_consensus.cc:740] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:20.482077  7406 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:20.482287  7700 log.cc:927] Time spent T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:02:20.482560  7698 consensus_queue.cc:260] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:20.483630  1692 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:02:20.483770  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 2839) took 1031 ms. Trace:
I20260709 13:02:20.484205  7698 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:20.458729  7679 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:20.485024  7569 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:20.488339  7672 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:02:20.488490  7679 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:20.484201  1622 rpcz_store.cc:276] 0709 13:02:19.452737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.452840 (+   103us) service_pool.cc:224] Handling call
0709 13:02:19.453159 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.453461 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.453488 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.453988 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.680615 (+226627us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:19.714596 (+ 33981us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.936591 (+221995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.936688 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.483556 (+546868us) raft_consensus.cc:1685] finished
0709 13:02:20.483579 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.483710 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28079,"prepare.queue_time_us":38773,"prepare.run_cpu_time_us":8891,"prepare.run_wall_time_us":158389,"raft.queue_time_us":245127,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":189,"spinlock_wait_cycles":38144,"thread_start_us":226027,"threads_started":1,"wal-append.queue_time_us":626505}
I20260709 13:02:20.490746  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 3162) took 1179 ms. Trace:
I20260709 13:02:20.491407  1547 rpcz_store.cc:276] 0709 13:02:19.310900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.311437 (+   537us) service_pool.cc:224] Handling call
0709 13:02:19.311848 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.312129 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.312165 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.323288 (+ 11123us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.605897 (+282609us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:19.605967 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.606059 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.490452 (+884393us) raft_consensus.cc:1685] finished
0709 13:02:20.490482 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.490669 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":209836,"threads_started":1,"wal-append.queue_time_us":834237}
I20260709 13:02:20.503516  7500 consensus_queue.cc:237] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:20.507643  7667 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:20.509627  7478 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:20.510402  7478 raft_consensus.cc:697] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:20.511655  7478 consensus_queue.cc:237] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:20.516032  7699 log.cc:927] Time spent T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:02:20.518311  7689 log.cc:927] Time spent T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:02:20.524304  7692 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:20.529747  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.538416  7630 consensus_meta.cc:287] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.949s	user 0.009s	sys 0.000s
I20260709 13:02:20.540315  7633 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:20.542016  7208 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:20.543174  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 3154) took 1316 ms. Trace:
I20260709 13:02:20.543718  1539 rpcz_store.cc:276] 0709 13:02:19.226591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.226846 (+   255us) service_pool.cc:224] Handling call
0709 13:02:19.248692 (+ 21846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.511203 (+262511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.512579 (+  1376us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.528176 (+ 15597us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.974535 (+446359us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:19.974589 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.974660 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.542884 (+568224us) raft_consensus.cc:1685] finished
0709 13:02:20.542914 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.543101 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":65954,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":29202,"thread_start_us":601470,"threads_started":2,"wal-append.queue_time_us":757201}
I20260709 13:02:20.379927  7552 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:20.455487  1694 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:02:20.427827  7697 log.cc:927] Time spent T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:02:20.360430  7590 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:20.461853  7666 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:20.481009  7691 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:02:20.547485  2237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45882 (request call id 1026) took 1062 ms. Trace:
I20260709 13:02:20.571776  2237 rpcz_store.cc:276] 0709 13:02:19.484632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.487316 (+  2684us) service_pool.cc:224] Handling call
0709 13:02:19.487592 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.487813 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.487839 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.488263 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.925507 (+437244us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:19.925549 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.925632 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.304042 (+378410us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:20.473260 (+169218us) raft_consensus.cc:1685] finished
0709 13:02:20.473291 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.547391 (+ 74100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6915968,"thread_start_us":379391,"threads_started":1,"wal-append.queue_time_us":614253}
I20260709 13:02:20.457288  7245 raft_consensus.cc:740] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:20.570922  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 1295) took 1085 ms. Trace:
I20260709 13:02:20.481554  7383 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:20.450115  7615 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:20.588910  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 375424us
I20260709 13:02:20.553845  7633 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:02:20.562011  7671 log.cc:927] Time spent T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
I20260709 13:02:20.589830  1618 rpcz_store.cc:276] 0709 13:02:19.485455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.489794 (+  4339us) service_pool.cc:224] Handling call
0709 13:02:19.490029 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.526588 (+ 36559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.526618 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.526659 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:19.526690 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.570634 (+1043944us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b54000aebd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:20.570706 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.570850 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83602688}
I20260709 13:02:20.560169  7552 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:20.602020  1614 raft_consensus.cc:2468] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
W20260709 13:02:20.454797  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 291019us
W20260709 13:02:20.607486  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.642868  6870 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:20.643769  7614 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:20.645821  2239 raft_consensus.cc:2393] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 17: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:20.644304  7614 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:20.650688  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:20.539129  7630 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:20.641373  7632 consensus_meta.cc:287] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 1.215s	user 0.010s	sys 0.003s
W20260709 13:02:20.645138  7417 consensus_meta.cc:287] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 1.332s	user 0.012s	sys 0.000s
I20260709 13:02:20.655304  1687 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 17. Current term is 18. Ops: []
W20260709 13:02:20.664327  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 51552.8us
I20260709 13:02:20.452171  7687 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:20.569716  7590 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:20.641223  7631 consensus_meta.cc:287] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
I20260709 13:02:20.551261  6866 consensus_queue.cc:260] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:20.611155  7534 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:20.647929  7476 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.007s	sys 0.026s
I20260709 13:02:20.690924  1621 raft_consensus.cc:1240] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:20.678344  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:20.640674  7698 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:20.469969  7567 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:20.654428  7705 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.650604  7514 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:20.696018  2210 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:20.696668  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 3163) took 1382 ms. Trace:
I20260709 13:02:20.701356  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:20.696738  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:20.673290  7668 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:20.700346  1618 raft_consensus.cc:1240] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:20.700451  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:20.701787  1545 rpcz_store.cc:276] 0709 13:02:19.314313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.314669 (+   356us) service_pool.cc:224] Handling call
0709 13:02:19.315099 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.315392 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.315416 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.333771 (+ 18355us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.603546 (+269775us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:19.603613 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.603690 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.696435 (+1092745us) raft_consensus.cc:1685] finished
0709 13:02:20.696456 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.696596 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":197064,"threads_started":1,"wal-append.queue_time_us":754100}
I20260709 13:02:20.709488  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:20.709563  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:20.710611  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:20.711858  1619 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:02:20.694170  7476 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.007s	sys 0.027s
I20260709 13:02:20.715864  1511 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:20.720475  1542 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:20.646799  7633 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:20.731120  1613 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:20.688512  7571 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:20.727479  1511 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:20.681010  7417 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:20.691318  7631 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:20.699707  7245 consensus_queue.cc:260] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:20.774072  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.760962  1542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 3161) took 1452 ms (client timeout 1769 ms). Trace:
W20260709 13:02:20.776311  1542 rpcz_store.cc:269] 0709 13:02:19.308383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.308535 (+   152us) service_pool.cc:224] Handling call
0709 13:02:20.760668 (+1452133us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54000b5754. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:20.760859 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2081430912}
W20260709 13:02:20.733647  1692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50480 (request call id 1031) took 1703 ms (client timeout 2117 ms). Trace:
W20260709 13:02:20.782557  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.784080  1619 raft_consensus.cc:1240] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:20.784276  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:20.677309  7632 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:20.688930  7703 consensus_queue.cc:1059] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.086s
I20260709 13:02:20.697921  7534 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:20.702473  7698 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:20.713020  7705 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:20.981051  1620 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:20.979710  1689 raft_consensus.cc:1240] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18. Ops: []
W20260709 13:02:20.779961  1692 rpcz_store.cc:269] 0709 13:02:19.030202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.030656 (+   454us) service_pool.cc:224] Handling call
0709 13:02:20.733410 (+1702754us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b540044b454. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:20.733574 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3339079040}
I20260709 13:02:20.983561  2245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:55918
I20260709 13:02:21.266429  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:21.319198  2239 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45866 (request call id 1183) took 1738 ms (client timeout 1728 ms). Trace:
I20260709 13:02:21.043745  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:21.319944  2239 rpcz_store.cc:269] 0709 13:02:19.581355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.581493 (+   138us) service_pool.cc:224] Handling call
0709 13:02:21.319011 (+1737518us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002ad5d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:21.319133 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2377359616}
I20260709 13:02:21.320727  1691 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:20.976797  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 190068us
W20260709 13:02:21.087832  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.803227  1538 raft_consensus.cc:1275] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:02:20.798840  1659 leader_election.cc:336] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.670s (SENT)
W20260709 13:02:21.323089  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 524203us
I20260709 13:02:21.277572  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:21.266423  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:20.792141  1542 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:02:21.327564  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 600059us
I20260709 13:02:20.870126  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:20.960266  1546 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:21.328670  1547 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:20.793165  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:21.329478  1511 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:20.978001  1539 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:20.760317  7615 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:21.173892  7569 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.330895  7569 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:21.331341  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:21.332304  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:21.332794  1538 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:21.333171  7569 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:20.755522  7708 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:02:21.337033  7632 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:21.337951  7123 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.338488  7123 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:21.340920  7123 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:20.725476  7383 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.341173  7680 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:21.341833  7383 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:21.343962  7383 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:20.725870  7702 raft_consensus.cc:2804] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:20.727624  7660 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:20.764374  7630 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:21.258064  7342 consensus_meta.cc:287] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 1.274s	user 0.013s	sys 0.001s
W20260709 13:02:20.768533  7369 consensus_meta.cc:287] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 1.173s	user 0.006s	sys 0.005s
I20260709 13:02:21.298182  7666 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:21.345664  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:21.345592  7369 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:21.346683  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 2845) took 1881 ms. Trace:
I20260709 13:02:21.347209  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:21.347959  7369 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:21.347734  7660 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:20.773056  7687 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:21.349159  1586 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:21.344470  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:21.349936  7660 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:21.350150  1688 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:21.344413  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:21.350934  1543 raft_consensus.cc:2468] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 6.
I20260709 13:02:21.351078  7564 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:21.345052  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:21.351553  7564 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:21.352013  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:21.352617  1540 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 17: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:21.353686  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 2059) took 1915 ms. Trace:
I20260709 13:02:21.354220  1541 raft_consensus.cc:1240] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:20.749148  7462 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:21.354025  1540 rpcz_store.cc:276] 0709 13:02:19.438186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.607190 (+169004us) service_pool.cc:224] Handling call
0709 13:02:21.353504 (+1746314us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54001298d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:21.353634 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4011111680}
I20260709 13:02:21.354985  1618 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:21.329777  1544 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
W20260709 13:02:21.356258  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.357270  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:21.347077  1613 rpcz_store.cc:276] 0709 13:02:19.465512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.466401 (+   889us) service_pool.cc:224] Handling call
0709 13:02:19.466756 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.731599 (+1264843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.346452 (+614853us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540042ca54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:21.346622 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2902483840}
I20260709 13:02:21.358106  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:21.359580  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.756616  7704 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:02:20.753511  7690 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 13:02:21.337280  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:21.378784  1539 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 16: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:02:21.262667  7607 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.005s	sys 0.031s
I20260709 13:02:21.373524  1688 raft_consensus.cc:2393] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 18: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:21.369350  1692 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:02:21.374673  1613 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 21. Current term is 22. Ops: []
W20260709 13:02:21.381953  1585 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.050s	sys 0.099s
W20260709 13:02:20.772233  7584 consensus_meta.cc:287] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.755s	user 0.011s	sys 0.000s
W20260709 13:02:21.316615  7718 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 13:02:21.382736  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 53329.9us
W20260709 13:02:21.371484  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 46683.7us
W20260709 13:02:21.377024  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 98733.1us
I20260709 13:02:21.386308  1622 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
W20260709 13:02:21.387869  1585 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.050s	sys 0.100s
I20260709 13:02:21.352087  7564 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:21.044346  7643 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.386309  2237 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:02:21.327767  7245 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:21.395074  1538 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
W20260709 13:02:21.418185  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 660961us
I20260709 13:02:21.425201  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:21.427058  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.427539  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.427882  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.428203  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.420317  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:21.392510  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:21.144129  7590 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:21.356572  7637 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.355726  7603 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.440732  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:21.443080  1692 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:20.795085  7514 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:21.364701  7687 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:21.450644  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:21.464148  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:20.725473  7668 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:21.472783  1619 raft_consensus.cc:2393] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 13:02:21.473857  7714 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
W20260709 13:02:21.474973  7709 log.cc:927] Time spent T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.513s	user 0.001s	sys 0.002s
I20260709 13:02:21.422096  7369 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:21.476738  7567 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:21.430253  7383 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:21.447132  7670 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.477530  7705 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:21.404146  7660 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:21.521541  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:21.521499  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 50382.5us
I20260709 13:02:21.215610  7712 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.589s
I20260709 13:02:21.392088  7702 raft_consensus.cc:697] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:21.530153  1691 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
I20260709 13:02:21.484644  7514 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:21.560624  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:21.584841  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:21.584499  1692 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:21.467593  7614 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:21.606292  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:21.612797  1619 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 12.
I20260709 13:02:21.616070  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:21.530267  7569 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.488536  7632 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:21.539398  7645 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:21.645566  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 2334) took 1246 ms. Trace:
I20260709 13:02:21.564052  1587 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:21.566951  7686 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:02:21.670323  1513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.072s	sys 0.114s
W20260709 13:02:21.670706  1513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.072s	sys 0.114s
I20260709 13:02:21.461486  7637 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:21.447652  7643 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:21.655055  1690 rpcz_store.cc:276] 0709 13:02:20.398981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.399475 (+   494us) service_pool.cc:224] Handling call
0709 13:02:20.399811 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.426128 (+ 26317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.426161 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.426658 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.591857 (+165199us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:20.591907 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.591975 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.645104 (+1053129us) raft_consensus.cc:1685] finished
0709 13:02:21.645195 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.645494 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25871,"raft.queue_time_us":27287,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":164899,"threads_started":1,"wal-append.queue_time_us":290940}
W20260709 13:02:21.672250  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 108308us
I20260709 13:02:21.680461  1587 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:21.461200  7603 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:21.540776  7646 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 13:02:21.486711  7666 consensus_queue.cc:1059] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.141s
I20260709 13:02:21.487568  7342 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.163s
I20260709 13:02:21.616823  7571 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:21.708455  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 1299) took 2166 ms. Trace:
I20260709 13:02:21.653496  7678 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:21.624002  7417 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:21.553273  7369 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:21.657969  7623 consensus_meta.cc:287] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 1.380s	user 0.013s	sys 0.003s
I20260709 13:02:21.572681  7670 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:21.709036  1615 rpcz_store.cc:276] 0709 13:02:19.537175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.541319 (+  4144us) service_pool.cc:224] Handling call
0709 13:02:19.542066 (+   747us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:19.548629 (+  6563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.548661 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:19.549592 (+   931us) log.cc:844] Serialized 52 byte log entry
0709 13:02:19.994368 (+444776us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:19.994735 (+   367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.994983 (+   248us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.752838 (+757855us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:21.661503 (+908665us) raft_consensus.cc:1685] finished
0709 13:02:21.661532 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.702262 (+ 40730us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27437,"raft.queue_time_us":11073,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":23762,"spinlock_wait_cycles":14732544,"thread_start_us":358901,"threads_started":1,"wal-append.queue_time_us":821422}
I20260709 13:02:21.699493  1587 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:21.703989  7577 consensus_meta.cc:287] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 2.194s	user 0.009s	sys 0.006s
I20260709 13:02:21.588163  7383 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:21.719754  7588 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:21.729229  7643 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:21.679432  7632 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:02:21.726970  7552 consensus_meta.cc:287] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 1.075s	user 0.005s	sys 0.005s
I20260709 13:02:21.701545  7574 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:21.703382  7633 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:21.748641  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 49427.3us
I20260709 13:02:21.717356  7631 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:21.768469  1587 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:21.698698  7686 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:21.770236  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 301627us
I20260709 13:02:21.755416  7571 raft_consensus.cc:3055] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:21.731024  7514 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:21.657025  7569 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:21.675426  7645 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:21.772732  2241 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 13:02:21.750036  2211 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.010s	sys 0.018s
W20260709 13:02:21.797394  2211 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.010s	sys 0.018s
I20260709 13:02:21.797478  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:21.797772  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 942956us
I20260709 13:02:21.761260  7680 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:21.790139  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:21.801100  2238 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:21.753528  7476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.980s	user 0.009s	sys 0.009s
I20260709 13:02:21.769620  7574 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.780102  7698 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:21.826867  7654 log.cc:927] Time spent T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 2.350s	user 0.026s	sys 0.023s
W20260709 13:02:21.827986  7661 consensus_meta.cc:287] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 1.534s	user 0.012s	sys 0.002s
I20260709 13:02:21.828411  7661 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:21.760341  7577 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:21.775333  7633 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:21.776540  7571 raft_consensus.cc:740] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:21.738168  7678 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:21.802429  7574 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:21.826572  7642 consensus_meta.cc:287] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 1.527s	user 0.009s	sys 0.003s
I20260709 13:02:21.793684  7614 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.847371  2237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45882 (request call id 1032) took 1169 ms. Trace:
W20260709 13:02:21.802332  7476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.009s	sys 0.019s
I20260709 13:02:21.796427  7534 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:21.800796  7680 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.740240  7702 consensus_queue.cc:237] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:21.772562  7552 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
W20260709 13:02:21.835381  7622 consensus_meta.cc:287] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 1.561s	user 0.009s	sys 0.006s
W20260709 13:02:21.857215  7723 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:21.854287  7703 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.858810  7680 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:21.859777  7607 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:21.863327  7668 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:21.855755  7614 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:21.863092  7722 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:21.873528  7660 raft_consensus.cc:697] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:21.877674  7722 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:21.873245  7673 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 1.744s	user 0.009s	sys 0.018s
I20260709 13:02:21.880759  7660 consensus_queue.cc:237] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:21.885411  7686 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:21.883286  7661 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:21.884533  7645 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:21.886135  7678 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:21.894256  7722 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:21.926604  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 480400us
I20260709 13:02:21.932209  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:21.951591  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:21.954253  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:21.955219  1538 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:21.957005  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:21.957835  1538 raft_consensus.cc:2376] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17. Re-sending same reply.
I20260709 13:02:21.959059  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:21.960134  1538 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:21.961181  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:21.962301  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:21.964187  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:21.777515  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 312047us
I20260709 13:02:21.969051  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:21.970297  1545 raft_consensus.cc:2368] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17.
I20260709 13:02:21.771216  1587 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:02:21.975967  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 401836us
I20260709 13:02:21.979074  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2893) took 2545 ms. Trace:
I20260709 13:02:21.979729  1696 rpcz_store.cc:276] 0709 13:02:19.433346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.435756 (+  2410us) service_pool.cc:224] Handling call
0709 13:02:19.436111 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.449781 (+ 13670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.449825 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.450367 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.700745 (+250378us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:19.700787 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.700852 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.828097 (+2127245us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:21.977975 (+149878us) raft_consensus.cc:1685] finished
0709 13:02:21.978039 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.978720 (+   681us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13137,"raft.queue_time_us":40523,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":31093,"spinlock_wait_cycles":11846400,"thread_start_us":249952,"threads_started":1,"wal-append.queue_time_us":599415}
I20260709 13:02:21.848976  2237 rpcz_store.cc:276] 0709 13:02:20.677874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.678074 (+   200us) service_pool.cc:224] Handling call
0709 13:02:21.846963 (+1168889us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b54005f8554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:21.847168 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1596487424}
I20260709 13:02:21.986060  2245 raft_consensus.cc:606] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:21.986308  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 308441us
I20260709 13:02:21.986850  2245 raft_consensus.cc:614] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:21.989288  2243 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:21.857312  7369 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:22.013757  1538 raft_consensus.cc:1240] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:02:22.019876  7729 consensus_queue.cc:1059] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:21.874825  7607 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:21.869264  7703 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.041653  7577 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.046075  7732 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:02:22.048323  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.097744  1695 raft_consensus.cc:3055] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:22.071836  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:22.053380  7728 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:22.052404  7633 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.087590  7552 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.070144  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:22.063948  7637 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:21.862340  7476 raft_consensus.cc:3055] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:22.086755  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:22.104862  7744 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:02:22.082322  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 3284) took 2112 ms. Trace:
I20260709 13:02:22.080659  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 1309) took 1303 ms. Trace:
I20260709 13:02:22.071048  2244 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:22.053061  7734 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:02:22.069391  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 298088us
I20260709 13:02:22.065276  7569 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:22.013487  7678 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:22.073416  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:22.066179  7726 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:22.062625  7722 consensus_queue.cc:1059] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:22.060393  7740 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:22.088778  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 1298) took 2561 ms. Trace:
I20260709 13:02:21.866778  7571 consensus_queue.cc:260] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.066879  7607 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:22.127038  1695 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:22.135983  1614 rpcz_store.cc:276] 0709 13:02:20.777235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.777932 (+   697us) service_pool.cc:224] Handling call
0709 13:02:20.960970 (+183038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.980134 (+ 19164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.980184 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.980246 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:20.980294 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.079943 (+1099649us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b54002d3554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:22.080024 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.080347 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43461376}
I20260709 13:02:22.130954  7728 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.135682  1620 rpcz_store.cc:276] 0709 13:02:19.970094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.308587 (+338493us) service_pool.cc:224] Handling call
0709 13:02:20.308996 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.330738 (+1021742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.081837 (+751099us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b54002021d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:22.082125 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1544816896}
I20260709 13:02:22.149045  2237 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:02:22.144140  1621 rpcz_store.cc:276] 0709 13:02:19.527195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.527406 (+   211us) service_pool.cc:224] Handling call
0709 13:02:19.527685 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.692754 (+1165069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.088122 (+1395368us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000ad7d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:22.088485 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2673665280}
I20260709 13:02:22.163275  7493 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:22.164451  7493 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.165436  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:22.163468  7607 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.167616  7740 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.167909  7607 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.169361  2240 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:22.171834  7735 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:22.188033  7569 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:22.188789  7735 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.189110  7569 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.190090  7646 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:22.190780  7646 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.173506  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:22.150761  7728 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:22.177795  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 925) took 1206 ms. Trace:
I20260709 13:02:22.156355  7732 raft_consensus.cc:3055] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:22.201756  2238 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:22.187711  7633 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.202648  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:22.172397  1695 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.206671  7552 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.207603  7731 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:22.209052  7589 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:02:22.210237  1690 raft_consensus.cc:1275] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:22.211056  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:22.214588  1543 rpcz_store.cc:276] 0709 13:02:20.971626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.402065 (+430439us) service_pool.cc:224] Handling call
0709 13:02:21.466345 (+ 64280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:21.964123 (+497778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.964169 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:21.965102 (+   933us) log.cc:844] Serialized 26 byte log entry
0709 13:02:21.973978 (+  8876us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:21.974031 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.975171 (+  1140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.177264 (+202093us) raft_consensus.cc:1685] finished
0709 13:02:22.177285 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.177571 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":369952,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":8604,"thread_start_us":505198,"threads_started":2,"wal-append.queue_time_us":10520}
I20260709 13:02:22.179006  2211 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:02:22.226136  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 47474.7us
I20260709 13:02:22.227438  7615 raft_consensus.cc:3055] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:22.227563  7661 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:22.228047  7615 raft_consensus.cc:740] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:22.228338  7661 raft_consensus.cc:697] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:22.229245  7678 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.229413  7615 consensus_queue.cc:260] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.229708  7661 consensus_queue.cc:237] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.230845  7615 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:22.172741  7476 raft_consensus.cc:740] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:22.232074  7678 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.232640  7476 consensus_queue.cc:260] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.234153  7476 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:22.234535  2242 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:22.236106  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:22.237218  2246 raft_consensus.cc:2393] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 16: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:22.238134  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:22.238601  7383 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:22.239493  7383 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:22.239929  6866 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:22.246557  7493 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:22.237023  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:22.171015  7740 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.252010  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:22.254055  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:22.218392  7569 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:22.219781  7732 raft_consensus.cc:740] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:02:22.238601  7713 log.cc:927] Time spent T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 1.596s	user 0.006s	sys 0.008s
I20260709 13:02:22.247043  7731 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.256668  2245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55918 (request call id 1) took 1524 ms. Trace:
I20260709 13:02:22.174013  7734 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.239959  7383 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:22.262542  2245 rpcz_store.cc:276] 0709 13:02:20.729391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.729790 (+   399us) service_pool.cc:224] Handling call
0709 13:02:22.242950 (+1513160us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54007a3ad4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc491725853 00007fc4966f360a 00007fc48fc797d4 00007fc48fc79762 00007fc48fc79691 00007fc48fc7960c 00007fc48fc788c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:22.243169 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1535087360}
I20260709 13:02:22.179162  7680 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.263360  7740 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.279572  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:22.283283  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.284225  1690 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:22.271737  7383 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:22.288342  1621 raft_consensus.cc:2393] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 11: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:22.294968  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:22.301527  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:22.289404  7637 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:22.302874  7637 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.303544  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 2849) took 1602 ms. Trace:
I20260709 13:02:22.304018  1622 rpcz_store.cc:276] 0709 13:02:20.700531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.701076 (+   545us) service_pool.cc:224] Handling call
0709 13:02:22.303160 (+1602084us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b54002d3a54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:22.303352 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1554542464}
I20260709 13:02:22.304388  7734 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:22.305476  7637 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.305686  1695 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:22.313822  7378 consensus_meta.cc:287] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 1.761s	user 0.017s	sys 0.003s
W20260709 13:02:22.312407  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.276288  7574 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.298666  7607 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.277052  7552 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:22.322628  7588 consensus_meta.cc:287] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.503s	user 0.014s	sys 0.005s
I20260709 13:02:22.333499  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.336238  1443 catalog_manager.cc:5697] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.333896  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:22.299633  7569 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:22.338593  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:22.348002  7719 log.cc:927] Time spent T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.967s	user 0.002s	sys 0.007s
I20260709 13:02:22.350502  7417 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:22.352741  7589 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.353737  7589 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:22.355352  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.355902  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.348208  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 3285) took 2170 ms. Trace:
I20260709 13:02:22.365947  7571 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:22.325896  7740 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:22.372087  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.374629  7749 log.cc:927] Time spent T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:02:22.380838  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 85908.2us
I20260709 13:02:22.358186  1617 rpcz_store.cc:276] 0709 13:02:20.177990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.460490 (+282500us) service_pool.cc:224] Handling call
0709 13:02:20.465666 (+  5176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.471119 (+  5453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.471158 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.471659 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.613377 (+141718us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:20.613433 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.613523 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.237628 (+1624105us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:22.347664 (+110036us) raft_consensus.cc:1685] finished
0709 13:02:22.347689 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.348040 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5036,"raft.queue_time_us":5144,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":4055,"spinlock_wait_cycles":9572096,"thread_start_us":125730,"threads_started":1,"wal-append.queue_time_us":154859}
I20260709 13:02:22.323531  7378 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.357885  7646 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:22.395360  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
W20260709 13:02:22.403811  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.406004  7123 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.406574  7631 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.407064  7622 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:22.414705  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.414113  2241 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:22.385248  7633 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.409319  1620 raft_consensus.cc:606] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:22.427256  1694 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 18: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:22.390980  7734 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.428690  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:22.433893  7660 raft_consensus.cc:3055] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:22.434453  7660 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:22.434146  7622 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.435448  7734 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.436914  7622 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.437001  7660 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.438333  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 2340) took 1094 ms. Trace:
I20260709 13:02:22.441008  7631 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:22.443702  7462 consensus_meta.cc:287] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 1.064s	user 0.011s	sys 0.014s
I20260709 13:02:22.366837  7732 consensus_queue.cc:260] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.443923  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:22.444203  7462 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:22.444995  7732 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:22.445348  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:22.445714  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:22.446522  2244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45882 (request call id 1036) took 1664 ms. Trace:
I20260709 13:02:22.446764  7574 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.447342  7646 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.447968  7646 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.450103  7646 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:22.450301  7703 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:22.451043  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 1312) took 1662 ms. Trace:
I20260709 13:02:22.451450  1616 rpcz_store.cc:276] 0709 13:02:20.788735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.788907 (+   172us) service_pool.cc:224] Handling call
0709 13:02:21.267562 (+478655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.424708 (+157146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.424735 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.424784 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:21.424820 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.418464 (+993644us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400210554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:22.422272 (+  3808us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.450848 (+ 28576us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360953600}
I20260709 13:02:22.453846  1512 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:22.437884  7734 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:22.455502  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:22.435381  7123 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.448119  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:22.457404  7245 consensus_meta.cc:287] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.986s	user 0.014s	sys 0.013s
I20260709 13:02:22.402951  7728 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.446882  2244 rpcz_store.cc:276] 0709 13:02:20.782554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.783366 (+   812us) service_pool.cc:224] Handling call
0709 13:02:20.976873 (+193507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.156103 (+1179230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.446235 (+290132us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54006211d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:22.446430 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2514719616}
I20260709 13:02:22.460215  1621 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:22.438699  1687 rpcz_store.cc:276] 0709 13:02:21.343387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.343499 (+   112us) service_pool.cc:224] Handling call
0709 13:02:21.343796 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.572086 (+228290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.572130 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.572185 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:21.572230 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.437838 (+865608us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b540027abd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:22.437890 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.438140 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524331264}
I20260709 13:02:22.460572  1614 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:02:22.423674  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:22.470849  1585 leader_election.cc:336] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.727s (SENT)
I20260709 13:02:22.471593  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:22.472443  7417 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:22.473407  7417 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.473783  7417 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:22.474625  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 2328) took 2083 ms. Trace:
I20260709 13:02:22.474984  1689 rpcz_store.cc:276] 0709 13:02:20.391514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.391955 (+   441us) service_pool.cc:224] Handling call
0709 13:02:20.392271 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.317524 (+925253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.474196 (+1156672us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b54002251d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:22.474466 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1350277504}
I20260709 13:02:22.476284  7378 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:22.477182  1615 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:22.387903  7569 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:22.478564  7750 log.cc:927] Time spent T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:02:22.478744  7614 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.479525  7462 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:22.479863  7569 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:22.479962  7462 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:22.480489  7462 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:22.481662  7740 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.482023  1587 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:22.483458  7702 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.483733  7731 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:22.484609  7588 consensus_queue.cc:1048] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:22.486315  7123 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:22.486816  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 542948us
I20260709 13:02:22.484123  7702 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.489114  1512 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:22.489805  7734 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:22.491417  7631 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:22.471843  7564 consensus_meta.cc:287] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.987s	user 0.015s	sys 0.005s
I20260709 13:02:22.494451  7680 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:22.490998  7734 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.498498  7552 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.477739  7574 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:22.483537  1585 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:22.487118  7123 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:22.439014  7660 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:22.515738  1511 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:22.517158  7603 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:22.519937  7715 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 1.137s	user 0.000s	sys 0.006s
I20260709 13:02:22.520726  7552 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:22.520973  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 96333.6us
I20260709 13:02:22.514678  7574 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.523669  1512 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:22.524987  1659 leader_election.cc:336] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.625s (SENT)
I20260709 13:02:22.533476  1613 raft_consensus.cc:2410] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:02:22.536526  7734 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:22.537055  7123 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:22.537446  7637 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:22.551823  7637 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:22.552754  7123 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:22.553471  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 2339) took 1210 ms. Trace:
I20260709 13:02:22.553331  7462 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.553838  1694 rpcz_store.cc:276] 0709 13:02:21.343096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.344849 (+  1753us) service_pool.cc:224] Handling call
0709 13:02:22.553243 (+1208394us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002256d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:22.553402 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2462057856}
I20260709 13:02:22.556056  2243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 1185) took 2921 ms. Trace:
I20260709 13:02:22.556625  2243 rpcz_store.cc:276] 0709 13:02:19.635166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.635423 (+   257us) service_pool.cc:224] Handling call
0709 13:02:19.678430 (+ 43007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.989956 (+2311526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.555703 (+565747us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b54007a3ad4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:22.555974 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5312292736}
I20260709 13:02:22.537978  7740 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.559015  7740 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:22.562302  7740 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.563845   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:22.564041  1443 catalog_manager.cc:5697] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.493089  7564 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.555428  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.541744  1695 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:02:22.544399  7722 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:22.544559  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.546660  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:22.547273  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:22.549751  1512 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:22.567121  1443 catalog_manager.cc:5697] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:22.570706  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 60325.3us
I20260709 13:02:22.567027  7670 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.581324  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 2343) took 1237 ms. Trace:
I20260709 13:02:22.581900  1695 rpcz_store.cc:276] 0709 13:02:21.344135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.348523 (+  4388us) service_pool.cc:224] Handling call
0709 13:02:21.348861 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.097487 (+748626us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b540033ff20. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916a2dc0 00007fc49172d1c0 00007fc49172e231 00007fc49172ad8f 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c
0709 13:02:22.569742 (+472255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.581253 (+ 11511us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":756802304}
I20260709 13:02:22.571586  1659 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:22.583447  1539 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:22.546404  7417 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.591821  1688 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 16: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:22.593758  1443 catalog_manager.cc:5697] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.595494  1531 tablet_service.cc:1558] Processing DeleteTablet for tablet 479456ab418d44c4983d2bb37eb0e700 with delete_type TABLET_DATA_TOMBSTONED (TS d7158d6c3b634dc7abb69eac58eba291 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:39608
I20260709 13:02:22.596342  1443 catalog_manager.cc:5697] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 11 to 12, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:02:22.600020  7712 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
W20260709 13:02:22.600507  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.602660  7735 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:22.603030  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 3291) took 1170 ms. Trace:
I20260709 13:02:22.606130  1615 raft_consensus.cc:2410] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:02:22.598408  1443 catalog_manager.cc:5697] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 11 to 16, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 16 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.586401  7603 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:02:22.605667  7670 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:22.608994  7670 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.610203   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:22.610325  7702 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:22.611397  7722 raft_consensus.cc:697] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 19 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:22.612247  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:22.612690  7670 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.603735  7462 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:22.613046  7722 consensus_queue.cc:237] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:22.616214  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 66602.7us
W20260709 13:02:22.611536  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 86605.3us
I20260709 13:02:22.620950  1512 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:22.623370  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.624603  7726 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:22.622400  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:22.628659  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 59309.3us
I20260709 13:02:22.632712  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.628063  7633 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:22.634632  1695 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 19.
I20260709 13:02:22.635129  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.635560  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.635999  1694 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:22.636282  1687 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:02:22.634418  1688 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:22.637336  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:22.637905  1690 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:22.603542  1619 rpcz_store.cc:276] 0709 13:02:21.432502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.652482 (+219980us) service_pool.cc:224] Handling call
0709 13:02:22.307453 (+654971us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:22.308180 (+   727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.308210 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:22.313481 (+  5271us) log.cc:844] Serialized 52 byte log entry
0709 13:02:22.345669 (+ 32188us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:22.345722 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.351114 (+  5392us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.477367 (+126253us) raft_consensus.cc:1685] finished
0709 13:02:22.477388 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.602401 (+125013us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b54002d3a50. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:22.602828 (+   427us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1326,"raft.queue_time_us":427,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":2537,"spinlock_wait_cycles":1487041920,"thread_start_us":31674,"threads_started":1,"wal-append.queue_time_us":142046}
I20260709 13:02:22.635737  7417 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.629031  7637 consensus_queue.cc:1059] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:02:22.643685  1443 catalog_manager.cc:5697] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 10 to 12, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 12 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.635070  7633 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.648320  7633 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:22.653843  1619 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:02:22.655589  1444 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42122 (request call id 243) took 29509 ms (client timeout 15000 ms). Trace:
I20260709 13:02:22.656059  7728 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.656436  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 1307) took 1879 ms. Trace:
I20260709 13:02:22.657802  7564 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.659504  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 3174) took 3244 ms. Trace:
I20260709 13:02:22.660018  1541 rpcz_store.cc:276] 0709 13:02:19.414542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.621288 (+206746us) service_pool.cc:224] Handling call
0709 13:02:21.354066 (+1732778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.354653 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.658961 (+1304308us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54001298d0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:22.659336 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3983655296}
I20260709 13:02:22.662302  7589 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:22.656874  1618 rpcz_store.cc:276] 0709 13:02:20.776685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.777287 (+   602us) service_pool.cc:224] Handling call
0709 13:02:20.777624 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.365101 (+587477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.656038 (+1290937us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b5400086454. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:22.656256 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1327241472}
I20260709 13:02:22.629508  7735 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:22.669315  1586 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:22.671105  7631 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:22.671983  7631 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:22.675561  1689 raft_consensus.cc:1240] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:22.674681  7686 consensus_queue.cc:1059] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:22.666105  7383 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.680100  7686 raft_consensus.cc:3055] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:22.680637  7686 raft_consensus.cc:740] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:22.682247  7686 consensus_queue.cc:260] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.694593  1690 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:22.700340  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:02:22.700368  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 71397.8us
I20260709 13:02:22.703056  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:22.656277  1444 rpcz_store.cc:269] 0709 13:01:53.163401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.167452 (+  4051us) service_pool.cc:224] Handling call
0709 13:02:22.655316 (+29487864us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:13.247449 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:13.323678 (+ 76229us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:13.323734 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:02:13.323767 (+    33us) tablet.cc:662] Decoding operations
0709 13:02:13.325099 (+  1332us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:13.325188 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:13.325213 (+    25us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:02:13.326430 (+  1217us) tablet.cc:701] Row locks acquired
0709 13:02:13.326475 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:02:13.326669 (+   194us) write_op.cc:270] Start()
0709 13:02:13.326816 (+   147us) write_op.cc:276] Timestamp: P: 1783602133326602 usec, L: 0
0709 13:02:13.326835 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:02:13.419580 (+ 92745us) log.cc:844] Serialized 5561 byte log entry
0709 13:02:13.761774 (+342194us) spinlock_profiling.cc:243] Waited 61.3 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc48e6210ac 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b
0709 13:02:16.030881 (+2269107us) op_driver.cc:464] REPLICATION: finished
0709 13:02:16.355578 (+324697us) write_op.cc:301] APPLY: starting
0709 13:02:16.355681 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:17.133245 (+777564us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:17.133293 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:17.690068 (+556775us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:17.863345 (+173277us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:02:17.863401 (+    56us) write_op.cc:312] APPLY: finished
0709 13:02:17.863841 (+   440us) log.cc:844] Serialized 129 byte log entry
0709 13:02:18.224785 (+360944us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:18.238061 (+ 13276us) write_op.cc:454] Released schema lock
0709 13:02:18.258006 (+ 19945us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:18.258434 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:18.258464 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":615435,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":317534,"apply.run_cpu_time_us":54761,"apply.run_wall_time_us":1902844,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62759,"num_ops":14,"prepare.queue_time_us":223181,"prepare.run_cpu_time_us":28841,"prepare.run_wall_time_us":870959,"raft.queue_time_us":1550550,"raft.run_cpu_time_us":11683,"raft.run_wall_time_us":308131,"replication_time_us":2648183,"spinlock_wait_cycles":141029760,"thread_start_us":2482459,"threads_started":5,"wal-append.queue_time_us":1119179,"wal-append.run_cpu_time_us":25465,"wal-append.run_wall_time_us":3500853}]]}
I20260709 13:02:22.706596  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:22.709724  7574 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:22.709842  1443 catalog_manager.cc:5697] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 12 to 14, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 14 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.712703  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:22.713253  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:22.714445  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:22.714721  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:22.717074  2242 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:22.719151  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:22.719718  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:22.721426  7577 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:22.723356  7686 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:22.722509  1443 catalog_manager.cc:5697] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:22.715490  1620 raft_consensus.cc:2393] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 15: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:22.727186  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:22.710676  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:22.730243  7123 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.733309  2244 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:22.739853  1690 raft_consensus.cc:2376] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17. Re-sending same reply.
I20260709 13:02:22.746742  1617 raft_consensus.cc:2393] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 21: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:22.707121  7564 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:22.746304  1586 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:22.748277  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:22.749557  1587 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:22.749423  7574 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:02:22.749766  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:22.753453  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:22.750864  1618 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
W20260709 13:02:22.754881  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 135754us
I20260709 13:02:22.752753  1587 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:22.755995  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:22.752264  1443 catalog_manager.cc:5697] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:22.763217  1587 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:22.761478  1511 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:22.764236  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:22.764819  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:22.770766  2210 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:22.772701  1622 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:02:22.780642  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.781836  1694 raft_consensus.cc:2410] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:02:22.782905  7615 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:22.783430  7615 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.783638  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.783869  7615 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:22.784538  1696 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:22.750191  7698 consensus_queue.cc:1059] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:02:22.787446  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.790813  1614 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:02:22.759656  7589 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:22.773057  1622 pending_rounds.cc:85] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 11
I20260709 13:02:22.793969  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.762161  7728 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:22.785583  7476 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:22.817057  7476 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.764968  7732 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:02:22.819736  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.821188  1617 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:22.796784  1690 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:02:22.798804  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:22.772022  7637 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:22.802546  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.802909  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:22.804529  7584 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:22.799213  7670 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:22.839452  7584 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:22.840068  7584 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:22.810863  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.808259  7589 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.841403  1619 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:22.841785  7589 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:22.835834  1694 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
W20260709 13:02:22.838342  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.845829  1687 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:22.847694  7728 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:22.848660  7728 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:22.849726  7637 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.850284  7637 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.852406  7736 raft_consensus.cc:3055] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:22.854022  1689 raft_consensus.cc:2410] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:02:22.852591  7637 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:22.800191  1622 pending_rounds.cc:107] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:02:22.855068  1622 raft_consensus.cc:2889] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:22.853046  7736 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:22.858392  2210 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:22.799847  7383 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:22.864049  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:22.751056  7631 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.865523  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.876009  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.876765  1690 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
I20260709 13:02:22.879496  2242 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:22.881206  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:22.882018  1692 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:22.884034  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.858312  7670 raft_consensus.cc:697] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:22.900322  7670 consensus_queue.cc:237] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:22.903493  7560 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:22.912138  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:22.910825  7633 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.915750  7560 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:22.916167  7588 consensus_queue.cc:1048] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:22.916435  7633 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.919068  1614 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:22.916811  7588 consensus_queue.cc:1243] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:22.920404  1687 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:22.923384  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:22.880908  7698 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.924077  1694 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:02:22.887959  7577 consensus_queue.cc:1059] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:02:22.940876  2244 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:02:22.949142  1587 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:22.947654  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:22.954583  1692 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 20.
W20260709 13:02:23.022682  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 75195.6us
W20260709 13:02:23.023253  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 67331.4us
I20260709 13:02:23.023976  1587 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:22.993916  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.931970  7739 raft_consensus.cc:3055] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:22.950963  7702 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:23.036957  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 93282.1us
I20260709 13:02:22.930567  7754 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.953280  7731 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:23.060467  7731 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.061051  7731 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:23.021674  7383 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.037012  1429 catalog_manager.cc:5028] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): tablet 479456ab418d44c4983d2bb37eb0e700 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:02:23.063373  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:23.036594  7739 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:23.064283  7745 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:23.065162  7745 raft_consensus.cc:697] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:23.065423  7739 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:23.066504  7754 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.940747  7123 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:23.072850  7754 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:23.066974  7739 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:23.063599  7383 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:22.929843  7584 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:23.040657  6866 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:23.080446  7762 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:02:22.962476  7476 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:23.044093  7574 raft_consensus.cc:3055] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:23.026263  7698 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.090698  1696 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:23.091075  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:23.090679  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:23.053905  7736 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:23.093277  7712 raft_consensus.cc:2764] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:02:23.093695  7736 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:23.094734  7712 raft_consensus.cc:1064] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:02:23.095674  2209 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:23.097276  7712 raft_consensus.cc:1068] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: Unable to promote non-voter e8a64798e5f94de8909707bcbd11804a: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:02:23.099465  7560 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:23.052562  7732 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.102146  7732 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.104620  7732 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:23.085249  7574 raft_consensus.cc:740] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:23.108533  7564 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.108263  7574 consensus_queue.cc:260] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.109179  7564 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.109658  7574 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:23.110133  7722 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.110713  7722 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:23.111496  1689 raft_consensus.cc:3055] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:23.111846  1689 raft_consensus.cc:740] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:23.112720  7722 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:23.112663  1689 consensus_queue.cc:260] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:23.113956  1689 raft_consensus.cc:3060] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:23.114379  7383 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:23.118537  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:23.119321  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:23.120298  1692 raft_consensus.cc:2410] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:02:23.118714  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:23.066401  7745 consensus_queue.cc:237] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:23.127455  7712 consensus_queue.cc:1059] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:23.128532  7735 raft_consensus.cc:3055] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:23.128937  7735 raft_consensus.cc:740] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:23.134262  7615 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:23.137144  1614 raft_consensus.cc:1240] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:23.140240  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:23.146308  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 122376us
I20260709 13:02:23.151129  1587 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:23.152820  1622 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
I20260709 13:02:23.154207  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:23.157253  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:23.160996  1587 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:23.127543  7698 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:23.139451  7564 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:23.166401  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:23.169965  1689 raft_consensus.cc:1275] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:02:23.170631  1689 pending_rounds.cc:85] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 13
I20260709 13:02:23.129207  7728 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:23.174670  1659 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:23.165774  7589 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.176205  7728 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:23.177278  7712 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:23.177708  7712 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.178066  7712 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:23.180750  1622 raft_consensus.cc:2393] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 19: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:23.181624  7589 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:23.183782  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:23.184990  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:23.185870  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:23.186614  2243 raft_consensus.cc:2368] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18.
I20260709 13:02:23.170866  1689 pending_rounds.cc:107] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:02:23.187345  1689 raft_consensus.cc:2889] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:23.185091  7584 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:23.188055  7702 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.188549  7702 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:23.188652  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:23.193338  7712 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:23.194648  1696 raft_consensus.cc:2368] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 19. Current term is 20.
I20260709 13:02:23.195612  1586 leader_election.cc:400] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18.
I20260709 13:02:23.195966  1586 leader_election.cc:403] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:02:23.196619  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.197160  7633 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:23.197476  7712 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:23.198328  7763 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.171s	user 0.003s	sys 0.000s
I20260709 13:02:23.209323  1618 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:02:23.211671  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:23.212100  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 49497.2us
I20260709 13:02:23.130007  7735 consensus_queue.cc:260] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:23.219425  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 58475.3us
I20260709 13:02:23.220978  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:23.221843  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:23.225831  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.224258  1587 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:23.222735  7732 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:23.242026  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 46611.2us
I20260709 13:02:23.242257  7732 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:23.245730  7633 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:23.250470  7123 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:23.225260  6866 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:23.251518  6866 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.251915  6866 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:23.218190  7731 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.254577  7731 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:23.258090  7732 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:23.258433  7589 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:23.259138  7589 consensus_queue.cc:1243] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:02:23.260663  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:23.263144  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:23.269258  2243 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:02:23.269734  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.272202  1511 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:02:23.275293  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 51140.5us
I20260709 13:02:23.235111  7698 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:23.276875  1511 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:23.277456  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:23.278668  2244 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:02:23.223599  7577 consensus_queue.cc:1059] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:02:23.303081  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:23.279739  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:23.285326  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:23.312388  1687 raft_consensus.cc:2410] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:02:23.287458  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:23.286415  1587 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:23.275153  7607 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:02:23.319766  7722 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:23.332136  7722 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.332589  7722 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:23.323144  7698 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:23.333388  7698 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:23.334343  7698 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.323267  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:23.279405  7728 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:23.329908  7615 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:23.330440  7476 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:23.276911  7732 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:23.323335  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:23.265969  7633 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18.
I20260709 13:02:23.336637  1511 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:23.339397  7736 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:23.345137  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:23.358656  1692 raft_consensus.cc:2393] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 18: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:23.323683  7735 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:23.367507  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:23.343806  7732 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.368942  7732 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:23.362643  1511 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:23.367559  7637 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:23.370801  7637 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.367792  7417 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:23.374327  7417 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.374754  7417 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:23.367790  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:23.376279  1695 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
W20260709 13:02:23.358456  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 79338.1us
I20260709 13:02:23.359426  7728 raft_consensus.cc:697] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:23.385531  7739 raft_consensus.cc:3055] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:23.385210  7728 consensus_queue.cc:237] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.386011  7739 raft_consensus.cc:740] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:23.392851  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:23.372970  7637 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:23.343860  7731 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:23.395098  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:23.399799  1695 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:23.380577  7622 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:23.442471  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:23.443390  1695 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:23.371188  6866 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.387118  7739 consensus_queue.cc:260] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:23.445729  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 128212us
W20260709 13:02:23.446350  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 116281us
I20260709 13:02:23.427351  7736 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:23.450260  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 222912us
W20260709 13:02:23.474521  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 111972us
I20260709 13:02:23.456099  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:23.482512  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.483901  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:23.436525  7637 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:23.486817  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:23.487073  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:23.489738  1692 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:23.490468  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:23.498669  1695 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:23.498813  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:23.499524  1694 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:23.500763  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:23.503603  1587 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:23.504812  6866 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:23.505445  6866 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:23.443310  7712 consensus_queue.cc:1059] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:02:23.445127  7622 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.472522  7736 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.444101  7731 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.520663  1694 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:23.529932  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:23.530730  1687 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:23.530133  1692 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:23.519301  7739 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:23.520205  7736 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:23.549837  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.549979  1587 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:23.554831  1587 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:02:23.556560  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 100600us
I20260709 13:02:23.553920  7795 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:23.559371  1691 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:23.561019  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.547932  7788 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:23.570502  1546 raft_consensus.cc:2393] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 20: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:23.563455  1587 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:23.573004  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.562019  7754 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:23.575541  1587 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:23.559943  7791 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:23.572942  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.580107  7754 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.562107  7795 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:23.581502  1543 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:23.568383  7680 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:23.582120  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:23.584973  7777 log.cc:927] Time spent T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:02:23.585240  7775 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:02:23.587903  7383 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:23.588531  7383 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.591744  7745 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:23.592555  7745 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.545871  7637 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:23.584105  1587 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:23.569921  7788 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:23.599455  1541 raft_consensus.cc:2468] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 12.
I20260709 13:02:23.578017  6866 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:23.606269  1687 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:23.608872  1587 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:23.667855   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:23.691892  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:23.612771  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.661130  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:23.732290  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 123469us
W20260709 13:02:23.754063  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.663592  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:23.595185  7680 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.594370  7754 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:23.744599  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.595966  7773 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:02:23.667415  1585 leader_election.cc:336] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.516s (SENT)
I20260709 13:02:23.660751  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:23.744091  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.761899  1539 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:23.761850  1585 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:23.710420  2209 leader_election.cc:336] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.620s (SENT)
I20260709 13:02:23.713171  7796 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:23.759773  1587 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:23.756639  1543 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:23.593999  7795 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:23.755393  1547 raft_consensus.cc:2410] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:02:23.661870  7637 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:23.641935  7123 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:23.668825  7731 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:23.767894  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.768105  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:23.769937  1545 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:23.744148  6866 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.663934  7788 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:23.772570  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 194944us
W20260709 13:02:23.773005  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:23.772984  7574 consensus_meta.cc:287] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.663s	user 0.012s	sys 0.000s
W20260709 13:02:23.816987  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 57293.4us
I20260709 13:02:23.819432  7698 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:23.765165  1546 raft_consensus.cc:2468] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
W20260709 13:02:23.819545  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 200983us
I20260709 13:02:23.749421  7783 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.753829  7633 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:23.776281  7417 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.777092  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.777541  7745 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:23.791283  1620 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
I20260709 13:02:23.794624  1689 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:23.795011  7622 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:23.756413  7680 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:23.774099  7383 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:23.822103  1539 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:23.822830  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:23.824194  1585 leader_election.cc:336] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.590s (SENT)
W20260709 13:02:23.827122  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.832840  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:23.815574  6866 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:23.766187  7631 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:02:23.642413  7791 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.845126  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:23.832700  7588 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.845870  1538 raft_consensus.cc:2393] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 17: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:23.829969  7589 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:23.846540  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.846606  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.845422  1585 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:23.846645  7797 log.cc:927] Time spent T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:02:23.852778  1547 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
W20260709 13:02:23.859812  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 175986us
W20260709 13:02:23.862277  7790 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:02:23.862517  7722 consensus_meta.cc:287] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.003s
I20260709 13:02:23.865345  2210 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:23.866494  7696 raft_consensus.cc:2804] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:23.867197  7696 raft_consensus.cc:697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:23.868237  7696 consensus_queue.cc:237] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:23.836869  7633 raft_consensus.cc:697] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:23.870137  7633 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.831858  7732 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.876971  1542 raft_consensus.cc:2410] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:02:23.877736  2244 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:23.881032  7417 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:23.883524  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:23.883360  7803 consensus_queue.cc:1059] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:23.884936  7803 raft_consensus.cc:3055] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:23.885296  7803 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:23.859797  7788 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:23.886195  7803 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.900187  7803 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:23.889060  1660 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:23.907857  7796 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:23.908634  7791 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:23.892797  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.909535  1546 raft_consensus.cc:2393] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 17: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:23.909612  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:23.910346  7796 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:23.893478  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.910918  7796 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:23.911338  7796 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:23.894022  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.915741  1544 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:23.916666  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:23.917251  1544 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:23.859903  7793 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.920392  7793 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:23.922367  7702 consensus_meta.cc:287] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.733s	user 0.011s	sys 0.000s
I20260709 13:02:23.894286  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:23.922832  7702 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:23.923612  1540 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:23.862987  7722 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.895738  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.925041  1691 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21.
I20260709 13:02:23.831283  7783 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:23.926263  2242 raft_consensus.cc:1240] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:23.896329  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.895710  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.898196  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:23.898675  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.888026  7476 raft_consensus.cc:3055] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:02:23.900360  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.889855  7802 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:23.910336  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.930289  1546 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 20.
I20260709 13:02:23.931468  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.932181  1546 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:23.933193  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.934028  1546 raft_consensus.cc:2393] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:23.925133  1542 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:23.895684  7809 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:23.944706  1541 raft_consensus.cc:2393] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 17: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:23.893654  6866 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:23.896858  7588 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:23.948506  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.951373  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.934911  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.951978  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.955619  1546 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 18: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:23.958035  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:23.958592  1660 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:23.958900  1688 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:02:23.968719  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:23.961179  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 137007us
I20260709 13:02:23.969256  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:23.967978  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:23.960811  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:23.983752  1538 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:23.967573  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:23.956746  1587 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:23.969889  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:23.986385  1542 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:02:23.983227  2241 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:02:23.972355  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:23.965281  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:23.935608  7476 raft_consensus.cc:740] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:23.942090  7739 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.994629  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:23.969286  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:23.995934  1543 raft_consensus.cc:2393] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 17: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:23.996289  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.996368  1539 raft_consensus.cc:2376] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17. Re-sending same reply.
I20260709 13:02:23.991840  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:23.998098  1540 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 20.
I20260709 13:02:23.998389  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:24.021631  1690 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:02:24.002858  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:24.005380  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:24.001029  1546 raft_consensus.cc:2410] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:02:24.001070  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:24.024195  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:24.025588  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:23.915139  7754 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:24.030751  1618 raft_consensus.cc:1240] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:24.034591  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:24.035550  1687 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 20: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:24.033917  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:24.039954  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:24.040207  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:23.963433  7803 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:24.039958  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:24.043776  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:23.961803  7793 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:24.044273  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.046909  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.071060  1547 raft_consensus.cc:2393] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:24.044849  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:24.072238  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.075883  1695 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:02:24.002446  7631 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:24.076417  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:24.076830  7631 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:24.077306  1547 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:24.079788  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.080585  7732 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:24.080958  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.082391  1541 pending_rounds.cc:85] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 6
I20260709 13:02:24.082609  1541 pending_rounds.cc:107] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:02:24.082825  1541 raft_consensus.cc:2889] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:24.083567  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.083410  7476 consensus_queue.cc:260] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:24.084332  1540 raft_consensus.cc:2393] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 15: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:24.084589  7588 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:24.085088  7476 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:24.085155  1696 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:02:24.086755  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.088044  1542 pending_rounds.cc:85] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 7
I20260709 13:02:24.088287  1542 pending_rounds.cc:107] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:02:24.088497  1542 raft_consensus.cc:2889] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:24.077275  7631 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:24.060137  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:24.070183  7803 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.097048  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.098315  1543 raft_consensus.cc:2393] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 21: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:02:24.099205  1585 leader_election.cc:336] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.744s (SENT)
I20260709 13:02:24.099980  1585 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:23.995930  7698 raft_consensus.cc:697] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:24.103487  1615 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:24.122004  1690 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:24.120267  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.127790  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:24.000397  7680 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:24.089412  7123 raft_consensus.cc:697] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:24.128540  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 83017.8us
I20260709 13:02:24.121369  7728 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.104007  7803 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:24.137339  1543 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:02:24.148968  1543 pending_rounds.cc:85] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 12
I20260709 13:02:24.149235  1543 pending_rounds.cc:107] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 13:02:24.149471  1543 raft_consensus.cc:2889] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:24.149785  1543 pending_rounds.cc:107] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:02:24.150007  1543 raft_consensus.cc:2889] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:24.137885  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:24.150645  1614 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:24.155395  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.144047  1546 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:24.157032  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:24.157589  1546 raft_consensus.cc:2376] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16. Re-sending same reply.
I20260709 13:02:24.160547  7728 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:24.162063  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 74714us
I20260709 13:02:24.162804  7728 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:24.162804  1543 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:24.142231  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:24.034490  7739 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:24.146919  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:24.151078  2245 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:02:24.134177  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 89065.5us
I20260709 13:02:24.168040  1546 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:02:24.170174  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:24.170562  1614 raft_consensus.cc:2468] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:02:24.174562  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:24.175211  2244 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:24.175323  7795 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:24.176218  7571 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:24.176607  7571 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:24.176986  7571 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:24.177563  7795 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:24.179560  7791 consensus_queue.cc:1059] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:24.181355  7680 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:24.182231  2238 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:24.182364  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:24.183365  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:24.184088  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.187674  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:24.188403  1616 raft_consensus.cc:2393] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 15: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:24.188750  7698 consensus_queue.cc:237] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:24.187671  7783 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:24.184039  1621 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:24.191028  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:24.192011  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:24.192704  1692 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 16: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:02:24.193511  7812 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:24.194888  1613 raft_consensus.cc:2368] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 20. Current term is 21.
I20260709 13:02:24.199889  1545 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21.
I20260709 13:02:24.174154  2210 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:24.182168  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:24.211879  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:24.212765  2211 leader_election.cc:336] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Timed out: RequestConsensusVote RPC to 127.0.107.195:34459 timed out after 2.117s (SENT)
I20260709 13:02:24.170127  1546 pending_rounds.cc:85] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 11
I20260709 13:02:24.214004  1546 pending_rounds.cc:107] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:02:24.214485  1546 raft_consensus.cc:2889] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:24.213581  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.213786  1547 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:02:24.216866  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:24.217484  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:24.218189  1659 leader_election.cc:336] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.631s (SENT)
I20260709 13:02:24.218364  1620 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
I20260709 13:02:24.220039  1538 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:24.143440  7588 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:24.222291  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:24.218871  1659 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:24.220696  1586 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:24.138428  7584 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:02:24.316045  1544 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
W20260709 13:02:24.639912  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 470536us
I20260709 13:02:24.258731  1543 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:02:24.348609  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.295977  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:24.645987  1620 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:02:24.347348  1621 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:24.314931  1618 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 19: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:24.226830  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:02:24.641292  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.649070  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:24.650740  1511 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:24.654834  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:24.656121  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.656759  1542 raft_consensus.cc:2393] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:24.260344  2210 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:24.249260  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:24.662348  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:24.663465  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.663478  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 442866us
I20260709 13:02:24.664316  1586 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:24.657123  7732 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.667641  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:24.668460  1542 raft_consensus.cc:2368] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15.
W20260709 13:02:24.498343  7817 log.cc:927] Time spent T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:02:24.468693  7796 consensus_meta.cc:287] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.557s	user 0.006s	sys 0.004s
I20260709 13:02:24.675895  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:24.341599  7736 consensus_meta.cc:287] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.783s	user 0.010s	sys 0.000s
I20260709 13:02:24.669250  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:24.497697  7814 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:02:24.671190  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:24.673202  7698 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:24.649812  7806 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:24.676628  1622 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:24.657719  7696 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.661453  7383 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:24.675135  7731 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.682456  7589 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:24.688513  7732 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:24.687124  7577 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:24.445947  7637 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.346621  7739 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:24.294538  7783 raft_consensus.cc:2804] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:24.493057  7788 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.694242  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.409898  7791 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.353616  6866 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:24.240993  7795 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:24.729336  7791 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:24.729585  7795 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:24.697190  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.698101  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.709586  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.259883  7728 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.441s
I20260709 13:02:24.717803  7809 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:24.717705  7731 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:24.712014  7589 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.462249  7571 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:24.699297  7698 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.744009  7698 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:24.748199  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:24.724288  1615 consensus_meta.cc:287] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.000s
I20260709 13:02:24.726249  1544 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 20: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:24.712350  7383 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:24.728713  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:24.249733  7123 consensus_queue.cc:237] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:24.722312  7577 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.719722  7754 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:24.734157  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.736266  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:24.698599  7736 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:24.737982  1542 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 18: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:24.697445  7796 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:24.725879  7783 raft_consensus.cc:697] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:24.739787  7589 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:24.725660  7788 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:24.741962  7702 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:24.742383  7795 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:24.749083  7731 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:24.710296  7631 consensus_meta.cc:287] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.001s
I20260709 13:02:24.753328  1615 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:24.754945  7383 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:24.719316  7696 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:24.758395  7577 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:24.762590  1546 raft_consensus.cc:2368] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17.
I20260709 13:02:24.728919  7637 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:24.781381  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.782262  1539 raft_consensus.cc:2368] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 16. Current term is 17.
I20260709 13:02:24.789165  7732 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:24.792891  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:24.793552  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:24.811439  1541 raft_consensus.cc:2368] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19.
I20260709 13:02:24.811975  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.812217  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:24.812793  1540 raft_consensus.cc:2393] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:02:24.771423  7476 consensus_meta.cc:287] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.686s	user 0.014s	sys 0.001s
I20260709 13:02:24.805019  7736 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:24.812918  1541 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 18: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:24.790688  7791 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:24.815595  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:24.816241  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.817953  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.818827  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.819204  1546 raft_consensus.cc:2368] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15.
I20260709 13:02:24.823429  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.824594  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:24.794806  7631 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:24.829725  1546 raft_consensus.cc:1240] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:24.832038  1512 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:24.833509  1614 raft_consensus.cc:1240] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:24.833577  7607 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:24.834314  7607 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:24.835384  7736 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.835570  7795 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.835942  7736 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:24.836333  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:24.836156  7795 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:24.837096  1547 raft_consensus.cc:2368] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17.
I20260709 13:02:24.838280  7736 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:24.838349  7795 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:24.824066  7783 consensus_queue.cc:237] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:24.840922  1546 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:02:24.819792  7476 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:24.828136  2211 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:24.834996  1542 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 20. Current term is 21. Ops: [18.12-20.13]
I20260709 13:02:24.866747  1541 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:24.822491  7793 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:24.871776  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 43683.7us
I20260709 13:02:24.872821  2211 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:24.875557  7662 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:24.876107  7662 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:24.878983  7662 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:24.877259  1546 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:24.883420  7702 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:24.886924  7702 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:24.887379  7702 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:24.887951  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.888468  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.888779  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.890825  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:24.891427  1689 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:02:24.892361  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:24.892534  7631 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:24.893095  1695 raft_consensus.cc:2393] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 19: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 13:02:24.892983  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 179789us
I20260709 13:02:24.896639  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:24.897619  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:24.897615  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:24.898386  1695 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:24.899266  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:24.900188  1615 raft_consensus.cc:2393] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 18: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:24.902056  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:24.902758  1688 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 18: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:24.876267  7788 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:24.903481  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:24.906380  1614 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 18: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:24.908325  1692 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:24.910187  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:24.910710  1692 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:24.907931  1511 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:02:24.915668  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 83698.3us
I20260709 13:02:24.926636  7828 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:02:24.934196  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 673909us
I20260709 13:02:24.934242  7736 consensus_queue.cc:1059] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:24.915928  2211 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:24.968554  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:24.976190  1585 leader_election.cc:336] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.796s (SENT)
W20260709 13:02:24.979197  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 63361.6us
I20260709 13:02:24.935766  1512 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:24.936053  1693 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:24.935855  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:24.980917  1695 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:24.886212  7571 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:24.992214  2211 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:24.998423  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:24.998471  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 945) took 1047 ms. Trace:
I20260709 13:02:24.999284  1695 raft_consensus.cc:2393] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 17: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 13:02:24.999784  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 282976us
I20260709 13:02:24.941156  2210 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:24.981714  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:24.999051  1539 rpcz_store.cc:276] 0709 13:02:23.950836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.026346 (+ 75510us) service_pool.cc:224] Handling call
0709 13:02:24.982889 (+956543us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b54000b5754. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:24.998412 (+ 15523us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1635061504}
I20260709 13:02:25.012017  1587 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:25.017361  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:25.023478  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 82413.5us
I20260709 13:02:25.025153  1695 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 18: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:24.884193  7793 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:24.935348  7837 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:25.034761  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:25.035708  1694 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:02:25.036104  2211 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:25.038781  1692 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:02:24.915966  7660 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:25.042493  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.042943  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:24.987896  7830 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:02:25.045490  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 109790us
I20260709 13:02:25.048761  1512 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:25.043725  1696 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:25.056257  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:25.056991  1689 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
W20260709 13:02:25.058044  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 115642us
W20260709 13:02:25.058657  1585 leader_election.cc:336] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.867s (SENT)
I20260709 13:02:25.059041  1585 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:25.062192  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 891583us
I20260709 13:02:24.976646  7383 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:25.026907  7631 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:25.068425  1696 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:02:25.069667  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.067152  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:25.026759  7828 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:25.072000  7571 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:25.072458  7794 raft_consensus.cc:3055] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:25.072563  7571 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:25.073217  7794 raft_consensus.cc:740] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:24.988047  7841 consensus_queue.cc:1048] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 13:02:25.074867  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:25.036901  7796 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:25.078955  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:25.079973  1687 raft_consensus.cc:2393] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 15: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:25.041756  7806 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.082132  1696 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:25.046209  7732 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:02:25.065007  7803 consensus_meta.cc:287] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.738s	user 0.011s	sys 0.001s
I20260709 13:02:25.086871  1542 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:25.087363  1512 leader_election.cc:400] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 19. Current term is 20.
I20260709 13:02:25.080789  1660 leader_election.cc:400] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 20. Current term is 21.
I20260709 13:02:25.084684  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:25.088259  1613 raft_consensus.cc:2393] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 13: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:25.087910  1660 leader_election.cc:403] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:25.077174  7827 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:25.090158  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:25.075294  7791 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:25.091609  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:25.093226  1696 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:25.096386  7607 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:25.097100  7722 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:25.112586  1512 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:25.099342  7836 consensus_queue.cc:1059] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:25.099685  7837 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:25.095808  1694 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21.
I20260709 13:02:25.078955  7788 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:25.105237  1687 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:25.105940  1660 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:25.092813  7827 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.112586  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:25.123327  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.125542  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:25.090034  7660 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:25.105373  7577 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:25.112242  7476 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:25.091049  7803 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:25.085858  7783 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:25.154873  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 118807us
W20260709 13:02:25.158286  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 94322.9us
I20260709 13:02:25.127522  7837 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:25.163476  7732 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:25.155609  7660 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:25.158962  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:25.165357  7698 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:25.159752  1659 leader_election.cc:336] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.581s (SENT)
I20260709 13:02:25.166567  1659 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:25.167456  7698 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:25.167804  1659 leader_election.cc:336] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.748s (SENT)
I20260709 13:02:25.168371  1659 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:25.169552  1659 leader_election.cc:336] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.769s (SENT)
I20260709 13:02:25.169924  1659 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:25.126623  7796 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 20. Current term is 21.
I20260709 13:02:25.125288  7662 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:25.146414  7827 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:25.160372  2211 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:25.181049  2209 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:25.184772  1618 raft_consensus.cc:2368] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16.
W20260709 13:02:25.240424  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 84423.5us
W20260709 13:02:25.240738  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 59758us
I20260709 13:02:25.241601  2209 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:25.155061  7696 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:25.088400  7806 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:25.159570  7836 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:25.156842  7783 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:25.249094  2244 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:25.180624  7788 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:25.119673  7794 consensus_queue.cc:260] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:25.254881  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 149876us
I20260709 13:02:25.255882  2243 raft_consensus.cc:1240] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:02:25.239921  7795 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:25.241961  7476 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:25.256654  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 3193) took 1067 ms. Trace:
I20260709 13:02:25.252223  7783 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:25.253165  7696 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:25.249217  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 224647us
I20260709 13:02:25.260372  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:25.264197  1547 rpcz_store.cc:276] 0709 13:02:24.188754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.837695 (+648941us) service_pool.cc:224] Handling call
0709 13:02:24.840834 (+  3139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.841795 (+   961us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:24.843162 (+  1367us) log.cc:844] Serialized 14 byte log entry
0709 13:02:25.256342 (+413180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.256399 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:25.256445 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.256502 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.256600 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14986,"prepare.queue_time_us":382,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":34798,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7103,"spinlock_wait_cycles":17664,"thread_start_us":354680,"threads_started":2,"wal-append.queue_time_us":281424}
I20260709 13:02:25.270803  2245 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:25.253324  7848 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:25.271443  7571 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:25.260843  7836 raft_consensus.cc:697] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:25.273492  7577 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:25.270666  7696 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:25.256942  7739 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:25.284113  7846 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:25.284991  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:25.286511  7589 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:25.282526  7702 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:25.298275  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 239604us
I20260709 13:02:25.311316  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:25.313766  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 131921us
I20260709 13:02:25.299719  7631 raft_consensus.cc:697] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:25.315343  1585 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.901s (SENT) [suppressed 50 similar messages]
I20260709 13:02:25.264067  7841 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:02:25.312065  7854 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:02:25.294216  7696 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:25.320976  7850 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:25.321273  7637 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:25.318219  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:25.324090  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:25.334589  2245 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:02:25.334872  1695 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
I20260709 13:02:25.315729  7698 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:25.338124  7662 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:25.326597  7571 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.338879  7571 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:25.339752  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:25.340616  2244 raft_consensus.cc:2410] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:02:25.340879  7571 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:25.316692  7739 raft_consensus.cc:697] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:25.341604  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:25.342168  7739 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:25.333684  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:25.354866  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:25.355604  1694 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
I20260709 13:02:25.357955  1660 leader_election.cc:400] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16.
I20260709 13:02:25.358393  1660 leader_election.cc:403] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:02:25.363690  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 68750.3us
I20260709 13:02:25.345687  1693 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:02:25.367731  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:25.372150  1687 raft_consensus.cc:1240] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:25.372682  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:25.373281  1689 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:25.378158  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:25.378799  1691 raft_consensus.cc:3060] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:25.379983  7836 consensus_queue.cc:237] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:25.377118  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:02:25.371910  7843 log.cc:927] Time spent T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 13:02:25.388947  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 122116us
W20260709 13:02:25.393189  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 276679us
I20260709 13:02:25.394013  1512 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:25.394867  7637 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:25.366874  7633 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:02:25.386060  7571 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:02:25.401031  1512 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:25.371133  7728 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:02:25.413529  1689 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 19.
I20260709 13:02:25.405750  1585 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:25.424088  1512 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:25.425143  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 255558us
I20260709 13:02:25.396512  7803 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:25.430308  1512 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:25.431816  2209 leader_election.cc:336] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.075s (SENT)
I20260709 13:02:25.432349  2209 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:25.432447  1512 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:25.434393  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:25.434372  1512 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:25.434033  7728 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:25.429091  7637 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:25.451753  1512 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:25.439781  7732 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:25.487964  7788 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.488576  7788 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:25.488950  7123 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:25.489584  7123 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:25.490715  7788 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:25.439397  1659 leader_election.cc:400] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15.
I20260709 13:02:25.492764  1659 leader_election.cc:403] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:02:25.494930  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.509953  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 58303.9us
I20260709 13:02:25.510088  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:25.510896  1619 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:25.511530  1512 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:25.514786  1587 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:25.515967  1587 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:25.406667  7631 consensus_queue.cc:237] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:25.517657  1512 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:25.435434  7564 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:25.433840  7853 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:25.526067  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 120409us
I20260709 13:02:25.463663  7803 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:25.524593  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:25.439451  7836 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.435570  7852 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:25.524158  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 121722us
I20260709 13:02:25.532864  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:25.552978  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.531680  7607 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:25.517817  7839 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:25.560184  1585 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:25.563655  1512 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:25.560273  2211 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:25.439054  7783 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:25.528836  7698 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:25.529824  7754 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:25.580523  1585 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:25.559938  7842 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:02:25.625808  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 85898.4us
I20260709 13:02:25.582118  7633 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:25.528249  7859 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:02:25.628556  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 65060.7us
I20260709 13:02:25.524546  7588 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
W20260709 13:02:25.673712  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 93262.1us
W20260709 13:02:25.677268  1688 consensus_meta.cc:287] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.013s
W20260709 13:02:25.680648  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 253641us
I20260709 13:02:25.697896  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:25.628114  7754 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.683760  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:25.684608  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:25.684808  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:25.627657  7698 raft_consensus.cc:697] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:25.560683  7855 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15.
I20260709 13:02:25.566882  7589 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:25.692530  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 254496us
I20260709 13:02:25.693706  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:25.695297  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:25.579968  7858 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:25.696439  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:25.776332  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 79950.2us
I20260709 13:02:25.777951  1512 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:25.535435  7836 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:25.681802  7839 raft_consensus.cc:2764] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:02:25.699865  2239 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:02:25.705963  1585 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:25.680809  7852 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:25.698639  7754 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:25.682144  7806 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:25.785555  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:25.692003  7831 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:25.580240  7803 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:25.693210  7859 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.732170  1659 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:25.688807  7584 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:25.582140  7696 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:25.707190  7857 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:25.702433  1688 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21.
I20260709 13:02:25.707314  7731 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:25.727038  7856 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:25.732678  7633 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:25.790674  2241 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:25.792816  2245 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
W20260709 13:02:25.794529  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 62449.6us
I20260709 13:02:25.696520  7842 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:25.780187  7732 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:25.790112  7859 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:25.788241  7858 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:25.835547  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:25.835858  1587 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:25.839982  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:25.841775  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.838625  7476 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:25.844523  7869 consensus_queue.cc:1059] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.263s
W20260709 13:02:25.845813  7870 log.cc:927] Time spent T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:02:25.846535  7866 log.cc:927] Time spent T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:02:25.846403  7803 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:25.851996  7865 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 13:02:25.852799  7836 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:25.855273  7861 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.441s	user 0.001s	sys 0.000s
I20260709 13:02:25.814908  7584 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:25.858768  1691 raft_consensus.cc:2468] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 19.
W20260709 13:02:25.875466  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 97581.5us
I20260709 13:02:25.901314  7633 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:25.927349  1512 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:25.886487  1659 leader_election.cc:336] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.718s (SENT)
I20260709 13:02:25.929459  1688 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:25.930078  1615 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:02:25.931386  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 259414us
W20260709 13:02:25.844241  7874 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:02:25.918521  1695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.003s	sys 0.010s
W20260709 13:02:25.932399  1695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.003s	sys 0.010s
W20260709 13:02:25.921789  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 85992.8us
I20260709 13:02:25.903280  7571 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16.
I20260709 13:02:25.903584  7857 raft_consensus.cc:697] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 19 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:25.940245  1512 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:25.941459  1659 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:25.941474  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:25.943284  1615 raft_consensus.cc:2393] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 19: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:25.943540  2211 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:25.796577  7852 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:25.950016  1512 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:25.903043  7731 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:25.950726  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:25.923417  7783 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:25.958271  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:25.959213  1545 raft_consensus.cc:2393] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 20: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:25.953135  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:25.955463  1613 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 19.
I20260709 13:02:25.952157  1542 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:25.840436  7698 consensus_queue.cc:237] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:25.928709  7633 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:25.960754  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:25.961395  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:25.961553  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:25.964619  1538 raft_consensus.cc:2376] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19. Re-sending same reply.
I20260709 13:02:25.965449  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:25.966862  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:25.967556  1546 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:25.968207  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:25.968873  1547 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:25.970331  1543 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:02:25.969723  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 83272.2us
I20260709 13:02:25.969496  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:25.975148  1659 leader_election.cc:336] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.940s (SENT)
I20260709 13:02:25.975548  1659 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:25.949416  7858 raft_consensus.cc:2764] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:02:25.978519  1613 raft_consensus.cc:1275] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:25.956359  7881 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.979789  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:25.957509  7732 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:25.979979  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:25.957742  7869 raft_consensus.cc:2804] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:02:25.994191  7827 consensus_meta.cc:287] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.751s	user 0.009s	sys 0.000s
I20260709 13:02:25.955216  7637 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:25.994652  7827 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:25.994689  7607 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:25.996100  1538 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:25.953477  7853 consensus_queue.cc:1059] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:02:25.997604  7607 raft_consensus.cc:3055] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:25.997977  7607 raft_consensus.cc:740] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:25.999133  7607 consensus_queue.cc:260] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:25.999912  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:26.000558  7607 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:26.001183  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:26.001998  1695 raft_consensus.cc:2410] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:02:26.002765  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:25.969167  7836 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:26.003747  1695 raft_consensus.cc:2410] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:02:26.004386  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:26.005167  1544 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:02:25.962325  7831 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:26.010305  1546 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21.
I20260709 13:02:25.993798  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:25.979600  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:25.988520  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:26.008507  1539 raft_consensus.cc:2376] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19. Re-sending same reply.
I20260709 13:02:26.011493  1696 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:26.012506  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:26.013567  1546 raft_consensus.cc:2393] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 21: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:26.016746  2246 raft_consensus.cc:2393] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 16: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:25.951383  7564 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:02:26.010488  1542 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:26.017969  1540 raft_consensus.cc:2393] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:26.018301  1619 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:25.996887  7827 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:26.023116  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.023762  1544 raft_consensus.cc:2468] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
I20260709 13:02:25.985386  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:26.051842  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:26.054767  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 69507.1us
I20260709 13:02:26.055444  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:26.057390  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 82254.4us
W20260709 13:02:26.057914  1659 leader_election.cc:336] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.987s (SENT)
I20260709 13:02:26.058283  1543 raft_consensus.cc:3060] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:26.060591  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:26.061286  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.056614  1660 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:26.077497  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:26.078150  1544 raft_consensus.cc:2376] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16. Re-sending same reply.
I20260709 13:02:26.080243  1547 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:26.022120  7732 raft_consensus.cc:697] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:26.029906  7836 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.082237  1691 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:26.028436  7831 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:26.056648  7476 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:26.082170  1660 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:26.057191  7860 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:26.027415  7739 consensus_queue.cc:1059] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:02:26.086053  1691 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:26.114276  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:26.088881  7869 raft_consensus.cc:697] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 19 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:02:26.094532  7837 consensus_meta.cc:287] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.931s	user 0.002s	sys 0.005s
I20260709 13:02:26.062527  7864 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:26.095355  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.087814  7803 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:26.086858  7884 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.089476  7571 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:26.099647  7842 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:26.100232  1659 leader_election.cc:336] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.013s (SENT)
I20260709 13:02:26.107806  1696 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
I20260709 13:02:26.085860  7696 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:26.136570  7837 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:26.147047  7732 consensus_queue.cc:237] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:26.149715  7852 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:26.149909  7879 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 13:02:25.905367  7856 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:26.157969  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 452005us
I20260709 13:02:26.186261  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:26.157902  7869 consensus_queue.cc:237] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:26.163748  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:26.165129  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.168184  1659 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:26.142876  7584 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:26.194707  7728 consensus_meta.cc:287] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.702s	user 0.007s	sys 0.003s
I20260709 13:02:26.195549  7731 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:26.009321  7881 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:26.202854  2237 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:02:26.166600  7571 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.159390  7803 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.211942  1696 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 11.
I20260709 13:02:26.214795  1691 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:26.224367  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:26.186327  7848 consensus_meta.cc:287] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.874s	user 0.005s	sys 0.005s
I20260709 13:02:26.150130  7831 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:26.077644  7857 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:26.246850  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 146622us
W20260709 13:02:26.247884  1659 leader_election.cc:336] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.036s (SENT)
I20260709 13:02:26.248342  1659 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:26.249449  7878 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:26.255330  7731 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:26.237160  7803 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:26.184360  7754 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:26.267098  7754 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:26.224290  7728 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:26.276409  7383 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:26.283228  1659 leader_election.cc:336] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.176s (SENT)
I20260709 13:02:26.223922  7476 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:26.283740  1659 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:26.235565  7571 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:26.316591  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.319787  1585 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:26.176177  7633 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:26.159093  7884 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:26.330912  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.282336  7848 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:26.333389  1585 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:26.335899  7680 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:26.338055  7584 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:02:26.351817  2238 raft_consensus.cc:1240] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:26.353473  7883 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:26.355480  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:26.356091  1696 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:26.359728  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:26.360414  1691 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:26.366238  1617 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:26.368712  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:26.370381  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:26.388438  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 55126us
W20260709 13:02:26.388681  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 105432us
W20260709 13:02:26.389361  1659 leader_election.cc:336] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 2.241s (SENT)
I20260709 13:02:26.389767  1659 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:26.376645  1622 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:26.350987  1543 raft_consensus.cc:1275] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:26.405017  1693 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:26.378345  7589 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:26.379616  7702 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:26.384791  7834 raft_consensus.cc:3055] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:26.423563  1696 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:26.376737  7881 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:26.413440  7660 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:26.364822  7859 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:26.420598  7855 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:26.455476  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:26.457681  2246 raft_consensus.cc:2410] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:02:26.440841  7840 log.cc:927] Time spent T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 1.284s	user 0.003s	sys 0.000s
I20260709 13:02:26.443377  7856 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:26.419116  7830 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:02:26.446419  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:26.429013  7837 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:26.448282  7887 raft_consensus.cc:3055] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:26.448858  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:26.452306  2238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45866 (request call id 1215) took 1197 ms. Trace:
I20260709 13:02:26.421649  7698 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.458248  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:26.459174  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:26.461886  1659 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:26.420917  7571 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:26.469875  1622 raft_consensus.cc:2393] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 16: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:26.485602  2238 rpcz_store.cc:276] 0709 13:02:25.254490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.254636 (+   146us) service_pool.cc:224] Handling call
0709 13:02:25.254986 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.352236 (+1097250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.452042 (+ 99806us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002afb54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:26.452228 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2521762176}
I20260709 13:02:26.426589  7834 raft_consensus.cc:740] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:26.465296  7884 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:26.157581   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:26.494022  7855 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:26.490866  7698 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:26.460783  7788 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:26.485173  7887 raft_consensus.cc:740] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:26.514142  7834 consensus_queue.cc:260] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:26.515036  7859 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:26.515643  7834 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:26.516875  7571 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:26.464217  7702 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 13:02:26.519312  7855 consensus_queue.cc:1175] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d7158d6c3b634dc7abb69eac58eba291" responder_term: 21 status { last_received { term: 16 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 20. Current term is 21. Ops: [18.12-20.13]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:26.499966  7788 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:26.521452  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:26.522177  1614 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:26.522599  7788 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:26.490617  7831 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:26.478099  7803 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:26.530715  1614 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 20.
I20260709 13:02:26.537590  2210 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:26.540313  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:26.541075  2237 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:02:26.525840  7571 consensus_queue.cc:1059] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:02:26.519305  7698 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:26.505242  7881 consensus_queue.cc:1059] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:02:26.548573  1586 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:26.551316  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 2415) took 1039 ms. Trace:
I20260709 13:02:26.551750  1693 rpcz_store.cc:276] 0709 13:02:25.511921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.516918 (+  4997us) service_pool.cc:224] Handling call
0709 13:02:26.551116 (+1034198us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b5400385754. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:26.551224 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955604736}
I20260709 13:02:26.555218  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.555908  1541 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:26.556876  7856 raft_consensus.cc:3055] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:26.556944  7123 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:26.557402  7856 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:26.557706  7123 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:26.558116  7123 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.558507  7123 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:26.558269  7856 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:26.559389  7791 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:26.559513  7589 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:26.560010  7791 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:26.563834  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.566875  1539 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:02:26.544929  7830 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:26.576357  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.577148  1541 raft_consensus.cc:2368] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19.
I20260709 13:02:26.577021  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:26.581143  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.581949  1543 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:26.583316  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.584288  1547 raft_consensus.cc:2368] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 20. Current term is 21.
I20260709 13:02:26.586740  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.587654  1543 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:02:26.589154  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.589790  1542 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:26.590626  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:26.596032  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.597036  1545 raft_consensus.cc:2393] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 16: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:26.598354  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.595302  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:26.539405  7831 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:26.601369  7831 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:26.601905  7856 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:26.603572  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.604195  1546 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:26.567342  7887 consensus_queue.cc:260] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:26.562299  7791 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:26.616458  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:26.617599  7803 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:26.618485  7830 raft_consensus.cc:697] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 20 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:26.619565  7830 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:26.674764  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:26.623734  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:26.683871  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:26.684718  2237 raft_consensus.cc:2393] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 15: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:26.686364  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:26.687000  2237 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:26.688623  1587 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:26.689896  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.624655  1542 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:26.642711  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:26.680019  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:26.697263  1617 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:26.627776  7880 log.cc:927] Time spent T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.781s	user 0.002s	sys 0.000s
I20260709 13:02:26.628201  1586 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:26.632110  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:26.708529  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:26.709272  1695 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:02:26.714610  7571 raft_consensus.cc:3055] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:26.711758  1543 raft_consensus.cc:2410] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:02:26.717602  7589 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:26.718125  7589 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:26.718619  7589 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:26.720213  7902 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.516s	user 0.003s	sys 0.000s
I20260709 13:02:26.715029  7571 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:26.721649  7571 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:26.722729  7571 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:26.725463  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.682775  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:26.729758  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:26.730108  2244 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:26.730297  1543 raft_consensus.cc:2393] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:26.730373  1541 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:26.728782  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:26.731662  1538 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:26.681823  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.736763  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 108634us
I20260709 13:02:26.737739  1586 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:26.743474  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:26.743549  2242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 1250) took 1352 ms. Trace:
I20260709 13:02:26.748045  1543 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:02:26.750869  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:26.751783  1692 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:02:26.754878  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:26.757766  1659 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:26.759984  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:26.760821  7803 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:26.744935  2242 rpcz_store.cc:276] 0709 13:02:25.391172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.391322 (+   150us) service_pool.cc:224] Handling call
0709 13:02:25.399688 (+  8366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:25.527564 (+127876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.527594 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:25.530258 (+  2664us) log.cc:844] Serialized 26 byte log entry
0709 13:02:25.728092 (+197834us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:25.728132 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.728202 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:26.627131 (+898929us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:26.726339 (+ 99208us) raft_consensus.cc:1685] finished
0709 13:02:26.726361 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.743485 (+ 17124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1541,"raft.queue_time_us":160528,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":14179,"spinlock_wait_cycles":37384064,"thread_start_us":258211,"threads_started":2,"wal-append.queue_time_us":222188}
I20260709 13:02:26.763830  2209 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:26.767247  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.767369  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.768327  1545 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:26.768978  2237 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:26.761672  1660 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:26.717792  7794 raft_consensus.cc:3060] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.779423  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.762287  1587 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:26.794557  1587 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:26.761345  7803 raft_consensus.cc:697] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:26.782888  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:26.785897  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:26.785907  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:26.796804  1539 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 18: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:26.785372  1538 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
W20260709 13:02:26.785341  1585 leader_election.cc:336] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.500s (SENT)
I20260709 13:02:26.761729  7831 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:26.777700  1696 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
I20260709 13:02:26.802435  2244 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:26.802915  1659 leader_election.cc:400] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 20. Current term is 21.
I20260709 13:02:26.804869  1542 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:26.779742  7910 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:26.790047  7856 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:26.868057  1689 raft_consensus.cc:1240] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:26.860536  1660 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:26.791159  7788 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:26.813001  7754 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:02:26.856698  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 92950.1us
I20260709 13:02:26.818110  1692 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:26.804104  7662 raft_consensus.cc:2764] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:02:26.798362  7839 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:26.806171  7809 raft_consensus.cc:2804] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:26.872265  1660 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:02:26.847180  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.932322  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.912283  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:26.867938  7856 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:26.880434  7796 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:02:26.933525  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.817795  7795 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 13:02:26.817473  7834 consensus_queue.cc:1059] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 13:02:26.980290  1691 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:26.991786  1659 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:26.929749  7788 raft_consensus.cc:697] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:26.995875  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:26.996618  1538 raft_consensus.cc:2376] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21. Re-sending same reply.
I20260709 13:02:26.998329  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:26.998960  1543 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:27.001891  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:27.003257  1539 raft_consensus.cc:2368] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18.
I20260709 13:02:27.003933  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:27.004289  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:27.004787  1547 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 20: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:26.997280  7844 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:27.006088  7844 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:27.006443  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:27.007145  1546 raft_consensus.cc:2376] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15. Re-sending same reply.
I20260709 13:02:26.997345  7809 raft_consensus.cc:697] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:26.993734  7839 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:27.009603  7809 consensus_queue.cc:237] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:27.010740  7839 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:26.997210  7791 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:26.988022  7702 consensus_queue.cc:1048] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:02:27.012005  7791 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:27.013231  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:27.014328  7791 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:27.011808  1538 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:27.014930  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:27.015770  1542 raft_consensus.cc:2393] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 17: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:27.016222  7793 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:27.008358  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:26.988407  7856 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:27.019769  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:27.020435  1544 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:27.034080  1659 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:27.008363  7844 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:27.040508  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:27.059599  1546 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:27.041013  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:27.062350  1542 raft_consensus.cc:3060] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:27.041178  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:27.063802  1547 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:27.041709  7834 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:27.045539  7914 log.cc:927] Time spent T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:27.042675  1539 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:27.049669  7887 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.057276  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:26.989737  7855 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:27.074410  1659 leader_election.cc:400] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19.
I20260709 13:02:27.074301  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:27.077234  7844 consensus_queue.cc:1059] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:27.079048  1692 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:27.080960  2211 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:27.081548  7795 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:27.039795  7881 raft_consensus.cc:3055] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:27.115345  7795 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:26.995965  7754 raft_consensus.cc:697] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:27.116019  7795 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:27.116597  7754 consensus_queue.cc:237] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:27.115515  7881 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:27.119845  7881 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:27.121290  7881 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:27.066393  7793 consensus_queue.cc:1059] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:02:27.125644  7793 consensus_queue.cc:1243] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer 822e08445eae4a33b2f2fe92060192c6 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:27.073153  7834 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:27.126410  7834 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:27.131907  1659 leader_election.cc:403] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:02:27.132920  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 52017.7us
I20260709 13:02:27.134613  1541 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:27.056134  7796 raft_consensus.cc:697] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:27.136735  1546 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:27.073318  1512 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:02:27.137393  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 339179us
I20260709 13:02:27.138542  1544 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
W20260709 13:02:27.109314  7913 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:02:27.154346  1585 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.740s (SENT)
I20260709 13:02:27.155097  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:27.157068  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 284844us
I20260709 13:02:27.157593  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 2417) took 1644 ms. Trace:
I20260709 13:02:27.160133  1542 raft_consensus.cc:2468] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
W20260709 13:02:27.159207  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 86063us
W20260709 13:02:27.165877  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.157958  1690 rpcz_store.cc:276] 0709 13:02:25.513091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.839999 (+326908us) service_pool.cc:224] Handling call
0709 13:02:25.840310 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.229823 (+389513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:26.229852 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:26.229891 (+    39us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:26.229935 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.157363 (+927428us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b5400133b54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:27.157409 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.157542 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":895276416}
I20260709 13:02:26.983508  7803 consensus_queue.cc:237] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:27.191039  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:27.192998  1585 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:27.193544  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 59906.5us
I20260709 13:02:27.194276  2211 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:27.136170  7828 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:27.200873  7856 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:27.203002  7123 consensus_meta.cc:287] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.001s
I20260709 13:02:27.203650  7123 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:27.207299  7698 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:27.203143  7856 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:27.206676  7788 consensus_queue.cc:237] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:27.208825  7856 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.209312  7856 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:27.211898  7123 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:27.133785  7841 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:27.184620  7839 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:27.220518  7839 raft_consensus.cc:697] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 17 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:27.220754  7854 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:27.196516  7844 consensus_queue.cc:1059] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:02:27.231150  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:27.243594  2243 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.189539  7886 raft_consensus.cc:3055] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:27.229990  7588 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:02:27.230489  7877 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:27.221465  7839 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:27.213645  7856 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:27.249413  7886 raft_consensus.cc:740] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:27.246395  7854 raft_consensus.cc:697] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:27.245281  7631 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 13:02:27.282294  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.248668  7831 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:02:27.270454  7795 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:27.273165  7830 consensus_queue.cc:1059] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:02:27.277921  7702 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:02:27.273294  7796 consensus_queue.cc:237] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:27.297583  7922 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19.
I20260709 13:02:27.314975  7881 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.317246  7793 raft_consensus.cc:3055] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:02:27.329273  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.000s	sys 0.026s
W20260709 13:02:27.335889  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.000s	sys 0.026s
W20260709 13:02:27.336436  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 528444us
W20260709 13:02:27.339071  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 264743us
I20260709 13:02:27.340206  1659 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:27.341050  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 179141us
I20260709 13:02:27.356086  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:27.342712  7794 consensus_meta.cc:287] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.000s
I20260709 13:02:27.353649  7855 raft_consensus.cc:697] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:27.361851  1692 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:27.334510  7793 raft_consensus.cc:740] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:27.363765  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:27.366246  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.370040  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:27.376793  1659 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:27.397537  1694 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:02:27.398751  7921 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:02:27.342905  7881 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:27.399564  7915 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:02:27.403532  7855 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:27.404078  7795 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:27.406164  7571 consensus_meta.cc:287] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.683s	user 0.006s	sys 0.006s
I20260709 13:02:27.415928  7791 raft_consensus.cc:3055] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:27.364219  7736 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.365932  7922 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.390699  7788 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.430387  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:27.424515  7589 consensus_meta.cc:287] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.705s	user 0.012s	sys 0.000s
I20260709 13:02:27.313670  7854 consensus_queue.cc:237] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:27.433856  1511 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:27.436117  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:27.436311  1694 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 20.
I20260709 13:02:27.436611  1622 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:27.458599  1621 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:27.452147  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:27.467623  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:27.431087  7791 raft_consensus.cc:740] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:27.433960  7877 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:27.509655  7877 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:27.450448  7736 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:27.512270  7877 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:27.513849  1540 raft_consensus.cc:1275] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:02:27.514330  1540 pending_rounds.cc:85] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 9
I20260709 13:02:27.514604  1540 pending_rounds.cc:107] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:02:27.514891  1540 raft_consensus.cc:2889] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:27.518884  1443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58806 (request call id 181) took 20591 ms (client timeout 15000 ms). Trace:
W20260709 13:02:27.524444  1443 rpcz_store.cc:269] 0709 13:02:06.927799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.929109 (+  1310us) service_pool.cc:224] Handling call
0709 13:02:27.518803 (+20589694us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:23.132703 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:23.133448 (+   745us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:23.133507 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:02:23.133525 (+    18us) tablet.cc:662] Decoding operations
0709 13:02:23.134733 (+  1208us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:23.134825 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:23.134849 (+    24us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:02:23.188074 (+ 53225us) tablet.cc:701] Row locks acquired
0709 13:02:23.188132 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:02:23.188319 (+   187us) write_op.cc:270] Start()
0709 13:02:23.188467 (+   148us) write_op.cc:276] Timestamp: P: 1783602143188252 usec, L: 0
0709 13:02:23.188493 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:02:23.189191 (+   698us) log.cc:844] Serialized 5133 byte log entry
0709 13:02:23.881042 (+691851us) op_driver.cc:464] REPLICATION: finished
0709 13:02:24.343869 (+462827us) write_op.cc:301] APPLY: starting
0709 13:02:24.343979 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:24.777662 (+433683us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:24.777833 (+   171us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:25.100032 (+322199us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:25.100513 (+   481us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:02:25.100569 (+    56us) write_op.cc:312] APPLY: finished
0709 13:02:25.101012 (+   443us) log.cc:844] Serialized 121 byte log entry
0709 13:02:25.267108 (+166096us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:25.267288 (+   180us) write_op.cc:454] Released schema lock
0709 13:02:25.284661 (+ 17373us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:25.285115 (+   454us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:25.285146 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6848321,"reported_tablets":19,"spinlock_wait_cycles":75264,"child_traces":[["op",{"apply.queue_time_us":413657,"apply.run_cpu_time_us":50641,"apply.run_wall_time_us":941258,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58571,"num_ops":13,"prepare.queue_time_us":221817,"prepare.run_cpu_time_us":37197,"prepare.run_wall_time_us":312844,"raft.queue_time_us":287138,"raft.run_cpu_time_us":40456,"raft.run_wall_time_us":220854,"replication_time_us":692386,"thread_start_us":886173,"threads_started":5,"wal-append.queue_time_us":471642,"wal-append.run_cpu_time_us":27710,"wal-append.run_wall_time_us":2383903}]]}
I20260709 13:02:27.461781  7844 raft_consensus.cc:3055] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:02:27.520738  7880 log.cc:927] Time spent T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:27.501863  7633 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:27.527944  7791 consensus_queue.cc:260] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:27.538034  7791 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:27.453691  7788 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:27.480217  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:27.549938  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 79777.5us
I20260709 13:02:27.550240  2243 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:27.553803  1620 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
W20260709 13:02:27.551467  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 117670us
W20260709 13:02:27.563265  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 221403us
W20260709 13:02:27.505537  7921 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:02:27.538934  7844 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:27.564036  1512 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:27.570091  1586 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:27.492487  7881 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:27.577081  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.455273  7589 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:27.449957  7922 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:27.569437  7794 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.514340  7887 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 13:02:27.595347  7633 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:27.509052  7793 consensus_queue.cc:260] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:27.607159  7839 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:27.607789  7839 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.608206  7839 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:27.612680  7834 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:27.577837  7938 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:27.615022  7834 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:27.590365  7794 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:27.615717  7809 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:27.647083  7633 raft_consensus.cc:697] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:27.694393  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 125436us
I20260709 13:02:27.709247  1613 raft_consensus.cc:1275] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:27.692494  7793 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:27.717737  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 139265us
I20260709 13:02:27.718672  1511 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:27.724869  1511 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:27.692718  7938 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
W20260709 13:02:27.728662  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 156732us
I20260709 13:02:27.728757  1511 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:27.729823  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 147019us
I20260709 13:02:27.731868  1512 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:27.733204  1613 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:27.737632  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:27.735106  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:27.724678  7931 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:27.705053  7809 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:27.736119  7788 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:27.756839  7828 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:27.754748  7864 consensus_queue.cc:1048] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
W20260709 13:02:27.758797  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.741243  7633 consensus_queue.cc:237] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:27.761168  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 963) took 1794 ms. Trace:
I20260709 13:02:27.761556  1540 rpcz_store.cc:276] 0709 13:02:25.968499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.059027 (+ 90528us) service_pool.cc:224] Handling call
0709 13:02:26.059315 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.515461 (+1456146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.760907 (+245446us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400322dd4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:27.761096 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3343740160}
I20260709 13:02:27.765383  7793 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:27.766607  7793 raft_consensus.cc:697] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:27.767117  7844 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:27.768551  7844 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:27.772145  7736 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:27.772981  7736 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:27.768694  7793 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:27.782159  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.781103  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:27.783802  1511 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:27.784420  7886 consensus_queue.cc:260] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:27.785140  1511 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:27.786058  7886 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:27.790804  7941 log.cc:927] Time spent T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:27.794332  7938 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:27.794883  7938 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:27.795328  7938 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:27.795440  7839 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:27.796636  1545 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:27.797716  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:27.801225  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:27.803545  1511 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:27.731474  7943 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:27.738775  7940 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:27.802525  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:27.806914  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:27.808887  1540 raft_consensus.cc:2393] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:27.819804  7922 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:27.823850  7945 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:02:27.834537  7839 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:27.837381  7940 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:27.838317  7940 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:27.839035  7940 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:27.839715  7940 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:27.841987  7794 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:27.852605  1540 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:02:27.860348  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 290315us
I20260709 13:02:27.806341  7736 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:27.863101  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:27.864418  1616 raft_consensus.cc:606] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:27.864900  1616 raft_consensus.cc:614] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:27.844595  7589 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:27.876102  7919 log.cc:927] Time spent T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.654s	user 0.000s	sys 0.004s
I20260709 13:02:27.877767  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 2423) took 2282 ms. Trace:
I20260709 13:02:27.878190  1688 rpcz_store.cc:276] 0709 13:02:25.594947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.936612 (+341665us) service_pool.cc:224] Handling call
0709 13:02:25.942852 (+  6240us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:25.950341 (+  7489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.950387 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:26.711758 (+761371us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b2c00151d48. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc490024a11 00007fc490034372 00007fc491766a01 00007fc49172b43a 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2
0709 13:02:26.712299 (+   541us) log.cc:844] Serialized 52 byte log entry
0709 13:02:26.963573 (+251274us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:26.963722 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.963960 (+   238us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:27.875428 (+911468us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:27.877490 (+  2062us) raft_consensus.cc:1685] finished
0709 13:02:27.877516 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.877701 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7077,"raft.queue_time_us":9403,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":8734,"spinlock_wait_cycles":7485568,"thread_start_us":192133,"threads_started":1,"wal-append.queue_time_us":370666}
W20260709 13:02:27.893971  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 517194us
W20260709 13:02:27.906924  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.907801  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.911770  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 442560us
I20260709 13:02:27.915740  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:27.907653  7795 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:27.920586  7795 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:27.915124  2211 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:27.921089  7795 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:27.903308  7933 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:27.933473  1696 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:02:27.923449  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:27.921722  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:27.928154  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:27.928372  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:27.929313  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:27.931155  1659 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:27.937086  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:27.937883  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:27.948953  1621 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:27.937959  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:27.951929  1687 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:27.955145  1659 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:27.959885  1659 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:27.960100  1688 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:27.964320  2244 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:27.921698  7930 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:27.970878  1659 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:27.927868  7872 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:27.972236  1585 leader_election.cc:400] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18.
I20260709 13:02:27.980388  1585 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:27.976490  1659 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:27.927506  7934 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:02:28.037528  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 57190.7us
I20260709 13:02:28.037809  7589 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:28.038110  7795 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.045400  7934 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:27.930979  7933 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.147s
I20260709 13:02:27.966931  7571 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:28.089404  7793 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.127895  1695 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:27.950528  7889 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:28.136844  1585 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:27.972712  7922 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:27.973733  7855 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:28.153153  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:28.162308  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 185896us
I20260709 13:02:28.172027  1659 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:28.172194  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:27.978780  7803 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:28.174949  1690 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:28.167119  1688 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:28.164383  7791 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:28.180190  1545 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:02:28.083043  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 110483us
I20260709 13:02:27.978452  7834 consensus_queue.cc:1059] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.189s
I20260709 13:02:28.174429  7970 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:27.983570  7831 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.186s
I20260709 13:02:27.983388  7860 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.188s
I20260709 13:02:28.185484  1585 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:28.186301  1690 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:28.188258  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:28.193346  1541 raft_consensus.cc:2376] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21. Re-sending same reply.
I20260709 13:02:28.194278  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:28.194985  1541 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 19: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:28.169279  7736 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.171226  7961 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.128309  7841 consensus_queue.cc:1048] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:02:28.188146  7889 raft_consensus.cc:697] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:28.197614  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:28.173029  7959 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:28.206719  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:28.208189  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:28.174398  7872 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.214205  1541 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:02:28.190869  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 383965us
I20260709 13:02:28.217257  1693 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:28.217707  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:28.218477  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:28.219624  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:28.181844  7930 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.177326  7931 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:28.224292  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:28.218405  1539 raft_consensus.cc:2376] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19. Re-sending same reply.
I20260709 13:02:28.221747  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:28.222422  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:28.222505  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:28.227499  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:28.227705  1689 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:28.223037  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:28.191824  7970 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.196336  7571 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:28.241428  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:28.199771  7922 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.236009  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:28.237288  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:28.238004  1660 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:28.173058  7793 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.248413  1693 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 14.
I20260709 13:02:28.206130  7731 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:28.220793  7754 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:28.226310  1690 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
I20260709 13:02:28.251754  2242 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:28.222365  7830 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.186793  7791 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.209849  7862 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:02:28.209582  7736 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.241945  7571 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:28.235168  7927 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:02:28.220607  7854 consensus_queue.cc:1059] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:02:28.257939  7754 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:28.272293  7796 raft_consensus.cc:3055] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:02:28.277289  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 83148us
I20260709 13:02:28.269974  7793 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:28.230397  7872 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:28.250511  7803 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:02:28.266491  7969 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:02:28.271710  7963 log.cc:927] Time spent T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:02:28.341001  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:28.244130  7929 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:28.348065  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 101290us
I20260709 13:02:28.244630  7123 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:02:28.332760  7966 log.cc:927] Time spent T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:02:28.243412  7970 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:28.220933  7961 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.367865  7803 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.336455  7588 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.248389  7922 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.360975  7754 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:28.361085  7795 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:28.281389  7830 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:28.339884  7571 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:28.376240  1692 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:28.383509  7967 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.354867  7809 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:28.257606  7731 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:28.366636  7886 consensus_meta.cc:287] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.001s
I20260709 13:02:28.416299  7588 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.242751  7930 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:28.362476  7975 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.361243  7796 raft_consensus.cc:740] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:28.404260  2237 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:28.365132  1546 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:28.378625  7933 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.370769  7934 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:28.381834  7956 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:28.404181  7844 consensus_meta.cc:287] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.635s	user 0.007s	sys 0.008s
I20260709 13:02:28.390287  7856 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:28.372306  7791 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:28.416987  7803 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:28.365646  7889 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:28.401942  7932 consensus_queue.cc:1059] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:02:28.422921  7736 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:28.419463  7929 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.485752  7929 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:28.429718  7860 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.421087  7873 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.430322  7967 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.445043  2244 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
I20260709 13:02:28.413508  7123 raft_consensus.cc:697] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:28.447798  7938 consensus_meta.cc:287] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.652s	user 0.006s	sys 0.009s
I20260709 13:02:28.442981  7731 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:28.460777  7588 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:28.460039  7961 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:28.462141  7930 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:28.466948  2243 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:02:28.459120  7922 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:28.480984  7856 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:28.484997  7932 raft_consensus.cc:3055] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:02:28.482947  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 67818.2us
W20260709 13:02:28.503383  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 280382us
I20260709 13:02:28.530001  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:28.533968  2245 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:28.546734  1585 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:28.568974  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:28.572921  2242 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:28.575351  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:28.576009  1540 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:28.581301  1585 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:28.581974  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:28.582624  1538 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:28.478535  7933 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:28.621462  1542 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:28.501390  7873 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:28.557823  7932 raft_consensus.cc:740] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:28.630757  1544 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:28.635340  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:28.480520  7956 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.648033  1541 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:28.649044  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:28.649184  7956 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:28.649650  1541 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:02:28.650486  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:28.557682  7796 consensus_queue.cc:260] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.500459  7860 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.654816  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:28.655758  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:28.638087  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:28.637679  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:28.651057  1541 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:02:28.639772  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:28.592996  7702 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:02:28.642068  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:28.642280  7967 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:28.570437  7934 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:28.668226  1687 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:28.644846  1512 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:28.627707  7927 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:28.646658  7929 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:28.585583  7980 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.062s
I20260709 13:02:28.643155  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:28.639149  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:28.478266  7975 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.679075  7975 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:28.651162  7970 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.675333  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:28.543987  7938 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:28.616737  7869 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260709 13:02:28.652395  7873 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:28.686508  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:28.711715  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 66902.6us
I20260709 13:02:28.715103  1622 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:28.718077  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:28.658473  1540 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:28.658690  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:28.545095  7736 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:28.660390  2242 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:28.662842  2241 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:28.663125  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.618188  7831 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:28.722432  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:28.672518  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:28.663621  7589 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:28.726087  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:28.713003  1512 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:28.566229  7891 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:28.667163  2209 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:28.587416  7877 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 13:02:28.721024  1541 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:02:28.727900  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:28.730373  1694 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:28.684242  7872 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:28.697350  7860 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:28.701239  7864 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.694012  7938 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:28.729714  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:28.738001  1614 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:28.729454  7891 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:28.623945  7953 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:02:28.690647  7970 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:28.741915  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 74825.8us
I20260709 13:02:28.743088  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:28.683147  7571 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:28.717643  7967 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:28.637516  7123 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.739122  7881 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.696768  7934 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.746296  1615 raft_consensus.cc:2410] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:02:28.688349  7754 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:28.731730  7930 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.795502  7930 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:28.798367  7930 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:28.746045  7991 consensus_queue.cc:1059] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:02:28.745882  7872 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:28.738685  7891 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:28.799927  7871 raft_consensus.cc:3055] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:28.800382  7856 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:28.800525  7871 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:28.801823  7871 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:28.806435  7932 consensus_queue.cc:260] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:28.776264  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:28.731909  7791 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:28.722491  7736 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.783816  7754 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:28.728880  7831 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.784538  1617 raft_consensus.cc:1240] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:28.789662  7970 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:28.789983  7795 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:28.793879  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:28.807817  7932 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:28.807756  7881 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.822077  7881 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:28.822695  7736 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:28.775879  7931 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.812820  7830 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:28.826718  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:28.873059  7795 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:28.878669  1613 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:28.879025  7795 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.881548  7795 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:28.872886  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:28.727919  1512 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:28.739478  7864 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:28.883575  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 155723us
I20260709 13:02:28.884421  7931 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:28.885270  7864 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:28.885833  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:28.886475  7931 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:28.887051  7943 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:28.887570  7943 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.887979  7943 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:28.888867  7881 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:28.889451  7881 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.895668  1660 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:28.871630  2242 raft_consensus.cc:1240] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:28.897184  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1365c85d063446a6a6a589798b355741"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:28.897814  1620 raft_consensus.cc:606] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:28.898236  1620 raft_consensus.cc:614] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:28.812186  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:28.899893  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:28.886471  2246 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:02:28.831951  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:28.910223  1692 raft_consensus.cc:1240] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:28.912755  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:28.917533  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:28.917621  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:28.918428  1691 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 21.
I20260709 13:02:28.918998  1695 raft_consensus.cc:2410] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 20 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:02:28.919399  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:28.922562  1687 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:28.923623  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:28.923309  7891 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:28.924417  1688 raft_consensus.cc:2410] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:02:28.927748  7990 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:28.873597  7803 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:28.932840  7943 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:28.934125  7803 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:28.875415  7933 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:28.939050  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:28.940336  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:28.940513  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:28.942227  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:28.948952  1613 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:28.949146  1619 raft_consensus.cc:1240] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:28.950246  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:28.955412  1691 raft_consensus.cc:3055] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:28.955917  1691 raft_consensus.cc:740] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:28.920979  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:28.915964  1659 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:28.937160  1614 raft_consensus.cc:1240] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:28.969018  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 53160.3us
I20260709 13:02:28.980167  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:28.980955  1688 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 20.
I20260709 13:02:28.982280  1693 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 20: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:28.971932  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:02:28.992447  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 50293.3us
I20260709 13:02:28.887096  7571 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:28.870445  7934 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:29.004716  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:29.004894  1687 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:29.005347  1690 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 10.
I20260709 13:02:28.936339  7795 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:28.957005  1691 consensus_queue.cc:260] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:28.900060  7791 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:28.938122  7990 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.999753  2210 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:29.013315  1659 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:28.980958  7961 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:29.014925  1691 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:28.983955  7803 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:29.028993  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:29.029947  2244 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:28.981053  7991 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.981528  7931 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:28.995319  7856 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:02:29.002451  7855 consensus_meta.cc:287] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.825s	user 0.011s	sys 0.000s
I20260709 13:02:28.980789  7967 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:29.006618  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:29.027263  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:29.031179  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:29.049604  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:28.991861  7662 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:02:29.032528  7944 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:28.938277  7938 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 13:02:29.011718  7956 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:29.048182  1688 raft_consensus.cc:1240] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:29.055524  1615 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:29.022689  7791 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:29.014674  7795 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:29.037029  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:29.023296  7736 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.023586  7881 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:29.069056  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:29.032902  7887 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:29.045279  7856 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.082850  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:29.051254  7855 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:29.089900  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:29.090418  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:29.076705  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:29.092618  2246 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
I20260709 13:02:29.055519  7934 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:29.098742  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:29.099444  1617 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:29.052912  7633 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:29.075673  7795 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:29.102800  1689 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:29.037319  7803 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:29.105250  8010 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.110507  7943 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:29.046449  7991 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.114735  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:29.088459  7887 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.137719  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:29.138113  1547 raft_consensus.cc:1240] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:29.116493  1616 raft_consensus.cc:1240] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:29.090154  7793 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:29.138314  1542 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 20.
I20260709 13:02:29.121276  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:29.122072  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.125479  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 94354.7us
I20260709 13:02:29.030239  7990 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.133490  2246 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:02:29.138746  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 125516us
I20260709 13:02:29.139966  1544 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:29.142541  1659 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:29.134827  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:29.135140  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:29.135638  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:29.143653  1619 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:29.136539  1543 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:29.144141  1545 raft_consensus.cc:2393] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:29.137604  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:29.095252  7856 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:29.143712  1615 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:29.089951  7830 consensus_queue.cc:1059] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:02:29.087431  7736 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.144140  1660 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:29.163159  1691 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:02:29.163604  1691 pending_rounds.cc:85] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 11
I20260709 13:02:29.163826  1691 pending_rounds.cc:107] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:02:29.164045  1691 raft_consensus.cc:2889] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:29.164755  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.156068  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:29.166860  1619 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 13.
I20260709 13:02:29.168367  1659 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:29.169622  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:29.170111  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:29.170933  1688 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 20.
I20260709 13:02:29.171187  1659 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:29.171715  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 121209us
I20260709 13:02:29.134451  7970 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:29.172694  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:29.173249  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:29.173583  1539 raft_consensus.cc:2410] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:02:29.175401  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:29.172345  1659 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:29.176002  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:29.142077  7887 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:29.140609  7571 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:29.141624  7793 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.215286  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:29.156651  7933 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:29.138361  7854 consensus_queue.cc:1059] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:02:29.125643  7633 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:29.195338  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.246304  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.173074  7952 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:02:29.234748  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:29.252005  1542 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:02:29.235109  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:29.237458  2238 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:29.240902  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.175675  7881 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:29.174557  7855 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:29.176856  7970 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:29.244199  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.209774  7930 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:29.248322  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:29.250048  1695 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:29.179824  7997 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:29.257066  1511 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:29.268384  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:29.271576  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:29.243005  7793 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:29.261616  1620 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:29.276808  1545 raft_consensus.cc:2393] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 21: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:29.135553  8010 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:29.301246  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 66210.7us
I20260709 13:02:29.261106  7930 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.266674  1587 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:29.251390  7631 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:29.259702  7855 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.261947  7970 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:29.375772  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:29.377720  2238 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 21.
W20260709 13:02:29.383455  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 116839us
I20260709 13:02:29.341867  7933 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.301416  7997 raft_consensus.cc:697] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:29.307574  7931 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:29.354249  7930 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:29.397912  1587 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:29.259363  8007 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.125s
I20260709 13:02:29.365132  7989 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:29.384812  7855 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:29.277318  7952 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.117s
I20260709 13:02:29.396539  7728 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:02:29.406230  7123 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:29.383419  7992 raft_consensus.cc:2764] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:02:29.411808  7997 consensus_queue.cc:237] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.436363  7953 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:29.437662  7791 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.438124  7953 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:29.423852  7989 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:29.370288  7631 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:29.443838  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:29.444692  7631 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:29.445107  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:29.446177  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:29.446627  1542 raft_consensus.cc:3060] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:29.392577  7860 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:29.407806  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:29.452209  1693 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:29.453914  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:29.454977  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:29.401278  8006 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
W20260709 13:02:29.402733  8002 log.cc:927] Time spent T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:02:29.455874  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:29.362907  1620 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:29.422305  7754 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:29.434192  7633 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:29.460480  1693 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 21.
I20260709 13:02:29.463644  7571 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:29.464370  7571 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.467579  7803 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:29.474697  7891 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:29.404429  7931 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.483587  7931 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:29.483848  8003 log.cc:927] Time spent T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
I20260709 13:02:29.492012  7736 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:29.425233  7882 consensus_queue.cc:1059] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:02:29.496107  7882 raft_consensus.cc:3055] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:29.496460  7882 raft_consensus.cc:740] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:29.497243  7882 consensus_queue.cc:260] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.498409  7882 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:29.499257  8011 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.134s	user 0.000s	sys 0.006s
I20260709 13:02:29.403726  7933 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.502030  7933 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:29.477162  7934 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:29.461705  7123 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:29.503697  7934 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:29.505865  7123 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:29.482226  7977 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:29.460834  1617 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:29.516795  7989 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:29.467032  7571 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:29.506731  7977 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.541989  1542 raft_consensus.cc:2468] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:29.490983  7795 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.544082  7793 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.548079  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 2959) took 1344 ms. Trace:
I20260709 13:02:29.556964  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:29.556968  1689 rpcz_store.cc:276] 0709 13:02:28.203941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.256203 (+ 52262us) service_pool.cc:224] Handling call
0709 13:02:28.259670 (+  3467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:29.117467 (+857797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.547828 (+430361us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b54000f19d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:29.548009 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938400512}
I20260709 13:02:29.558096  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:29.558769  1542 raft_consensus.cc:2393] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 14: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:29.560505  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:29.561102  1617 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:02:29.563432  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:29.563968  1617 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
I20260709 13:02:29.548724  7856 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:29.548720  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:29.551918  7791 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:29.552347  7931 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:29.547031  7887 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:29.591960  1687 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:29.597620  1547 raft_consensus.cc:2393] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 18: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:29.598305  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:29.598912  1542 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:29.599211  1546 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 20: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:29.601466  7793 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:29.603175  7931 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:29.605448  7887 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:29.607403  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:29.609081  1542 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:29.613010  7977 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:29.621436  7828 raft_consensus.cc:3055] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:29.621913  7828 raft_consensus.cc:740] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:29.571981  7739 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.586856  1585 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:02:29.632742  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 46007.7us
I20260709 13:02:29.574195  7891 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:02:29.594276  7571 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:29.622743  7828 consensus_queue.cc:260] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:29.646572  1585 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:29.652344  1585 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:29.639200  7631 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:02:29.654582  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 341024us
W20260709 13:02:29.688851  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.629045  7739 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:29.641695  7959 consensus_queue.cc:1059] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:02:29.653349  7891 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:29.644151  7571 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.628211  7930 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.651022  7123 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:02:29.690128  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:29.669976  8010 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:29.709861  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:29.710423  1693 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:29.694442  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:29.711889  1613 raft_consensus.cc:606] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:29.712263  1613 raft_consensus.cc:614] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:29.702670  1542 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:29.667217  7795 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:29.715927  7930 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:29.684700  7631 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.696087  7728 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:29.716272  7571 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:29.704931  7831 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:29.740228  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 313887us
I20260709 13:02:29.726598  7631 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:29.709383  7662 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:02:29.748324  1587 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:29.750780  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.754592  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 205938us
I20260709 13:02:29.725751  7934 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:29.746862  7961 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:29.754034  7754 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:29.767697  8012 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:02:29.772300  7934 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:29.772892  1511 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:29.773111  7882 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:29.773605  7944 consensus_queue.cc:1059] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:29.774363  7944 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:29.775367  7931 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:29.776511  7736 raft_consensus.cc:3055] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:29.776942  7736 raft_consensus.cc:740] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:29.777809  7736 consensus_queue.cc:260] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.778807  7938 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:29.761932  7571 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:29.779388  7938 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.778936  7736 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:29.779932  1689 raft_consensus.cc:1240] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:29.765473  7961 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:29.782524  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:29.783440  7961 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:29.779865  7571 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.784464  7961 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:29.784862  7961 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:29.784974  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.785233  7961 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:29.786158  7571 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:29.785920  7855 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:29.787145  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:29.787768  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:29.783900  7944 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:29.788478  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:29.788745  7944 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.789520  7944 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:29.789746  7860 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:29.792775  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:29.793391  7864 raft_consensus.cc:3055] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:29.793795  7864 raft_consensus.cc:740] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:29.794376  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:29.794627  7864 consensus_queue.cc:260] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:29.795626  7864 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:29.796506  8019 consensus_queue.cc:1059] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:29.788846  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:29.745136  7831 consensus_queue.cc:1059] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:02:29.802354  8010 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:29.802968  8010 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.805058  8010 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:29.798666  1617 raft_consensus.cc:2393] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 20: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:29.764084  7793 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:02:29.802485  8015 log.cc:927] Time spent T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:29.781551  7938 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:29.810087  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a69de749cce497b83e6489ad367017a"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:29.819840  1613 raft_consensus.cc:606] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:29.820237  1613 raft_consensus.cc:614] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:29.824528  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.799654  1511 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:29.750408  7952 consensus_queue.cc:1059] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:02:29.826771  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:29.828444  1695 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:02:29.769918  7970 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:29.835126  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:29.841142  1693 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:02:29.826207  7736 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:29.844966  7736 raft_consensus.cc:697] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 21 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:29.844692  7944 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.845796  7736 consensus_queue.cc:237] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:29.846783  7944 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:29.848754  7970 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:29.827351  7961 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.852515  7961 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:29.853029  7855 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:29.854493  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.855587  7952 raft_consensus.cc:3055] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:29.856014  7952 raft_consensus.cc:740] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:29.862598  7992 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:29.856843  7952 consensus_queue.cc:260] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:29.863394  7992 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:29.864571  7952 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:29.866954  7992 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:29.867612  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.868532  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:29.869357  1693 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:02:29.869762  7739 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:29.872444  7891 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:29.873602  2211 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:29.874817  7796 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:29.875030  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:29.875787  1693 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:02:29.876907  2211 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:29.833350  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:29.883791  7961 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:29.885829  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 52554us
I20260709 13:02:29.887286  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:29.887830  1618 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:29.887879  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:29.888562  1617 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:02:29.889979  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 1113) took 1155 ms. Trace:
I20260709 13:02:29.890333  1696 rpcz_store.cc:276] 0709 13:02:28.734968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.735073 (+   105us) service_pool.cc:224] Handling call
0709 13:02:28.735367 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:28.742336 (+  6969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.742366 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:28.742790 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:02:28.911012 (+168222us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:29.011202 (+100190us) log.cc:844] Serialized 14 byte log entry
0709 13:02:29.118587 (+107385us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b1800269d40. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e5b8c0a 00007fc497cf8219 00007fc48e640a40 00007fc48e63b4e4 00007fc48e63b455 00007fc491723060 00007fc491735716 00007fc491746287 00007fc491746208
0709 13:02:29.889620 (+771033us) spinlock_profiling.cc:243] Waited 92.2 ms on lock 0x7b5400266720. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916a6733 00007fc49172bdbf 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c
0709 13:02:29.889666 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.889750 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:29.889790 (+    40us) raft_consensus.cc:1685] finished
0709 13:02:29.889802 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:29.889925 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51417,"prepare.queue_time_us":106283,"prepare.run_cpu_time_us":139,"prepare.run_wall_time_us":139,"raft.queue_time_us":115926,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":21982,"spinlock_wait_cycles":218556416,"thread_start_us":164781,"threads_started":1,"wal-append.queue_time_us":283711}
I20260709 13:02:29.892858  7992 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:29.893209  7992 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:29.893564  7992 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:29.896178  1617 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 22.
I20260709 13:02:29.896374  1618 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:29.898164  7990 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:29.902937  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.906072  7680 raft_consensus.cc:3055] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:29.906494  7680 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:29.907851  7854 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:29.908363  7854 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.908766  7854 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:29.916019  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:29.917044  1511 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:29.919814  1539 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
W20260709 13:02:29.930842  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 376099us
I20260709 13:02:29.935529  2209 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:29.933627  7944 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:29.933722  7956 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:29.944044  7631 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:29.975126  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 212457us
I20260709 13:02:29.927414  7680 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:29.971689  7956 raft_consensus.cc:697] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 22 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:29.973073  7944 raft_consensus.cc:697] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:29.986073  7953 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:02:29.998633  1660 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:29.983039  8023 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:29.990269  8028 consensus_queue.cc:1059] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:02:30.086409  8028 raft_consensus.cc:3055] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:30.086795  8028 raft_consensus.cc:740] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:30.087150  7886 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.087693  8028 consensus_queue.cc:260] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.088111  7886 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.012874  1687 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:30.016928  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:30.096623  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 79773.2us
I20260709 13:02:29.991003  7970 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:02:30.000643  7680 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:30.019645  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.026569  1692 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:02:30.109388  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:30.110069  1692 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:30.027078  7944 consensus_queue.cc:237] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.028090  7828 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:30.028337  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:30.028923  2238 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 20 LEARNER]: Advancing to term 21
I20260709 13:02:30.029640  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:30.112761  2242 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:02:30.113961  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:30.114145  1586 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:30.114524  1696 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:30.030987  7728 raft_consensus.cc:3055] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:30.031422  7956 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.011898  7571 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.011716  7855 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:30.037886  7991 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:30.043444  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:30.129441  7571 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.130379  1621 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:30.045125  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:30.045414  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:30.132838  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:30.045848  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:30.134486  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:30.047504  1693 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:30.138114  2210 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:30.049435  1614 raft_consensus.cc:1240] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:30.054374  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.055387  2239 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:55918
I20260709 13:02:30.059620  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:30.063089  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:30.063635  7967 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.063841  7961 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.064034  7871 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:30.064214  7938 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:30.065819  8035 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:02:30.066219  7989 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:30.066471  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:30.063580  1512 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:30.069875  7990 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.070433  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.071481  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:30.072240  7631 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:30.072705  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:30.073312  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:30.083978  1445 catalog_manager.cc:5697] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 14 to 15, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:30.093974  7886 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:29.988806  7856 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:30.111053  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.030368  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:30.115662  1660 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:30.116079  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.117120  7952 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:30.117033  7728 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:30.125227  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:30.103178  7796 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:30.118921  7992 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.222870  2246 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:30.224114  7992 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:30.183895  7571 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:30.178618  7736 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:30.226763  7736 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.227103  7736 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:30.229820  1445 catalog_manager.cc:5697] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:30.203974  7855 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:30.231564  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 981) took 1099 ms. Trace:
I20260709 13:02:30.139521  1691 raft_consensus.cc:2368] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14.
I20260709 13:02:30.141510  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:30.232097  1543 rpcz_store.cc:276] 0709 13:02:29.132252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.144632 (+ 12380us) service_pool.cc:224] Handling call
0709 13:02:29.144927 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:29.745230 (+600303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.745269 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:29.745706 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:02:30.135466 (+389760us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:30.135505 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.199749 (+ 64244us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54002e4854. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:30.199818 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:30.231287 (+ 31469us) raft_consensus.cc:1685] finished
0709 13:02:30.231307 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.231505 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":370434,"raft.queue_time_us":364803,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":7296,"spinlock_wait_cycles":549091584,"thread_start_us":379637,"threads_started":1,"wal-append.queue_time_us":469607}
I20260709 13:02:30.238687  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:30.153054  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:30.110441  7953 consensus_queue.cc:1059] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:02:30.117002  7633 consensus_queue.cc:1059] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:02:30.158484  7830 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:02:30.172139  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 108627us
I20260709 13:02:30.254573  1512 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:30.177330  1695 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 21: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:30.179040  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:30.179448  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:30.207782  2242 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:30.189779  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 74108.1us
I20260709 13:02:30.257687  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:30.212555  1613 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:30.218701  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:30.221098  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:30.168969  1692 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21.
I20260709 13:02:30.231633  7855 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.157287  2238 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 21 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:02:30.251255  1691 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:30.252418  1587 leader_election.cc:400] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14.
I20260709 13:02:30.161331  7961 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.171406  7989 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:30.158617  7967 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.191185  7952 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:30.268354  1587 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:30.248730  7793 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:30.176551  8027 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:02:30.176285  7938 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.250761  7856 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:30.186700  7990 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.268078  1512 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:30.275144  1660 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:30.251873  7970 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:30.267439  7855 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:30.267716  7955 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:30.330547  7955 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:30.299600  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:30.332571  1660 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:30.333529  1660 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:30.334522  7795 raft_consensus.cc:2764] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:02:30.335294  7795 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:30.296149  7891 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:02:30.335909  7795 raft_consensus.cc:697] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:30.336953  7795 consensus_queue.cc:237] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:30.339685  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.300952  2242 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:02:30.276100  7571 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:30.316447  7961 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:30.284720  7952 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:30.273226  7991 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:02:30.352900  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:30.325682  7938 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:30.285142  7728 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.291510  7793 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.328918  7992 raft_consensus.cc:3055] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:30.347470  1621 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:02:30.304567  7989 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.287911  7831 raft_consensus.cc:3055] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:02:30.360584  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 54790.9us
I20260709 13:02:30.385700  2210 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:30.364425  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:30.367841  7728 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:30.370675  7793 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:30.388055  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.351270  8035 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:02:30.377946  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 109694us
I20260709 13:02:30.349642  7796 raft_consensus.cc:2804] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:30.305111  7930 raft_consensus.cc:2764] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:02:30.391161  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:30.387545  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.371326  7875 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.403410  7989 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:30.304932  7856 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.409523  7875 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.345224  7970 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.373636  7992 raft_consensus.cc:740] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:30.384291  7831 raft_consensus.cc:740] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:30.456036  8023 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:30.473206  8023 raft_consensus.cc:697] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:30.394544  7793 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.459726  7887 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:30.485226  7887 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:30.487843  8039 log.cc:927] Time spent T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.359s	user 0.005s	sys 0.000s
I20260709 13:02:30.491387  7887 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:30.470301  7854 consensus_meta.cc:287] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.001s
I20260709 13:02:30.492216  7854 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.493330  2241 raft_consensus.cc:1240] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:02:30.495074  2239 raft_consensus.cc:606] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:30.495553  2239 raft_consensus.cc:614] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:30.413532  7796 raft_consensus.cc:697] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:30.496798  7796 consensus_queue.cc:237] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.472196  7831 consensus_queue.cc:260] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:30.390340  7891 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:30.482235  7990 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:30.483649  7992 consensus_queue.cc:260] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.408145  7997 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:30.474171  8023 consensus_queue.cc:237] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.464563  7967 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:30.466840  7952 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.499820  7754 raft_consensus.cc:3055] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:30.503299  7854 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:30.483083  7970 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:30.535611  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.551859  1618 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:30.531920  7891 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:30.512266  2243 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:30.541390  7992 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:30.520408  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.547708  7831 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:30.571039  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.520785  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 187300us
W20260709 13:02:30.523190  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.525569  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 48625.4us
I20260709 13:02:30.522450  7736 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.534343  7754 raft_consensus.cc:740] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:30.532099  7997 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.583105  7754 consensus_queue.cc:260] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.584228  7754 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:30.584630  7997 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:30.585538  7891 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.485167  7793 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.514984  2246 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:02:30.574671  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:02:30.509738  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 241696us
I20260709 13:02:30.593247  1695 raft_consensus.cc:1240] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:02:30.598197  1512 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:30.520004  7855 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.619656  1512 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:30.634011  7932 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:30.608577  7997 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:02:30.629401  8048 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:30.639374  7856 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:30.638859  8048 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.640980  7793 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:30.644845  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:30.645717  2245 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:02:30.628543  7991 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:30.648408  7991 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.648907  7736 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:30.651448  7961 consensus_queue.cc:1059] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:30.652573  7961 consensus_queue.cc:1059] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:30.653805  7961 raft_consensus.cc:3055] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:30.654261  7961 raft_consensus.cc:740] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:30.654803  7952 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:30.623700  8049 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:30.655831  8049 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:30.656315  8049 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.627043  7967 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:02:30.660735  7855 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:30.664062  7961 consensus_queue.cc:260] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.667428  7938 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:30.667970  7932 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:30.669060  7956 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:30.672554  7956 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.669625  7955 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:30.675693  7955 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.678231  7955 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:30.671625  7932 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:30.679919  1659 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.691s (SENT) [suppressed 14 similar messages]
I20260709 13:02:30.670310  7736 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:02:30.680696  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.666869  1511 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:30.683643  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:30.684368  2241 raft_consensus.cc:2368] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14.
I20260709 13:02:30.695771  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.697307  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.698143  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:30.699050  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.699836  1688 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 21.
I20260709 13:02:30.701601  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:30.704452  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:30.705752  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:30.709143  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.711454  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:30.711761  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.712037  1691 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:30.712917  1694 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 15: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:30.714219  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:30.671178  7938 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.651038  7991 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:30.693176  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:30.720831  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.720117  1586 leader_election.cc:400] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14.
I20260709 13:02:30.721616  1586 leader_election.cc:403] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:02:30.722543  7891 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:30.725835  1691 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 22.
I20260709 13:02:30.727097  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:30.727559  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:30.729374  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.689231  7955 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:30.734350  1692 raft_consensus.cc:1240] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:30.735440  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.735572  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:30.740345  2246 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:30.736193  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:30.736286  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:30.743141  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:30.726224  7961 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:30.718220  8048 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:30.751192  2211 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:30.747712  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 45589.2us
I20260709 13:02:30.729154  7956 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:30.749053  1688 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:02:30.749804  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:30.744273  1660 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:30.758275  1691 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:30.748924  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.731567  7855 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:30.753482  1586 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:30.753751  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.754648  2209 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:30.688823  7736 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.718086  7952 consensus_queue.cc:1059] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:02:30.760946  1690 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:30.717381  7728 consensus_queue.cc:1059] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:02:30.764554  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.737308  7856 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:30.740020  7955 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:30.779842  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 99924.2us
I20260709 13:02:30.744330  7932 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:30.761453  1688 raft_consensus.cc:1240] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:02:30.781157  1695 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
W20260709 13:02:30.799659  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 45088.3us
I20260709 13:02:30.802558  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:30.759747  8010 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.803570  2245 raft_consensus.cc:2393] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 15: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:30.797600  7938 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:30.786173  1659 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:30.763175  7886 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:30.807832  8051 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:30.809567  1659 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:30.810575  8051 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:30.812237  1659 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:30.812536  1691 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:02:30.813289  8051 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:30.816146  2211 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:30.817028  7997 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:02:30.824038  8059 log.cc:927] Time spent T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:02:30.780560  7754 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:30.827776  7886 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:30.828372  7886 raft_consensus.cc:697] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:30.829411  7886 consensus_queue.cc:237] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.840520  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:30.765079  7795 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:30.848482  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.784945  7955 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:30.765365  8048 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:30.782763  7956 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:30.851542  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:30.858881  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:30.869742  1618 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 22: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:30.853811  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:30.795068  8028 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:30.870755  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:30.871428  1621 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:30.806150  7887 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:30.873749  1539 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:02:30.804216  7856 raft_consensus.cc:697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:30.817736  7796 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:02:30.877142  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:30.880739  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.837162  7991 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:30.882081  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:30.882728  1695 raft_consensus.cc:1240] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:02:30.883849  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:30.888517  1539 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:30.883895  1546 raft_consensus.cc:1240] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:30.882126  1688 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:30.889544  1541 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:30.851553  7754 raft_consensus.cc:697] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:30.850229  7795 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:30.897667  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:30.866555  7793 raft_consensus.cc:3055] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:30.898267  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:30.892608  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:30.901659  1545 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:02:30.903885  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:30.899308  1547 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:02:30.872965  7932 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:30.877104  7967 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:30.848011  8010 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.847165  8051 consensus_queue.cc:1059] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:02:30.929811  1539 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:02:30.930884  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:30.931099  1541 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:30.931560  1539 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:30.932423  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:30.932545  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:30.933100  1539 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:30.933826  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:30.934201  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:30.923944  1547 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:02:30.926162  8049 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.896184  8069 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.873265  7956 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.934652  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:30.906484  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:30.905260  7795 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:30.943687  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.947201  1689 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:02:30.936611  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.873620  8048 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.897578  7938 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:30.894244  7796 consensus_queue.cc:1243] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:30.904318  7793 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:30.944252  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.944675  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:30.943630  1546 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:30.969903  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:30.970453  1546 raft_consensus.cc:2376] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18. Re-sending same reply.
W20260709 13:02:30.970731  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.965504  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.971163  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:30.971758  1546 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:30.972481  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:30.937590  1541 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:30.949182  1538 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:30.951040  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:30.952833  1659 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:30.953763  8067 log.cc:927] Time spent T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:02:30.953895  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:30.954499  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:30.955868  7736 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:30.898654  7991 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.957746  7956 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:30.958256  8048 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:30.961931  7875 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:30.974169  2210 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:30.927959  7967 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:30.979393  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:30.980837  1512 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:30.919199  7932 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:30.979931  7988 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:31.002861  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:31.003785  2245 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
W20260709 13:02:30.987857  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.975643  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:30.992687  2209 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:30.997112  1512 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:31.006875  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:31.008322  1541 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:31.010739  1512 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:31.011051  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:31.011646  1511 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:31.011665  1543 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:31.012615  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:30.946993  8069 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.017441  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:31.022440  1512 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:30.973706  7953 consensus_queue.cc:1059] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:02:31.009603  8048 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:02:31.024570  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 57243.6us
I20260709 13:02:31.035784  1541 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21.
I20260709 13:02:31.037074  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:31.038235  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:31.039170  1541 raft_consensus.cc:2410] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:02:30.975226  7938 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.041018  1544 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
I20260709 13:02:31.042265  1541 raft_consensus.cc:1240] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:31.025158  7886 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:31.020016  7956 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:31.025882  7736 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:31.062225  1543 raft_consensus.cc:2410] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:02:30.969563  7856 consensus_queue.cc:237] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.015844  8072 raft_consensus.cc:2764] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:02:31.069186  8082 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.069756  8082 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:31.024379  8068 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:30.984578  7754 consensus_queue.cc:237] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.030923  8073 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:02:31.073954  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 43739.9us
I20260709 13:02:31.020428  7988 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.058463  7886 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:02:31.088536  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 116974us
I20260709 13:02:31.089548  1585 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:31.077214  8048 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:31.099355  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.024869  7793 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.083916  8073 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:31.091773  7886 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:31.120718  7967 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:31.123078  8082 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:31.125356  7988 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:31.127184  8069 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:31.116586  8074 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
W20260709 13:02:31.132266  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 109904us
I20260709 13:02:31.088084  7955 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.135524  1512 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:31.114362  8073 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:31.147822  1512 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:31.137900  7952 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.134778  8087 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:31.146080  8069 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:31.181134  7891 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 13. Current term is 14.
I20260709 13:02:31.136992  8010 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:31.173868  7955 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:31.187664  7952 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:31.188273  7938 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:31.198253  7952 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:31.191694  7795 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.199647  1687 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
I20260709 13:02:31.202039  8048 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:31.203390  7795 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:31.205134  8073 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.212559  8073 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:31.214771  7887 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:31.215580  7886 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.220217  7886 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:31.229806  1544 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:31.282593  7889 raft_consensus.cc:3055] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:31.283113  7889 raft_consensus.cc:740] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:31.295945  8055 log.cc:927] Time spent T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.512s	user 0.004s	sys 0.000s
I20260709 13:02:31.317014  7932 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:31.324337  7997 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.324939  7997 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:31.327023  7997 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:31.327798  7997 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:31.328491  8051 raft_consensus.cc:3055] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:31.329258  8051 raft_consensus.cc:740] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:02:31.330416  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 377599us
I20260709 13:02:31.330112  8051 consensus_queue.cc:260] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.331276  7997 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:31.333051  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:31.333817  7990 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:31.334388  7990 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:31.338851  7796 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.339516  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:31.339447  7796 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.340564  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:31.341693  7796 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:31.342104  7856 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.342732  7855 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:31.342620  7856 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:31.344707  7796 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:31.345466  7796 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.346444  7796 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:31.344884  7856 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:31.350777  8060 log.cc:927] Time spent T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Append to log took a long time: real 0.555s	user 0.000s	sys 0.002s
I20260709 13:02:31.334908  7990 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:31.355280  1615 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 13:02:31.341717  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:31.383221  1689 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:31.383797  8098 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:31.386475  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:31.360591  8065 log.cc:927] Time spent T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.564s	user 0.003s	sys 0.000s
I20260709 13:02:31.365706  1659 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:31.392938  1659 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:31.394093  1659 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:31.369828  7990 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:31.395593  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:31.395938  2241 raft_consensus.cc:1240] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:31.397130  7990 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:31.353754  7997 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:31.363992  7796 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:31.352370  2243 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:31.399852  7796 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:31.400568  7571 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:31.400985  7571 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:31.401350  7571 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:31.408142  7856 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:31.408933  7856 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:02:31.414795  8058 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.619s	user 0.003s	sys 0.000s
I20260709 13:02:31.414592  7854 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:31.417102  7571 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:31.419591  1660 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:31.420784  7571 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:31.421934  7571 consensus_queue.cc:1059] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:31.424665  7796 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:31.424805  7793 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:31.425243  7796 raft_consensus.cc:697] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:31.426180  7796 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.443656  1546 raft_consensus.cc:2410] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:02:31.444362  8049 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:31.451346  8098 raft_consensus.cc:3055] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:31.451855  8098 raft_consensus.cc:740] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:31.452734  8098 consensus_queue.cc:260] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.453739  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:31.454692  2241 raft_consensus.cc:2410] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:02:31.453788  8098 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:31.458791  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 311007us
I20260709 13:02:31.466604  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:31.467376  2245 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:31.469718  1512 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:31.470715  7932 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:31.471318  8070 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:31.572755  1512 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:31.622118  8070 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:31.624917  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 61344.5us
I20260709 13:02:31.625789  1512 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:31.626535  8070 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:31.626936  8070 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.627297  8070 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:31.632668  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 486347us
I20260709 13:02:31.633605  1585 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:31.635516  8093 consensus_queue.cc:1059] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:31.636472  7831 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:31.637131  7988 raft_consensus.cc:3055] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:31.637559  7988 raft_consensus.cc:740] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:31.637756  7938 consensus_queue.cc:1059] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:31.638363  7988 consensus_queue.cc:260] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:31.638679  7938 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:31.639876  7967 raft_consensus.cc:3055] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:31.640316  7967 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:31.641146  7967 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:31.642362  7967 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:31.638298  7882 raft_consensus.cc:3055] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:31.643038  7882 raft_consensus.cc:740] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:31.643846  7882 consensus_queue.cc:260] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.644487  7988 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:31.644819  7882 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:31.635219  1585 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:31.657090  8070 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:31.658593  7932 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:31.676985  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.695437  7736 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:31.696161  7736 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.701244  7736 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:31.705515  2209 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:31.717136  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:31.722440  1691 raft_consensus.cc:3055] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:31.722878  1691 raft_consensus.cc:740] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:31.722751  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:31.723788  1543 raft_consensus.cc:2393] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 11: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:31.723953  1691 consensus_queue.cc:260] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:31.725008  1691 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:31.725819  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:31.726621  1543 raft_consensus.cc:2410] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:02:31.727741  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:31.728477  1543 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 13:02:31.729235  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:31.731375  8098 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:31.730141  1695 raft_consensus.cc:2393] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 22: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:31.742980  1695 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:02:31.740079  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:31.750342  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:31.751192  1543 raft_consensus.cc:2393] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 17: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:31.752141  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:31.752388  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:31.752899  1689 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:31.754998  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:31.756363  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:31.756960  1541 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:02:31.757845  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:31.758438  1546 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:31.758912  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:31.761209  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:31.761890  1541 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 20: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:31.762351  1689 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:31.762473  7856 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:31.763088  7856 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:31.765216  1547 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:31.765523  7856 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:31.767444  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:31.768170  7739 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:31.756847  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:31.769404  1696 raft_consensus.cc:2393] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 19: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:31.768625  7739 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.732173  8098 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:31.770444  7739 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:31.783056  8071 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:31.783769  8071 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.786598  8071 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:31.789173  2245 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:31.790730  7938 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.791603  7938 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:31.793962  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:31.795171  7938 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:31.795781  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:31.796669  1688 raft_consensus.cc:2393] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 19: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:02:31.798928  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 70196.5us
I20260709 13:02:31.800028  8107 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:02:31.800992  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.802078  8098 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:31.800576  8107 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.804201  8107 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:31.805161  7739 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.807722  7991 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:31.798444  1512 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:31.811647  7991 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:31.812343  7991 raft_consensus.cc:697] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:31.813580  7991 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.819058  2209 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:31.821856  1691 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:02:31.827500  1691 pending_rounds.cc:85] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 9
I20260709 13:02:31.827895  1691 pending_rounds.cc:107] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:02:31.828266  1691 raft_consensus.cc:2889] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:31.827718  7830 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:31.832229  8070 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:31.837411  2241 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:31.839334  7970 consensus_queue.cc:1059] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:02:31.843394  7736 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:31.844019  7736 consensus_queue.cc:1243] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer 822e08445eae4a33b2f2fe92060192c6 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:31.838774  7739 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:31.847532  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:31.868016  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.875486  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.880117  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 762291us
I20260709 13:02:31.881470  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:31.883764  2243 raft_consensus.cc:1240] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:02:31.883944  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:31.884745  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:31.884888  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:31.885782  1691 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 20: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:31.886869  2241 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:31.887418  7990 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.887925  7990 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:31.890384  7990 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:31.891374  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:31.892307  1544 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 17: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:31.893810  1691 pending_rounds.cc:85] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 8
I20260709 13:02:31.895533  1691 pending_rounds.cc:107] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:02:31.898036  1691 raft_consensus.cc:2889] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:31.896559  1544 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:02:31.894487  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.898711  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:31.902230  1545 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
I20260709 13:02:31.906442  2246 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:31.911626  7990 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:31.914352  7970 raft_consensus.cc:3055] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:31.914819  7970 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:31.903193  1659 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:31.915843  7990 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:31.915719  7970 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:31.917212  7970 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:31.918440  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:31.919616  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:31.920182  1541 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:31.927379  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:31.927629  1541 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
I20260709 13:02:31.928151  1693 raft_consensus.cc:2393] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 19: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:31.930990  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:31.931864  1541 raft_consensus.cc:2393] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 15: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:31.934365  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:31.934612  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:31.935105  2245 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:31.935722  7990 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:31.938352  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:31.939195  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:31.944438  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:31.945194  1547 raft_consensus.cc:2393] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 22: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:31.947188  7571 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:31.948674  1659 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:31.950397  7571 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:31.951573  1659 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:31.955474  7571 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:31.956739  1659 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:31.961601  7571 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:31.964021  7571 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:31.968420  1659 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:31.970407  7571 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:02:31.972637  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 337436us
I20260709 13:02:31.973807  8093 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:31.975330  1659 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:31.975462  7932 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:31.978277  7932 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:31.982553  1690 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:31.987753  1585 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:31.988986  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:31.989758  1690 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 18: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:31.991604  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:31.997217  1543 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:02:31.999441  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:32.000627  1694 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:32.008358  8051 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:32.014531  7882 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:32.019977  7930 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:32.023422  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:31.935379  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.024904  1511 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:32.027401  7932 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:32.027906  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:32.029345  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:32.033785  7793 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.034399  7793 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:32.038074  7793 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:32.040493  7891 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.041070  7891 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.042373  8027 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.042894  8027 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.044864  8027 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:32.045519  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.046123  1622 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
I20260709 13:02:32.046519  1689 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:31.992587  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:32.043028  8068 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:32.048074  1621 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:32.051692  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:32.052990  1690 raft_consensus.cc:2410] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:02:32.072800  2243 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:32.078962  7891 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:32.080760  7889 consensus_queue.cc:260] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:32.082087  7889 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:32.023509  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 48265.7us
I20260709 13:02:32.088073  1659 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:32.089015  7970 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:32.091127  7970 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:32.092631  1659 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:32.094841  1659 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:32.085613  7997 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.097215  7795 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:32.097759  7795 raft_consensus.cc:697] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:32.097640  7997 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:32.098694  7795 consensus_queue.cc:237] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.099133  2209 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:32.100080  2209 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:02:32.102501  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 114813us
I20260709 13:02:32.105721  7886 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:32.104460  7854 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:02:32.106180  7886 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:32.106577  7886 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:32.094491  7739 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.107486  7739 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:32.109474  7739 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:32.097826  2210 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:32.116039  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:32.095593  7571 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:02:32.123137  1692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.006s	sys 0.009s
W20260709 13:02:32.125620  1692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.007s	sys 0.009s
I20260709 13:02:32.124707  8051 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.135062  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:32.137976  2243 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:32.111382  8019 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:32.121316  7631 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.144924  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:32.147157  1690 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:32.126051  8093 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:32.154644  8093 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:32.155596  8093 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.156852  8093 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:32.157936  7886 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:32.151592  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:32.159847  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:32.125169  7680 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:32.161290  7680 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:32.161752  7680 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:32.161981  7938 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:32.162505  7938 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.151592  8088 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:02:32.145364  7739 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:02:32.159833  1693 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 12.
I20260709 13:02:32.145187  7754 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.166313  7754 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:32.125144  7571 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:32.167469  7571 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:32.142627  8083 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:32.168503  7754 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:32.137701  8051 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.168326  8083 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.170457  8051 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:32.170778  8083 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:32.134186  7891 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.144972  8081 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:32.171581  8019 raft_consensus.cc:697] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:32.145648  7854 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:32.145733  7953 consensus_queue.cc:1059] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:02:32.165474  7631 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.172938  8019 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:32.171788  8081 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.125764  7970 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:02:32.172636  7854 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:32.175037  7631 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:32.175052  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.154179  8091 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.175704  7854 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:32.176359  8091 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:32.178443  8091 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:32.179801  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:32.180286  7930 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:32.180413  2241 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:32.180948  8081 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:32.181895  1586 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:32.171708  7891 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.143687  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:32.187619  7571 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.170188  7680 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.189489  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:32.185824  7891 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:32.190784  8068 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:32.191322  7953 raft_consensus.cc:3055] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:32.211409  7953 raft_consensus.cc:740] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:32.202687  8068 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:32.213109  8068 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:32.212747  7953 consensus_queue.cc:260] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:32.195616  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 64459.3us
I20260709 13:02:32.220022  7953 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:32.220252  7886 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:32.221311  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.221869  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:32.222697  1693 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 18: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:32.222820  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.195103  7930 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:32.223627  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.223927  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.224300  1621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:32.224828  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.225193  1613 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:32.225980  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.221944  1620 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:32.131865  7997 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:32.203136  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.221930  1622 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:02:32.202780  7631 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:32.228506  7631 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.228880  7631 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:32.234339  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.234983  8023 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:32.237475  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:32.238336  1619 raft_consensus.cc:2410] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:02:32.239176  7571 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:32.243016  1619 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:32.243414  2211 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:32.242185  7680 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:32.249650  7872 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:02:32.259090  7938 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:32.250538  7875 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:32.271798  7875 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.275722  7875 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:32.307008  8068 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:32.344465  1511 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:32.348719  1511 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:02:32.350857  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 209932us
I20260709 13:02:32.359154  1587 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:32.362421  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:32.363931  1547 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:32.364840  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.365283  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.366271  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.366937  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.367733  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:32.368597  1613 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:32.369266  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:32.370357  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.366994  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.371527  1619 raft_consensus.cc:2410] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 19 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:02:32.371416  1617 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:32.372403  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.373405  1619 raft_consensus.cc:2410] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:02:32.375981  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.378252  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.379226  1622 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 22.
I20260709 13:02:32.383301  7736 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:32.384572  7736 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:32.385237  7736 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 19 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:32.386942  7736 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:32.391739  7571 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:32.392905  7571 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.400427  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.401568  1622 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
I20260709 13:02:32.402709  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.419986  7891 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:32.420737  7891 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.421236  7891 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:32.421677  7889 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:32.362890  1587 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:32.449538  7830 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.450603  7830 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:32.454419  7830 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:32.461866  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:32.422685  7854 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:32.479768  7997 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:32.480749  7997 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:32.484481  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 121857us
I20260709 13:02:32.486299  8123 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:32.487520  8123 consensus_queue.cc:1059] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:32.489463  8093 raft_consensus.cc:3055] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:32.490056  8093 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:32.491770  8093 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.494200  8093 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:32.495886  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.496510  2243 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:32.496767  1616 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:32.498674  1620 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19. Ops: []
W20260709 13:02:32.499606  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 63623.3us
I20260709 13:02:32.501035  1620 raft_consensus.cc:1275] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:02:32.501754  2246 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
I20260709 13:02:32.505457  7854 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:32.506233  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.605208  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.610601  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:32.619768  1547 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:02:32.619530  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:32.620241  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 259477us
I20260709 13:02:32.623468  7571 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:32.511397  7889 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.623340  1620 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:32.630199  7680 consensus_queue.cc:1059] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.184s
I20260709 13:02:32.631963  8027 raft_consensus.cc:3055] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:32.632449  8027 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:32.634009  8027 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:32.634804  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.640445  8019 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:32.641360  7889 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:32.641290  8019 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:32.647553  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.651172  1613 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
I20260709 13:02:32.651862  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:32.653441  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:32.655433  7793 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:32.656266  7793 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:32.659124  7571 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.659898  7571 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:32.661222  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:32.661933  7571 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:32.674917  8070 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:32.675874  8070 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.680014  8068 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:32.624131  7882 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 13:02:32.689035  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:32.690814  1621 raft_consensus.cc:606] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:32.691339  1621 raft_consensus.cc:614] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:32.662030  1620 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 20: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:32.696211  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:32.701025  1659 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:32.701722  8019 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:32.702498  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 56375.7us
I20260709 13:02:32.703553  7571 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:32.703954  7571 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:32.704296  7571 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:32.704641  7631 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:32.705884  1618 raft_consensus.cc:2368] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17.
I20260709 13:02:32.708968  7930 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.709754  7930 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:32.711614  1643 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4460 after lost signal to thread 431
W20260709 13:02:32.712131  1643 debug-util.cc:398] Leaking SignalData structure 0x7b08002a3500 after lost signal to thread 434
I20260709 13:02:32.712399  8091 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:02:32.713420  1643 debug-util.cc:398] Leaking SignalData structure 0x7b08002c8380 after lost signal to thread 1479
I20260709 13:02:32.713085  8091 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:32.715217  1643 debug-util.cc:398] Leaking SignalData structure 0x7b08001a8e00 after lost signal to thread 1571
I20260709 13:02:32.732805  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:32.733553  7930 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:32.715826  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:32.735620  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:32.737449  7795 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.738286  7631 leader_election.cc:290] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:32.738083  7795 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:32.739632  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:32.743021  2246 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:32.742753  1615 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 11.
I20260709 13:02:32.742736  1620 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
W20260709 13:02:32.748657  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 45404.4us
I20260709 13:02:32.717340  7793 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:32.717288  8091 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:32.752046  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.742532  8070 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:32.755950  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:32.757201   436 debug-util.cc:398] Leaking SignalData structure 0x7b08003c4aa0 after lost signal to thread 1692
I20260709 13:02:32.755388  1546 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:32.760193  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.730278  7891 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.763054  1613 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:32.767204  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:32.768796  1544 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:32.775799  7795 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:32.776904  2241 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:32.777860  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:32.785808  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:32.788411  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.789376  1616 raft_consensus.cc:2368] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 19. Current term is 20.
I20260709 13:02:32.793927  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:32.796391  7953 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.796787  7571 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.796826  2210 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:02:32.809044  1643 debug-util.cc:398] Leaking SignalData structure 0x7b0800132480 after lost signal to thread 1646
I20260709 13:02:32.789819  1692 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:32.819883  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:32.854135  7571 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:32.860455  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 114598us
I20260709 13:02:32.788183  7793 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:32.867682  7891 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:32.872777  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.885512  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.886324  1617 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 22.
I20260709 13:02:32.888557  1693 raft_consensus.cc:1240] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:32.887166  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.880995  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:32.898787  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.900610  2246 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
W20260709 13:02:32.897743  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 122351us
I20260709 13:02:32.891610  7953 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:32.918501  1643 debug-util.cc:398] Leaking SignalData structure 0x7b08003dcfe0 after lost signal to thread 1720
I20260709 13:02:32.923424  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:32.927875  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:33.007009  1620 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 21.
I20260709 13:02:32.928265  1538 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:02:33.008606  1643 debug-util.cc:398] Leaking SignalData structure 0x7b0800398c80 after lost signal to thread 1721
I20260709 13:02:32.938148  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:32.983043  1586 leader_election.cc:304] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:32.942647  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:32.937834  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:32.925545  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:32.955353  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:32.934567   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:32.936986  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.929134  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:32.946975  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:32.916088  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:32.939359  1691 raft_consensus.cc:1240] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:33.008088  1622 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:32.948654  1618 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:02:32.932991  1694 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:32.950258  1616 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:32.940760  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:32.947826  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:32.925184  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:32.937709  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:32.938603  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:32.926007  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:32.945065  8027 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:32.946262  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:33.053391  1687 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:32.959440  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:32.947362  7875 consensus_meta.cc:287] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: Time spent flushing consensus metadata: real 0.671s	user 0.011s	sys 0.012s
W20260709 13:02:32.956957  8139 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.099s	user 0.003s	sys 0.000s
I20260709 13:02:32.927789  7854 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.050601  1619 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:02:32.933568  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:32.902228  7793 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:32.916874  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:32.962272  7872 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:32.959821  7953 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:33.035722  7736 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.065523  1546 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21.
W20260709 13:02:33.068480  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 85504.4us
W20260709 13:02:33.076921  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.980151  7989 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:32.964319  7997 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:33.064476  1692 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 22.
I20260709 13:02:33.063881  1547 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:33.079994  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 187213us
I20260709 13:02:33.073068  1541 raft_consensus.cc:2393] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 16: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:33.067637  1542 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 22.
I20260709 13:02:33.087814  1542 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:33.070359  7875 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.078682  1543 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:33.075173  1690 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 22.
I20260709 13:02:33.089037  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:33.075176  8123 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:33.093897  8123 raft_consensus.cc:697] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:33.080883  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:33.095206  8123 consensus_queue.cc:237] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.096055   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:33.110306  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:33.095710  1444 catalog_manager.cc:5697] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.094787  1538 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:33.099409  1539 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:33.100458  2245 raft_consensus.cc:2368] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13.
I20260709 13:02:33.101539  7875 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:33.078842  7854 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.103380  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:33.103978  7793 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:33.103817  7989 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.116887  7793 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:32.928372  1660 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:33.117489  7793 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.117887  7793 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:33.118324  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 255296us
I20260709 13:02:33.118427  7989 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:33.104422  7736 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.120842  7736 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:33.121387  7736 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:33.122812  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:33.104738  7872 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:33.108008  1621 raft_consensus.cc:2368] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 19. Current term is 20.
I20260709 13:02:33.115095  1544 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 20.
I20260709 13:02:33.126093  8136 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:33.126549  8136 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.126868  8136 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:33.115665  8093 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.143096  1547 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
W20260709 13:02:33.147533  1643 debug-util.cc:398] Leaking SignalData structure 0x7b080032cec0 after lost signal to thread 2270
W20260709 13:02:33.148010  1643 debug-util.cc:398] Leaking SignalData structure 0x7b080034baa0 after lost signal to thread 2271
I20260709 13:02:33.151559  1660 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:33.141446  7795 consensus_queue.cc:1048] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:02:33.132349  7997 consensus_queue.cc:1059] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:02:33.162077  7571 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:33.164577  7571 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.164940  7571 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:33.141448  8093 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.168246  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:33.173127  8093 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:33.175297  7854 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:33.184629  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:33.188476  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:33.189196  1696 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21.
I20260709 13:02:33.185740  7872 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.185349  2245 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:33.196710  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:33.197144  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 114502us
I20260709 13:02:33.198689  1621 raft_consensus.cc:2410] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:02:33.199118  1691 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:33.200160  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 169075us
I20260709 13:02:33.200469  1587 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:33.201996  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:33.179417  1444 catalog_manager.cc:5697] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 9 to 11, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 11 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.208812  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:33.209303  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
W20260709 13:02:33.209487  1445 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42114 (request call id 272) took 41635 ms (client timeout 15000 ms). Trace:
I20260709 13:02:33.209554  1539 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:02:33.211156  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:33.211706  1546 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:33.211650  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:33.212735  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:33.213044  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:33.213582  1539 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:33.214164  1659 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:33.214365  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:33.216671  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:33.217206  1541 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:33.217965  1540 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:33.218524  1541 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:33.215109  1585 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:33.219477  7997 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:33.219946  7997 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.220286  7997 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:33.223562  7930 raft_consensus.cc:3055] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:33.224115  7930 raft_consensus.cc:740] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:33.225126  7930 consensus_queue.cc:260] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.226086  1547 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
I20260709 13:02:33.226459  7930 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:33.206458  8093 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:33.230592  8093 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.230530  1531 tablet_service.cc:1558] Processing DeleteTablet for tablet 479456ab418d44c4983d2bb37eb0e700 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:39608
I20260709 13:02:33.231221  8093 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:33.235472  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:33.237623  1546 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:33.238687  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:33.240913  1614 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:33.241385  1511 leader_election.cc:400] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13.
I20260709 13:02:33.241604  1511 leader_election.cc:403] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:33.243060  1586 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:33.244637  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:33.244712  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:33.245566  1689 raft_consensus.cc:2410] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:02:33.246802  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:33.248095  7571 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:33.250643  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 52425us
I20260709 13:02:33.251834  1542 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
W20260709 13:02:33.253539  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 107724us
I20260709 13:02:33.256942  1690 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:33.257942  8086 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:33.258374  8086 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.258486  2209 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:33.258374  1696 raft_consensus.cc:2393] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 12: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:33.258761  8086 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:33.250394  8027 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:33.261325  8070 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:33.263674  1444 catalog_manager.cc:5697] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:33.265565  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:33.269569  7793 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.246358  7736 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:33.306162  1538 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 20.
I20260709 13:02:33.307039  7571 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:33.307693  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 92544.7us
I20260709 13:02:33.313187  1693 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 21: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:33.315070  1511 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:33.314174  7989 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:33.339207  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:33.340490  1543 raft_consensus.cc:2368] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 17. Current term is 18.
I20260709 13:02:33.346287  1542 raft_consensus.cc:3060] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:02:33.318280  7854 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.347273  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:33.348242  1587 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:33.355625  8147 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 12. Current term is 13.
W20260709 13:02:33.358259  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 81585.3us
I20260709 13:02:33.359339  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:33.360776  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:33.362061  7736 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.364645  1444 catalog_manager.cc:5697] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.367372  8148 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:33.368176  8148 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:33.369045  8148 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:33.369647  8148 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.370085  8148 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:33.371783  1429 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5814bf31e900408885160ea0f89d6189 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d7158d6c3b634dc7abb69eac58eba291 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:33.372560  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:33.372890  1429 catalog_manager.cc:5028] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): tablet 479456ab418d44c4983d2bb37eb0e700 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:02:33.367751  7854 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.380549  7854 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:33.366452  1444 catalog_manager.cc:5697] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 12 to 14, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:33.374940  1660 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:33.312822  8091 consensus_queue.cc:1059] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:02:33.347741  1659 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:33.388283  1542 raft_consensus.cc:2468] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:33.389691  2209 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:33.393034  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:33.340346  7989 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:33.399474  7989 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:33.399974  7891 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:33.400676  7891 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:33.402215  7891 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:33.403645  8117 log.cc:927] Time spent T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:33.388273  7997 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.406248  7997 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:33.407320  1587 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:33.408529  1587 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:33.412226  7793 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:33.235689  1445 rpcz_store.cc:269] 0709 13:01:51.574356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.574582 (+   226us) service_pool.cc:224] Handling call
0709 13:02:33.209272 (+41634690us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:30.579687 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:30.580390 (+   703us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:30.580437 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:02:30.580469 (+    32us) tablet.cc:662] Decoding operations
0709 13:02:30.580918 (+   449us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:30.580980 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:30.581011 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:02:30.581361 (+   350us) tablet.cc:701] Row locks acquired
0709 13:02:30.581387 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:02:30.598667 (+ 17280us) write_op.cc:270] Start()
0709 13:02:30.603981 (+  5314us) write_op.cc:276] Timestamp: P: 1783602150590761 usec, L: 0
0709 13:02:30.604007 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:02:30.604727 (+   720us) log.cc:844] Serialized 929 byte log entry
0709 13:02:31.349825 (+745098us) spinlock_profiling.cc:243] Waited 9.16 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:31.370925 (+ 21100us) op_driver.cc:464] REPLICATION: finished
0709 13:02:31.433121 (+ 62196us) write_op.cc:301] APPLY: starting
0709 13:02:31.433202 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:31.434749 (+  1547us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:31.434772 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:31.435956 (+  1184us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:31.436150 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:02:31.436202 (+    52us) write_op.cc:312] APPLY: finished
0709 13:02:31.436414 (+   212us) log.cc:844] Serialized 33 byte log entry
0709 13:02:31.437256 (+   842us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:31.437356 (+   100us) write_op.cc:454] Released schema lock
0709 13:02:31.437402 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:31.440654 (+  3252us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:31.440685 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":574980,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":61962,"apply.run_cpu_time_us":3983,"apply.run_wall_time_us":4649,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12503,"num_ops":2,"prepare.queue_time_us":210463,"prepare.run_cpu_time_us":26245,"prepare.run_wall_time_us":183597,"raft.queue_time_us":14049,"raft.run_cpu_time_us":18530,"raft.run_wall_time_us":70245,"replication_time_us":766804,"spinlock_wait_cycles":21060480,"thread_start_us":451255,"threads_started":4,"wal-append.queue_time_us":190502,"wal-append.run_cpu_time_us":13975,"wal-append.run_wall_time_us":1688685}]]}
I20260709 13:02:33.412865  7953 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:33.414427  7953 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:33.395057  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:33.417145  7571 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:33.402709  7891 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:33.420017  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 67136.5us
I20260709 13:02:33.421010  1691 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 20.
I20260709 13:02:33.429838  7571 raft_consensus.cc:2764] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:02:33.431183  2209 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:33.415724  8027 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:33.436576  1585 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:33.421350  7631 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:33.427438  7882 raft_consensus.cc:3055] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:33.433513  8123 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:33.440970  7828 raft_consensus.cc:2804] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:33.441627  7875 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:33.431941  8093 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.448325  1444 catalog_manager.cc:5697] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 13 to 17, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 17 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.449520  7882 raft_consensus.cc:740] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:33.450578  8123 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.451058  8123 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:33.456638  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:33.457355  1543 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
I20260709 13:02:33.450495  1444 catalog_manager.cc:5697] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 16 to 19, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:33.459167  1444 catalog_manager.cc:5697] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.460791  7875 raft_consensus.cc:697] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:33.416891  8155 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:02:33.461823  7875 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.462996  8149 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:33.463490  8149 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:33.463932  8149 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:33.450492  7882 consensus_queue.cc:260] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.467512  7828 raft_consensus.cc:697] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:33.463632  1444 catalog_manager.cc:5697] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 12 to 15, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:33.468464  7882 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:33.468833  7828 consensus_queue.cc:237] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.469607  1444 catalog_manager.cc:5697] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.449151  8093 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:33.434931  7997 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:33.487126  7997 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:33.487717  7997 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:33.502261  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 70626.5us
I20260709 13:02:33.503504  8091 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:33.503631  7953 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:33.504019  8091 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.504380  8091 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:33.505687  7793 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.506230  7793 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.513093  7571 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.513684  7571 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.524067  7736 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:33.536221  7571 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:33.537535  7891 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:33.544847  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 184160us
W20260709 13:02:33.546466  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 209026us
I20260709 13:02:33.546808  2209 leader_election.cc:400] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 17. Current term is 18.
I20260709 13:02:33.471292  1444 catalog_manager.cc:5697] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 9 to 13, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 13 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:33.551417  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 141572us
I20260709 13:02:33.555655  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:33.556663  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 51312.3us
I20260709 13:02:33.575736  2209 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:33.576773  1659 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:33.577435  7854 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:33.578701  1691 raft_consensus.cc:2393] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 20: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:33.570206  8086 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.434190  8027 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.596298  8027 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:33.597600  8086 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:33.420611  8136 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.574254  7793 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:33.577881  8162 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:33.580375  1659 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:33.579857  7854 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.600325  7854 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:33.600909  8136 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:33.581481  8158 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:33.583453  1444 catalog_manager.cc:5697] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 15 to 22, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 22 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:33.605129  1585 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:33.603550  8158 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.606310  8027 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.578990  8123 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:33.607465  7891 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:33.607897  8158 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:33.608737  8123 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:33.588235  1587 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:33.610005  1585 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:33.610193  8123 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:33.582773  8091 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.603103  8148 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:33.567898  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 193064us
I20260709 13:02:33.605145  1444 catalog_manager.cc:5697] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 12 to 15, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 15 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.615324  8158 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:33.622921  8158 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.631192  8158 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:33.631126  7793 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:33.617161  1444 catalog_manager.cc:5697] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 9 to 10, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:33.618819  8027 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:33.617413  1660 leader_election.cc:400] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 19. Current term is 20.
I20260709 13:02:33.632536  1444 catalog_manager.cc:5697] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 16 to 20, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 20 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:33.622303  1659 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:33.635257  1660 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:33.634367  1444 catalog_manager.cc:5697] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 16 to 18, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:33.629796  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:33.635531  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:33.635939  1659 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:33.638621  1691 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 21.
I20260709 13:02:33.640625  1444 catalog_manager.cc:5697] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:33.641590  1512 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:33.639204  1585 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:33.644498  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:33.645622  8151 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:33.646068  8151 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.646423  8151 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:33.617205  8091 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:33.638499  8148 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:33.648069  8148 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.650462  8148 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:33.643415  1587 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:33.622004  8136 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:02:33.634886  7571 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:02:33.653649  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:33.656518  7795 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:33.566414  7989 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.613914  7854 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.650686  7997 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:33.691080  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 47712.3us
I20260709 13:02:33.695150  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:33.654443  7891 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:33.654275  7793 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:33.698952  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:33.706977  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:33.661662  8136 raft_consensus.cc:2804] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:33.708730  2245 raft_consensus.cc:1240] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:33.708575  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 69431.5us
I20260709 13:02:33.710580  1688 raft_consensus.cc:2410] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:02:33.634541  8162 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:02:33.661819  7795 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.669975  8148 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:33.721167  1689 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:02:33.725106  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:33.725737  1694 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:33.724195  1693 raft_consensus.cc:1240] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:02:33.703948  8091 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:33.729023  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:33.730585  1687 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:33.703409  8093 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:33.729511  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:33.735414  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:33.735577  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:33.706015  7891 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.736097  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:33.739104  1540 raft_consensus.cc:3060] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:33.729039  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:33.736747  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:02:33.728447  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 92556.2us
I20260709 13:02:33.740098  2246 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:33.709483  7793 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.735666  1541 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Advancing to term 23
W20260709 13:02:33.741964  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 106553us
I20260709 13:02:33.743664  1543 raft_consensus.cc:2393] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 20: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:33.741979  1695 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 16: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:33.747759  7854 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:33.727079  7795 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:33.749601  7875 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.750262  7875 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.724170  8123 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:33.756866  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 121730us
I20260709 13:02:33.757853  1660 leader_election.cc:400] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 19. Current term is 20.
I20260709 13:02:33.756867  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:33.760118  1539 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:33.735188  8136 raft_consensus.cc:697] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:33.739580  8093 raft_consensus.cc:697] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:33.775810  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:33.776523  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:33.743409  7891 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:33.779850  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:33.780639  1660 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:33.744534  7793 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:33.762069  8091 raft_consensus.cc:697] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:33.798421  2246 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:33.806447  1511 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:33.824927  1687 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 23.
I20260709 13:02:33.847517  1694 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 23.
I20260709 13:02:33.835722  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:33.856001  1543 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:33.859649  7989 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:33.860579  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 80134.6us
I20260709 13:02:33.807838  8158 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.862128  8160 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.862651  8160 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.863950  8158 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:33.864190  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 83667.4us
W20260709 13:02:33.864878  8161 log.cc:927] Time spent T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:02:33.864928  1660 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:33.814901  7930 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:02:33.867434  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 80000us
W20260709 13:02:33.863986  8163 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:02:33.897908  1511 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:33.898888  7872 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.899459  1511 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:33.899506  7872 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.900480  8150 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:33.901013  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:33.901418  8150 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:33.902136  8150 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:33.902868  7930 raft_consensus.cc:697] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:33.903932  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:33.903820  7930 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.904994  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:33.905725  1542 raft_consensus.cc:2393] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 15: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:33.906402  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:33.864769  8160 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:33.871104  8148 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:33.857033  8091 consensus_queue.cc:237] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.883776  7631 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:33.885931  7891 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.887372  8162 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:33.887954  8093 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.888854  1543 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 19.
I20260709 13:02:33.902400  7872 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:33.892819  8151 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.893555  8136 consensus_queue.cc:237] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.894019  8167 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:33.896467  7997 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:33.866642  8149 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.876408  1688 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:02:33.875766  1587 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:33.922236  1541 raft_consensus.cc:2468] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 23.
I20260709 13:02:33.869792  8158 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:33.922736  1689 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
W20260709 13:02:33.947211  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 71530.6us
I20260709 13:02:33.925596  1539 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:33.888813  8156 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:02:33.927858  7631 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.931542  1543 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:33.933131  7891 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:33.945272  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:33.953986  1541 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:02:33.955734  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:33.956120  1511 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:33.951422  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:33.944499  1688 pending_rounds.cc:85] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 13
I20260709 13:02:33.956609  1689 raft_consensus.cc:3060] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:33.915370  7795 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:33.956981  1688 pending_rounds.cc:107] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:02:33.980612  1688 raft_consensus.cc:2889] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:33.976306  2209 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:33.989209  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:33.993664  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:33.997562  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:33.995217  1545 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:33.998778  1689 raft_consensus.cc:2468] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:02:33.992479  7795 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:33.972222  8160 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:33.999549  1587 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:33.973874  8148 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:34.002869  1544 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:02:34.004101  1543 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:34.011650  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:34.012526  1689 raft_consensus.cc:2393] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 16: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:33.936790  8162 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:33.981722  8158 raft_consensus.cc:697] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:34.009017  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:34.005597  1585 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:34.020372  1541 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 22.
I20260709 13:02:34.020187  1587 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:02:34.026003  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 98446.9us
I20260709 13:02:34.027961  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:34.028960  1689 raft_consensus.cc:2393] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 19: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:34.033514  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:34.034626  1546 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 22: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:33.952239  8167 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:34.024483  7882 raft_consensus.cc:2804] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:02:34.047933  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 71679.4us
I20260709 13:02:34.031569  8123 raft_consensus.cc:2804] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:34.040853  8168 consensus_queue.cc:1059] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:02:34.052978  8159 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:34.053534  7882 raft_consensus.cc:697] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:34.054741  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:34.036574  8091 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:34.061909  1695 raft_consensus.cc:2393] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 19: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:02:34.066731  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 46608.7us
I20260709 13:02:34.074952  1511 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:02:34.077001  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 71471.8us
I20260709 13:02:34.078830  1585 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:34.081200  1687 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:34.031576  8160 consensus_queue.cc:1059] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:02:34.091923  1695 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:02:34.095785  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 46925.9us
I20260709 13:02:34.096069  7882 consensus_queue.cc:237] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:34.096647  1511 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:34.097540  8147 raft_consensus.cc:2764] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:02:34.085093  8159 raft_consensus.cc:697] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 19 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:34.100095  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:34.079635  8123 raft_consensus.cc:697] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:34.091923  1614 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:34.100829  1622 raft_consensus.cc:2393] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 20: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:34.103112  1540 raft_consensus.cc:2468] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 23.
I20260709 13:02:34.105290  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:34.110105  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:34.111306  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:34.112347  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:34.086736  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 68196.2us
I20260709 13:02:34.113449  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:34.113529  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:34.114473  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:34.082702  8091 raft_consensus.cc:697] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:34.115183  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:34.115824  1615 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 22.
I20260709 13:02:34.117864  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:34.118435  1620 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 22: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:34.114099  2241 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:34.120321  1617 raft_consensus.cc:2393] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 16: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:34.103035  8147 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:34.129101  1614 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:34.077701  8158 consensus_queue.cc:237] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:34.139848  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 88559.3us
I20260709 13:02:34.140419  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:34.123190  8151 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:34.131182  8027 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:34.134327  8149 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:34.138582  8176 log.cc:927] Time spent T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:34.158530   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:34.136951  7930 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:34.136124  7793 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:34.160553  7795 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:02:34.165277  7793 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:34.166712  8179 log.cc:927] Time spent T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:34.171657  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:34.172396  2246 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:34.155931  7997 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.186049  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:34.173596  7930 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:34.187896  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:34.188398  2241 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:34.189630  7930 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:34.180390  8123 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:34.170816  8159 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:34.192219  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:34.193986  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:34.162732  8027 raft_consensus.cc:697] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:34.200950  1621 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:34.194873  7997 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:34.246470  2241 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:34.226240  7930 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:02:34.252363  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 154288us
W20260709 13:02:34.258956  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 103475us
I20260709 13:02:34.263398  8027 consensus_queue.cc:237] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:34.208003  8091 consensus_queue.cc:237] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:34.268998  1621 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:34.270737  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:34.278439  1660 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:34.257928  8180 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:02:34.295840  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:34.302342  1660 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:34.305656  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:34.299062  8158 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:34.308688  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:34.312438  1660 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:34.302013  8149 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:34.321599  1660 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:34.269265  7930 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:34.302729  7854 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:02:34.321779  8151 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:34.317761  7795 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:34.321358  8149 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:34.320531  8162 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:34.326020  7793 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:34.467471  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 171663us
W20260709 13:02:34.487752  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 182400us
I20260709 13:02:34.338459  8155 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:34.457826  8192 log.cc:927] Time spent T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:02:34.462255  8149 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:34.551942  1511 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:34.490542  8158 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:34.594941  7631 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:34.592552  8195 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.565718  7793 raft_consensus.cc:2764] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:02:34.598901  8166 raft_consensus.cc:2804] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:34.599699  8158 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:34.608732  7930 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:34.612298  8149 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:34.613359  7997 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:34.571003  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 259988us
I20260709 13:02:34.563740  8151 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.602576  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 111795us
I20260709 13:02:34.627779  2211 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:34.627571  8206 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:34.655939  8166 raft_consensus.cc:697] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:02:34.646309  8204 log.cc:927] Time spent T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:02:34.621088  8195 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:34.650415  7875 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:34.668690  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:34.656086  8151 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:34.675423  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:34.697811  1511 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:34.669008  7875 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:34.706058  7793 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:34.706416  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:34.706868  8196 log.cc:927] Time spent T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.484s	user 0.000s	sys 0.011s
I20260709 13:02:34.709357  8187 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:34.711162  7953 raft_consensus.cc:3055] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:34.711593  7953 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:34.712567  8194 log.cc:927] Time spent T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.489s	user 0.003s	sys 0.007s
I20260709 13:02:34.712463  7953 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:34.713805  7953 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:34.714269  8195 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:34.677786  8091 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.716233  8091 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:34.718411  8091 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:34.726202  7997 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:34.727212  7997 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:34.729588  7997 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:34.736685  1660 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:34.747216  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:34.737011  8167 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:34.739082  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.751749  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:34.753872  1587 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:34.754047  8158 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:34.754992  8158 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:34.755452  1660 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:34.755518  8158 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:34.756510  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:34.756786  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:34.757712  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:34.757907  1660 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:34.758776  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:34.756407  8158 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:34.760818  8166 consensus_queue.cc:237] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:34.759792  7930 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:34.755628  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:34.759413  8162 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:34.749620  8151 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:34.742503  8149 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:34.767458  1619 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
W20260709 13:02:34.778204  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 80445.5us
I20260709 13:02:34.762413  8186 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:34.759436  8167 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:34.780393  7997 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:34.780995  8167 raft_consensus.cc:697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:34.781948  8167 consensus_queue.cc:237] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:34.765955  7795 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:34.781011  7997 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:34.804601  1620 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 22.
I20260709 13:02:34.802627  8206 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.806617  8206 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:34.808187  7997 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:34.816648  1511 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:34.823412  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:34.824419  1691 raft_consensus.cc:2393] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 22: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:34.825363  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:34.826222  1689 raft_consensus.cc:2393] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 21: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:02:34.829569  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 62055.6us
I20260709 13:02:34.830406  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:34.832499  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:34.835615  1660 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:34.832965  7997 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:34.837970  1690 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:34.840014  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:34.842332  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 173690us
I20260709 13:02:34.839870  8222 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:34.845849  2246 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:34.847000  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:34.847302  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:34.848414  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:34.849953  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:34.851342  2243 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:34.854442  2241 raft_consensus.cc:1240] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:34.852948  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:34.855877  1622 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:34.857075  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:34.850937  7989 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.009s
W20260709 13:02:34.864670  1429 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5814bf31e900408885160ea0f89d6189 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d7158d6c3b634dc7abb69eac58eba291 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:34.867681  8189 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:02:34.871424  8193 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.650s	user 0.003s	sys 0.010s
I20260709 13:02:34.874342  8151 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:34.875056  8151 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:34.840395  8150 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:34.875375  7795 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:34.877234  7795 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:34.874439  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 68280.8us
I20260709 13:02:34.879573  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:34.880829  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:34.882277  7736 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:34.882948  7736 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:34.884455  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:34.892426  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:34.892963  2243 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:34.845094  8166 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:34.839000  7930 raft_consensus.cc:697] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:34.896158  1622 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:34.896726  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:34.901305  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:34.901912  1688 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 22.
I20260709 13:02:34.902180  2242 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:34.902395  1693 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:34.900604  1585 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:34.901351  8027 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:02:34.894064  7882 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.909669  1586 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:34.916630  8214 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:34.917472  7891 raft_consensus.cc:3055] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:34.918169  8216 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.899649  7736 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.918787  8223 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:34.919891  1688 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:34.921276  1511 leader_election.cc:400] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17.
I20260709 13:02:34.897383  8166 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.844012  7997 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:34.937609  2209 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:34.932492  7953 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:34.996745  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 44981.3us
I20260709 13:02:34.997714  2209 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:34.931798  7891 raft_consensus.cc:740] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:35.002102  8159 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:34.999949  7989 raft_consensus.cc:2764] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:02:35.001490  2209 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:34.938952  8214 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:35.008760  1693 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:34.946266  8166 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:35.018389  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 121432us
I20260709 13:02:35.019150  1688 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:02:35.020066  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:34.932246  7882 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:35.026530  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:35.020789  1689 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:34.936611  8086 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:02:35.022087  1542 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:02:35.029224  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 108100us
I20260709 13:02:34.935385  8027 consensus_queue.cc:1059] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 13:02:35.035372  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:35.014024  7872 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:35.031059  1545 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:35.013553  8150 raft_consensus.cc:697] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:34.942000  8216 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:35.047039  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:34.942351  7736 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:35.030499  1539 raft_consensus.cc:1275] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:35.029702  8223 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.041055  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:35.057185  1541 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 11.
I20260709 13:02:35.042829  1542 raft_consensus.cc:2393] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 22: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:35.025368  1587 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:35.047910  1538 raft_consensus.cc:2368] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 21. Current term is 22.
I20260709 13:02:35.059708  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:35.048097  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:35.048656  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:35.050186  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:35.061116  1546 raft_consensus.cc:3060] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:02:35.062142  1539 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:35.023334  8093 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:02:35.052217  8228 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:35.053850  7997 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:35.004686  7828 consensus_queue.cc:1059] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:02:35.056383  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:35.033056  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:35.065778  1542 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:35.070622  1543 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 22.
I20260709 13:02:35.066484  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:35.071502  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:35.072013  1541 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 11.
I20260709 13:02:35.073240  1511 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:35.073544  1543 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:35.071465  1689 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 22.
I20260709 13:02:35.067121  1545 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:35.067728  1539 raft_consensus.cc:1275] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:02:35.036826  8170 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 13:02:35.063903  8197 log.cc:927] Time spent T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.826s	user 0.008s	sys 0.024s
I20260709 13:02:35.075069  1585 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:35.064337  8168 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:35.081243  1585 leader_election.cc:400] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 21. Current term is 22.
I20260709 13:02:35.081671  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:35.083127  8214 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:35.084468  8216 leader_election.cc:290] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:35.085162  8150 consensus_queue.cc:237] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:35.087599  8199 log.cc:927] Time spent T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.865s	user 0.003s	sys 0.014s
I20260709 13:02:35.089663  8019 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:35.107383  1544 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:35.102349  8184 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:02:35.108511  1585 leader_election.cc:403] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:35.108786  1540 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:35.066581  8158 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:35.041988  7930 consensus_queue.cc:237] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:35.103392  8027 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:35.103720  8168 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.080019  7631 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:02:35.109745  8086 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:35.149610  1546 raft_consensus.cc:2468] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
W20260709 13:02:35.153450  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 104138us
I20260709 13:02:35.077561  8228 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:35.125825  8091 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:02:35.125274  8027 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.157902  1511 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:35.140758  8168 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:35.176105  1543 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:35.178138  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:35.112900  8223 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:35.135720  8123 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:02:35.197022  8226 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:35.197749  8226 raft_consensus.cc:697] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:35.201308  8158 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:35.205758  8184 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.206351  8184 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:35.208017  8228 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:35.208105  8151 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:35.210258  7736 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:35.210866  7736 raft_consensus.cc:2764] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:02:35.211293  7882 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:35.211784  7882 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:35.198762  8226 consensus_queue.cc:237] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:35.212234  7882 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:35.213344  8184 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:35.213760  8151 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.214159  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:35.215094  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:35.215550  1660 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:35.216881  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:35.191308  8223 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:35.169955  8027 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.154996  8086 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:35.185089  8206 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:35.219195  1614 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:35.218935  1660 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:35.214228  7882 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:35.251983  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:35.256683  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 175047us
I20260709 13:02:35.235577  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:35.237795  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:35.248765  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:35.250447  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:35.232995  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:35.236891  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:02:35.232112  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 108951us
I20260709 13:02:35.233333  1659 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:35.269297  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 188192us
W20260709 13:02:35.292500  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 73641.2us
I20260709 13:02:35.349586  1620 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:35.231877  8228 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:35.214322  8151 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:35.292873  1687 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 20.
W20260709 13:02:35.377806  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 144538us
I20260709 13:02:35.378700  1659 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:35.221609  8158 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:35.376313  1619 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:35.384574  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:35.380573  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:35.391085  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:35.415295  1693 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 20.
I20260709 13:02:35.220173  8170 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.163s
I20260709 13:02:35.222734  8155 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.161s
I20260709 13:02:35.351647  8227 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:35.391618  8228 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:35.457787  1620 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 23.
I20260709 13:02:35.465667  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:35.465816  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:35.467378  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:35.357610  8223 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:02:35.423957  8227 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:35.502368  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:35.503283  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:35.513175  1540 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:35.509963  1512 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:35.463721  8218 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:35.419049  7989 consensus_queue.cc:1048] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:02:35.524834  7891 consensus_queue.cc:260] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:35.459403  8214 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:02:35.482730  7736 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:02:35.560168  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 181477us
I20260709 13:02:35.566004  7891 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:35.570554  2241 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:35.481506  7854 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:02:35.510025  7631 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.576735  7631 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:35.514549  8227 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:35.581869  8237 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:35.582458  8166 consensus_meta.cc:287] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.000s
I20260709 13:02:35.584211  8151 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:35.585633  7793 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:35.586308  7793 raft_consensus.cc:697] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 22 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:35.586443  8091 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 21. Current term is 22.
I20260709 13:02:35.594472  1544 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:35.521668  8247 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:35.601248  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 91399.7us
I20260709 13:02:35.555730  8068 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.610903  1691 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:35.582934  8166 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:35.645081  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:35.587741  8264 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:35.659942  1696 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:02:35.605430  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 221068us
I20260709 13:02:35.708285  1695 raft_consensus.cc:2393] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:02:35.711583  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 112490us
I20260709 13:02:35.595388  7736 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:35.714900  1659 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:35.658591  7631 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:35.582458  8237 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:35.726105  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:35.718758  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 332014us
I20260709 13:02:35.726771  1544 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:02:35.732905  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:35.735935  1511 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:35.740572  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:35.741266  1546 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:35.745199  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:35.770344  1541 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 20.
I20260709 13:02:35.717677  8158 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 22 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:35.791911  1696 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:35.635502  8068 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:35.731798  8086 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:35.609913  8247 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:35.729671  1587 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:02:35.800086  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 447629us
I20260709 13:02:35.657511  7793 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:35.729622  1659 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:35.859293  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:35.860760  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:35.742816  8223 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
W20260709 13:02:35.873126  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 143534us
I20260709 13:02:35.874207  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:35.700274  8264 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:35.863036  1622 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:02:35.732108  8186 consensus_queue.cc:1048] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.109s
I20260709 13:02:35.893450  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:35.878489  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:35.896595  1621 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 22.
I20260709 13:02:35.880005  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:35.884809  1620 raft_consensus.cc:2393] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 20: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:35.880395  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:35.891279  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:35.898243  1613 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
I20260709 13:02:35.886279  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
W20260709 13:02:35.903812  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 174220us
I20260709 13:02:35.904321  1618 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 16: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:35.898519  1691 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:02:35.905356  1660 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:35.867199  8151 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:35.912896  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:35.872701  8086 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:35.912299  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:35.878973  8184 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:35.930433  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:35.864979  8226 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:02:35.939199  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:35.918347  8162 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:35.972721  1614 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:02:35.938123  8245 log.cc:927] Time spent T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:02:35.975777  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 61813.2us
W20260709 13:02:35.929672  8168 consensus_meta.cc:287] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.729s	user 0.010s	sys 0.003s
I20260709 13:02:35.921288  8091 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:02:35.939464  8184 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:35.908660  8093 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:35.908385  8222 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:02:35.980405  8266 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:35.982527  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:35.999126  8266 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:02:35.998771  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 193681us
I20260709 13:02:36.000727  8266 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:35.992765  8158 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:35.995529  8228 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:36.004083  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:36.004169  8228 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:36.005553  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:36.005595  8228 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:35.980222  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:36.026794  1429 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5814bf31e900408885160ea0f89d6189 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d7158d6c3b634dc7abb69eac58eba291 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:35.938285  8086 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:36.063653  8243 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
I20260709 13:02:36.028918  1614 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:35.962505  8151 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:36.025535  8217 log.cc:927] Time spent T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:35.971362  8240 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.058s
I20260709 13:02:35.993237  8184 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:36.031404  1543 raft_consensus.cc:1240] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:02:35.998057  8168 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.095670  1621 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 22.
I20260709 13:02:36.042320  8166 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:36.008535  8162 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:02:36.070189  7891 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:35.980440  8248 consensus_queue.cc:1059] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.379s
I20260709 13:02:36.026527  8093 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.108223  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 1188) took 1206 ms. Trace:
I20260709 13:02:36.112540  8271 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:36.115681  8271 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:36.113991  1692 rpcz_store.cc:276] 0709 13:02:34.897001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.897693 (+   692us) service_pool.cc:224] Handling call
0709 13:02:34.897978 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.936122 (+ 38144us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:35.031221 (+ 95099us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.462076 (+430855us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:35.462633 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.462818 (+   185us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:35.462881 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.462973 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.103325 (+640352us) raft_consensus.cc:1685] finished
0709 13:02:36.103355 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.103524 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40861,"prepare.queue_time_us":149608,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":92500,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":23122,"thread_start_us":432705,"threads_started":4,"wal-append.queue_time_us":372131}
I20260709 13:02:36.116432  8262 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:36.093902  8253 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:36.113732  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 201509us
I20260709 13:02:36.120129  2211 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:36.121572  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:36.070281  8274 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:02:36.112746  7891 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.123876  7830 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:36.125816  8249 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:02:36.159085  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 2246) took 1131 ms. Trace:
I20260709 13:02:36.160142  8264 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:36.160450  8168 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:36.156889  7830 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:36.161633  7830 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:36.159602  1538 rpcz_store.cc:276] 0709 13:02:35.028022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.070697 (+ 42675us) service_pool.cc:224] Handling call
0709 13:02:35.080424 (+  9727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.249088 (+168664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.249124 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:35.345765 (+ 96641us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.459653 (+113888us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:35.459690 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.459766 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.158731 (+698965us) raft_consensus.cc:1685] finished
0709 13:02:36.158761 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.158978 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29797,"raft.queue_time_us":44006,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4797,"thread_start_us":251752,"threads_started":2,"wal-append.queue_time_us":399333}
I20260709 13:02:36.162009  8271 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.163131  8271 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:36.164458  1542 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.167735  8093 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:36.172277  8215 raft_consensus.cc:3055] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:36.172640  8253 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:36.172781  8215 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:36.173693  8215 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.174678  8215 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:36.128638  8261 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:36.130141  8151 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:36.130683  8247 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:36.131875  8270 log.cc:927] Time spent T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:02:36.139792  8027 consensus_meta.cc:287] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.850s	user 0.009s	sys 0.003s
I20260709 13:02:36.191125  8027 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.193199  8027 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:36.177002  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 55711.9us
I20260709 13:02:36.119751  8237 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:36.174896  7891 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:36.187635  7795 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:36.191468  1695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 2558) took 1338 ms (client timeout 1738 ms). Trace:
W20260709 13:02:36.195180  1695 rpcz_store.cc:269] 0709 13:02:34.852598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.852732 (+   134us) service_pool.cc:224] Handling call
0709 13:02:36.191254 (+1338522us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b5400386154. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:36.191383 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1952568192}
I20260709 13:02:36.196794  1695 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:02:36.143625  8068 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:36.198530  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:36.181142  1542 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:36.100730  8228 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:36.220082  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 484125us
I20260709 13:02:36.230063  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:36.230893  1619 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 15.
I20260709 13:02:36.238022  1621 raft_consensus.cc:1240] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:36.244978  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 46531.9us
I20260709 13:02:36.246515  1660 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:36.249975  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 2572) took 1011 ms. Trace:
I20260709 13:02:36.250407  1687 rpcz_store.cc:276] 0709 13:02:35.238458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.384646 (+146188us) service_pool.cc:224] Handling call
0709 13:02:35.384946 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.545499 (+160553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.545552 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:35.604434 (+ 58882us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.878737 (+274303us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:35.878780 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.878839 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.249745 (+370906us) raft_consensus.cc:1685] finished
0709 13:02:36.249764 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.249918 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58059,"raft.queue_time_us":80070,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":18358,"thread_start_us":279518,"threads_started":2,"wal-append.queue_time_us":277828}
I20260709 13:02:36.253511  1511 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:36.251332  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 99285us
I20260709 13:02:36.248317  8265 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.264474  8279 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:36.265326  8256 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:36.265753  8256 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:36.264703  8265 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:36.266122  8256 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:36.267120  8264 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.267895  8265 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:36.271076  8187 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:36.271698  8187 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.273756  8187 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:36.261375  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:36.267665  8264 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.280648  1660 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:36.287475  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:36.284353  8279 raft_consensus.cc:697] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 23 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:36.289110  8240 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:36.289387  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:36.289551  8086 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:36.295676  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:36.311630  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:36.316164  1511 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:36.317595  1511 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:36.253168  7795 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:02:36.323848  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:36.328264  8229 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:36.328774  8229 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:36.329205  8229 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:36.328500  8279 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.340297  8229 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:36.340770  8227 consensus_meta.cc:287] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.761s	user 0.012s	sys 0.000s
I20260709 13:02:36.326891  8262 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:36.343004  8229 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:36.343387  7830 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.312608  8158 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:36.322803  8068 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:36.347818  8091 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:36.348495  8091 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.349779  8226 raft_consensus.cc:3055] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:36.350267  8226 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:36.351501  8091 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:36.358345  8252 log.cc:927] Time spent T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.560s	user 0.003s	sys 0.000s
I20260709 13:02:36.364777  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45660 (request call id 2570) took 1126 ms. Trace:
I20260709 13:02:36.365300  1693 rpcz_store.cc:276] 0709 13:02:35.237980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.384084 (+146104us) service_pool.cc:224] Handling call
0709 13:02:36.364618 (+980534us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b54001b6f54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:36.364708 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53615488}
I20260709 13:02:36.366384  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:36.367494  7830 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:36.380829  8264 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:36.381196  8273 log.cc:927] Time spent T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
W20260709 13:02:36.382632  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 63809.9us
I20260709 13:02:36.383407  8240 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:36.384603  8266 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.385825  1511 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:36.386837  8266 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:36.386993  8264 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:36.388900  1511 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:36.390621  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:36.392025  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:36.393589  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:36.394222  1613 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:36.364795  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 2242) took 1338 ms. Trace:
I20260709 13:02:36.395525  1622 raft_consensus.cc:2393] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 12: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:36.394909  1545 rpcz_store.cc:276] 0709 13:02:35.026792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.063390 (+ 36598us) service_pool.cc:224] Handling call
0709 13:02:35.063663 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.075329 (+ 11666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.364571 (+1289242us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b540011fb54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:36.364746 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7116160}
I20260709 13:02:36.341388  8227 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.391407  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:36.389652  8068 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:36.320474  8281 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:02:36.406908  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.412743  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 2566) took 1195 ms. Trace:
I20260709 13:02:36.407835  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:36.417121  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:36.395576  8170 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.418543  2243 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:36.412029  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:36.422700  1619 raft_consensus.cc:1275] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:02:36.426046  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.415611  1688 rpcz_store.cc:276] 0709 13:02:35.217160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.217308 (+   148us) service_pool.cc:224] Handling call
0709 13:02:35.236121 (+ 18813us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.236485 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.236514 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:35.352126 (+115612us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.463666 (+111540us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:35.463728 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.463800 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.357471 (+893671us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:36.405833 (+ 48362us) raft_consensus.cc:1685] finished
0709 13:02:36.405888 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.412654 (+  6766us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":41719,"spinlock_wait_cycles":57347712,"thread_start_us":72789,"threads_started":1,"wal-append.queue_time_us":322562}
I20260709 13:02:36.406899  8068 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.427100  2210 leader_election.cc:304] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:36.428601  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:36.429565  1587 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:36.427848  8187 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:36.432351  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:36.432675  8187 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.426564  8170 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.436527  7736 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:36.438441  8170 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:36.411929  7891 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:36.439384  7891 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.442406  7891 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:36.443256  8068 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.404567  8264 consensus_queue.cc:1059] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:02:36.445956  8264 raft_consensus.cc:3055] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:36.446290  8264 raft_consensus.cc:740] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:36.397034  8226 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.453586  8226 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:36.454614  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1053) took 1434 ms. Trace:
W20260709 13:02:36.454895  8240 consensus_queue.cc:1175] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" responder_term: 23 status { last_received { term: 20 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 22. Current term is 23. Ops: [22.13-22.13]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:36.457638  8227 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:36.414862  8091 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.459465  8091 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.461687  8091 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:36.480115  7875 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:36.455003  1547 rpcz_store.cc:276] 0709 13:02:35.020434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.020594 (+   160us) service_pool.cc:224] Handling call
0709 13:02:35.039443 (+ 18849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.039652 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:35.148345 (+108693us) log.cc:844] Serialized 14 byte log entry
0709 13:02:36.453824 (+1305479us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b18002da960. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc4912d34bc 00007fc48e62148b 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63b455 00007fc491723060 00007fc491735716 00007fc491746287
0709 13:02:36.454126 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 13:02:36.454298 (+   172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:36.454345 (+    47us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:36.454386 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.454451 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.454562 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":182808,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":80,"raft.queue_time_us":189549,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":32126,"spinlock_wait_cycles":3600000,"thread_start_us":499060,"threads_started":3,"wal-append.queue_time_us":281532}
I20260709 13:02:36.485231  1613 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 21.
I20260709 13:02:36.485378  8256 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.488379  1616 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:36.489502  1511 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:36.435050  8187 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:36.497396  8244 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.624s	user 0.000s	sys 0.001s
I20260709 13:02:36.499404  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 1189) took 1601 ms. Trace:
I20260709 13:02:36.499773  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:36.500523  1620 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 22.
I20260709 13:02:36.499800  1694 rpcz_store.cc:276] 0709 13:02:34.897916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.898019 (+   103us) service_pool.cc:224] Handling call
0709 13:02:34.901507 (+  3488us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:35.014609 (+113102us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.014635 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:35.019404 (+  4769us) log.cc:844] Serialized 52 byte log entry
0709 13:02:35.389493 (+370089us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:35.469628 (+ 80135us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.469914 (+   286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.470017 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.496829 (+1026812us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:36.499057 (+  2228us) raft_consensus.cc:1685] finished
0709 13:02:36.499168 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.499344 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6729,"prepare.queue_time_us":68914,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":8326,"raft.queue_time_us":70015,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":130,"spinlock_wait_cycles":38416128,"thread_start_us":432452,"threads_started":2,"wal-append.queue_time_us":689415}
I20260709 13:02:36.491267  8195 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:36.512945  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:36.508455  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:36.501595  8240 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:36.522737  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:36.532022  8269 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:36.532832  8269 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.536643  8269 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:36.527081  8195 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:36.544198  1585 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:36.544310  8195 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.545042  8091 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:36.545467  8091 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:36.545840  8091 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:36.519553  8281 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:36.548729  8281 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:36.549242  8281 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:36.490353  8264 consensus_queue.cc:260] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.552246  1585 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:36.507843  7891 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:02:36.582261  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:36.529654  8256 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:36.558734  8195 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:36.559115  8269 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:36.551994  8240 raft_consensus.cc:697] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 21 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:36.575819  8247 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:36.583304  7736 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:36.583220  8229 raft_consensus.cc:493] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:36.585971  7793 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:36.587083  8264 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:36.585446  8248 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:36.586856  8262 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:36.581765  8068 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.660132  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:36.655611  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 264240us
I20260709 13:02:36.651868  2241 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:36.693323  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:36.693343  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:36.677405  1622 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:36.705195  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:36.706591  1660 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:36.704470  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:36.642755  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.720964  1622 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:36.776810  1696 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:36.774050  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 73704.4us
I20260709 13:02:36.749461  2210 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:36.753243  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 167622us
W20260709 13:02:36.647959  8297 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:02:36.670267  8236 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:36.786958  8236 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.787439  8256 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:36.787986  8256 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.661953  8229 raft_consensus.cc:515] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.789408  8236 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:36.774231  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 67716.8us
I20260709 13:02:36.789930  8256 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:36.790382  8229 leader_election.cc:290] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:36.780455  8151 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:36.784264  1587 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:36.791266  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:36.643009  8263 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:36.656050  8149 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:02:36.683414  8184 consensus_meta.cc:287] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.576s	user 0.002s	sys 0.008s
I20260709 13:02:36.648742  7795 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:36.648656  7997 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:36.664417  7736 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.796273  8257 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:36.783553  8218 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:36.670159  8223 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:36.653950  8298 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:36.648113  8250 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:36.672676  8068 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:36.655021  8265 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:36.650566  8295 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:02:36.804946  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 55622.8us
W20260709 13:02:36.859983  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 75796us
I20260709 13:02:36.647625  8275 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.670356  8167 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 13:02:36.830735  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:36.831045  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:36.663944  8091 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.818459  8253 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:36.682092  8240 consensus_queue.cc:237] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.682261  8262 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.845170  8263 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:36.666448  8248 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.806756  8229 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:36.806949  8256 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:02:36.853888  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.806557  8184 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.658270  8247 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.856874  7736 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:36.851330  8250 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.800783  8149 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.818675  7795 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.893141  7631 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:36.831406  8223 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.912173  7631 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:36.911917  8229 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.912602  7631 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:36.913357  7795 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:36.828624  7997 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.913961  8229 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:36.914600  8263 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:36.868014  8187 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:36.915282  7997 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:36.858685  1692 raft_consensus.cc:1240] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:36.875355  8295 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.915560  8187 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.866832  1696 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
I20260709 13:02:36.916293  8247 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:36.917092  8149 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:36.916873  8256 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.665413  7793 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:36.858989  8254 log.cc:927] Time spent T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 1.019s	user 0.003s	sys 0.000s
I20260709 13:02:36.808759  1660 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:36.928476  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 119820us
I20260709 13:02:36.931281  1692 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:36.807439  8191 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:36.887354  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:36.793071  8269 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.841296  1695 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:36.831704  8086 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.913535  8223 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:36.919282  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:36.917397  8295 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:36.906486  8195 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:02:36.908463  8307 log.cc:927] Time spent T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:02:36.936836  7997 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:36.951182  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 122982us
W20260709 13:02:36.905512  8304 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:02:36.942049  1687 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 23 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:36.801069  8151 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.917507  8187 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:36.927186  1691 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:02:36.871095  8265 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.954568  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:36.900651  8091 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:36.982438  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:36.990500  1695 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:36.983363  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:36.986480  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:36.984249  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:36.891713  8275 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:36.940109  7736 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.990929  2242 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 14.
I20260709 13:02:36.999907  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:36.976739  8216 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.019452  1696 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 22.
I20260709 13:02:37.025309  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:37.019510  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 183447us
I20260709 13:02:36.937881  7795 consensus_queue.cc:1048] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:02:37.034319  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:37.034926  1541 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:02:37.021278  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 66807.7us
I20260709 13:02:37.018494  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 2565) took 1801 ms. Trace:
I20260709 13:02:37.035532  1690 rpcz_store.cc:276] 0709 13:02:35.216865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.216987 (+   122us) service_pool.cc:224] Handling call
0709 13:02:35.236121 (+ 19134us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.250890 (+ 14769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.250922 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:35.353383 (+102461us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.463283 (+109900us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:35.463337 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.463422 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.857933 (+1394511us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:36.993382 (+135449us) raft_consensus.cc:1685] finished
0709 13:02:36.993402 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.018437 (+ 25035us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":317,"raft.queue_time_us":41827,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":2119,"spinlock_wait_cycles":55806848,"thread_start_us":72659,"threads_started":1,"wal-append.queue_time_us":327933}
I20260709 13:02:37.024616  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:37.037540  1691 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:02:37.038434  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:37.038995  1620 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:37.029435  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:37.042404  8168 raft_consensus.cc:493] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:37.043299  1613 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:02:37.043093  8168 raft_consensus.cc:515] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:37.043603  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:37.044749  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:37.030834  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:37.054795  1541 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 23.
I20260709 13:02:37.059993  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:37.057020  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:37.057329  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:37.060866  1545 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:37.058493  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:37.059320  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:37.059528  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:37.055729  1620 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:37.065557  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:37.066884  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:37.067792  1543 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:37.069458  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:37.070266  1543 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:37.068941  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:36.942505  8281 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:37.066471  1545 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
W20260709 13:02:37.078855  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.079635  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:36.951328  8253 consensus_queue.cc:1059] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:02:37.045763  8168 leader_election.cc:290] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:37.017776  8184 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:36.985195  8223 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:02:36.999871  8248 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:36.946436  8086 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:37.090384  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:37.090581  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:37.018791  8269 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:36.984767  8278 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.091s
I20260709 13:02:37.018605  8262 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:37.108212  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:37.162829  1695 raft_consensus.cc:2393] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 22: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:37.112141  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:37.113430  1687 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:37.088335  8091 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:37.131083  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:37.132815  8269 consensus_queue.cc:1059] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:37.134513  1542 raft_consensus.cc:1275] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:37.135850  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 1199) took 1265 ms. Trace:
W20260709 13:02:37.136199  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 45691.7us
I20260709 13:02:37.136382  8315 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:02:37.137233  8309 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:37.137398  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:37.178325  1613 raft_consensus.cc:2410] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:02:37.138093  8267 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:37.140025  8275 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:37.141718  8151 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:37.143049  8303 log.cc:927] Time spent T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:37.016947  7736 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:36.991621  8195 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:37.149045  8281 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:37.151597  7795 raft_consensus.cc:3055] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:37.152441  1619 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:37.153180  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:37.206238  1538 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:37.153630  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:37.153925  1545 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 22.
I20260709 13:02:37.131181  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:37.174644  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:37.181391  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 150611us
I20260709 13:02:37.175624  1689 rpcz_store.cc:276] 0709 13:02:35.870280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.194713 (+324433us) service_pool.cc:224] Handling call
0709 13:02:36.195028 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.222926 (+ 27898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.222961 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:36.223405 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:02:36.643872 (+420467us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b1800025ba0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb0d1 00007fc4916e6a0f
0709 13:02:36.785368 (+141496us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:36.785406 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.785468 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.904951 (+119483us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:37.135583 (+230632us) raft_consensus.cc:1685] finished
0709 13:02:37.135604 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.135776 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31756,"raft.queue_time_us":46523,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":8215,"spinlock_wait_cycles":35163776,"thread_start_us":141336,"threads_started":1,"wal-append.queue_time_us":603865}
W20260709 13:02:37.208984  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.188483  8250 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:37.211278  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:37.188696  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817bc4013144ede80163d16316d4860" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:37.189391  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:37.189968  2211 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:37.191030  1687 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:02:37.183645  1615 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:37.194244  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:37.199734  1544 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:02:37.195760  2242 raft_consensus.cc:3060] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 21 LEARNER]: Advancing to term 23
I20260709 13:02:37.067914  8216 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:37.205864  7795 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:37.219894  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:37.220088  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:37.221524  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:37.221645  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:37.222986  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:37.088589  8247 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.096s
I20260709 13:02:37.151021  7631 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:37.233700  1542 raft_consensus.cc:1240] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:37.243956  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:37.244804  2211 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:37.245039  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:37.266834  1616 raft_consensus.cc:1240] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:02:37.266060  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:37.196997  8262 raft_consensus.cc:3055] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:37.271951  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:37.266191  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f88fe569c2476cb298d5e6b745bb5c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:37.199514  8266 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:37.227941  8249 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:02:37.295058  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:37.229283  7854 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:37.394037  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:37.427798  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:37.428344  8312 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 13:02:37.428270  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:37.429015  2237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:37.394557  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:37.395038  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:37.431193  2245 raft_consensus.cc:2393] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 16: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:37.432713  7854 raft_consensus.cc:697] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:37.181927  8091 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:37.434060  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:37.433810  7854 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:37.435124  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:37.435341  8091 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:37.436430  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:37.417850  8264 consensus_meta.cc:287] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.752s	user 0.011s	sys 0.000s
W20260709 13:02:37.404438  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.293553  7989 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:37.479326  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:37.480666  2245 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:37.297659  1688 raft_consensus.cc:2393] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 12: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:37.220292  7795 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:37.273610  8262 raft_consensus.cc:740] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:37.294497  8266 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:37.397935  1538 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:37.476246  1539 raft_consensus.cc:2410] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:37.492295  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:37.492899  1541 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:02:37.421726  8283 log.cc:927] Time spent T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:02:37.476719  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:37.418102  8256 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:37.492388  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:37.493032  1695 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 22.
I20260709 13:02:37.503095  7795 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:37.488627  7793 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:37.505362  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:37.505973  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:37.487879  7989 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:37.530344  7989 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:37.496618  8266 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:37.536655  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:37.490000  8281 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:37.527582  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:37.527966  7631 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:37.528959  8263 consensus_meta.cc:287] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.000s
I20260709 13:02:37.526016  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:37.537775  2211 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:37.526978  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:37.535471  1659 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:37.544159  1586 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:37.550107  1538 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:37.553333  1538 raft_consensus.cc:1240] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 21 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:37.550313  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:37.561513  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:37.562945  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:37.559067  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 281420us
I20260709 13:02:37.568706  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:37.533656  8216 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:37.533521  7997 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:37.573856  1659 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:37.577163  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:37.556849  8151 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:02:37.580874  8328 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:02:37.580675  8151 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:37.572937  7828 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:37.546150  8275 consensus_queue.cc:1048] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:02:37.574685  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:37.582188  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:37.690295  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:37.571019  7736 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:37.557387  8281 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:37.585785  8216 consensus_queue.cc:1059] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.175s
I20260709 13:02:37.758131  1547 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
W20260709 13:02:37.751961  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 178143us
I20260709 13:02:37.767692  1659 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:37.763708  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:37.765007  1687 raft_consensus.cc:2393] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 22: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:37.570043  8318 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:37.673292  2242 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 23 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:02:37.776252  1512 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:37.780681  1659 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:37.756166  8086 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:37.590902  8149 consensus_meta.cc:287] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.673s	user 0.008s	sys 0.000s
I20260709 13:02:37.799819  1512 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:37.576674  7631 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:37.801599  1542 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:02:37.804689  1512 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:37.805543  8269 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:37.549407  8263 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:37.682778  8256 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:37.584754  8195 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:37.806463  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 234627us
I20260709 13:02:37.584224  8227 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:37.759490  8281 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:37.765542  7828 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:37.811364  1659 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:37.793308  8218 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:37.777045  8318 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:37.815956  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:37.802153  8167 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:37.813052  8271 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:37.802479  7736 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:37.790385  8275 consensus_queue.cc:1059] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:02:37.534432   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:37.587369  7997 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:37.834671  1659 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:37.845839  1695 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 22.
I20260709 13:02:37.847226  1617 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:37.821448  1512 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:37.848512  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:37.856422  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:37.857524  8269 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:37.861076  8269 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:37.862344  8151 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:37.584630  8262 consensus_queue.cc:260] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:37.871750  8218 raft_consensus.cc:3055] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:37.872258  8262 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:37.875437  8167 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:37.810935  7631 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:37.876062  8227 consensus_queue.cc:1059] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:37.825624  8256 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:37.807639  8149 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:37.833904  7989 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:37.879367  8250 consensus_queue.cc:1175] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "822e08445eae4a33b2f2fe92060192c6" responder_term: 17 status { last_received { term: 14 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17. Ops: [16.14-16.14]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:37.841363  8158 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:37.847878  8318 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:37.881078  1695 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:02:37.882323  8275 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:02:37.889534  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 68150us
I20260709 13:02:37.913508  1695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34244
W20260709 13:02:37.871162  8332 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:02:37.915550  8275 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:37.889091  8226 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:37.893966  7736 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:37.895663  1511 leader_election.cc:304] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:37.899292  8281 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:37.926975  8281 raft_consensus.cc:2749] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:37.927430  1585 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:37.928031  8226 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:37.905732  8167 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:37.825999  8264 consensus_queue.cc:1059] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:02:37.931159  8167 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:37.931934  8264 raft_consensus.cc:3055] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:37.932725  8264 raft_consensus.cc:740] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:37.933403  8167 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:37.933924  8167 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:37.933777  8264 consensus_queue.cc:260] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:37.938140  8257 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:37.938658  8257 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:37.940809  7989 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:37.899374  8305 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:37.909240  7631 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:37.963376  8317 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:37.965230  8317 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:37.949520  1585 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:37.891649  8218 raft_consensus.cc:740] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:37.835538  7828 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:37.918185  1694 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 20. Current term is 21. Ops: []
W20260709 13:02:37.894937  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 328612us
I20260709 13:02:37.809145  8240 consensus_queue.cc:1059] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:02:37.970728  1585 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:37.923849  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:37.972683  1543 raft_consensus.cc:2410] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:02:37.925052  1511 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:37.973434  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 48450us
I20260709 13:02:37.976931  1511 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:37.956926  8266 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:37.966207  8317 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:37.832746  7795 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:37.921710  8275 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:37.992126  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:37.991932  1585 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:38.005685  1543 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:37.967444  8269 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:38.013852  1688 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:38.011175  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:37.979333  7793 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:38.017429  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:37.994432  8086 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:38.019582  1543 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 18: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:37.994527  8264 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:38.002399  8093 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:38.020507  8240 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:38.024983  8086 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:38.009007  7795 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:38.028409  8263 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.069460  8093 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.012642  8257 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.115000  8093 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:38.115433  8257 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:38.119781  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 3360) took 1005 ms. Trace:
I20260709 13:02:38.120175  1546 rpcz_store.cc:276] 0709 13:02:37.114140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.267052 (+152912us) service_pool.cc:224] Handling call
0709 13:02:37.267366 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.267681 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.267707 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.293957 (+ 26250us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.813371 (+519414us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:37.813421 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.813494 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.119496 (+306002us) raft_consensus.cc:1685] finished
0709 13:02:38.119515 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.119707 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":620,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":126370,"thread_start_us":404889,"threads_started":1,"wal-append.queue_time_us":622000}
I20260709 13:02:38.121968  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:38.123481  8338 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:02:38.108901  7997 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:38.123001  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:38.082844  8086 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:38.016598  8218 consensus_queue.cc:260] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.147910  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:38.148469  1540 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:38.149217  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:38.149783  1687 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
W20260709 13:02:38.162263  8340 log.cc:927] Time spent T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:02:38.167448  8173 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:38.178611  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 2272) took 1088 ms. Trace:
I20260709 13:02:38.179211  1544 rpcz_store.cc:276] 0709 13:02:37.090655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.090801 (+   146us) service_pool.cc:224] Handling call
0709 13:02:37.091119 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.213511 (+122392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.178308 (+964797us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400193554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:38.178534 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235451136}
I20260709 13:02:38.181896  1690 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:02:38.183451  2209 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:38.192041  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 272655us
I20260709 13:02:38.160408  8240 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:38.157991  8218 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:38.203946  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:38.204537  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.191716  8211 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.192332  8250 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.197641  8240 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:38.222724  8240 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:38.222461  8158 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:38.197849  8349 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:38.233799  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:38.240299  8347 log.cc:927] Time spent T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:02:38.242061  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:38.243336  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:38.244477  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:38.252998  2242 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:38.247198  8093 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.220587  8250 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.258826  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:38.256750  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 250491us
I20260709 13:02:38.258369  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:38.285408  1585 leader_election.cc:304] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:38.219952  8211 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:38.263990  7795 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:38.301538  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 324629us
I20260709 13:02:38.306455  1511 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:38.307219  8240 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:38.307740  8240 raft_consensus.cc:697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:38.308636  8240 consensus_queue.cc:237] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.333181  1545 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
W20260709 13:02:38.334983  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 135635us
W20260709 13:02:38.341737  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 53105.1us
I20260709 13:02:38.342782  2209 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:38.337163  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:38.325984  8357 raft_consensus.cc:2749] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:38.350728  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:38.353112  2242 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:38.353614  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:38.342993  1585 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:38.355531  1585 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:38.360836  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:38.359911  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:38.366851  8093 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.367931  8370 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:38.357228  8356 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:38.377488  8357 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:38.377898  8357 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.378208  8357 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:38.353848  7793 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:38.392669  1585 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:02:38.397881  8322 log.cc:927] Time spent T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.981s	user 0.003s	sys 0.000s
I20260709 13:02:38.399979  8189 raft_consensus.cc:3055] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:38.402591  8189 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:38.403525  8250 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.403782  8189 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:38.405138  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:38.405220  8189 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:38.405799  1689 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:02:38.409003  2243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 1319) took 1411 ms. Trace:
I20260709 13:02:38.414047  8266 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:38.415431  8211 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:38.416445  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.409544  2243 rpcz_store.cc:276] 0709 13:02:36.997316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.002196 (+  4880us) service_pool.cc:224] Handling call
0709 13:02:37.002464 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.002784 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.002814 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.003282 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.087359 (+ 84077us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:37.087399 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.087472 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.397173 (+1309701us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:38.408603 (+ 11430us) raft_consensus.cc:1685] finished
0709 13:02:38.408635 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.408901 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1297,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":9893632,"thread_start_us":79544,"threads_started":1,"wal-append.queue_time_us":243942}
I20260709 13:02:38.385695  7793 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:38.419492  8370 raft_consensus.cc:697] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:38.426967  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 71492.3us
I20260709 13:02:38.428802  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:38.443698  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:38.444382  2243 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:38.426036  8369 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:38.389241  8318 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:38.426195  7793 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:38.459275  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:38.459553  2245 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:38.445675  8369 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.464078  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 3445) took 1765 ms. Trace:
W20260709 13:02:38.467298  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 88360.2us
I20260709 13:02:38.464566  1618 rpcz_store.cc:276] 0709 13:02:36.693469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.694677 (+  1208us) service_pool.cc:224] Handling call
0709 13:02:36.785147 (+ 90470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.785346 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:36.946409 (+161063us) log.cc:844] Serialized 14 byte log entry
0709 13:02:38.442664 (+1496255us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b18001bda20. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc4912d34bc 00007fc48e62148b 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb23a
0709 13:02:38.458780 (+ 16116us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:38.458835 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:38.458883 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.458945 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.459044 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15890,"prepare.queue_time_us":227363,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2087,"spinlock_wait_cycles":11452800,"thread_start_us":252744,"threads_started":2,"wal-append.queue_time_us":562329}
I20260709 13:02:38.471637  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:38.473711  8266 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.474262  8266 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.475318  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45652 (request call id 3060) took 1539 ms. Trace:
I20260709 13:02:38.475733  1694 rpcz_store.cc:276] 0709 13:02:36.935993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.936105 (+   112us) service_pool.cc:224] Handling call
0709 13:02:36.936398 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.971500 (+1035102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.475053 (+503553us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b54001b6f54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:38.475221 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2257224576}
I20260709 13:02:38.476441  8266 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:38.473232  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:38.462934  7631 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:38.443804  7828 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:38.499325  1615 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:38.499574  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39612 (request call id 3364) took 1330 ms. Trace:
I20260709 13:02:38.449082  8086 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:38.500152  8266 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:38.469689  8375 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:02:38.521425  8266 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:38.467969  8369 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:38.501199  1541 rpcz_store.cc:276] 0709 13:02:37.169441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.416703 (+247262us) service_pool.cc:224] Handling call
0709 13:02:37.492673 (+ 75970us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.493317 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.499378 (+1006061us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b5400187ed0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172a8ad 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:38.499518 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166063360}
I20260709 13:02:38.526460  1614 raft_consensus.cc:1240] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:38.528291  8318 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:38.528746  8086 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:38.524880  8223 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:38.532107  1695 raft_consensus.cc:606] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Received request to transfer leadership
I20260709 13:02:38.532626  1695 raft_consensus.cc:614] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:38.531629  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:38.538462  8358 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.539017  8358 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.541224  8358 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.546794  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 2596) took 1113 ms. Trace:
W20260709 13:02:38.557644  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 109390us
I20260709 13:02:38.523447  8257 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:02:38.556344  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 107833us
I20260709 13:02:38.466958  8370 consensus_queue.cc:237] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.561056  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:38.547276  1692 rpcz_store.cc:276] 0709 13:02:37.433206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.480512 (+ 47306us) service_pool.cc:224] Handling call
0709 13:02:37.480852 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:37.481198 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.481225 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:37.493369 (+ 12144us) log.cc:844] Serialized 52 byte log entry
0709 13:02:38.415833 (+922464us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b1800438880. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e620e07 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b 00007fc4912cad23 00007fc4912cb0d1 00007fc4916e6a0f
0709 13:02:38.522988 (+107155us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:38.523041 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.523161 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.523203 (+    42us) raft_consensus.cc:1685] finished
0709 13:02:38.523213 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.546726 (+ 23513us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3180,"raft.queue_time_us":302,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":10313,"spinlock_wait_cycles":31098624,"thread_start_us":106654,"threads_started":1,"wal-append.queue_time_us":1017683}
I20260709 13:02:38.564026  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:38.565510  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:38.558697  8366 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:38.576819  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:38.577023  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:38.555840  8357 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:38.577634  1659 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:41871 timed out after 1.704s (SENT) [suppressed 5 similar messages]
I20260709 13:02:38.584563  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:38.568313  8262 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:02:38.575938  8364 log.cc:927] Time spent T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:02:38.588490  1511 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:38.562608  8257 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:38.595564  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:38.595944  1621 raft_consensus.cc:2368] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 22. Current term is 23.
I20260709 13:02:38.583550  8281 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:38.601019  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:38.600585  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:38.586369  8240 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:38.605370  1619 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 23.
I20260709 13:02:38.611852  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:38.614763  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:38.588446  8383 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:38.616120  1619 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 12.
I20260709 13:02:38.599483  8250 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:38.620843  2246 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:38.622568  7828 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 23 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.622889  8266 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:38.624284  8357 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.625911  8383 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.617504  8358 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:38.618188  8308 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:38.638460  8308 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.640775  8308 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.582245  8366 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:38.643065  8366 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.631271  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:38.644411  8257 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:38.652194  8383 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.600556  8264 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:38.604478  8375 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
W20260709 13:02:38.633467  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 55848.4us
I20260709 13:02:38.596966  8262 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:38.660467  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.626848  7793 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:38.667832  1546 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 16.
I20260709 13:02:38.670583  7793 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:38.677829  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:38.679311  8375 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:38.681574  8375 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:38.682241  8149 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:38.683640  1694 raft_consensus.cc:1240] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:38.684648  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:38.685388  1693 raft_consensus.cc:2393] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 20: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:38.685504  8262 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.613299  8281 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:38.687618  8281 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:38.688539  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:38.658617  8358 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.692112  8358 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.693192  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:38.695874  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.696249  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:38.697523  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:38.698194  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:38.698526  2238 raft_consensus.cc:2393] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 16: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:38.699429  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:38.700470  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:38.710925  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:38.711928  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:38.713788  1544 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:38.717738  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 2597) took 1284 ms. Trace:
I20260709 13:02:38.718336  1688 rpcz_store.cc:276] 0709 13:02:37.440645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.491985 (+ 51340us) service_pool.cc:224] Handling call
0709 13:02:37.518438 (+ 26453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:38.017440 (+499002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.717433 (+699993us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b5400133b54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:38.717645 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135972736}
W20260709 13:02:38.701715  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.701997  1620 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:02:38.682847  8149 consensus_queue.cc:1059] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:38.721948  8149 raft_consensus.cc:3055] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:38.722024  1544 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 23.
I20260709 13:02:38.722368  8149 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:38.704494  8226 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:38.679006  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:38.723316  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:38.723670  1538 raft_consensus.cc:2393] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 18: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:38.723860  8265 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:38.725085  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1075) took 1239 ms. Trace:
I20260709 13:02:38.709663  1511 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:38.671758  8264 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.725497  1542 rpcz_store.cc:276] 0709 13:02:37.485187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.840849 (+355662us) service_pool.cc:224] Handling call
0709 13:02:37.860008 (+ 19159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.889636 (+ 29628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.889679 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.889733 (+    54us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:37.889796 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.724872 (+835076us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b54002e4854. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:38.724928 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.725037 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67547392}
I20260709 13:02:38.726867  1511 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:38.727607  8264 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.727867  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40034 (request call id 3455) took 1499 ms. Trace:
I20260709 13:02:38.728142  8264 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:38.723938  1544 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
W20260709 13:02:38.728925  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 3371) took 1299 ms (client timeout 1704 ms). Trace:
W20260709 13:02:38.729327  1547 rpcz_store.cc:269] 0709 13:02:37.429720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.505101 (+ 75381us) service_pool.cc:224] Handling call
0709 13:02:38.728735 (+1223634us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54003223d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:38.728849 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579693952}
W20260709 13:02:38.730147  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39628 (request call id 2260) took 1673 ms (client timeout 1729 ms). Trace:
W20260709 13:02:38.730631  1539 rpcz_store.cc:269] 0709 13:02:37.056893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.057027 (+   134us) service_pool.cc:224] Handling call
0709 13:02:38.729942 (+1672915us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b5400069ad4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:38.730093 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":952697728}
I20260709 13:02:38.731463  8369 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:38.732645  1622 raft_consensus.cc:2393] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 17: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:38.732803  8271 raft_consensus.cc:3055] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:38.733309  8271 raft_consensus.cc:740] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:38.710573  1613 raft_consensus.cc:1240] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:38.728583  1617 rpcz_store.cc:276] 0709 13:02:37.228393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.301219 (+ 72826us) service_pool.cc:224] Handling call
0709 13:02:37.405452 (+104233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.863308 (+457856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.727632 (+864324us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54003200d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:38.727805 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012857088}
I20260709 13:02:38.727993  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:38.738387  1585 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:38.740932  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:38.740876  1585 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:38.740473  1511 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:38.747992  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:38.754645  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:38.755635  1613 raft_consensus.cc:2368] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17.
I20260709 13:02:38.755707  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:38.756618  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:38.754820  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:38.753458  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 125788us
I20260709 13:02:38.728957  8264 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:38.765573  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:38.752148  8358 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:38.767427  8358 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.767932  8358 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:38.771559  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:38.772975  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:38.773770  8369 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:38.776490  8149 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.777834  8149 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:38.780282  8271 consensus_queue.cc:260] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.781430  8271 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:38.782137  8262 consensus_queue.cc:1175] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" responder_term: 16 status { last_received { term: 16 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 16 index: 10 } }
I20260709 13:02:38.757072  8281 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:38.753535  7793 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.783088  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:38.751854  8263 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:38.783983  2238 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:38.784160  8263 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:38.785094  8263 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.757232  8027 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:38.787506  8027 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:38.787921  8027 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:38.783694  7793 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:38.790439  7793 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:38.783215  8281 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.795974  8281 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:38.810286  7631 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:38.810871  7631 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:38.783617  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:38.814198  1616 raft_consensus.cc:606] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:38.814363  8358 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.816573  8358 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 24 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.817515  8281 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.818269  2238 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:38.821029  8281 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.821770  1619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:38.822320  1619 raft_consensus.cc:606] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:38.822629  1619 raft_consensus.cc:614] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:38.823652  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:38.824396  2239 raft_consensus.cc:2393] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 15: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:38.825920  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:38.826195  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:38.828779  1586 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:38.835691  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:38.838807  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:38.836351  2240 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:02:38.814385  8256 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:38.845393  8317 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:38.859776  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a69de749cce497b83e6489ad367017a"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:38.860628  1615 raft_consensus.cc:606] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:38.861016  1615 raft_consensus.cc:614] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:38.838974  8375 consensus_queue.cc:1059] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
W20260709 13:02:38.886226  1545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1073) took 1401 ms (client timeout 1822 ms). Trace:
I20260709 13:02:38.886482  1542 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:02:38.886677  1545 rpcz_store.cc:269] 0709 13:02:37.484549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.526767 (+ 42218us) service_pool.cc:224] Handling call
0709 13:02:38.886022 (+1359255us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b54001284d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:38.886159 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1390271744}
I20260709 13:02:38.890583  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:38.892052  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:38.892750  1545 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:38.893702  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:38.894279  1545 raft_consensus.cc:2376] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17. Re-sending same reply.
I20260709 13:02:38.899497  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "646909798f0047ef9e8073d28a784525"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:38.898519  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:38.900295  1615 raft_consensus.cc:606] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:38.900797  1615 raft_consensus.cc:614] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:38.902132  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 60932.9us
I20260709 13:02:38.904469  8370 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:38.905073  8370 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:38.908018  8370 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:38.921162  8308 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:38.911942  1546 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:02:38.922905  8372 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:38.921504  8370 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:02:38.925434  1587 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:38.930408  1586 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:38.918241  8226 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:38.919169  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 156738us
I20260709 13:02:38.920003  8383 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.915527  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:38.930703  1587 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:38.936872  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:38.937989  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.939163  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:38.915529  8369 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:38.939549  8318 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:38.939666  8223 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:38.940408  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:38.897783  8390 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:38.940562  8223 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.941200  2238 raft_consensus.cc:2410] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:02:38.941303  8390 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.939805  8369 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.942747  8223 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:38.940026  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:38.943393  1616 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:38.921721  8308 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.939767  1619 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:38.945510  8308 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.947963  7631 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.935137  8380 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:38.949364  8369 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.950445  8380 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:38.950577  1587 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:38.950040  1616 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:02:38.951258  8383 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.951462  8380 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:38.952528  8086 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:38.953325  8383 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.954018  8390 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.954236  1587 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:38.956699  1545 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 24 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:02:38.958760  1616 raft_consensus.cc:1275] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:38.958946  1619 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 24.
I20260709 13:02:38.960291  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:38.961185  2244 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21.
I20260709 13:02:38.962622  1586 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:38.960901  1546 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:38.964720  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:38.965569  2246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:55918
I20260709 13:02:38.966027  2246 raft_consensus.cc:606] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:38.966302  2246 raft_consensus.cc:614] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:38.967003  2244 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45886 (request call id 1330) took 1772 ms (client timeout 1825 ms). Trace:
I20260709 13:02:38.968423  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:38.971748  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:38.972324  1546 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:38.929818  8370 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:38.972736  2238 raft_consensus.cc:1240] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:38.973544  1587 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:38.973778  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:38.967502  2244 rpcz_store.cc:269] 0709 13:02:37.189701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.266331 (+ 76630us) service_pool.cc:224] Handling call
0709 13:02:38.915392 (+1649061us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800003998. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e606b71 00007fc48e606a22 00007fc49751fc09 00007fc496679ee0 00007fc4967430ab 00007fc496743131 00007fc4966f10a0 00007fc4966f0984 00007fc48fc6b6d4 00007fc48fc6b662
0709 13:02:38.961555 (+ 46163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2849152}
I20260709 13:02:38.976107  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:38.945367  8027 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:38.983204  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:38.963660  8390 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:38.975080  8086 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:38.976373  7631 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:38.993213  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 54587.7us
I20260709 13:02:38.996553  1616 raft_consensus.cc:1240] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:02:38.997620  8256 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.997934  8027 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:38.998010  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:38.998366  8271 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:38.999065  1617 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 23. Current term is 24. Ops: []
I20260709 13:02:38.999647  8271 consensus_queue.cc:1059] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:39.000492  8271 raft_consensus.cc:3055] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:39.000824  8271 raft_consensus.cc:740] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:39.001626  8271 consensus_queue.cc:260] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:39.002804  8271 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:38.998137  1511 leader_election.cc:400] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17.
I20260709 13:02:39.003852  1511 leader_election.cc:403] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:02:39.016451  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:39.021337  1618 raft_consensus.cc:1240] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:02:39.018427  1546 raft_consensus.cc:2468] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:38.991335  8370 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:39.022559  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
W20260709 13:02:39.024523  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.024447  1617 raft_consensus.cc:606] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:39.026973  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:39.028053  1696 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 21: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:02:39.029896  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.030234  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:39.030943  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:39.036289  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:39.039551  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:39.040334  1693 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:39.042063  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:38.989053  8223 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:39.052675  1511 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:39.054243  1511 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:39.055155  1694 raft_consensus.cc:2393] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 17: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:39.048010  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:39.048336  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:39.032240  1696 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:38.994663  7795 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:39.059909  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:39.060652  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:39.050658  1512 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:39.061966  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6f3b457deb4725b437c627cc3a5cd7" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:39.065601  1618 raft_consensus.cc:2393] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 17: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:39.019920  8308 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:39.066777  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:39.071973  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:39.082120  1512 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:39.083824  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.084724  1622 raft_consensus.cc:2393] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 21: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:39.084931  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:39.080933  8401 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:02:39.085554  1618 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:39.085626  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:39.047104  8149 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.089077  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:38.998171  8256 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:39.049419  8358 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:39.095356  1512 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:39.063849  8240 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:39.085983  8086 raft_consensus.cc:697] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:39.098249  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:39.062716  8265 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:39.062995  8266 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:39.068934  7736 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:39.069355  8218 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:39.102470  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:39.103219  1616 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:39.101823  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:39.085810  8264 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:39.083550  7795 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:39.086390  8353 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:39.070107  8247 consensus_queue.cc:1048] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:02:39.060832  7631 consensus_queue.cc:1059] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.036s
I20260709 13:02:39.092535  8250 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:39.064029  8223 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:39.091742  8278 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:39.122500  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:39.123344  1619 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 21: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:39.099062  7793 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:02:39.106204  8264 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:39.111136  8358 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:39.127296  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:39.108184  8240 raft_consensus.cc:697] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:39.097939  8149 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:39.104599  8266 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:39.137779  8264 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:39.143736  8358 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:39.170192  8358 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:39.113945  8353 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:39.172698  8353 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:39.105753  8265 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:39.109304  8218 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:39.125068  8278 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:39.149251  8086 consensus_queue.cc:237] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:39.150736  8397 log.cc:927] Time spent T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:02:39.150609  8223 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:39.184667  8240 consensus_queue.cc:237] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:39.187891  8149 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:39.191656  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:39.197018  8278 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:39.210480  8399 log.cc:927] Time spent T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 13:02:39.210391  8264 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:39.225536  8264 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 23 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:39.217013  8358 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:39.223785  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.213701  8308 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 16. Current term is 17.
I20260709 13:02:39.228350  8390 raft_consensus.cc:3055] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:39.231050  1620 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:39.232663  8317 raft_consensus.cc:3055] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:39.243299  8375 raft_consensus.cc:1064] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:02:39.244736  1693 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 23.
W20260709 13:02:39.243199  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 147950us
I20260709 13:02:39.254979  1587 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:39.257509  8318 consensus_queue.cc:1059] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
W20260709 13:02:39.297290  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.311123  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 54934.7us
I20260709 13:02:39.312301  1512 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:39.339708  1512 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:39.248301  8413 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:39.260700  1587 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:39.262850  8093 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:39.251560  8390 raft_consensus.cc:740] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:39.251560  8317 raft_consensus.cc:740] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:39.372078  1512 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:39.364243  8308 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:39.376459  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 316469us
I20260709 13:02:39.378857  1512 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:39.373770  8408 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:39.374114  7793 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:39.376672  8281 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:39.383140  1660 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:39.374315  7736 raft_consensus.cc:697] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 24 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:39.386265  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50552 (request call id 1554) took 1029 ms. Trace:
I20260709 13:02:39.368088  8414 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:02:39.386772  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:39.388702  8358 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:39.382056  8247 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:39.385900  8317 consensus_queue.cc:260] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:39.386706  1614 rpcz_store.cc:276] 0709 13:02:38.357055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.357220 (+   165us) service_pool.cc:224] Handling call
0709 13:02:38.357531 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:38.526842 (+169311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.385890 (+859048us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54001e8054. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:39.386202 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388040448}
I20260709 13:02:39.394579  8317 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:39.398453  1540 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:39.400022  7872 consensus_queue.cc:1059] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:02:39.403060  7872 raft_consensus.cc:3055] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:39.403534  7872 raft_consensus.cc:740] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:39.406236  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:39.406807  2245 raft_consensus.cc:2376] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21. Re-sending same reply.
I20260709 13:02:39.384213  8413 consensus_queue.cc:1059] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:02:39.407739  8413 raft_consensus.cc:3055] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:39.408095  8413 raft_consensus.cc:740] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:39.408927  8413 consensus_queue.cc:260] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:39.410130  8413 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:39.411187  8398 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.473s	user 0.000s	sys 0.001s
I20260709 13:02:39.396895  8353 consensus_queue.cc:1059] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:02:39.412093  8353 raft_consensus.cc:3055] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:02:39.412432  8353 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:39.413175  8353 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:39.413702  8027 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.414268  8353 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:39.414165  8027 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:39.414438  2244 raft_consensus.cc:1240] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:39.395159  8223 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:39.395088  8414 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:39.382105  8149 consensus_queue.cc:1059] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:02:39.419731  1586 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:02:39.424862  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.420791  1660 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:39.404573  7872 consensus_queue.cc:260] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:39.424126  8408 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:02:39.439636  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 178985us
I20260709 13:02:39.440616  1587 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:39.384428  8390 consensus_queue.cc:260] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:39.443492  1587 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:39.445204  1660 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:39.448709  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:39.451511  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:39.433593  8278 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:39.426469  8414 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:39.446451  7872 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:39.424018  7736 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:39.447537  7795 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:39.491796  2209 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:39.494664  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:39.496115  1659 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:39.451756  8149 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:39.581959  8027 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:39.489112  8091 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:39.583029  8091 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:39.583478  8091 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:39.587848  8410 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.438s	user 0.005s	sys 0.013s
I20260709 13:02:39.592012  8091 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:39.595036  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.452522  8257 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:02:39.598242  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 106555us
I20260709 13:02:39.602737  1540 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:39.604513  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:39.607297  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:39.476078  8223 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:39.613878  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 170443us
I20260709 13:02:39.614777  1587 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:39.612408  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:39.621119  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:39.511864  8086 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:39.624136  1543 raft_consensus.cc:2410] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:02:39.623621  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:39.623529  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 127488us
I20260709 13:02:39.635123  1587 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:39.612847  8211 raft_consensus.cc:2764] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:02:39.636209  1659 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:39.637481  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:39.639001  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:39.613749  8223 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:02:39.646287  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 194812us
I20260709 13:02:39.622745  8390 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:39.651093  1660 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:39.615167  8091 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:39.655133  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.642187  8416 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:02:39.679138  8417 log.cc:927] Time spent T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:02:39.652695  8223 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:39.687144  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:39.649030  7795 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:39.646873  8421 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:39.669620  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:39.686357  8091 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:39.654335  8408 raft_consensus.cc:697] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:39.718266  8408 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:39.694018  8257 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:39.720757  8256 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:39.720594  8257 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:39.723600  8167 raft_consensus.cc:3055] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:39.724033  8167 raft_consensus.cc:740] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:39.724804  8167 consensus_queue.cc:260] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:39.689860  7795 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:39.726711  7795 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:39.697747  8266 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:39.711337  8278 consensus_queue.cc:1059] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:39.655961  7854 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:02:39.668493  8416 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:39.731364  8416 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:39.738480  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:39.716550  8414 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:39.717311  8418 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:02:39.740082  1546 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:39.753412  1544 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:39.715013  8413 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:39.760506  7795 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:39.818689  2242 consensus_queue.cc:237] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:39.759371  8167 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:39.837972  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.872973  1512 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:39.889273  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 53298.1us
I20260709 13:02:39.894192  8264 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:39.905498  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.910223  1585 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:39.841933  8218 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:39.762669  8173 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.126s
I20260709 13:02:39.924576  1585 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:39.933974  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:39.934958  1692 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:39.888255  8376 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:39.953897  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:39.958887  1689 raft_consensus.cc:2410] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for term 24 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:02:39.954080  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:39.960328  1688 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:39.954731  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:39.956241  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:39.957343  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:39.962508  1691 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:39.894876  8425 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:39.971124  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:39.911463  8278 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.956727  8405 log.cc:927] Time spent T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.910s	user 0.005s	sys 0.015s
I20260709 13:02:40.007578  1689 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:39.999974  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:40.012311  1690 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:39.927891  8423 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.939798  8424 raft_consensus.cc:2804] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:40.015275  1692 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 23.
I20260709 13:02:40.028770  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:40.030296  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:39.998858  8416 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:39.992743  7793 consensus_meta.cc:287] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.000s
I20260709 13:02:40.019891  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:40.013603  8278 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:39.972954  8223 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:40.020829  7795 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:40.011220  8425 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.028180  8423 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.039711  8265 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:40.041019  8425 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:40.041427  8423 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:39.969580  8376 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:40.042788  1693 raft_consensus.cc:1275] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:02:40.042972  8278 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:40.043191  1693 pending_rounds.cc:85] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 8
I20260709 13:02:40.043488  1693 pending_rounds.cc:107] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:02:40.043704  1693 raft_consensus.cc:2889] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:40.044183  8376 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:40.045006  1689 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:02:40.009641  8262 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.049309  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:40.050261  1695 raft_consensus.cc:2393] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 17: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:02:40.011317  8263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.127s	user 0.026s	sys 0.021s
I20260709 13:02:40.034876  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:40.053501  1692 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:40.035303  1688 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 13.
I20260709 13:02:40.047359  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:39.963341  8353 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:39.983990  8086 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:40.052789  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:40.055212  1687 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:40.056689  1688 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 13:02:40.061432  1688 pending_rounds.cc:85] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 13
I20260709 13:02:40.061847  1688 pending_rounds.cc:107] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:02:40.062259  1688 raft_consensus.cc:2889] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:40.047477  1691 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
I20260709 13:02:40.068821  1692 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:02:40.053865  8263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.175s	user 0.026s	sys 0.021s
I20260709 13:02:40.047047  7793 raft_consensus.cc:2749] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:40.049496  8424 raft_consensus.cc:697] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:40.050704  8423 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.099524  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 360555us
I20260709 13:02:40.101693  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:40.125247  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.125355  1542 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:40.052018  8278 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.117949  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:40.051862  8240 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:40.126480  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:40.130421  1543 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:40.072072  7795 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:02:40.131537  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 438960us
I20260709 13:02:40.136240  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:40.052949  8262 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.141661  1690 raft_consensus.cc:2393] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 17: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:40.116415  8086 raft_consensus.cc:697] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:40.144438  1512 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:40.136372  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.148872  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:40.075160  8353 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:40.129673  8356 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:40.152952  1512 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:40.158947  8264 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:40.162119  1512 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:02:40.162555  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 220175us
W20260709 13:02:40.165797  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.160233  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:40.159514  8218 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:40.168713  8358 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:40.169250  8358 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:40.169708  8358 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:40.128346  8423 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.178323  8223 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:40.177023  1512 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:40.138121  7795 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.186771  1660 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:40.136399  8240 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.132004  8278 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:40.174057  8247 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:40.190418  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:40.196314  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:40.230077   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:02:40.230649  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 43958.6us
I20260709 13:02:40.231372  1660 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:40.188427  7793 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:40.165283  8356 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:40.238438  1616 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:40.189414  8218 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:02:40.193382  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 266451us
I20260709 13:02:40.253104  1587 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:40.261859  1691 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:40.185640  8093 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:02:40.266592  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:40.275869  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:40.250378  7793 raft_consensus.cc:697] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:40.257616  8432 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:40.304625  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 51615.2us
I20260709 13:02:40.270315  8408 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:40.269835  7736 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:40.273254  8416 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:40.273404  8422 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:40.279330  8380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.325s	user 0.015s	sys 0.025s
I20260709 13:02:40.320007  1587 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:40.282881  8223 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:40.187932  8424 consensus_queue.cc:237] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.240576  8086 consensus_queue.cc:237] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.307479  8430 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:40.340271  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:40.347327  1691 raft_consensus.cc:2393] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 15: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:40.343113  1587 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:40.344462  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.342406  8380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.382s	user 0.015s	sys 0.026s
I20260709 13:02:40.326440  8408 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.337090  8223 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:40.380725  1587 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:40.343387  8438 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:40.372648  8428 log.cc:927] Time spent T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:02:40.370325  8262 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:40.370494  8353 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:40.373240  8195 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:40.395562   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:40.382254  8442 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:40.335788  7736 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:40.384063  8223 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:40.388480  8438 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:40.394485  8423 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:40.402827  8370 raft_consensus.cc:2749] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:40.379721  8093 consensus_queue.cc:1059] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:02:40.449390  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:40.440804  8264 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:40.416036  7795 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:40.381220  7793 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:40.406536  8380 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:02:40.424504  8438 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:40.445583  8240 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:40.462270  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:40.463636  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 70885.3us
I20260709 13:02:40.464780  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:40.453567  8436 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:02:40.426090  8414 raft_consensus.cc:493] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:40.424659  8278 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:40.419786  8262 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:02:40.480463  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:40.480993  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:40.440918  8263 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:02:40.420399  8195 consensus_queue.cc:1059] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:02:40.489732  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:40.518577  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:40.490051  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:40.518174  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:40.523895  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:40.517972  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:40.548509  8449 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:40.549232  8449 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:40.551757  8449 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:40.552322  8449 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:02:40.553437  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 50917.3us
I20260709 13:02:40.501839  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d351fa3549448eda026a66b8c124d58" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:40.556141  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 66678.1us
I20260709 13:02:40.556643  1688 raft_consensus.cc:2393] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 15: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:40.569715  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:40.570060  1587 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:40.517452  8434 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 13:02:40.523829  8390 consensus_meta.cc:287] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.866s	user 0.007s	sys 0.005s
W20260709 13:02:40.496747  8452 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:02:40.516693  8441 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:02:40.517027  8440 log.cc:927] Time spent T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:02:40.462955  8408 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:40.575290  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.589781  2211 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:40.452695  8264 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:40.516146  8445 log.cc:927] Time spent T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:02:40.514730  7736 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:40.580153  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:40.593297  1687 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:40.580470  1539 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:40.487427  8240 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:40.581794  1587 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:40.552835  8449 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.500468  8356 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:40.567636  8278 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.593633  2211 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:40.584281  8266 raft_consensus.cc:3055] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:40.557749  8414 raft_consensus.cc:515] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:40.596264  8359 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:40.604743  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:40.605060  8264 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:40.605783  8357 raft_consensus.cc:993] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:40.593360  8027 raft_consensus.cc:3055] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:40.616657  1660 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:40.618031  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.612327  8266 raft_consensus.cc:740] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:40.625036  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.656951  1621 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:02:40.625533  8356 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:40.626629  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 473456us
I20260709 13:02:40.629437  8264 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:40.614719  8278 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.614544  8408 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:02:40.621212  8380 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:40.612133  8263 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:40.635582  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:40.672235  1696 raft_consensus.cc:2393] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 17: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:40.609799  8240 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.638499  1694 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:40.641155  1688 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:40.644438  8450 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.645331  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.645855  8357 raft_consensus.cc:1081] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:40.646539  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 3023) took 1710 ms. Trace:
W20260709 13:02:40.647732  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.659314  1660 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:40.666949  1511 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:40.685631  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.513404  8358 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:40.673666  1696 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:40.674866  1687 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 23.
I20260709 13:02:40.654237  8027 raft_consensus.cc:740] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:40.684690  1615 rpcz_store.cc:276] 0709 13:02:38.935747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.936639 (+   892us) service_pool.cc:224] Handling call
0709 13:02:40.646277 (+1709638us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540042ca54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:40.646449 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3318990208}
I20260709 13:02:40.662768  8167 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:40.706430  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 47228.6us
I20260709 13:02:40.734673  2244 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:02:40.743006  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 56796.6us
I20260709 13:02:40.744763  1660 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:40.745702  7795 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:40.751535  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.752914  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.754205  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.755295  7736 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:40.755884  7736 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:40.757201  8438 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:40.757990  7736 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:40.741649  8423 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:40.759995  8464 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:40.761606  1619 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:40.766533  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
W20260709 13:02:40.741907  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 66958.1us
I20260709 13:02:40.771481  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.771621  2210 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:40.670337  8247 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 23 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:40.782364  1613 raft_consensus.cc:2393] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 17: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:40.789305  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.669315  8264 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.835251  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.835904  1618 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 16.
I20260709 13:02:40.836659  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.836834  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.838390  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:40.825822  1695 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:02:40.827142  1622 raft_consensus.cc:1240] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:40.827402  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.840354  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:40.841109  1614 raft_consensus.cc:2393] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 17: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:40.828460  8333 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.839334  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.844897  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.845239  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.848042  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.852456  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.768604  8438 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:40.755306  8358 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:40.774480  8424 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.865000  1613 raft_consensus.cc:1240] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:40.853080  1618 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:40.866313  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.782492  8236 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:40.854125  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.860069  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:40.874133  7795 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:40.874508  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:40.861111  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:40.790526  8462 log.cc:927] Time spent T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:40.735052  8450 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.877175  7795 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:40.834836  8423 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.893776  8423 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.896071  8423 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:40.887010  8240 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:40.878330  8424 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:40.860761  8333 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:40.899710  8424 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:40.900378  8424 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:40.873504  8236 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:40.901599  8236 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:40.872846  8223 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:40.907465  1691 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:40.911904  8359 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:40.912652  8359 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:40.915812  8359 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:40.916481  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 2306) took 1179 ms. Trace:
I20260709 13:02:40.917415  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:40.918190  2246 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 23.
I20260709 13:02:40.921269  8429 raft_consensus.cc:993] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:40.922037  8429 raft_consensus.cc:1081] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:40.883453  8414 leader_election.cc:290] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:40.884085  8247 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.869859  8027 consensus_queue.cc:260] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.926604  8027 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:40.927386  1615 raft_consensus.cc:1240] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:40.782492  8266 consensus_queue.cc:260] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.931504  8333 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:40.892256  8450 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:40.869494  8469 consensus_queue.cc:1048] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:02:40.933069  8449 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:40.931877  8439 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.598s	user 0.005s	sys 0.004s
I20260709 13:02:40.784407  8390 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.093s
I20260709 13:02:40.882817  8264 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:40.934547  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.900843  8424 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:40.936439  1586 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:40.936841  8424 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:40.937254  1693 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:40.937330  8424 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:40.937875  8424 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.938254  8424 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:40.938205  8360 consensus_queue.cc:1059] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:40.939504  8360 consensus_queue.cc:1059] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:40.917083  1543 rpcz_store.cc:276] 0709 13:02:39.736962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.739479 (+  2517us) service_pool.cc:224] Handling call
0709 13:02:39.739726 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.132274 (+392548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.916153 (+783879us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b5400347e54. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:40.916395 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":897905920}
I20260709 13:02:40.940616  8360 raft_consensus.cc:3055] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:40.941032  8360 raft_consensus.cc:740] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:40.939653  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:40.944037  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:40.944478  2246 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:40.945631  1696 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:40.935015  8278 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:40.947849  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:40.949877  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:40.950583  2240 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
I20260709 13:02:40.969866  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:40.972059  1693 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 23.
I20260709 13:02:40.973380  1693 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:40.975360  1587 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:40.978641  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:40.983960  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.979772  2245 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
I20260709 13:02:40.955710  8374 raft_consensus.cc:3055] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:40.946774  8264 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:41.012238  8380 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.984898  8423 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.955343  8449 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:41.027352  1692 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:41.023844  8264 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:40.956018  8223 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:41.029083  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 362152us
W20260709 13:02:41.030357  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 286539us
I20260709 13:02:40.987677  8317 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:02:41.034441  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.989681  8091 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:41.036418  8423 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.016439  8374 raft_consensus.cc:740] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:41.045171  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:41.070430  1543 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:41.045994  1546 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:41.058405  1544 raft_consensus.cc:1240] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 23 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:41.059337  1694 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:02:41.026283  8149 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.046950  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39628
I20260709 13:02:41.053587  1538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39628
I20260709 13:02:40.941915  8360 consensus_queue.cc:260] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:40.987005  8429 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:02:40.987318  8419 consensus_queue.cc:1059] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:02:41.068282  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:40.989440  8318 consensus_queue.cc:1059] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:02:41.074558  1538 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:41.074882  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:41.077361  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.094933  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.095633  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.096168  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.096660  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.097200  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:41.097433  8360 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:41.098263  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.098810  1691 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 21.
I20260709 13:02:41.084888  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.097204  1688 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
I20260709 13:02:41.103381  1692 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
I20260709 13:02:41.106194  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.105157  1511 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:41.081640  1659 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:41.107422  1538 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:41.108364  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 233897us
I20260709 13:02:41.010834  8375 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 14, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:41.119957  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.120729  1691 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 21.
I20260709 13:02:41.040447  8449 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.121865  1542 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:41.122267  1542 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:41.124092  1621 raft_consensus.cc:1240] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:41.129078  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:41.129720  1546 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:41.131536  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:41.132411  8262 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:41.132463  8481 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:41.133100  8481 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.133049  8262 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:41.133611  8481 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:41.079879  8149 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.135399  8262 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:41.136583  8149 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:41.137384  8264 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:41.123741  8278 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:41.128418  1538 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.139616  8278 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.140116  8278 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:41.140997  8374 consensus_queue.cc:260] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:41.142216  8374 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:41.033839  8380 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.144063  1538 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:41.144179  8423 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:41.144380  8380 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:41.142283  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.076064  8454 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:02:41.150003  8424 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:41.074412  8438 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:02:41.128252  8419 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.156052  8419 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:41.158283  8419 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:41.161706  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:41.163558  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:41.168267  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:41.109562  1660 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:41.164485  1539 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:41.169533  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:41.181416  1538 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:41.067128  8247 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:02:41.170680  8419 consensus_queue.cc:1059] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:41.171399  8278 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.177239  8477 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:41.179378  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 69923.9us
I20260709 13:02:41.217547  1542 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.222506  1538 raft_consensus.cc:1240] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:41.217244  1585 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:02:41.223382  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 54065.8us
I20260709 13:02:41.189126  8236 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:41.228205  1546 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:41.229550  1540 raft_consensus.cc:1240] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:41.228823  1660 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:41.236619  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:41.228641  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 278185us
I20260709 13:02:41.232548  1512 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:41.241011  2211 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:41.241895  1512 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:41.248239  8474 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:02:41.199388  8483 log.cc:927] Time spent T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:02:41.251010  1660 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:41.237289  1692 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:41.250852  1512 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:41.180235  8449 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:41.266499  1512 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:41.074735  8091 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:41.268455  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 51340.3us
I20260709 13:02:41.251510  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.249539  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:41.269474  1585 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:41.270795  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:41.271464  1539 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:41.272843  1660 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:41.271137  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 165869us
I20260709 13:02:41.274119  1660 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:41.276196  7631 raft_consensus.cc:1027] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: attempt to promote peer e8a64798e5f94de8909707bcbd11804a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:02:41.249593  8464 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:41.263913  8149 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:41.271445  8264 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:41.268211  8450 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:41.263713  8475 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:41.302744  8475 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:41.304765  8278 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:41.305022  8475 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:41.305873  8424 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 24 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:41.306984  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.272917  8419 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:41.308387  8419 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:41.308809  8419 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:41.271070  8425 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:41.328158  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:41.264093  8359 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:41.282552  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.283383  1512 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:41.277235  8430 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:41.329488  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:41.289188  8236 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:41.291460  8266 raft_consensus.cc:3060] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:41.292630  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:41.300632  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:41.302126  8091 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:41.336189  1587 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:41.276249  8469 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:41.338563  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:41.339365  1621 raft_consensus.cc:2393] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 21: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
W20260709 13:02:41.339581  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 56248us
I20260709 13:02:41.342065  1659 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:41.343436  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.343138  1659 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:41.345204  1696 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:02:41.344324  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.349131  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:41.349838  1621 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 17: Already voted for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in this term.
I20260709 13:02:41.279894  1660 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:41.272858  8372 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:02:41.281530  8408 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:41.316787  8481 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.281467  8477 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:41.283833  8264 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:41.320688  8383 raft_consensus.cc:3055] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:41.321252  8369 raft_consensus.cc:3055] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:41.374365  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:41.323856  8173 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.379042  8173 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:41.379525  8424 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:41.347443  8430 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:41.380496  8430 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:41.380856  8430 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:41.381217  8173 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:41.351109  1659 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:41.382673  1659 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:41.374202  8369 raft_consensus.cc:740] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:41.345556  8091 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:41.383404  8091 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.383486  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39628 (request call id 2311) took 1156 ms. Trace:
I20260709 13:02:41.383787  8091 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:41.384195  8477 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:41.384373  8223 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:41.384778  8223 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.385190  8223 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:41.385699  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.386340  1687 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
W20260709 13:02:41.351640  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 71834.3us
I20260709 13:02:41.352885  1696 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:41.361644  8264 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:41.387939  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:41.389298  1660 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:41.389798  1694 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:02:41.390349  1660 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:41.390654  8149 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:41.352340  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:41.391584  1540 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:41.393663  8425 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:41.384770  8477 raft_consensus.cc:697] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 19 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:41.395917  1696 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 14. (term mismatch)
I20260709 13:02:41.396291  1696 pending_rounds.cc:85] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Aborting all ops after (but not including) 13
I20260709 13:02:41.396509  8450 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:41.383795  8369 consensus_queue.cc:260] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.341523  8469 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:41.397115  8450 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:41.397730  8369 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:41.362421  8422 raft_consensus.cc:2749] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:41.347119  8423 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:41.398607  1660 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:41.398876  8423 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:41.399335  8423 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:41.399425  8422 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:41.396534  1696 pending_rounds.cc:107] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 13:02:41.399925  8422 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.400422  8422 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:41.396306  8477 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:41.357547  1539 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:41.358301  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:41.358704  1543 raft_consensus.cc:2393] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 18: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:41.402392  1688 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:41.375669  1689 raft_consensus.cc:2393] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 20: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:41.387176  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.349529  7736 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:41.383922  1544 rpcz_store.cc:276] 0709 13:02:40.226738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.226901 (+   163us) service_pool.cc:224] Handling call
0709 13:02:40.246413 (+ 19512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:41.072024 (+825611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.383289 (+311265us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b5400193554. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:41.383432 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866722560}
I20260709 13:02:41.347158  8474 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:41.405426  8474 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.405818  8474 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:41.406751  8450 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:41.408744  1690 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:41.359114  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:41.399996  1696 raft_consensus.cc:2889] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:41.411397  8223 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.408653  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:41.356734  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:41.417176  1621 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 21.
W20260709 13:02:41.417833  1444 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58806 (request call id 182) took 16746 ms (client timeout 15000 ms). Trace:
I20260709 13:02:41.419142  8425 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:41.418872  8422 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.416353  1660 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:41.423528  8425 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:41.397765  8469 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:41.404254  7736 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:41.436468  2239 raft_consensus.cc:1240] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:41.437860   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:41.449448  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.449769  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.450421  1690 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 21.
I20260709 13:02:41.453138  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:41.371549  8383 raft_consensus.cc:740] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:41.429865  1540 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:41.433772  2244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:41.428061  1688 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 24.
I20260709 13:02:41.453503  1512 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:41.460879  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:41.464797  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:41.475589  1616 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:02:41.479595  7631 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:41.480208  7631 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.487042  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:41.459537  8425 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.431056  8438 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
W20260709 13:02:41.521639  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 246159us
I20260709 13:02:41.473325  8449 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:02:41.528661  7631 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:41.484458  8454 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.501065  1696 raft_consensus.cc:2393] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 18: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:41.463342  8278 consensus_queue.cc:1059] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:02:41.479391  8408 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.467547  8414 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:41.534024  8503 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.537453  1542 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:41.541374  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:41.507597  8223 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:41.554997  1689 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:41.508158  8360 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:41.418253  1444 rpcz_store.cc:269] 0709 13:02:24.671896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.672122 (+   226us) service_pool.cc:224] Handling call
0709 13:02:41.417745 (+16745623us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:33.995445 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:33.996284 (+   839us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:33.996336 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:02:33.996358 (+    22us) tablet.cc:662] Decoding operations
0709 13:02:34.167965 (+171607us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:34.168075 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:34.168102 (+    27us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:02:34.169437 (+  1335us) tablet.cc:701] Row locks acquired
0709 13:02:34.169485 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:02:34.169661 (+   176us) write_op.cc:270] Start()
0709 13:02:34.169812 (+   151us) write_op.cc:276] Timestamp: P: 1783602154169600 usec, L: 0
0709 13:02:34.169848 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:02:34.170608 (+   760us) log.cc:844] Serialized 6787 byte log entry
0709 13:02:34.946132 (+775524us) op_driver.cc:464] REPLICATION: finished
0709 13:02:35.090762 (+144630us) write_op.cc:301] APPLY: starting
0709 13:02:35.091050 (+   288us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:35.548059 (+457009us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:35.570584 (+ 22525us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:36.373350 (+802766us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b1800483b20. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc49146a0ec 00007fc49146caf7 00007fc49146dfb0 00007fc4951821bb 00007fc4951c95d4 00007fc4950758da 00007fc4950783cb 00007fc495077fd3 00007fc495176e34
0709 13:02:36.461738 (+ 88388us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:36.462211 (+   473us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:02:36.462291 (+    80us) write_op.cc:312] APPLY: finished
0709 13:02:36.490940 (+ 28649us) log.cc:844] Serialized 156 byte log entry
0709 13:02:36.679184 (+188244us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc48e6210ac 00007fc49747bab9 00007fc48e63d69b 00007fc48e63b93f 00007fc48e63dc02 00007fc4912c520b
0709 13:02:36.816318 (+137134us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.836762 (+ 20444us) write_op.cc:454] Released schema lock
0709 13:02:36.891845 (+ 55083us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:36.899404 (+  7559us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.899434 (+    30us) write_op.cc:454] Released schema lock
0709 13:02:36.907798 (+  8364us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
Metrics: {"mutex_wait_us":1543,"reported_tablets":29,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":139434,"apply.run_cpu_time_us":50247,"apply.run_wall_time_us":1808698,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75323,"num_ops":17,"prepare.queue_time_us":225153,"prepare.run_cpu_time_us":22916,"prepare.run_wall_time_us":307653,"raft.queue_time_us":137484,"raft.run_cpu_time_us":26188,"raft.run_wall_time_us":177751,"replication_time_us":754573,"spinlock_wait_cycles":38162944,"thread_start_us":698743,"threads_started":5,"wal-append.queue_time_us":507878,"wal-append.run_cpu_time_us":52142,"wal-append.run_wall_time_us":2682389}]]}
I20260709 13:02:41.559777  1687 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:02:41.541437  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 89215.8us
I20260709 13:02:41.553660  8414 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:41.561076  1587 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:02:41.554212  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 103551us
I20260709 13:02:41.564628  7631 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:41.565150  7631 raft_consensus.cc:697] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:41.565475  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:41.566154  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:41.566515  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:41.566922  1615 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 24.
I20260709 13:02:41.567324  1696 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:02:41.549824  8465 log.cc:927] Time spent T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:41.565896  7631 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:41.590595  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:41.592451  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:41.600044  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:41.640877  1539 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:41.552603  8173 consensus_queue.cc:1059] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:02:41.598469  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:41.524940  8425 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.563792  8236 consensus_queue.cc:1059] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.081s
I20260709 13:02:41.593369  1659 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:02:41.587628  8456 log.cc:927] Time spent T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:02:41.655524  1689 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:41.567507  8414 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:41.658380  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:41.643159  8491 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:02:41.657369  1512 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
W20260709 13:02:41.663620  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.546300  8454 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.556630  8408 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.671765  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:41.570106  8360 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:41.677551  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 84261.5us
W20260709 13:02:41.686120  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 86177.2us
I20260709 13:02:41.687004  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:41.688858  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 124255us
I20260709 13:02:41.693228  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:41.693858  1622 raft_consensus.cc:3055] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:41.694162  1622 raft_consensus.cc:740] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:41.696139  1493 auto_rebalancer.cc:893] Removing replace marker failed: Replica 822e08445eae4a33b2f2fe92060192c6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
W20260709 13:02:41.696606  1493 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:02:41.696879  1493 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:02:41.697129  1443 catalog_manager.cc:5697] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 14 to 20, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 20 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:41.699036  1443 catalog_manager.cc:5697] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 14 to 16, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
W20260709 13:02:41.700127  8495 log.cc:927] Time spent T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:02:41.700826  1443 catalog_manager.cc:5697] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 14 to 19. New cstate: current_term: 19 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:41.555218  8383 consensus_queue.cc:260] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.702247  1443 catalog_manager.cc:5697] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 8 to 15, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.589035  8487 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.124s
I20260709 13:02:41.709542  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:41.720460  1617 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:41.703061  8383 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:41.566905  8503 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:41.693572  8149 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:41.746539  1585 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:41.709218  8477 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:41.766390  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:41.744745  1622 consensus_queue.cc:260] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.774794  1443 catalog_manager.cc:5697] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 13 to 16, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.788663  1622 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:41.736855  8422 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:41.708664  8437 consensus_queue.cc:1175] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "822e08445eae4a33b2f2fe92060192c6" responder_term: 20 status { last_received { term: 19 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 19. Current term is 20. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:41.742110  8449 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:02:41.790787  8501 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:02:41.787801  1443 catalog_manager.cc:5697] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 18 to 19, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 19 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:41.771347  8477 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.771605  8278 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:41.735874  8478 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:02:41.784996  7736 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:41.785229  8149 raft_consensus.cc:697] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:41.809262  1443 catalog_manager.cc:5697] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:41.742264  8505 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.068s
I20260709 13:02:41.798288  8458 raft_consensus.cc:2749] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:41.779528  8457 consensus_queue.cc:1175] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d7158d6c3b634dc7abb69eac58eba291" responder_term: 18 status { last_received { term: 17 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:41.805078  8477 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:41.852779  1443 catalog_manager.cc:5697] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 16 to 20, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 20 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
W20260709 13:02:41.857690  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 200381us
I20260709 13:02:41.862134  1622 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:41.792562  8027 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:02:41.866780  1547 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:02:41.866931  1544 raft_consensus.cc:1240] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:41.868336  1543 raft_consensus.cc:1240] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:41.870076  1540 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18. Ops: []
W20260709 13:02:41.850179  8266 consensus_meta.cc:287] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.001s
I20260709 13:02:41.872399  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:41.878844  1547 raft_consensus.cc:2393] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 18: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:41.876317  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:41.880046  1541 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:41.881671  8247 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:41.848351  8506 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.889401  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:41.890609  1541 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:41.894078  1691 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:41.899093  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:41.899865  1539 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:41.891677  1443 catalog_manager.cc:5697] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 13 to 15, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:41.801882  8481 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:41.806216  8449 raft_consensus.cc:697] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:41.877467  8262 raft_consensus.cc:493] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:41.903548  8247 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.906818  8149 consensus_queue.cc:237] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:41.870954  8450 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:02:41.914541  8497 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
W20260709 13:02:41.902443  2211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.000s	sys 0.015s
I20260709 13:02:41.913870  1443 catalog_manager.cc:5697] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
W20260709 13:02:42.003661  2211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.000s	sys 0.016s
I20260709 13:02:41.859790  8257 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:41.915094  8496 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 13:02:41.917925  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.007473  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:41.986217  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 60934.5us
I20260709 13:02:41.905463  8506 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:41.975908  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:41.923069  8372 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
W20260709 13:02:41.918288  8474 consensus_meta.cc:287] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.000s
W20260709 13:02:41.962170  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.919499  8425 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:42.028856  8369 consensus_meta.cc:287] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.000s
I20260709 13:02:42.029702  8247 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:41.915395  8511 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.967825  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:42.031828  2245 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:41.969293  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:42.033788  2241 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:02:42.033879  8430 consensus_meta.cc:287] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.652s	user 0.004s	sys 0.006s
W20260709 13:02:42.038750  8423 consensus_meta.cc:287] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.639s	user 0.007s	sys 0.000s
I20260709 13:02:41.925700  8380 consensus_queue.cc:1059] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
W20260709 13:02:42.007004  8264 consensus_meta.cc:287] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.001s
I20260709 13:02:41.925814  8262 raft_consensus.cc:515] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:41.953922  8503 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:41.968096  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:41.952728  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:41.972096  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:41.877514  1511 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:42.016706  8419 consensus_meta.cc:287] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.703s	user 0.006s	sys 0.005s
I20260709 13:02:41.962339  8365 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:42.063798  8449 consensus_queue.cc:237] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:42.064096  8365 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.045807  8262 leader_election.cc:290] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:42.050684  8499 raft_consensus.cc:3055] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:41.954025  1659 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:42.011363  1619 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:02:42.055779  8518 consensus_queue.cc:1059] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.065s
I20260709 13:02:42.012459  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:42.009451  1443 catalog_manager.cc:5697] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:42.015997  1547 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:41.972633  8360 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:42.016841  1585 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:41.926043  8454 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:42.004735  8091 consensus_meta.cc:287] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.000s
I20260709 13:02:42.020779  8357 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:41.967116  2243 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 23 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:02:41.968879  8408 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:42.095036  1660 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:42.053020  1617 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:42.051926  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:42.043008  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927e42de9e944ae8a2d45f30be59d5df" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:42.110368  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 93617.6us
I20260709 13:02:42.118484  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:42.003963  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 723174us
I20260709 13:02:42.057482  2238 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 17.
I20260709 13:02:42.057013  2241 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 24.
I20260709 13:02:42.031726  8511 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:42.058159  1586 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:42.060319  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 182841us
I20260709 13:02:42.043885  8264 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:42.051678  8474 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:42.045018  8318 raft_consensus.cc:3055] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:02:42.083686  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 129731us
I20260709 13:02:42.082984  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:42.097882  1620 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
I20260709 13:02:42.108421  1443 catalog_manager.cc:5697] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 12 to 13, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:42.116354  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:42.116375  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:42.138921  1687 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21.
I20260709 13:02:42.080878  8506 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:42.117622  1615 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:42.034523  8430 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.039215  8423 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:42.083710  8496 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:02:42.134440  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 76389.9us
W20260709 13:02:42.086158  8469 consensus_meta.cc:287] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.000s
I20260709 13:02:42.138244  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:42.067409  8505 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:42.088260  8266 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:42.126019  1511 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:42.140630  1693 raft_consensus.cc:2393] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 18: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:42.084787  8518 raft_consensus.cc:3055] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:42.139570  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:42.078715  8499 raft_consensus.cc:740] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:42.138165  8236 consensus_queue.cc:1243] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer d7158d6c3b634dc7abb69eac58eba291 log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:02:42.143838  7854 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:42.144763  8514 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:42.144598  8498 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:42.123438  8353 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:42.123979  8357 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:42.143908  1443 catalog_manager.cc:5697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:42.140920  8376 consensus_queue.cc:1059] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:02:42.069381  8414 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.083523  8477 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:42.119902  8091 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.160480  1544 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21.
I20260709 13:02:42.160576  8264 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:42.067229  8365 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:42.120697  8454 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:42.013618  8450 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.176074  8474 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:42.177095  1587 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:42.180128  1690 raft_consensus.cc:1240] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:42.095263  8419 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:42.184772  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 58839.3us
I20260709 13:02:42.135496  8517 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:42.138839  8318 raft_consensus.cc:740] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:42.214998  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 75480.3us
I20260709 13:02:42.184156  8266 raft_consensus.cc:493] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.285532  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:42.185681  8518 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:42.288013  1689 raft_consensus.cc:1240] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
W20260709 13:02:42.279886  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 102855us
I20260709 13:02:42.261080  8523 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:42.216758  8093 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 13:02:42.282163  1540 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:42.183367  8469 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:42.279843  8454 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.282564  1511 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:42.297417  8419 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:42.284749  8429 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:42.284355  8499 consensus_queue.cc:260] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.299357  1614 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:42.287729  8266 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:42.274448  8522 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:42.320310  8511 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:42.320416  8522 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:42.320878  8522 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:42.322461  8449 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:42.324323  8521 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:42.325991  8357 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:42.262007  8333 consensus_queue.cc:1059] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 13:02:42.331219  8414 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:42.331993  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:42.334371  8477 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:42.334547  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7d1afbc98a49f3a48b32b8d2b9b646" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:42.335453  8430 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:42.336843  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:42.336889  8091 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:42.317189  8359 consensus_queue.cc:1059] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 13:02:42.341207  8359 raft_consensus.cc:3055] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:42.341591  8359 raft_consensus.cc:740] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:42.342502  8359 consensus_queue.cc:260] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.343607  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:42.319967  8474 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:42.314496  8318 consensus_queue.cc:260] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:42.344833  8318 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:42.314998  8429 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.345338  8429 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:42.343806  8359 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:42.280189  8236 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:42.351671  8236 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.354040  8236 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:42.357131  2239 raft_consensus.cc:3055] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:42.357456  2239 raft_consensus.cc:740] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:42.360060  1538 raft_consensus.cc:3060] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:42.360431  8469 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:42.269011  8514 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.362617  8514 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:42.359691  2239 consensus_queue.cc:260] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.363739  2239 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:42.364836  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:42.367575  1538 raft_consensus.cc:2468] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:42.368885  1443 catalog_manager.cc:5697] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 10 to 15, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:42.370234  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:42.371541  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:42.373311  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:42.373853  2243 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:42.355093  8532 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:02:42.375360  1614 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:42.315587  8454 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:42.379468  1511 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:42.381237  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:42.379673  1443 catalog_manager.cc:5697] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:42.382948  1443 catalog_manager.cc:5697] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 14 to 17, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:42.384181  2243 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:42.385900  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:42.380442  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:42.299367  8518 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.393982  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:42.389106  1586 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:42.402858  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:42.403388  1511 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:42.380875  8469 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:42.409389  1511 leader_election.cc:304] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:42.407670  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:42.384490  8474 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:42.421926  1511 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:42.408053  8091 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:42.428751  1511 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:42.417232  8414 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:42.452075  8266 raft_consensus.cc:515] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:42.426733  8449 raft_consensus.cc:2749] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:42.428333  8511 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:42.407667  8450 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:42.469199  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45660 (request call id 2649) took 1233 ms. Trace:
W20260709 13:02:42.472986  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 44330.1us
I20260709 13:02:42.469751  1691 rpcz_store.cc:276] 0709 13:02:41.235621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.236021 (+   400us) service_pool.cc:224] Handling call
0709 13:02:41.236366 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:41.899351 (+662985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.468918 (+569567us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54002c5954. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172be01 00007fc49172a83e 00007fc4966ef419 00007fc48fc66bd4 00007fc48fc66b62 00007fc48fc66a91 00007fc48fc66a0c 00007fc48fc65cc2 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:42.469125 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1511509248}
W20260709 13:02:42.451387  8524 log.cc:927] Time spent T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.168s	user 0.000s	sys 0.002s
I20260709 13:02:42.417976  8469 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:42.477942  1443 catalog_manager.cc:5697] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:42.479117  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:42.426321  8474 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:42.482558  1443 catalog_manager.cc:5697] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 15 to 18, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:42.468643  8264 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:42.429827  8091 raft_consensus.cc:697] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:42.491122  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:42.493067  8266 leader_election.cc:290] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:42.489498  8370 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.495512  2210 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:42.496863  8374 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:42.499899  8531 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:02:42.519593  2210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.531881  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 3048) took 1069 ms. Trace:
I20260709 13:02:42.538280  1443 catalog_manager.cc:5697] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:42.539764  1443 catalog_manager.cc:5697] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:42.538388  2210 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:42.537145  1620 rpcz_store.cc:276] 0709 13:02:41.462155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.462313 (+   158us) service_pool.cc:224] Handling call
0709 13:02:42.499495 (+1037182us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b54003205d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:42.531821 (+ 32326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1396363648}
I20260709 13:02:42.483209  8469 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:42.489100  8474 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:42.541992  8370 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:42.553308  8370 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:42.555094  8487 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.555675  8487 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.558166  8487 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:42.560132  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:42.560791  1615 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
I20260709 13:02:42.563987  2210 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:42.564777  8374 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:42.565155  8374 raft_consensus.cc:493] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.565486  8374 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:42.569761  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 451358us
I20260709 13:02:42.571364  1585 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:42.573446  8093 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:42.573792  8530 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.290s	user 0.002s	sys 0.000s
I20260709 13:02:42.574342  8374 raft_consensus.cc:515] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.577231  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:42.577803  1615 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:42.579456  8511 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:42.582028  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:42.583180  8481 raft_consensus.cc:2749] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:42.585528  1615 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
I20260709 13:02:42.587056  2210 leader_election.cc:304] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:42.587342  1511 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:42.588893  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:42.589901  1543 raft_consensus.cc:2368] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18.
I20260709 13:02:42.591125  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:42.598547  8511 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:42.599105  8511 raft_consensus.cc:697] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:42.599414  8498 consensus_queue.cc:1059] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:42.600272  8498 raft_consensus.cc:3055] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:42.599995  8511 consensus_queue.cc:237] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:42.600620  8498 raft_consensus.cc:740] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:42.601462  8498 consensus_queue.cc:260] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.601842  1587 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:42.602586  8498 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:42.544832  8473 raft_consensus.cc:2749] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:42.622453  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:42.607798  8333 raft_consensus.cc:2804] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:42.630201  8474 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.622300  8318 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:42.642575  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:42.643587  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:42.644030  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:42.646248  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:42.654393  1618 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:42.646662  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:42.649381  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:42.659837  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:42.666289  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3bc16a73cd42baba8ebfcbf2a0e93b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:42.668258  1621 raft_consensus.cc:2368] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 17. Current term is 18.
W20260709 13:02:42.671736  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.671623  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:42.649695  8374 leader_election.cc:290] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:42.661530  8333 raft_consensus.cc:697] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:42.683120  8333 consensus_queue.cc:237] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.687721  1585 leader_election.cc:400] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18.
I20260709 13:02:42.626844  8419 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:02:42.688046  1585 leader_election.cc:403] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:02:42.688649  8318 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18.
I20260709 13:02:42.648351  8474 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:42.697697  2241 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
I20260709 13:02:42.700832  2239 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:42.686702  2245 raft_consensus.cc:2955] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 10 to 16, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:42.704520  1618 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 22.
I20260709 13:02:42.624737  8091 consensus_queue.cc:237] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.670115  8454 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:42.710387  8356 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:02:42.727617  8522 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.737723  8522 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:42.765863   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:42.777868  2238 raft_consensus.cc:1240] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:42.729285  8429 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:42.788719  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:42.790066  1620 raft_consensus.cc:2368] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 21. Current term is 22.
I20260709 13:02:42.790669  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39612 (request call id 3427) took 1365 ms. Trace:
I20260709 13:02:42.791282  1538 rpcz_store.cc:276] 0709 13:02:41.424867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.435876 (+ 11009us) service_pool.cc:224] Handling call
0709 13:02:42.790104 (+1354228us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b54002fb2d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:42.790418 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2060894592}
I20260709 13:02:42.797391  8454 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:42.798177  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 126459us
I20260709 13:02:42.798671  8449 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:42.811594  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:42.813987  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.820736  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:42.821648  2246 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:42.828372  8545 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:02:42.831784  8544 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:02:42.838255  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:42.839416  1541 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:42.845656  8424 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.846679  8424 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.849542  8423 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:42.850778  8424 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:42.852451  8481 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.853358  8481 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.855286  1619 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:42.856884  1511 leader_election.cc:304] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:42.843438  8429 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:42.864049  8449 raft_consensus.cc:2749] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:42.867012  8481 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:42.873387  8510 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.192s	user 0.002s	sys 0.000s
I20260709 13:02:42.885062  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:42.889225  8429 consensus_queue.cc:1059] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:42.891321  1545 raft_consensus.cc:2955] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 4 to 11, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:42.895779  8344 raft_consensus.cc:2955] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 4 to 11, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:42.898983  8517 raft_consensus.cc:2955] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index 10 to 16, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:42.901618  2239 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:02:42.908196  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:42.909060  2241 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 15.
I20260709 13:02:42.909511  8499 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:42.910290  2246 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:42.892822  8458 raft_consensus.cc:3055] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:42.918738  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40022 (request call id 3051) took 1326 ms. Trace:
I20260709 13:02:42.919466  1586 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:42.919431  8390 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:02:42.870816  8539 log.cc:927] Time spent T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.141s	user 0.002s	sys 0.000s
I20260709 13:02:42.922302  8458 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:42.922547  1614 rpcz_store.cc:276] 0709 13:02:41.592108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.592224 (+   116us) service_pool.cc:224] Handling call
0709 13:02:42.918355 (+1326131us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b540033c054. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49172f2fa 00007fc4966f0b17 00007fc48fc6b6d4 00007fc48fc6b662 00007fc48fc6b591 00007fc48fc6b50c 00007fc48fc6a7c2 00007fc48fa6648c 00007fc48fa658c6 00007fc48fa6526f
0709 13:02:42.918534 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1514882304}
I20260709 13:02:42.932327  8372 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:42.936666  8372 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.937101  8372 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:42.928485  1586 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:02:42.942637  2211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.944310  1547 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:42.947788  1660 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:42.948720  8278 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:42.949718  8278 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.950426  1538 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:42.948745  1689 raft_consensus.cc:1240] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:02:42.959978  1541 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 22.
I20260709 13:02:42.964655  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:42.965718  1688 raft_consensus.cc:2368] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18.
I20260709 13:02:42.969473  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:42.975628  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:42.975979  8278 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:42.976398  1689 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:42.977636  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:42.978920  8408 raft_consensus.cc:2804] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:42.979485  8408 raft_consensus.cc:697] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:42.980665  8408 consensus_queue.cc:237] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:42.984236  8438 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:42.984956  8438 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:42.966754  8266 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
W20260709 13:02:43.001161  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:43.005949  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 149323us
I20260709 13:02:43.008052  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:43.008584  1511 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:43.008998  1694 raft_consensus.cc:3060] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:43.017947  8430 raft_consensus.cc:2804] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:43.018923  8518 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:43.019902  1695 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:02:43.031054  8266 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:43.034026  8266 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:43.024359  8278 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:43.034793  8278 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:43.035995  8458 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:43.037458  8278 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:43.037647  8458 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:43.046612  8481 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:43.048986  1511 leader_election.cc:400] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 21. Current term is 22.
I20260709 13:02:43.049247  8481 raft_consensus.cc:697] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 22 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:43.050693  8481 consensus_queue.cc:237] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:43.052501  8413 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:43.049413  1511 leader_election.cc:403] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:02:43.055596  8413 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:43.056555  1659 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:43.057897  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:43.058636  1696 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 14.
I20260709 13:02:43.059408  8438 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:43.059875  8257 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:43.061146  8223 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:43.062163  8372 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:43.063325  8449 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:43.064081  8149 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:02:43.065312  8149 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:43.065708  8149 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:43.034720  8469 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:43.068534  1539 raft_consensus.cc:3060] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:43.048990  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:43.081873  1689 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:43.085942  1511 leader_election.cc:400] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 17. Current term is 18.
I20260709 13:02:43.086364  1511 leader_election.cc:403] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:02:43.086814  8372 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:43.087218  1511 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:43.090266  8450 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 21. Current term is 22.
I20260709 13:02:43.091153  8450 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 17. Current term is 18.
I20260709 13:02:43.027755  8430 raft_consensus.cc:697] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:43.092062  8450 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:43.092689  8450 raft_consensus.cc:697] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:43.093686  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:43.094321  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:43.095626  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:43.096369  1547 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:43.098542  1694 raft_consensus.cc:2468] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 22.
I20260709 13:02:43.098939  1539 raft_consensus.cc:2468] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:43.093700  8450 consensus_queue.cc:237] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:43.092913  8430 consensus_queue.cc:237] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:43.066843  8149 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:43.103360  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:43.059170  8413 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:43.072777  8469 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:43.112303  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:43.120409  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:43.125006  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:43.121714  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:43.126045  2239 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:43.127532  2238 raft_consensus.cc:2368] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 17. Current term is 18.
W20260709 13:02:43.129254  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.167477  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:43.168497  1538 raft_consensus.cc:2393] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 20: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:43.168548  8149 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:43.162986  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 215476us
I20260709 13:02:43.176401  1545 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:43.184650  1547 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:02:43.188242  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:43.189671  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.177933  8344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:37990 (request call id 3) took 4800 ms. Trace:
I20260709 13:02:43.190762  8344 rpcz_store.cc:276] 0709 13:02:38.377195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.379215 (+  2020us) service_pool.cc:224] Handling call
0709 13:02:39.203838 (+824623us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b1800403980. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc49176673d 00007fc491731f3f 00007fc4917316b3 00007fc4917299fa 00007fc4966f14c9 00007fc48fc6dc54 00007fc48fc6dbe2 00007fc48fc6db11 00007fc48fc6da8c 00007fc48fc6cd42
0709 13:02:39.766363 (+562525us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b58008c0cd0. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491694571 00007fc4916870aa 00007fc491709447 00007fc49172670a 00007fc49172776a 00007fc49172691b 00007fc49173203c 00007fc4917316b3 00007fc4917299fa 00007fc4966f14c9 00007fc48fc6dc54
0709 13:02:39.940375 (+174012us) log.cc:844] Serialized 501 byte log entry
0709 13:02:40.931224 (+990849us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:41.131446 (+200222us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b180049ca20. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc497506de1 00007fc4975135b1 00007fc48e63e3f3 00007fc48e6407c1 00007fc48e640779 00007fc48e640709 00007fc48e6406d1 00007fc48e63f9cd 000000000038f354 000000000038f199 00007fc48e62183a
0709 13:02:43.177801 (+2046355us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":14772,"mutex_wait_us":31874,"raft.queue_time_us":7947,"raft.run_cpu_time_us":656,"raft.run_wall_time_us":658,"spinlock_wait_cycles":670676096,"thread_start_us":231355,"threads_started":1,"wal-append.queue_time_us":359516,"wal-append.run_cpu_time_us":15510,"wal-append.run_wall_time_us":1643873}
I20260709 13:02:43.196265  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5814bf31e900408885160ea0f89d6189 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
W20260709 13:02:43.206753  8549 log.cc:927] Time spent T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:02:43.205379  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:43.214437  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aca6dcf002947d6841150860825871b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:43.215286  1621 raft_consensus.cc:3060] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:43.215703  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:43.217530  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:43.220175  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:43.221506  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:43.223773  2243 raft_consensus.cc:1240] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:43.225543  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:43.226719  2242 raft_consensus.cc:2393] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 20: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:43.233920  2239 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:43.235486  1586 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:43.237495  8380 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:02:43.243729  8556 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:02:43.245183  1659 leader_election.cc:304] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:43.248010  8223 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:43.250145  8223 raft_consensus.cc:2804] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:43.250663  8223 raft_consensus.cc:697] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 21 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:43.255195  1585 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:43.259148  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:43.258883  2241 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:43.265563  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:43.266933  1689 raft_consensus.cc:2368] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 21. Current term is 22.
I20260709 13:02:43.260557  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:43.257066  1621 raft_consensus.cc:2468] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:02:43.261407  2243 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:43.261693  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:43.256259  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:43.243060  8380 raft_consensus.cc:697] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:43.279980  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:43.284293  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:43.306543  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:43.307578  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:43.307876  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:43.308175  1689 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
W20260709 13:02:43.308646  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 53638.5us
I20260709 13:02:43.312212  8419 raft_consensus.cc:2804] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:43.312749  8419 raft_consensus.cc:697] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:43.313745  8408 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:43.313711  8419 consensus_queue.cc:237] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:43.316023  8380 consensus_queue.cc:237] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:43.318311  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:43.319067  1618 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:43.332163  8262 consensus_queue.cc:1059] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:43.333244  8262 raft_consensus.cc:3055] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:02:43.332748  8223 consensus_queue.cc:237] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:43.333580  2240 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:43.333642  8262 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:02:43.335743  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.336905  8262 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:43.341244  1587 leader_election.cc:400] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 17. Current term is 18.
I20260709 13:02:43.343429  8458 consensus_queue.cc:1059] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:43.344349  8262 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:43.344924  8383 raft_consensus.cc:3055] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:43.346921  8383 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:43.347491  8548 log.cc:927] Time spent T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.157s	user 0.003s	sys 0.000s
I20260709 13:02:43.348042  8383 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:43.349921  8383 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:43.342909  1587 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:43.350006  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.366446  1512 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:43.367029  1622 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:02:43.369621  8523 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:43.374229  8344 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:43.375645  1660 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:43.380124  1512 leader_election.cc:400] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 21. Current term is 22.
I20260709 13:02:43.382370  1512 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:43.383304  8499 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:43.388820  8408 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:43.390089  1688 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:02:43.389999  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 47228.8us
I20260709 13:02:43.391360  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:43.392084  1690 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:43.393110  1689 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:43.393322  1587 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:43.394477  8317 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:02:43.396157  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 45593.5us
I20260709 13:02:43.398025  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c528a0f6bdb44c4187c750d0b1429ba1" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:43.399669  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:43.401018  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:43.401731  1694 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
I20260709 13:02:43.402662  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:43.406040  8408 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:02:43.411515  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:43.412159  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:43.412218  1693 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:43.394081  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13edebc31dfe4957b3870b909ea5330e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:43.417649  1689 raft_consensus.cc:3060] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:43.419451  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:43.423544  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 287021us
I20260709 13:02:43.427726  8449 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:43.429607  1511 leader_election.cc:400] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 17. Current term is 18.
I20260709 13:02:43.434746  1511 leader_election.cc:403] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:02:43.384490  1660 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:43.439800  1689 raft_consensus.cc:2468] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
I20260709 13:02:43.442248  1693 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:43.445595  1691 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 21.
I20260709 13:02:43.441285  1511 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:43.447386  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:43.507109  1696 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 17. Current term is 18. Ops: [16.14-17.15]
W20260709 13:02:43.505252  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 64026.3us
W20260709 13:02:43.515121  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 130741us
I20260709 13:02:43.526794  1687 raft_consensus.cc:2368] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 23. Current term is 24.
I20260709 13:02:43.439687  8449 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:43.446694  8149 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:43.543300  1660 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:43.548090  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:43.451632  8481 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 17. Current term is 18.
I20260709 13:02:43.553556  1694 raft_consensus.cc:1275] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:02:43.553812  1660 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:43.545914  1618 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:43.514870  8469 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:43.555413  8413 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:43.577809  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:43.579034  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 196768us
I20260709 13:02:43.539732  8449 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:43.585110  1693 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 18. Current term is 19. Ops: []
W20260709 13:02:43.586553  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.563274  8430 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:43.572852  8469 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:43.600059  1620 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:02:43.605548  1660 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:43.600637  1620 pending_rounds.cc:85] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting all ops after (but not including) 9
I20260709 13:02:43.585109  8449 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:43.577252  8257 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:02:43.622411  1690 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 22.
W20260709 13:02:43.624536  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.626099  1545 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:43.609310  1620 pending_rounds.cc:107] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:02:43.628098  1620 raft_consensus.cc:2889] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:43.604507  8469 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:43.636785  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.609841  8149 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:02:43.650116  1688 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15.
I20260709 13:02:43.658093  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:43.658756  2241 raft_consensus.cc:2376] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20. Re-sending same reply.
I20260709 13:02:43.622413  8419 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:43.667275  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:43.668035  1690 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:02:43.668650  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:43.683877  1695 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:43.654348  8278 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:43.692257  8550 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.692893  8550 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:43.693295  8521 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:43.693859  8521 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:43.672533  8262 raft_consensus.cc:493] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:43.699761  8262 raft_consensus.cc:515] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:43.701713  8262 leader_election.cc:290] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:43.680542  8419 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:43.706254  8419 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:43.713086  8430 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:43.687290  1689 raft_consensus.cc:2955] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 10 to 16, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:43.713786  1692 raft_consensus.cc:1240] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:43.714115  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:43.714954  1687 raft_consensus.cc:2393] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 15: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:43.720077  1620 raft_consensus.cc:1275] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:02:43.721771  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:43.722959  8521 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:43.724542  8469 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:43.726686  1587 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:02:43.733353  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 127947us
I20260709 13:02:43.736029  1511 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:43.735226  1690 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 16.
I20260709 13:02:43.741402  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:43.742249  1545 raft_consensus.cc:2393] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 21: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:43.679857  1546 raft_consensus.cc:2955] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 10 to 16, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:43.732939  8424 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:43.732388  8550 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:43.763470  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:43.784000  2246 raft_consensus.cc:2393] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 15: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:43.790352  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:43.792039  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:43.794272  8568 log.cc:927] Time spent T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.106s	user 0.001s	sys 0.002s
W20260709 13:02:43.794898  8567 log.cc:927] Time spent T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 13:02:43.796211  8571 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:02:43.796819  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 69587.9us
I20260709 13:02:43.797715  2238 raft_consensus.cc:1275] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:43.799403  8481 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:43.801452  8481 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:43.829391  8449 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:43.835309  8430 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:43.835389  8576 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.838090  8576 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:43.839025  8223 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:02:43.845201  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 55423.7us
I20260709 13:02:43.852340  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:43.862097  8576 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:43.876313  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 46414.5us
I20260709 13:02:43.879889  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:43.880714  1693 raft_consensus.cc:2393] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 21: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
W20260709 13:02:43.882751  2211 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:34459 timed out after 1.522s (SENT) [suppressed 7 similar messages]
I20260709 13:02:43.882994  1616 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:43.757126  8419 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
I20260709 13:02:43.887720  8511 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:43.891592  1512 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:43.893847  8474 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:43.894202  8223 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:43.899677  8503 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:43.899377  8429 consensus_queue.cc:1048] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:43.900393  8503 raft_consensus.cc:697] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:43.902093  8503 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:43.949637  1618 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:43.962291  8449 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:43.963408  8469 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:43.941591  8550 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.974332  8550 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:43.976958  8550 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:43.939379  8450 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:43.978955  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:43.988858  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9355ac91422346bb9f5dfa3c1424df25" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:43.996549  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.015403  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.022177  2238 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:02:43.968122  8511 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:02:44.030555  1618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:44.031533  1618 raft_consensus.cc:606] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:44.034183  1587 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:44.043767  1696 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:02:44.060463  1687 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:02:44.092852  1617 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:02:44.102471  8223 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:44.048292  8552 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:44.062515  8424 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:44.124756  8091 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:44.125228  8438 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:44.126833  8438 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:44.045377  8429 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 13:02:44.137836  1444 catalog_manager.cc:5697] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 18 to 20, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 20 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:44.139631  1444 catalog_manager.cc:5697] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 16 to 19, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 19 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:44.167004  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 275492us
W20260709 13:02:44.189347  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 306571us
I20260709 13:02:44.168641  1444 catalog_manager.cc:5697] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:44.191457  1444 catalog_manager.cc:5697] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 15 to 18, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 18 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.222121  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:44.231918  1444 catalog_manager.cc:5697] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:44.195199  8390 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:44.234360  1512 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:44.242121  1444 catalog_manager.cc:5697] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 17 to 19, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 19 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.255024  1444 catalog_manager.cc:5697] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 14 to 17, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 17 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.308246  1444 catalog_manager.cc:5697] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 13 to 16, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:44.242866  8372 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:44.346400  8503 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:44.347222  8503 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 21 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
W20260709 13:02:44.347767  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 118686us
I20260709 13:02:44.348680  1512 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:44.348428  8503 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:44.354457  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:44.355090  1613 raft_consensus.cc:606] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:44.355372  8223 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.355978  8223 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:44.358052  8223 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:44.355444  1613 raft_consensus.cc:614] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:44.409662  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 46039us
I20260709 13:02:44.412325  1444 catalog_manager.cc:5697] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 12 to 18, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 18 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.414153  1444 catalog_manager.cc:5697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 11 to 18. New cstate: current_term: 18 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:44.419484  1444 catalog_manager.cc:5697] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:44.426672  8449 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:44.433061  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:44.440691  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.446206  8587 log.cc:927] Time spent T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 13:02:44.452632  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 68185.3us
I20260709 13:02:44.459040  1512 leader_election.cc:304] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:44.248629  8390 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:44.409014  8372 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:44.473297  8586 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:02:44.504756  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
W20260709 13:02:44.493438  8588 log.cc:927] Time spent T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:02:44.511555  1659 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:44.510555  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 288593us
I20260709 13:02:44.525635  1695 raft_consensus.cc:1275] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:02:44.525192  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:44.506104  8523 raft_consensus.cc:2749] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:44.553974  2212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.506379  8550 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:44.461055  1444 catalog_manager.cc:5697] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 13 to 15, now has a pending config: VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195), VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193), VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 15 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:02:44.554172  8582 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:02:44.593686  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 92789.2us
I20260709 13:02:44.612432  8438 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.615314  8438 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:44.617580  8438 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:44.594065  8424 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:44.569248  8550 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:44.629449  1444 catalog_manager.cc:5697] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 9 to 12, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 12 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.613664  8592 raft_consensus.cc:476] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Not starting pre-election -- already a leader
W20260709 13:02:44.645218  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 74348.2us
I20260709 13:02:44.623477  8580 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:44.656807  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:44.644918  8591 log.cc:927] Time spent T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.130s	user 0.001s	sys 0.001s
I20260709 13:02:44.644556  8581 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:44.667407  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50480 (request call id 1249) took 1346 ms. Trace:
I20260709 13:02:44.651300  8469 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:44.672925  1691 rpcz_store.cc:276] 0709 13:02:43.313942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.508437 (+194495us) service_pool.cc:224] Handling call
0709 13:02:43.509189 (+   752us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.519864 (+ 10675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.519910 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:43.661741 (+141831us) log.cc:844] Serialized 501 byte log entry
0709 13:02:44.032532 (+370791us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:44.032589 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.032708 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.658672 (+625964us) raft_consensus.cc:1685] finished
0709 13:02:44.658695 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.660333 (+  1638us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":345336,"threads_started":1,"wal-append.queue_time_us":541949}
W20260709 13:02:44.684720  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 198596us
I20260709 13:02:44.687068  1543 raft_consensus.cc:1275] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:02:44.692430  1546 raft_consensus.cc:1240] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:44.676553  8578 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:02:44.714576  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 207550us
I20260709 13:02:44.686475  8469 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:44.704190  8449 raft_consensus.cc:697] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:44.714053  8390 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:44.742745  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:44.736019  8511 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.758093  1538 raft_consensus.cc:1240] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Rejecting Update request from peer 822e08445eae4a33b2f2fe92060192c6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:44.758280  2246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5814bf31e900408885160ea0f89d6189"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:55918
I20260709 13:02:44.758890  2246 raft_consensus.cc:606] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:44.759958  1545 raft_consensus.cc:1275] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:02:44.760857  1690 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:02:44.761229  8605 log.cc:927] Time spent T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:02:44.762194  8449 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:44.765484  8603 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:02:44.769836  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
W20260709 13:02:44.770568  8594 log.cc:927] Time spent T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.212s	user 0.000s	sys 0.002s
I20260709 13:02:44.775785  8469 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:02:44.776567  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 61458.9us
I20260709 13:02:44.778278  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:44.761233  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:44.779044  1688 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21.
I20260709 13:02:44.784663  1688 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:44.795761  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:44.796711  1619 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 22.
W20260709 13:02:44.790180  8600 log.cc:927] Time spent T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:02:44.800909  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:44.819557  8595 log.cc:927] Time spent T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:02:44.808350  1587 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:44.825114  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:44.790719  8511 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:44.863535  1695 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 25: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:44.832906  8424 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:02:44.884781  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 107139us
I20260709 13:02:44.893764  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:44.894631  1546 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 25.
I20260709 13:02:44.868033  8550 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:44.888765  8424 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.882928  8450 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:02:44.905788  1542 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:44.911339  8612 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:44.911854  8612 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:44.912204  8612 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:44.912319  8223 consensus_queue.cc:1059] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:44.887811  8578 consensus_queue.cc:1059] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:02:44.915692  8518 raft_consensus.cc:3055] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:44.916069  8518 raft_consensus.cc:740] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:44.916878  8518 consensus_queue.cc:260] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:44.919777  8602 log.cc:927] Time spent T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:02:44.923629  8511 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:44.891994  8607 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:02:44.866662  8613 consensus_queue.cc:1048] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:02:44.929493  8581 raft_consensus.cc:3055] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:44.929919  8581 raft_consensus.cc:740] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:44.933544  1444 catalog_manager.cc:5697] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 15 to 17, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:44.934945  1444 catalog_manager.cc:5697] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 10 to 13, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 13 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.936424  1444 catalog_manager.cc:5697] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 20 to 23, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 23 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:44.939204  1444 catalog_manager.cc:5697] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.941844  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:44.942653  1694 raft_consensus.cc:2393] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 18: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:02:44.946676  8601 log.cc:927] Time spent T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.335s	user 0.002s	sys 0.000s
I20260709 13:02:44.904340  8424 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:44.958307  8380 raft_consensus.cc:993] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:44.958254  8458 consensus_queue.cc:1048] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:02:44.959069  8590 log.cc:927] Time spent T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.262s	user 0.001s	sys 0.001s
I20260709 13:02:44.959280  8437 raft_consensus.cc:1081] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:44.973381  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:44.960733  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40022 (request call id 3084) took 1123 ms. Trace:
I20260709 13:02:44.975378  1585 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:44.975291  1620 rpcz_store.cc:276] 0709 13:02:43.837199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.841733 (+  4534us) service_pool.cc:224] Handling call
0709 13:02:43.842138 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.842793 (+   655us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:43.872831 (+ 30038us) log.cc:844] Serialized 14 byte log entry
0709 13:02:44.171670 (+298839us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.173479 (+  1809us) log.cc:844] Serialized 26 byte log entry
0709 13:02:44.173606 (+   127us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:44.173634 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.173700 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.958527 (+784827us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b4400022b4c. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc48e4c6db1 00007fc48e564c85 00007fc48e5656a2 00007fc4912d71db 00007fc4912d2aaf 00007fc4912c686e 00007fc4912c5bb6 00007fc4912c57d8 00007fc4912cf221 00007fc4912cf1d9 00007fc4912cf169
0709 13:02:44.960429 (+  1902us) raft_consensus.cc:1685] finished
0709 13:02:44.960532 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.960652 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22027,"prepare.queue_time_us":30044,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":43871,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":30330,"spinlock_wait_cycles":16535296,"thread_start_us":257847,"threads_started":1,"wal-append.queue_time_us":774870}
W20260709 13:02:44.979607  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 190352us
W20260709 13:02:44.993510  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 100053us
W20260709 13:02:45.005999  2209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.025270  2211 leader_election.cc:400] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 23 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 23. Current term is 24.
I20260709 13:02:45.025794  2211 leader_election.cc:403] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:02:44.930749  8581 consensus_queue.cc:260] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.012838  8438 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:45.012320  8278 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:45.070286  8438 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:02:45.087025  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 204984us
I20260709 13:02:45.044546  1546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39628
W20260709 13:02:45.086447  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 196051us
I20260709 13:02:45.091718  1546 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:45.092247  1546 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:45.073083  8511 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.088436  8581 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:45.094884  8438 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:02:45.140530  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 132290us
I20260709 13:02:45.088109  8278 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:45.147351  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 247365us
I20260709 13:02:45.148713  1546 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.133744  8592 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:45.123019  8580 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 23. Current term is 24.
I20260709 13:02:45.109313  8511 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:45.161463  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:45.164585  2239 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 22.
I20260709 13:02:45.170137  8278 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:45.177141  8625 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:45.155743  8645 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.179579  8645 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:45.182049  8645 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:45.155296  8644 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.160404  8413 consensus_queue.cc:1048] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:02:45.183068  8644 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.185683  8644 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:45.151114  8639 raft_consensus.cc:493] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:45.187132  8424 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:45.220736  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 128230us
I20260709 13:02:45.222095  1659 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:02:45.177132  8626 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:02:45.187790  8639 raft_consensus.cc:515] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.172734  8372 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:45.233950  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:45.236218  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 45875us
I20260709 13:02:45.245982  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:45.187683  8580 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:45.254200  1659 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:45.257543  1620 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:45.258104  8580 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.258654  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:45.260115  8481 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:45.261214  2242 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 22: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:45.264930  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00924ae4c66740e59de627a44de33c38" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:45.157616  8647 consensus_queue.cc:1048] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.104s
I20260709 13:02:45.270536  8449 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:45.162206  8592 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.254626  8278 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:45.277828  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:45.280550  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:45.281493  1693 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
W20260709 13:02:45.288233  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 132212us
I20260709 13:02:45.296430  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:45.298571  1546 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:45.299278  8632 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:45.302315  8631 raft_consensus.cc:493] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:45.303164  8631 raft_consensus.cc:515] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.270895  8481 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.310561  8481 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:45.310912  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.273147  8449 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.273066  8424 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:45.313213  8449 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:45.273993  8612 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.273695  8511 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:45.277088  8639 leader_election.cc:290] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:45.333912  8631 leader_election.cc:290] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:45.337793  2211 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:45.276301  8592 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:45.342047  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:45.342679  1616 raft_consensus.cc:3055] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:45.342752  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:45.343050  1616 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:45.344029  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:45.344372  1616 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.345667  2238 raft_consensus.cc:2393] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 22: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:02:45.344709  8618 consensus_queue.cc:1059] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:02:45.347740  1696 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:02:45.347911  1689 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:02:45.326222  1587 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:45.335918  8612 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:45.351503  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:45.351449  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:45.348686  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05911a041e044f48bce12648b58061be" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:45.349139  8640 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:02:45.354210  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:45.354305  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:45.354993  1694 raft_consensus.cc:2393] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 in current term 19: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:45.355172  1622 raft_consensus.cc:2368] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 22. Current term is 23.
I20260709 13:02:45.351555  8550 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.357398  8550 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.361295  8437 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:45.361529  8618 raft_consensus.cc:3055] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:45.361837  8437 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.361956  8618 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:45.362279  8437 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:45.362783  8413 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.362910  8618 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.363603  8413 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.364383  8618 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:45.366093  8413 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:45.368955  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:45.369607  8592 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:45.371414  8654 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:45.371059  8592 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.380108  8550 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:45.380460  8438 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:45.382997  8438 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 25 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:45.385936  8654 raft_consensus.cc:2749] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:45.387272  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:45.388500  1696 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:45.395020  2238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:45.395759  2238 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:02:45.394707  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca86ee366e14bdd8686ea8e5b48be10" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:45.397500  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:45.398182  8518 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:45.398135  2243 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:45.402078  1660 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:45.402552  8607 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:45.405552  8633 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:45.405946  8633 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.406270  8633 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:45.406730  8580 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:45.396463  8612 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.408372  8612 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:45.410604  8612 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:02:45.422111  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 9355ac91422346bb9f5dfa3c1424df25: Illegal state: Replica d7158d6c3b634dc7abb69eac58eba291 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:45.431425  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:45.432595  8450 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:02:45.433027  8629 raft_consensus.cc:993] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:45.433501  8629 raft_consensus.cc:1081] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:45.434623  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:45.435496  1687 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 25: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:02:45.441388  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:45.442028  1622 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 15.
I20260709 13:02:45.450615  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:45.453303  2240 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:45.454599  1616 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:45.386926  8437 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:45.472863  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
W20260709 13:02:45.474516  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 77410.4us
W20260709 13:02:45.471153  1443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42132 (request call id 244) took 15237 ms (client timeout 15000 ms). Trace:
I20260709 13:02:45.480490  1616 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:45.482998  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:45.483585  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03423b07f7be422db9d20b7313be1bab" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:45.486567  2240 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 23.
I20260709 13:02:45.486699  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:45.487730  1586 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:45.488921  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:45.489312  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:45.490036  1692 raft_consensus.cc:2376] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 15. Re-sending same reply.
I20260709 13:02:45.490132  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:45.490914  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:45.490447  1688 raft_consensus.cc:2955] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 4 to 11, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:45.492031  8278 raft_consensus.cc:493] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:45.489497  1689 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 18.
I20260709 13:02:45.492584  8278 raft_consensus.cc:515] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:45.495344  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.500952  1620 raft_consensus.cc:2410] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 26 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:02:45.495671  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:45.502769  1511 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:45.506943  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:45.482124  8592 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:45.508505  1511 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:45.521530  1511 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:45.508615  1688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5814bf31e900408885160ea0f89d6189"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:45.515522  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:45.522264  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:45.523648  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:45.525382  1539 raft_consensus.cc:2410] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 26 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:02:45.523339  1688 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:45.527025  1688 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:45.522778  1660 leader_election.cc:400] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 22. Current term is 23.
I20260709 13:02:45.528242  1660 leader_election.cc:403] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:02:45.500042  8091 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:45.494673  8278 leader_election.cc:290] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:45.538261  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:45.539961  1659 leader_election.cc:304] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:45.539034  8091 raft_consensus.cc:697] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:45.538298  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:45.543218  8091 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.552994  1659 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:45.554430  8640 raft_consensus.cc:2749] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:45.555078  8640 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:45.555656  8437 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:45.559458  8633 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.561221  1687 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:02:45.561748  8633 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:45.524609  8262 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:45.525079  8449 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:45.507992  8523 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:45.566401  1696 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 23.
I20260709 13:02:45.578895  2243 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
W20260709 13:02:45.575923  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 66195.8us
I20260709 13:02:45.590615  1660 leader_election.cc:304] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:45.595633  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:45.603204  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:45.597131  1511 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:45.604318  1694 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:45.603098  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:45.596247  1616 raft_consensus.cc:606] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:45.607411  1688 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.603209  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:45.613826  2241 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:45.618083  1688 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:45.619275  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:45.620090  2243 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:45.622171  2239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee97fe9eef14f818a1f9178885dfc31" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:45.623427  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:45.623592  8413 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:45.623970  8413 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.624035  2246 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:45.624245  2238 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:02:45.625777  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:45.626212  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:45.485539  1443 rpcz_store.cc:269] 0709 13:02:30.233521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.233690 (+   169us) service_pool.cc:224] Handling call
0709 13:02:45.470898 (+15237208us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:42.733800 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:42.734407 (+   607us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:42.734440 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:02:42.734451 (+    11us) tablet.cc:662] Decoding operations
0709 13:02:42.737894 (+  3443us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:42.737950 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:42.737976 (+    26us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:02:42.739750 (+  1774us) tablet.cc:701] Row locks acquired
0709 13:02:42.739769 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:02:42.739933 (+   164us) write_op.cc:270] Start()
0709 13:02:42.807227 (+ 67294us) write_op.cc:276] Timestamp: P: 1783602162739876 usec, L: 0
0709 13:02:42.807326 (+    99us) op_driver.cc:348] REPLICATION: starting
0709 13:02:42.808828 (+  1502us) log.cc:844] Serialized 7880 byte log entry
0709 13:02:43.300262 (+491434us) op_driver.cc:464] REPLICATION: finished
0709 13:02:43.643887 (+343625us) write_op.cc:301] APPLY: starting
0709 13:02:43.644028 (+   141us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:43.801466 (+157438us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:43.801607 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:43.889512 (+ 87905us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:43.889941 (+   429us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:02:43.890011 (+    70us) write_op.cc:312] APPLY: finished
0709 13:02:43.895702 (+  5691us) log.cc:844] Serialized 180 byte log entry
0709 13:02:43.899447 (+  3745us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:43.899782 (+   335us) write_op.cc:454] Released schema lock
0709 13:02:43.899877 (+    95us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:43.900390 (+   513us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:43.900430 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8840,"reported_tablets":50,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":343297,"apply.run_cpu_time_us":28473,"apply.run_wall_time_us":256489,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87887,"num_ops":20,"prepare.queue_time_us":163507,"prepare.run_cpu_time_us":17364,"prepare.run_wall_time_us":194706,"raft.queue_time_us":279182,"raft.run_cpu_time_us":6214,"raft.run_wall_time_us":147893,"replication_time_us":492728,"thread_start_us":600929,"threads_started":4,"wal-append.queue_time_us":200604,"wal-append.run_cpu_time_us":46835,"wal-append.run_wall_time_us":1889786}]]}
I20260709 13:02:45.624517  8503 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:45.577154  8523 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:02:45.589982  8633 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981) with higher term. Message: Invalid argument: T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 22. Current term is 23.
I20260709 13:02:45.644197  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:02:45.606213  8552 raft_consensus.cc:2749] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:45.618240  2240 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:02:45.633400  2211 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:45.637105  1511 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:45.640241  2243 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:45.649466  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:45.649742  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97fa1eb9d6548d3852cfed83b346e69" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:45.651211  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:45.651935  2241 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:45.624414  8413 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:45.657254  1511 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:45.631371  8638 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.643471  8523 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:45.662561  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:45.642355  8640 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:45.680882  1541 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 25.
I20260709 13:02:45.676165  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:45.681713  2240 raft_consensus.cc:3055] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:45.682176  2240 raft_consensus.cc:740] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:45.682997  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:45.683813  1616 raft_consensus.cc:606] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:45.684260  1616 raft_consensus.cc:614] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:45.676499  8608 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:45.676947  8469 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:45.649410  8503 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 19 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:45.683256  2240 consensus_queue.cc:260] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.709568  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:45.709864  2240 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:45.663496  8614 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:45.713280  1660 leader_election.cc:304] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:45.716118  1694 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:45.680001  8654 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:45.719849  1511 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6
W20260709 13:02:45.725077  8666 log.cc:927] Time spent T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:45.726681  2241 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 22.
I20260709 13:02:45.692642  8640 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.722844  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:45.729571  8640 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:45.731194  8091 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:45.732085  8091 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:45.736366  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 103031us
I20260709 13:02:45.737581  2211 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:45.738698  8503 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.740605  2240 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:45.720189  1587 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:45.745903  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:45.748183  2211 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:45.749971  2246 raft_consensus.cc:2393] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 18: Already voted for candidate d7158d6c3b634dc7abb69eac58eba291 in this term.
I20260709 13:02:45.692430  8450 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:45.718245  8593 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:45.669422  8638 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.741706  8550 raft_consensus.cc:2749] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:45.750837  8654 raft_consensus.cc:697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:45.752848  8437 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:45.775967  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:45.776660  1616 raft_consensus.cc:606] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:45.776891  8642 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:45.777367  8642 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.777706  8642 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:45.777031  1616 raft_consensus.cc:614] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:45.764744  8511 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:45.786257  8091 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:45.782356  8437 raft_consensus.cc:697] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:45.787762  8661 log.cc:927] Time spent T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:45.788369  8437 consensus_queue.cc:237] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:45.791715   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:45.793736   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:45.783686  8511 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:02:45.796463  8511 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:45.783334  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 63587.6us
I20260709 13:02:45.750412  8608 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:02:45.787372  8356 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:45.805583  8614 raft_consensus.cc:697] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:45.809582  8481 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.004s
I20260709 13:02:45.813278  8614 consensus_queue.cc:237] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:45.823972  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 5d987fd742df4898acd2aaa15097431c: Illegal state: Replica 822e08445eae4a33b2f2fe92060192c6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:45.836889  8654 consensus_queue.cc:237] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.837740  2246 raft_consensus.cc:1240] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:02:45.820169  8413 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:45.875020  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 103512us
I20260709 13:02:45.885982  8670 consensus_queue.cc:1059] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
I20260709 13:02:45.890007  8413 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:45.891306  8670 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:45.891786  8670 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:45.892726  8670 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:45.896116  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:45.896662  8523 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:45.898648  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:45.901034  2241 raft_consensus.cc:1813] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Handling vote request from an unknown peer dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:45.901538  2241 raft_consensus.cc:2393] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in current term 16: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
W20260709 13:02:45.902179  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 7803266de9984fac88726b08bee73921: Illegal state: Replica 822e08445eae4a33b2f2fe92060192c6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:45.905267  1512 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:45.907102  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a5febc6e54b13a4ed0d342e7b7f8f" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:45.907856  1617 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:45.917801  1659 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:45.923660  1547 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:45.926719  2242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:45.927439  2242 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:45.905126  8670 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:45.932708  2209 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:45.910802  8607 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:45.940266  8647 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:45.927449  8223 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:45.919739  8638 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:45.958273  1617 raft_consensus.cc:2468] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
W20260709 13:02:45.965785  8664 log.cc:927] Time spent T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.318s	user 0.004s	sys 0.000s
I20260709 13:02:45.967494  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:45.967737  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:45.969758  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:45.979815  1660 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:45.980890  1660 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:45.982239  1660 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:45.984401  1543 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:45.984879  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:46.002805  1543 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:02:46.004024  1659 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:46.006820  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:46.016319  1585 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:45.998231  8278 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:46.007560  8612 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:46.007823  8640 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:46.016048  8550 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:46.034008  8665 log.cc:927] Time spent T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.315s	user 0.003s	sys 0.000s
I20260709 13:02:46.036536  8318 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:46.039350  8511 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:46.045768  8278 raft_consensus.cc:697] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:46.046953  8278 consensus_queue.cc:237] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:46.047681  8612 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 22 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:46.048681  8612 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:46.052846  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:46.025692  8640 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.054524  8640 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:46.054709  1542 raft_consensus.cc:2410] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for term 22 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:02:46.070920  1660 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:46.071090  2245 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:02:46.072705  8523 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:46.073148  8638 raft_consensus.cc:2804] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:46.073717  8638 raft_consensus.cc:697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:46.076424  8318 raft_consensus.cc:993] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:46.076249  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:02:46.076910  8318 raft_consensus.cc:1081] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:46.091713  8429 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:46.074712  8638 consensus_queue.cc:237] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:46.105566  8642 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:46.107745  2243 raft_consensus.cc:1240] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:02:46.107874  8642 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:46.111004  8449 consensus_queue.cc:1059] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:46.111943  8449 raft_consensus.cc:3055] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:46.112277  8449 raft_consensus.cc:740] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:46.113088  8449 consensus_queue.cc:260] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:46.114362  8449 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:46.119918  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:46.120424  1587 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:46.126607  1693 raft_consensus.cc:2368] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19.
I20260709 13:02:46.130719  1512 leader_election.cc:400] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19.
I20260709 13:02:46.131361  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:46.133165  1512 leader_election.cc:403] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:02:46.133795  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:46.139948  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:46.137686  8429 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:46.137564  8450 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:46.151968  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 93517.4us
I20260709 13:02:46.105585  8640 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:46.144640  8511 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:46.160210  2243 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:46.153875  8550 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:46.162379  1511 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:46.171164  8640 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:46.173252  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:46.177592  1688 raft_consensus.cc:2368] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 19. Current term is 20.
I20260709 13:02:46.166872  1585 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:46.185798  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685ae4154c6d4c3abdaf18547da9ffe2" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:46.186362  2243 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:46.187152  1512 leader_election.cc:400] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 19. Current term is 20.
I20260709 13:02:46.178920  8614 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:46.196072  8645 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:02:46.202314  8645 raft_consensus.cc:697] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 25 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:46.203190  8645 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:46.213351  2243 raft_consensus.cc:2468] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:46.214809  1660 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:46.215901  8637 raft_consensus.cc:2804] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:46.216441  8637 raft_consensus.cc:697] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:46.217258  8637 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:46.196317  8614 raft_consensus.cc:697] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 19 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:46.224115  8614 consensus_queue.cc:237] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:46.226944  8450 raft_consensus.cc:2749] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) with higher term. Message: Invalid argument: T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d7158d6c3b634dc7abb69eac58eba291 for earlier term 18. Current term is 19.
I20260709 13:02:46.232183  1617 raft_consensus.cc:1240] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Rejecting Update request from peer e8a64798e5f94de8909707bcbd11804a for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:46.248979  1546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39628
I20260709 13:02:46.259688  1546 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:46.260260  1546 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:46.272063  1542 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:46.274567  1545 raft_consensus.cc:2410] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:02:46.258539  8429 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:46.287038  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:46.277312  8640 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.265635  8629 consensus_queue.cc:1059] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:02:46.300226  8640 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:46.305011  2245 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:02:46.330097  1693 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:46.329770  1546 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:46.336001  2209 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:46.338205  8438 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:02:46.349706  1687 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:02:46.351416  1546 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:46.353611  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:46.354190  1688 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:46.328923  8654 raft_consensus.cc:3055] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:46.358354  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
W20260709 13:02:46.361317  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 62711.1us
I20260709 13:02:46.361900  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:46.348906  8640 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:46.362685  1542 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:02:46.360069  8654 raft_consensus.cc:740] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:46.367287  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:46.367905  1622 raft_consensus.cc:3055] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:46.368594  1688 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
I20260709 13:02:46.330399  8670 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:02:46.360388  8578 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:46.368180  1622 raft_consensus.cc:740] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
W20260709 13:02:46.380427  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 4f5673bb37ab4e1b9ae5af2d2091b347: Illegal state: Replica dcc91bf6e3bd468bbbbfc26e3a7c5e01 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:46.374292  1622 consensus_queue.cc:260] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:46.383991  1622 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:46.368522  8318 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 13:02:46.391800  8654 consensus_queue.cc:260] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:46.393136  8654 raft_consensus.cc:3060] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:46.395398  2245 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:46.398610  8607 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:46.402105  1622 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
I20260709 13:02:46.428857  1659 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:46.412307  1511 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:46.434691  1696 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:46.370847  8458 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:02:46.435735  8593 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:46.463088  8612 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:46.478736  8612 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.481873  8593 raft_consensus.cc:697] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 17 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:46.497650  8612 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:46.535190  1614 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:46.539505  8413 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:02:46.555891  2243 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:02:46.560882  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 134651us
I20260709 13:02:46.566087  8637 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:46.540978  8593 consensus_queue.cc:237] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:46.583884  1622 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:02:46.587718  8607 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:46.593338  1444 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58806 (request call id 183) took 3525 ms. Trace:
I20260709 13:02:46.593763  1444 rpcz_store.cc:276] 0709 13:02:43.067934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.068232 (+   298us) service_pool.cc:224] Handling call
0709 13:02:46.593255 (+3525023us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:45.161900 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:45.188531 (+ 26631us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:45.188592 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:02:45.188632 (+    40us) tablet.cc:662] Decoding operations
0709 13:02:45.190341 (+  1709us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:45.190433 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:45.190473 (+    40us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:02:45.316241 (+125768us) tablet.cc:701] Row locks acquired
0709 13:02:45.316287 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:02:45.316492 (+   205us) write_op.cc:270] Start()
0709 13:02:45.316650 (+   158us) write_op.cc:276] Timestamp: P: 1783602165316415 usec, L: 0
0709 13:02:45.316675 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:02:45.337727 (+ 21052us) log.cc:844] Serialized 6975 byte log entry
0709 13:02:45.678483 (+340756us) op_driver.cc:464] REPLICATION: finished
0709 13:02:45.827554 (+149071us) write_op.cc:301] APPLY: starting
0709 13:02:45.827640 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:46.169645 (+342005us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:46.169758 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:46.249559 (+ 79801us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:46.250000 (+   441us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:02:46.250068 (+    68us) write_op.cc:312] APPLY: finished
0709 13:02:46.250576 (+   508us) log.cc:844] Serialized 156 byte log entry
0709 13:02:46.250845 (+   269us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:46.251060 (+   215us) write_op.cc:454] Released schema lock
0709 13:02:46.251142 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:46.284448 (+ 33306us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:46.290744 (+  6296us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":562560,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":139570,"apply.run_cpu_time_us":27103,"apply.run_wall_time_us":449846,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75323,"num_ops":17,"prepare.queue_time_us":183837,"prepare.run_cpu_time_us":38292,"prepare.run_wall_time_us":343200,"raft.queue_time_us":165283,"raft.run_cpu_time_us":23759,"raft.run_wall_time_us":79802,"replication_time_us":361655,"thread_start_us":471552,"threads_started":4,"wal-append.queue_time_us":168409}]]}
I20260709 13:02:46.619419  2245 raft_consensus.cc:1275] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:02:46.619840  2245 pending_rounds.cc:85] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: Aborting all ops after (but not including) 11
I20260709 13:02:46.620043  2245 pending_rounds.cc:107] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:02:46.620260  2245 raft_consensus.cc:2889] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:46.622344  8631 consensus_queue.cc:1048] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:46.623273  8612 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:46.628324  8612 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:46.628908  1542 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 17. (term mismatch)
I20260709 13:02:46.629357  1542 pending_rounds.cc:85] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 16
I20260709 13:02:46.629635  1542 pending_rounds.cc:107] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260709 13:02:46.629931  1542 raft_consensus.cc:2889] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:46.630350  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:46.633589  1542 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:02:46.604305  8694 log.cc:927] Time spent T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:02:46.655632  1445 catalog_manager.cc:5697] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:46.635196  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:46.659403  1542 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:46.662683  2241 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:02:46.659552  1445 catalog_manager.cc:5697] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 15 to 23, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 23 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.669477  8612 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:02:46.685580  8593 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:02:46.693343  1542 raft_consensus.cc:2468] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:02:46.675709  1445 catalog_manager.cc:5697] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.700917  1687 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:46.700909  1445 catalog_manager.cc:5697] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.706974  1659 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:46.708528  1546 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 25 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:02:46.697606  8631 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 13:02:46.699903  8223 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:02:46.711383  8631 raft_consensus.cc:2804] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:46.712044  8631 raft_consensus.cc:697] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 21 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:46.713394  2241 raft_consensus.cc:1240] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:46.715552  2246 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:02:46.722409  8637 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:46.719370  8614 consensus_queue.cc:1059] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:02:46.723773  8614 raft_consensus.cc:3055] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:46.724243  8614 raft_consensus.cc:740] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:46.725016  8614 consensus_queue.cc:260] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:46.726150  8614 raft_consensus.cc:3060] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:46.719604  8618 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:02:46.727694  8618 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:46.729799  8618 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:46.730806  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:46.731470  8523 consensus_queue.cc:1175] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "822e08445eae4a33b2f2fe92060192c6" responder_term: 20 status { last_received { term: 20 index: 15 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d7158d6c3b634dc7abb69eac58eba291 for earlier term 19. Current term is 20. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:46.736569  8380 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:46.715939  1445 catalog_manager.cc:5697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 12 to 14, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:46.746130  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3e3b7b46ab493c8eda918df77def64" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:46.746903  1545 raft_consensus.cc:2368] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 20. Current term is 21.
I20260709 13:02:46.748227  1445 catalog_manager.cc:5697] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 18 to 20, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.752326  8631 consensus_queue.cc:237] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:46.790601  1691 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:02:46.795099  2209 leader_election.cc:400] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 20. Current term is 21.
I20260709 13:02:46.795509  2209 leader_election.cc:403] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:46.806155   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:46.797715  8629 raft_consensus.cc:3060] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:02:46.821297  1445 catalog_manager.cc:5697] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 18 to 19, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.802127  8380 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:02:46.886812  1445 catalog_manager.cc:5697] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 11 to 16, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.933106  1445 catalog_manager.cc:5697] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 13 to 21, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 21 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.944232  1445 catalog_manager.cc:5697] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 13 to 20, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 20 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:46.952462  1445 catalog_manager.cc:5697] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 15 to 16, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 16 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:02:46.967175  8705 log.cc:927] Time spent T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:02:47.009289  8629 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871) with higher term. Message: Invalid argument: T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a for earlier term 20. Current term is 21.
I20260709 13:02:47.032570  1687 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:47.046392  1545 raft_consensus.cc:1275] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:02:47.046840  1545 pending_rounds.cc:85] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291: Aborting all ops after (but not including) 14
I20260709 13:02:47.047045  1545 pending_rounds.cc:107] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:02:47.047302  1545 raft_consensus.cc:2889] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:47.054236  8511 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:47.054772  8631 consensus_queue.cc:1048] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:47.091714  1614 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:47.093346  8614 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:47.255797  1444 catalog_manager.cc:5697] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 20 to 23, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 23 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:47.257361  1444 catalog_manager.cc:5697] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:47.258698  1444 catalog_manager.cc:5697] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 16 to 18, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:47.260875  1444 catalog_manager.cc:5697] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 14 to 16, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:47.272505  1444 catalog_manager.cc:5697] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:47.274055  1444 catalog_manager.cc:5697] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:47.275483  1444 catalog_manager.cc:5697] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 19 to 20, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 20 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:47.276831  1444 catalog_manager.cc:5697] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:47.293913  1445 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42122 (request call id 245) took 10916 ms. Trace:
I20260709 13:02:47.295176  1444 catalog_manager.cc:5697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 18 to 19, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:47.315986  1444 catalog_manager.cc:5697] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 17 to 18, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:47.317487  1444 catalog_manager.cc:5697] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 14 to 17, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:47.318827  1444 catalog_manager.cc:5697] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 19 to 20, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 20 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:47.320462  1444 catalog_manager.cc:5697] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:47.323791  1444 catalog_manager.cc:5697] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 10 to 16, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:47.327492  1444 catalog_manager.cc:5697] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 18 to 20, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 20 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:47.328914  1444 catalog_manager.cc:5697] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 4 to 11, term changed from 15 to 16, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195), VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted, no longer has a pending config: VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195), VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193), VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 16 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:47.324945  1445 rpcz_store.cc:276] 0709 13:02:36.377925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.378102 (+   177us) service_pool.cc:224] Handling call
0709 13:02:47.293835 (+10915733us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:47.083448 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:47.084041 (+   593us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:47.084082 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:02:47.084101 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:47.085148 (+  1047us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:47.085239 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:47.085271 (+    32us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:02:47.086285 (+  1014us) tablet.cc:701] Row locks acquired
0709 13:02:47.086306 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:02:47.086448 (+   142us) write_op.cc:270] Start()
0709 13:02:47.086553 (+   105us) write_op.cc:276] Timestamp: P: 1783602167086404 usec, L: 0
0709 13:02:47.086576 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:02:47.092868 (+  6292us) log.cc:844] Serialized 4412 byte log entry
0709 13:02:47.135953 (+ 43085us) op_driver.cc:464] REPLICATION: finished
0709 13:02:47.183402 (+ 47449us) write_op.cc:301] APPLY: starting
0709 13:02:47.183490 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:47.194925 (+ 11435us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:47.195034 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:47.210185 (+ 15151us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:47.210459 (+   274us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:02:47.210512 (+    53us) write_op.cc:312] APPLY: finished
0709 13:02:47.210868 (+   356us) log.cc:844] Serialized 105 byte log entry
0709 13:02:47.211052 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:47.211193 (+   141us) write_op.cc:454] Released schema lock
0709 13:02:47.211263 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:47.240123 (+ 28860us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:47.240156 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36211,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":47172,"apply.run_cpu_time_us":14255,"apply.run_wall_time_us":56656,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50195,"num_ops":11,"prepare.queue_time_us":119504,"prepare.run_cpu_time_us":4155,"prepare.run_wall_time_us":24099,"replication_time_us":49201,"thread_start_us":116156,"threads_started":2}]]}
I20260709 13:02:47.335969  2245 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:02:47.337484  8631 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:47.343866  1540 raft_consensus.cc:1275] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:02:47.345289  8631 consensus_queue.cc:1048] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:47.496263  8638 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:02:47.503114  8638 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:47.509294  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d7158d6c3b634dc7abb69eac58eba291" is_pre_election: true
I20260709 13:02:47.509656  8262 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.510196  8262 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:47.516018  1546 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:47.520340  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:47.521085  2245 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:02:47.522493  1511 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:47.523497  8614 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:47.524013  8614 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.524601  8614 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:47.527261  8262 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:47.578050  8614 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:47.667347  8614 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:02:47.670387  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 116278us
I20260709 13:02:47.676011  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:47.683749  2246 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:47.686709  1440 catalog_manager.cc:5697] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.688625  8638 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:47.690200  1440 catalog_manager.cc:5697] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:47.694496  2246 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
I20260709 13:02:47.663054  1444 catalog_manager.cc:5697] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 18 to 21, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:47.700011  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:02:47.700757  2245 raft_consensus.cc:2368] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 19. Current term is 20.
I20260709 13:02:47.703012  1660 leader_election.cc:400] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 19. Current term is 20.
I20260709 13:02:47.703409  1660 leader_election.cc:403] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:47.718972  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:47.711367  8638 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:02:47.723832  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:02:47.728813  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet e52504b3c7614b43be2a7cf1be42ad66: Illegal state: Replica dcc91bf6e3bd468bbbbfc26e3a7c5e01 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:47.740882  1614 consensus_queue.cc:237] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:47.746944  1440 catalog_manager.cc:5697] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 15 to 18, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:47.760288  1440 catalog_manager.cc:5697] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 13 to 16, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.790771  1511 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:47.791781  8262 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:47.792449  8262 raft_consensus.cc:697] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:47.793612  8262 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:47.820035  8638 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413) with higher term. Message: Invalid argument: T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 for earlier term 19. Current term is 20.
I20260709 13:02:47.844007  1696 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
W20260709 13:02:47.872612  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 137749us
W20260709 13:02:47.894656  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 139499us
W20260709 13:02:47.937168  1586 consensus_peers.cc:597] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b6f3b457deb4725b437c627cc3a5cd7. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:47.988052  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 77764.9us
I20260709 13:02:47.989558  1545 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:48.001968   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:48.018450  8691 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:48.029201  1442 catalog_manager.cc:5697] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:48.039578  1692 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:48.047909  1606 tablet_service.cc:1558] Processing DeleteTablet for tablet 5814bf31e900408885160ea0f89d6189 with delete_type TABLET_DATA_TOMBSTONED (TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:46476
I20260709 13:02:48.069643  8738 tablet_replica.cc:333] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:02:48.073989  8736 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:48.099809  8738 raft_consensus.cc:2243] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:48.100554  8738 raft_consensus.cc:2272] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:48.101234  8357 raft_consensus.cc:2955] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:48.103691  8738 ts_tablet_manager.cc:1916] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:48.118974  1545 raft_consensus.cc:2955] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
W20260709 13:02:48.123327  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 710dba62795546819d9b3fd89ad4e8fe: Illegal state: Replica 822e08445eae4a33b2f2fe92060192c6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
W20260709 13:02:48.124701  1440 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42122 (request call id 244) took 31957 ms (client timeout 15000 ms). Trace:
W20260709 13:02:48.132516  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 4f5673bb37ab4e1b9ae5af2d2091b347: Illegal state: Replica dcc91bf6e3bd468bbbbfc26e3a7c5e01 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:48.132480  1692 raft_consensus.cc:2955] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
W20260709 13:02:48.125159  1440 rpcz_store.cc:269] 0709 13:02:16.187357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.202920 (+ 15563us) service_pool.cc:224] Handling call
0709 13:02:48.124597 (+31921677us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:47.823996 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:47.824813 (+   817us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:47.824863 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:02:47.824887 (+    24us) tablet.cc:662] Decoding operations
0709 13:02:47.825772 (+   885us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:47.825849 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:47.825897 (+    48us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:02:47.826471 (+   574us) tablet.cc:701] Row locks acquired
0709 13:02:47.826493 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:02:47.826693 (+   200us) write_op.cc:270] Start()
0709 13:02:47.826835 (+   142us) write_op.cc:276] Timestamp: P: 1783602167826630 usec, L: 0
0709 13:02:47.826855 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:02:47.851741 (+ 24886us) log.cc:844] Serialized 1706 byte log entry
0709 13:02:47.853765 (+  2024us) op_driver.cc:464] REPLICATION: finished
0709 13:02:47.854279 (+   514us) write_op.cc:301] APPLY: starting
0709 13:02:47.854366 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:47.865641 (+ 11275us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:47.865745 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:47.868463 (+  2718us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:47.868646 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:02:47.868698 (+    52us) write_op.cc:312] APPLY: finished
0709 13:02:47.869200 (+   502us) log.cc:844] Serialized 49 byte log entry
0709 13:02:47.869373 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:47.869516 (+   143us) write_op.cc:454] Released schema lock
0709 13:02:47.869567 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:47.869910 (+   343us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:47.869948 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":60,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":305,"apply.run_cpu_time_us":6327,"apply.run_wall_time_us":15582,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16752,"num_ops":4,"prepare.queue_time_us":35429,"prepare.run_cpu_time_us":4202,"prepare.run_wall_time_us":28063,"replication_time_us":26779}]]}
I20260709 13:02:48.205999  8738 ts_tablet_manager.cc:1929] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 13:02:48.206487  1692 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:02:48.213603  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:48.213126  1439 catalog_manager.cc:5697] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:48.214217  1616 raft_consensus.cc:606] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:48.218254  1439 catalog_manager.cc:5697] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 14 to 22, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 22 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.220577  1439 catalog_manager.cc:5697] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 15 to 16, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.222389  8734 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:02:48.244551  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32470c2737744478bac199459790b787"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:48.245378  1620 raft_consensus.cc:606] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:48.248279  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:48.248924  1620 raft_consensus.cc:606] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:48.252228  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:48.253090  1620 raft_consensus.cc:606] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:48.206576  8738 log.cc:1199] T 5814bf31e900408885160ea0f89d6189 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root/wals/5814bf31e900408885160ea0f89d6189
I20260709 13:02:48.264660  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:48.266393  1439 catalog_manager.cc:5697] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:48.288522  1620 raft_consensus.cc:606] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:48.297888   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:02:48.298820  1442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42132 (request call id 243) took 40135 ms (client timeout 15000 ms). Trace:
I20260709 13:02:48.299835   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:48.265736  1430 catalog_manager.cc:5028] TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): tablet 5814bf31e900408885160ea0f89d6189 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
W20260709 13:02:48.299286  1442 rpcz_store.cc:269] 0709 13:02:08.163354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.163671 (+   317us) service_pool.cc:224] Handling call
0709 13:02:48.102577 (+39938906us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:48.102602 (+    25us) write_op.cc:454] Released schema lock
0709 13:02:48.298705 (+196103us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:48.093830 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:48.094323 (+   493us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:48.094369 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:02:48.094386 (+    17us) tablet.cc:662] Decoding operations
0709 13:02:48.094700 (+   314us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:48.094752 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:48.094776 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:48.094946 (+   170us) tablet.cc:701] Row locks acquired
0709 13:02:48.094962 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:02:48.095090 (+   128us) write_op.cc:270] Start()
0709 13:02:48.095202 (+   112us) write_op.cc:276] Timestamp: P: 1783602168095052 usec, L: 0
0709 13:02:48.095223 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:02:48.095873 (+   650us) log.cc:844] Serialized 541 byte log entry
0709 13:02:48.097761 (+  1888us) op_driver.cc:464] REPLICATION: finished
0709 13:02:48.098197 (+   436us) write_op.cc:301] APPLY: starting
0709 13:02:48.098264 (+    67us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:48.099039 (+   775us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:48.099173 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:48.099878 (+   705us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:48.100018 (+   140us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:02:48.100063 (+    45us) write_op.cc:312] APPLY: finished
0709 13:02:48.100244 (+   181us) log.cc:844] Serialized 25 byte log entry
0709 13:02:48.100421 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:48.100495 (+    74us) write_op.cc:454] Released schema lock
0709 13:02:48.100531 (+    36us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":2174892,"reported_tablets":50,"spinlock_wait_cycles":9472,"child_traces":[["op",{"apply.queue_time_us":246,"apply.run_cpu_time_us":2604,"apply.run_wall_time_us":2603,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4188,"num_ops":1,"prepare.queue_time_us":5314,"prepare.run_cpu_time_us":2302,"prepare.run_wall_time_us":2303,"replication_time_us":2402}]]}
I20260709 13:02:48.339919  2246 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:02:48.345971  8614 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:02:48.336087  1430 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 70352.5us
I20260709 13:02:48.502765  8728 raft_consensus.cc:993] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:48.504379  8728 raft_consensus.cc:1081] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:48.521592  1692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:45660
I20260709 13:02:48.522187  1692 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:48.522537  1692 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:48.550241  8743 ts_tablet_manager.cc:933] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:48.563669  1692 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:48.600189  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:48.600656  1692 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:48.600816  1620 raft_consensus.cc:3055] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:02:48.601154  1620 raft_consensus.cc:740] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:48.601927  1620 consensus_queue.cc:260] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:48.603001  1620 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:48.603410  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479456ab418d44c4983d2bb37eb0e700" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:48.603988  2245 raft_consensus.cc:3060] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:48.612197  1443 catalog_manager.cc:5697] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 16 to 18, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.614101  8736 raft_consensus.cc:993] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:48.614750  8726 raft_consensus.cc:1081] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:48.614130  1443 catalog_manager.cc:5697] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 14 to 18, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.624401  8743 tablet_copy_client.cc:323] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39981
I20260709 13:02:48.625451  1441 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 5814bf31e900408885160ea0f89d6189 with cas_config_opid_index 4: aborting the task: latest config opid_index 11; task opid_index 4
I20260709 13:02:48.626549  1632 tablet_copy_service.cc:140] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Received BeginTabletCopySession request for tablet 4b6f3b457deb4725b437c627cc3a5cd7 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50552)
I20260709 13:02:48.647644  1632 tablet_copy_service.cc:161] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Beginning new tablet copy session on tablet 4b6f3b457deb4725b437c627cc3a5cd7 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50552: session id = e8a64798e5f94de8909707bcbd11804a-4b6f3b457deb4725b437c627cc3a5cd7
W20260709 13:02:48.648095  1439 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42114 (request call id 274) took 16631 ms (client timeout 15000 ms). Trace:
I20260709 13:02:48.635829  8357 raft_consensus.cc:993] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:48.651700  2245 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 24.
I20260709 13:02:48.618232  1443 catalog_manager.cc:5697] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 19 to 20, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 20 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:48.652851  1546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32470c2737744478bac199459790b787"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39628
I20260709 13:02:48.653625  1546 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:48.652701  1660 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:48.654141  1546 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:48.654762  8640 raft_consensus.cc:2804] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:48.655326  8640 raft_consensus.cc:697] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 24 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:48.655714  8357 raft_consensus.cc:1081] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:48.656414  8640 consensus_queue.cc:237] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:48.653147  1443 catalog_manager.cc:5697] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:48.661898  1443 catalog_manager.cc:5697] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 20 to 23, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 23 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:48.664641  1692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:45660
I20260709 13:02:48.664861  1443 catalog_manager.cc:5697] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:48.665352  1692 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:48.666837  1692 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:48.667025  1443 catalog_manager.cc:5697] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:48.668413  1443 catalog_manager.cc:5697] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 17 to 18, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:48.669612  1443 catalog_manager.cc:5697] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 18 to 20, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 20 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.673216  1443 catalog_manager.cc:5697] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 19 to 21, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.674746  1443 catalog_manager.cc:5697] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 14 to 16, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:48.686178  1632 tablet_copy_source_session.cc:215] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:02:48.705462  1441 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42114 (request call id 273) took 33316 ms (client timeout 15000 ms). Trace:
W20260709 13:02:48.707177  1441 rpcz_store.cc:269] 0709 13:02:15.389489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.389759 (+   270us) service_pool.cc:224] Handling call
0709 13:02:48.705379 (+33315620us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41674,"reported_tablets":50}
I20260709 13:02:48.709149  1620 raft_consensus.cc:2468] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 24.
W20260709 13:02:48.648635  1439 rpcz_store.cc:269] 0709 13:02:32.016287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.016501 (+   214us) service_pool.cc:224] Handling call
0709 13:02:48.648007 (+16631506us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:48.367033 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:48.367673 (+   640us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:48.367710 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:02:48.367731 (+    21us) tablet.cc:662] Decoding operations
0709 13:02:48.368296 (+   565us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:48.368393 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:48.368427 (+    34us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:02:48.368853 (+   426us) tablet.cc:701] Row locks acquired
0709 13:02:48.368868 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:02:48.369005 (+   137us) write_op.cc:270] Start()
0709 13:02:48.369124 (+   119us) write_op.cc:276] Timestamp: P: 1783602168368961 usec, L: 0
0709 13:02:48.369149 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:02:48.369965 (+   816us) log.cc:844] Serialized 1706 byte log entry
0709 13:02:48.376888 (+  6923us) op_driver.cc:464] REPLICATION: finished
0709 13:02:48.381682 (+  4794us) write_op.cc:301] APPLY: starting
0709 13:02:48.381768 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:48.384164 (+  2396us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:48.384261 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:48.474122 (+ 89861us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:48.474362 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:02:48.474428 (+    66us) write_op.cc:312] APPLY: finished
0709 13:02:48.474723 (+   295us) log.cc:844] Serialized 49 byte log entry
0709 13:02:48.475786 (+  1063us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:48.475924 (+   138us) write_op.cc:454] Released schema lock
0709 13:02:48.475984 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:48.478240 (+  2256us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:48.478270 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":407407,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":1213,"apply.run_cpu_time_us":7836,"apply.run_wall_time_us":96505,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16752,"num_ops":4,"prepare.queue_time_us":114,"prepare.run_cpu_time_us":3208,"prepare.run_wall_time_us":5786,"replication_time_us":5794}]]}
I20260709 13:02:48.720745  1546 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:48.723311  1443 catalog_manager.cc:5697] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 20 to 23, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 23 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:48.726400  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:48.726876  1546 leader_election.cc:290] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:48.734869  2243 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:48.736361  1443 catalog_manager.cc:5697] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 18 to 21, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 21 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:48.737775  1443 catalog_manager.cc:5697] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 15 to 18, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.739794  1443 catalog_manager.cc:5697] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 16 to 17, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:48.741340  1692 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:48.741564  1443 catalog_manager.cc:5697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:48.746676  1443 catalog_manager.cc:5697] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 17 to 18, leader changed from e8a64798e5f94de8909707bcbd11804a (127.0.107.196) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:48.748754  1443 catalog_manager.cc:5697] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 10 to 13, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:48.750150  1443 catalog_manager.cc:5697] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:48.734841  8743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b6f3b457deb4725b437c627cc3a5cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:48.756525  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:48.757309  1620 raft_consensus.cc:3055] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:48.757664  1620 raft_consensus.cc:740] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:48.758783  1620 consensus_queue.cc:260] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:48.770733  1620 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:48.767333  1692 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:48.775766  8458 raft_consensus.cc:993] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:48.777601  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0db569e82e490f9de2c0a9300c24bf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:48.793491  2245 raft_consensus.cc:3060] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:48.753842  2243 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:48.786191  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:48.799314  1614 raft_consensus.cc:3055] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:48.799639  1614 raft_consensus.cc:740] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:48.800388  1614 consensus_queue.cc:260] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:48.801473  1614 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:48.792078  8458 raft_consensus.cc:1081] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:48.807193  1692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:45660
I20260709 13:02:48.807770  1692 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:48.808135  1692 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:48.817440  1511 leader_election.cc:304] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:48.818396  1614 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:48.818521  8734 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:48.823770  8734 raft_consensus.cc:697] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:48.825827  8734 consensus_queue.cc:237] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:48.821344  2245 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:48.839920  1660 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:48.840936  8637 raft_consensus.cc:2804] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:48.841428  8637 raft_consensus.cc:697] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:48.842198  1620 raft_consensus.cc:2468] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:48.844365  1692 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:48.842303  8637 consensus_queue.cc:237] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:48.867973  1692 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:48.869894  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:48.870090  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:48.870555  1620 raft_consensus.cc:3055] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:48.871025  1620 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:48.871623  1539 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:48.875689  1620 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:48.876562  8458 raft_consensus.cc:993] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:48.892457  1539 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:48.894598  1659 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:48.899801  1620 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:48.891130  8438 raft_consensus.cc:1081] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:48.908576  1620 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:02:48.902421  8638 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:48.941381  8638 raft_consensus.cc:697] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:48.942384  8638 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:48.924887  1441 catalog_manager.cc:5697] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:02:48.966081  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 68995.9us
I20260709 13:02:48.971884  1443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42132 (request call id 245) took 2759 ms. Trace:
I20260709 13:02:48.972396  1443 rpcz_store.cc:276] 0709 13:02:46.212228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.212366 (+   138us) service_pool.cc:224] Handling call
0709 13:02:48.971823 (+2759457us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:48.769576 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:48.770110 (+   534us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:48.770144 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:02:48.770156 (+    12us) tablet.cc:662] Decoding operations
0709 13:02:48.771753 (+  1597us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:48.771828 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:48.771865 (+    37us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:02:48.773318 (+  1453us) tablet.cc:701] Row locks acquired
0709 13:02:48.773339 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:02:48.773489 (+   150us) write_op.cc:270] Start()
0709 13:02:48.773613 (+   124us) write_op.cc:276] Timestamp: P: 1783602168773444 usec, L: 0
0709 13:02:48.773636 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:02:48.774335 (+   699us) log.cc:844] Serialized 7521 byte log entry
0709 13:02:48.777354 (+  3019us) op_driver.cc:464] REPLICATION: finished
0709 13:02:48.777635 (+   281us) write_op.cc:301] APPLY: starting
0709 13:02:48.777712 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:48.787959 (+ 10247us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:48.788064 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:48.913295 (+125231us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:48.913585 (+   290us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:02:48.913631 (+    46us) write_op.cc:312] APPLY: finished
0709 13:02:48.914031 (+   400us) log.cc:844] Serialized 172 byte log entry
0709 13:02:48.914207 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:48.914383 (+   176us) write_op.cc:454] Released schema lock
0709 13:02:48.914446 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:48.928266 (+ 13820us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:48.928300 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36603,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":103,"apply.run_cpu_time_us":22824,"apply.run_wall_time_us":150592,"cfile_cache_hit":76,"cfile_cache_hit_bytes":79572,"num_ops":19,"prepare.queue_time_us":109,"prepare.run_cpu_time_us":5025,"prepare.run_wall_time_us":7442,"replication_time_us":3607}]]}
I20260709 13:02:48.986495  8743 tablet_copy_client.cc:806] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:48.997711  1545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39628
I20260709 13:02:48.998310  1545 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:48.998667  1545 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:48.995452  8743 tablet_copy_client.cc:670] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:48.986569  1438 catalog_manager.cc:5697] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 22 to 25, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 25 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:49.014297  8743 tablet_copy_client.cc:538] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:02:49.029767  8755 log.cc:927] Time spent T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:02:49.014861  1438 catalog_manager.cc:5697] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 16 to 17, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.040823  1438 catalog_manager.cc:5697] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } }
I20260709 13:02:49.047812  2245 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:02:49.050161  8631 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:02:49.078729  1545 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:49.082728  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:49.083389  1620 raft_consensus.cc:3055] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:49.083735  1620 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:49.084554  1545 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:49.084506  1620 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:49.085726  1620 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:49.086649  8743 tablet_bootstrap.cc:492] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:02:49.093533  1620 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
I20260709 13:02:49.094357  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:49.094599  1511 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:49.094950  1696 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:49.096685  8753 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:49.097206  8753 raft_consensus.cc:697] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:49.098008  8753 consensus_queue.cc:237] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:49.116139  1696 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 20.
I20260709 13:02:49.152422  1443 catalog_manager.cc:5697] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 23 to 24, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 24 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:49.180876  1620 raft_consensus.cc:1275] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:02:49.184032  8638 consensus_queue.cc:1048] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
I20260709 13:02:49.230121  2245 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:49.231915  8734 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:49.292732  1620 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:49.295615  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42114 (request call id 275) took 2156 ms. Trace:
I20260709 13:02:49.305799  8637 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:49.323415  1620 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:49.323987   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:49.349128  1441 catalog_manager.cc:5697] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 16 to 17, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.359269  8753 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:49.363715  1443 catalog_manager.cc:5697] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 17 to 18, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:49.371847  1441 catalog_manager.cc:5697] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 16 to 17, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:49.384876  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 47668.8us
I20260709 13:02:49.395577  2246 raft_consensus.cc:1275] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:49.400118  1441 catalog_manager.cc:5697] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index -1 to 12, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 19 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:49.397152  8637 consensus_queue.cc:1048] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:02:49.296113  1438 rpcz_store.cc:276] 0709 13:02:47.139254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.139491 (+   237us) service_pool.cc:224] Handling call
0709 13:02:47.184555 (+ 45064us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b540016e4d4. stack: 00007fc48e60c343 00007fc48e60c240 00007fc48df9b1d4 00007fc497cd9304 00007fc497cd9299 00007fc491695090 00007fc491733f3a 00007fc4974ea1cc 00007fc4975e837e 00007fc495aa92a4 00007fc495aa9232 00007fc495aa9161 00007fc495aa90dc 00007fc495aa8392 00007fc48fa6648c 00007fc48fa658c6
0709 13:02:49.295532 (+2110977us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:49.124642 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:49.125288 (+   646us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:49.125335 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:02:49.125364 (+    29us) tablet.cc:662] Decoding operations
0709 13:02:49.126240 (+   876us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:49.126329 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:49.126385 (+    56us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:02:49.126874 (+   489us) tablet.cc:701] Row locks acquired
0709 13:02:49.126895 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:02:49.127050 (+   155us) write_op.cc:270] Start()
0709 13:02:49.127208 (+   158us) write_op.cc:276] Timestamp: P: 1783602169127003 usec, L: 0
0709 13:02:49.127265 (+    57us) op_driver.cc:348] REPLICATION: starting
0709 13:02:49.127925 (+   660us) log.cc:844] Serialized 1317 byte log entry
0709 13:02:49.134292 (+  6367us) op_driver.cc:464] REPLICATION: finished
0709 13:02:49.134776 (+   484us) write_op.cc:301] APPLY: starting
0709 13:02:49.134867 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:49.137139 (+  2272us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:49.137264 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:49.140116 (+  2852us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:49.140340 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:02:49.140413 (+    73us) write_op.cc:312] APPLY: finished
0709 13:02:49.140701 (+   288us) log.cc:844] Serialized 41 byte log entry
0709 13:02:49.145322 (+  4621us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:49.145417 (+    95us) write_op.cc:454] Released schema lock
0709 13:02:49.145463 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:49.151900 (+  6437us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:49.151936 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"spinlock_wait_cycles":73125632,"child_traces":[["op",{"apply.queue_time_us":260,"apply.run_cpu_time_us":6184,"apply.run_wall_time_us":17066,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12564,"num_ops":3,"prepare.queue_time_us":136,"prepare.run_cpu_time_us":3438,"prepare.run_wall_time_us":8413,"replication_time_us":6888,"spinlock_wait_cycles":34304}]]}
I20260709 13:02:49.435204  1617 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:49.444182  8637 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:49.455856  1445 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42122 (request call id 246) took 2048 ms. Trace:
I20260709 13:02:49.456430  1445 rpcz_store.cc:276] 0709 13:02:47.402056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.402691 (+   635us) service_pool.cc:224] Handling call
0709 13:02:49.449938 (+2047247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60817,"reported_tablets":36}
I20260709 13:02:49.490073  1614 consensus_queue.cc:237] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:49.505672  1545 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:49.537004  8732 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 13:02:49.611263  8660 log.cc:927] Time spent T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:49.697885  1692 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:02:49.744076  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 44809.2us
I20260709 13:02:49.750201  1614 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:49.754307  1540 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:02:49.766552  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 45637.9us
I20260709 13:02:49.767289  8765 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:49.769098  8765 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:49.794747  8743 tablet_bootstrap.cc:492] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:49.795975  8743 tablet_bootstrap.cc:492] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:02:49.796758  8743 ts_tablet_manager.cc:1403] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.710s	user 0.054s	sys 0.011s
W20260709 13:02:49.811554  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 47581us
I20260709 13:02:49.850828  2245 raft_consensus.cc:1275] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:02:49.859205  1445 catalog_manager.cc:5697] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 19 to 20, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 20 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:49.916882  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 52880.9us
W20260709 13:02:49.916882  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 56571.4us
W20260709 13:02:49.966435  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 116781us
W20260709 13:02:49.974089  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 53173.5us
W20260709 13:02:49.968540  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 77719.5us
I20260709 13:02:49.996193  8775 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:02:49.997169  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 129032us
I20260709 13:02:50.002462  8743 raft_consensus.cc:359] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:50.003412  8743 raft_consensus.cc:740] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:02:50.004154  8743 consensus_queue.cc:260] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:50.015998  8743 ts_tablet_manager.cc:1434] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.219s	user 0.006s	sys 0.004s
I20260709 13:02:50.057344  1632 tablet_copy_service.cc:342] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-4b6f3b457deb4725b437c627cc3a5cd7 received from {username='slave'} at 127.0.0.1:50552
I20260709 13:02:50.057955  1632 tablet_copy_service.cc:434] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-4b6f3b457deb4725b437c627cc3a5cd7 on tablet 4b6f3b457deb4725b437c627cc3a5cd7 with peer e8a64798e5f94de8909707bcbd11804a
W20260709 13:02:50.064654  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 88950.6us
I20260709 13:02:50.091393  8774 consensus_queue.cc:1048] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:02:50.066627  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 56778.9us
I20260709 13:02:50.129098  2241 raft_consensus.cc:1217] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 LEARNER]: Deduplicated request from leader. Original: 19.11->[19.12-19.12]   Dedup: 19.12->[]
I20260709 13:02:50.219892  8776 raft_consensus.cc:2955] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:50.238356  2240 raft_consensus.cc:2955] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:50.260625  1540 raft_consensus.cc:2955] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:50.275801  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5ee97fe9eef14f818a1f9178885dfc31 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:50.278834  1445 catalog_manager.cc:5697] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 16 to 17, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New cstate: current_term: 23 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:50.300650  1684 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ee97fe9eef14f818a1f9178885dfc31 with delete_type TABLET_DATA_TOMBSTONED (TS 822e08445eae4a33b2f2fe92060192c6 not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:34244
I20260709 13:02:50.352522  8801 tablet_replica.cc:333] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:02:50.360401  8801 raft_consensus.cc:2243] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.372340  8801 raft_consensus.cc:2272] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.379560  8801 ts_tablet_manager.cc:1916] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:50.465473  8801 ts_tablet_manager.cc:1929] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.16
I20260709 13:02:50.465907  8801 log.cc:1199] T 5ee97fe9eef14f818a1f9178885dfc31 P 822e08445eae4a33b2f2fe92060192c6: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root/wals/5ee97fe9eef14f818a1f9178885dfc31
I20260709 13:02:50.468123  1431 catalog_manager.cc:5028] TS 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): tablet 5ee97fe9eef14f818a1f9178885dfc31 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:02:50.526676  8797 raft_consensus.cc:1064] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:02:50.529397  8797 consensus_queue.cc:237] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:50.584762  1692 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:02:50.586961  8754 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:50.593565  2241 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:02:50.595096  8776 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:50.624794  1540 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:02:50.626560  8775 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:50.676071  8775 raft_consensus.cc:2955] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:50.680404  2240 raft_consensus.cc:2955] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:50.707592  1441 catalog_manager.cc:5697] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 12 to 13, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:50.711002  1540 raft_consensus.cc:2955] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:02:50.815313  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 58263.8us
I20260709 13:02:50.818341  1694 raft_consensus.cc:2955] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:50.842885  1617 consensus_queue.cc:237] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:50.847795  2240 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:50.849537  8775 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:50.857246   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:50.864486  8754 raft_consensus.cc:2955] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:50.869257  2240 raft_consensus.cc:2955] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:50.877067  1540 raft_consensus.cc:1275] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:50.892668  8775 consensus_queue.cc:1048] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:50.898489  1542 raft_consensus.cc:2955] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:50.910328  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4b6f3b457deb4725b437c627cc3a5cd7 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:50.925324  1445 catalog_manager.cc:5697] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 13 to 14, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New cstate: current_term: 19 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:50.973212  1684 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b6f3b457deb4725b437c627cc3a5cd7 with delete_type TABLET_DATA_TOMBSTONED (TS 822e08445eae4a33b2f2fe92060192c6 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:34244
I20260709 13:02:50.986390  8808 tablet_replica.cc:333] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:02:51.012174  8808 raft_consensus.cc:2243] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:51.013147  8808 raft_consensus.cc:2272] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.021174  8808 ts_tablet_manager.cc:1916] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:02:51.074366  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 50109us
W20260709 13:02:51.084765  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 90439us
I20260709 13:02:51.145123  8808 ts_tablet_manager.cc:1929] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.13
I20260709 13:02:51.155512  8808 log.cc:1199] T 4b6f3b457deb4725b437c627cc3a5cd7 P 822e08445eae4a33b2f2fe92060192c6: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root/wals/4b6f3b457deb4725b437c627cc3a5cd7
I20260709 13:02:51.157194  1431 catalog_manager.cc:5028] TS 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): tablet 4b6f3b457deb4725b437c627cc3a5cd7 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:02:51.279526  1542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:36596
I20260709 13:02:51.280248  1542 raft_consensus.cc:606] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 19 LEADER]: Received request to transfer leadership to TS e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:51.293166  1542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:36596
I20260709 13:02:51.293859  1542 raft_consensus.cc:606] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:51.301088  1542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32470c2737744478bac199459790b787"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:36596
I20260709 13:02:51.301764  1542 raft_consensus.cc:606] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Received request to transfer leadership to TS e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:51.306888  1542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:36596
I20260709 13:02:51.308068  1542 raft_consensus.cc:606] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:51.312362  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:51.312978  1617 raft_consensus.cc:606] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:51.314611   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:51.316462   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:51.366045  8813 raft_consensus.cc:993] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: : Instructing follower e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:02:51.366703  8812 raft_consensus.cc:1081] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Signalling peer e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:02:51.368537  2241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32470c2737744478bac199459790b787"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:45866
I20260709 13:02:51.369138  2241 raft_consensus.cc:493] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:51.369494  2241 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:51.377902  2241 raft_consensus.cc:515] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:51.391884  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:51.392481  1542 raft_consensus.cc:3055] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:51.392832  1542 raft_consensus.cc:740] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:51.392518  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32470c2737744478bac199459790b787" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:51.393870  1617 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:51.393546  1542 consensus_queue.cc:260] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:51.394608  1542 raft_consensus.cc:3060] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:51.401417  1542 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 19.
I20260709 13:02:51.402634  1617 raft_consensus.cc:2468] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 19.
I20260709 13:02:51.403744  2209 leader_election.cc:304] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:51.404644  8794 raft_consensus.cc:2804] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:51.405194  8794 raft_consensus.cc:697] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 19 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:51.406138  8794 consensus_queue.cc:237] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:51.403865  2241 leader_election.cc:290] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:51.458392  8812 raft_consensus.cc:993] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: : Instructing follower e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:02:51.458905  8812 raft_consensus.cc:1081] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 19 LEADER]: Signalling peer e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:02:51.470324  1445 catalog_manager.cc:5697] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 18 to 19, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 19 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.471743  2241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:45866
I20260709 13:02:51.473316  2241 raft_consensus.cc:493] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:51.475337  2241 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:51.582031  8811 raft_consensus.cc:993] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:51.582712  8811 raft_consensus.cc:1081] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:51.602414  1688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:45652
I20260709 13:02:51.603044  1688 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:51.603427  1688 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:51.608590  8811 raft_consensus.cc:993] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:51.609110  8811 raft_consensus.cc:1081] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:51.613621  1688 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:51.615527  1693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:45652
I20260709 13:02:51.616146  1693 raft_consensus.cc:493] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:51.616528  1693 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:51.502239  2241 raft_consensus.cc:515] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:51.621018  1688 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:51.621966  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:51.622634  1617 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:51.628350  2241 leader_election.cc:290] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:51.629434  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:51.630481  1620 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:51.636937  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f253020cc7a4b66aa6c8f66a42d44c6" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:51.637584  1540 raft_consensus.cc:3055] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:51.637629  1620 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 20.
I20260709 13:02:51.638051  1540 raft_consensus.cc:740] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:51.638913  2210 leader_election.cc:304] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:51.641142  8794 raft_consensus.cc:2804] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:51.641880  8794 raft_consensus.cc:697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 20 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:51.643246  8794 consensus_queue.cc:237] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:51.644474  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:51.645066  1542 raft_consensus.cc:3055] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:51.645366  1542 raft_consensus.cc:740] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:51.646030  1542 consensus_queue.cc:260] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:51.647325  1542 raft_consensus.cc:3060] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:51.648746  1540 consensus_queue.cc:260] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:51.649181  1617 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:02:51.657202  1540 raft_consensus.cc:3060] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:51.657352  1542 raft_consensus.cc:2468] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:02:51.657918  1660 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:51.660116  8638 raft_consensus.cc:2804] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:51.660643  8638 raft_consensus.cc:697] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 21 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:51.661471  8638 consensus_queue.cc:237] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:51.637859  1693 raft_consensus.cc:515] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:51.669411  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:51.670236  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d7fbb63fde4df88c4345a9532b4738" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:51.672441  1542 raft_consensus.cc:3055] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:51.677031  1542 raft_consensus.cc:740] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:51.674283  1693 leader_election.cc:290] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:51.678793  1542 consensus_queue.cc:260] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:51.672616  1620 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:51.684489  1542 raft_consensus.cc:3060] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:51.698701  1540 raft_consensus.cc:2468] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 20.
I20260709 13:02:51.708328  1620 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:02:51.717876  1441 catalog_manager.cc:5697] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 19 to 20, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 20 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.725319  1445 catalog_manager.cc:5697] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 20 to 21, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.730160  1660 leader_election.cc:304] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:51.731945  8637 raft_consensus.cc:2804] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:51.732440  8637 raft_consensus.cc:697] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 21 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:51.733251  8637 consensus_queue.cc:237] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:51.744016  1542 raft_consensus.cc:2468] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:02:51.785938  1445 catalog_manager.cc:5697] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 20 to 21, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.847501  8776 raft_consensus.cc:993] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:51.847962  8776 raft_consensus.cc:1081] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:51.849646  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39628
I20260709 13:02:51.850221  1542 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:51.850560  1542 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:51.857688  1542 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:51.860608  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:51.861181  1620 raft_consensus.cc:3055] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:51.861486  1620 raft_consensus.cc:740] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:51.862473  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:51.863034  2241 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:51.862221  1620 consensus_queue.cc:260] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:51.870397  1620 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:51.878111  1620 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:51.883342  1511 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:51.884593  8811 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:51.885093  8811 raft_consensus.cc:697] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:51.886056  8811 consensus_queue.cc:237] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:51.881567  2241 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 18.
I20260709 13:02:51.882081  1542 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 18 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:51.934319  1445 catalog_manager.cc:5697] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 17 to 18, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.990882  1540 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:51.992616  8730 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:02:52.022123  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 56203.5us
I20260709 13:02:52.030516  1620 raft_consensus.cc:1275] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:52.033284  8730 consensus_queue.cc:1048] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:52.093673  1544 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:52.101197  8637 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:02:52.159083  1614 raft_consensus.cc:1275] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:52.173218  1693 consensus_queue.cc:237] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:52.174597  8637 consensus_queue.cc:1048] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:52.240680  1620 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:52.259001  8771 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:02:52.260635  1660 consensus_peers.cc:597] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b42f5c0b467d44b1878074fc21fa8f41. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:52.264142  1540 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:52.272173  8824 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:02:52.277457  1540 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:02:52.281311  1620 raft_consensus.cc:1275] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:02:52.284547  8833 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:02:52.289662  2241 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:02:52.291591  8813 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 13:02:52.295521  8833 consensus_queue.cc:1048] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:02:52.316726  1620 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:52.317420   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:52.331528  8824 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:02:52.408740  1539 raft_consensus.cc:1275] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:52.420616  8842 consensus_queue.cc:1048] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
W20260709 13:02:52.503118  8823 log.cc:927] Time spent T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:02:52.544994  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 113602us
I20260709 13:02:52.553723  8849 raft_consensus.cc:2955] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
W20260709 13:02:52.594561  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 51474.6us
W20260709 13:02:52.594985  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 92611.4us
I20260709 13:02:52.612005  1542 raft_consensus.cc:2955] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:52.628584  1614 raft_consensus.cc:2955] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:52.635974  1620 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:02:52.705621  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 50004.5us
W20260709 13:02:52.706866  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 63340us
I20260709 13:02:52.726730  8862 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:52.777882  1445 catalog_manager.cc:5697] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index -1 to 11, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 16 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
W20260709 13:02:52.826828  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 67741.9us
W20260709 13:02:52.866438  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 112439us
W20260709 13:02:52.885071  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 57236.5us
I20260709 13:02:52.915405  8868 ts_tablet_manager.cc:933] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:53.032308  8868 tablet_copy_client.cc:323] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 13:02:53.035665  1706 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet b42f5c0b467d44b1878074fc21fa8f41 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 13:02:53.036680  1706 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet b42f5c0b467d44b1878074fc21fa8f41 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-b42f5c0b467d44b1878074fc21fa8f41
I20260709 13:02:53.068334  1706 tablet_copy_source_session.cc:215] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:53.072276  8868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42f5c0b467d44b1878074fc21fa8f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.096382  8868 tablet_copy_client.cc:806] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:53.097126  8868 tablet_copy_client.cc:670] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:53.101408  8868 tablet_copy_client.cc:538] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:53.115631  8868 tablet_bootstrap.cc:492] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:02:53.169929  1617 consensus_queue.cc:237] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:53.385856  1688 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:53.393021  1540 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:53.398017  8826 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:53.401173  8877 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:02:53.404172  1586 consensus_peers.cc:597] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c528a0f6bdb44c4187c750d0b1429ba1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:53.465402  8872 raft_consensus.cc:2955] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:53.472954  1691 raft_consensus.cc:2955] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:53.477658  1542 raft_consensus.cc:2955] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:53.500138  1617 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:53.510329  1445 catalog_manager.cc:5697] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index -1 to 13, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 17 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:53.546236  1542 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:02:53.548054  1586 consensus_peers.cc:597] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ded1641387fd4fd4be29caddb22781fb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:53.550169  1691 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:02:53.551738  8776 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:53.557193  8872 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:53.590533   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:53.600268  8776 raft_consensus.cc:2955] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:53.609117  1542 raft_consensus.cc:2955] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:53.617869  8868 tablet_bootstrap.cc:492] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:53.619074  8868 tablet_bootstrap.cc:492] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:02:53.638154  1691 raft_consensus.cc:2955] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:53.631102  1443 catalog_manager.cc:5697] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index -1 to 15, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 23 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:53.643064  8868 ts_tablet_manager.cc:1403] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.528s	user 0.030s	sys 0.027s
I20260709 13:02:53.661885  1688 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:53.668545  8868 raft_consensus.cc:359] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:53.676867  8868 raft_consensus.cc:740] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:02:53.677757  8868 consensus_queue.cc:260] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:53.683982  1546 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:02:53.678452  1660 consensus_peers.cc:597] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d987fd742df4898acd2aaa15097431c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:53.678918  1617 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:53.696957  8638 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:53.698938  8638 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:53.685910  8868 ts_tablet_manager.cc:1434] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:02:53.722895  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-b42f5c0b467d44b1878074fc21fa8f41 received from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:53.723650  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-b42f5c0b467d44b1878074fc21fa8f41 on tablet b42f5c0b467d44b1878074fc21fa8f41 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:53.777663  8638 raft_consensus.cc:2955] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:53.782866  1614 raft_consensus.cc:2955] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:53.788506  1542 raft_consensus.cc:2955] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:53.809448  8868 ts_tablet_manager.cc:933] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:53.848754  8868 tablet_copy_client.cc:323] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39981
I20260709 13:02:53.867729  1632 tablet_copy_service.cc:140] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Received BeginTabletCopySession request for tablet c528a0f6bdb44c4187c750d0b1429ba1 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50552)
I20260709 13:02:53.868333  1632 tablet_copy_service.cc:161] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Beginning new tablet copy session on tablet c528a0f6bdb44c4187c750d0b1429ba1 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50552: session id = e8a64798e5f94de8909707bcbd11804a-c528a0f6bdb44c4187c750d0b1429ba1
I20260709 13:02:53.871119  1445 catalog_manager.cc:5697] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index -1 to 12, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 17 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:53.909045  1632 tablet_copy_source_session.cc:215] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:53.914790  8868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c528a0f6bdb44c4187c750d0b1429ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.962621  8868 tablet_copy_client.cc:806] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:53.963403  8868 tablet_copy_client.cc:670] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:53.968551  8868 tablet_copy_client.cc:538] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:53.995467  8868 tablet_bootstrap.cc:492] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:02:54.089488  2246 raft_consensus.cc:1217] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 13:02:54.133719  8906 ts_tablet_manager.cc:933] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:54.146203  8906 tablet_copy_client.cc:323] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 13:02:54.146807  8907 ts_tablet_manager.cc:933] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:54.148065  1706 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet 5d987fd742df4898acd2aaa15097431c from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 13:02:54.170490  1706 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet 5d987fd742df4898acd2aaa15097431c from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-5d987fd742df4898acd2aaa15097431c
I20260709 13:02:54.155484  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5814bf31e900408885160ea0f89d6189"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:44410
I20260709 13:02:54.175561  1688 raft_consensus.cc:606] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:54.178695  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:44410
I20260709 13:02:54.179252  1693 raft_consensus.cc:606] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Received request to transfer leadership to TS dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:54.183811  1706 tablet_copy_source_session.cc:215] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:54.189778  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d987fd742df4898acd2aaa15097431c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:54.195463  1540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:36596
I20260709 13:02:54.196069  1540 raft_consensus.cc:606] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Received request to transfer leadership to TS dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:02:54.198676   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:02:54.201099   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:54.202134  8907 tablet_copy_client.cc:323] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39981
I20260709 13:02:54.204020  1632 tablet_copy_service.cc:140] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Received BeginTabletCopySession request for tablet ded1641387fd4fd4be29caddb22781fb from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50552)
I20260709 13:02:54.204595  1632 tablet_copy_service.cc:161] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Beginning new tablet copy session on tablet ded1641387fd4fd4be29caddb22781fb from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50552: session id = e8a64798e5f94de8909707bcbd11804a-ded1641387fd4fd4be29caddb22781fb
I20260709 13:02:54.210031  8638 raft_consensus.cc:993] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:02:54.210558  8638 raft_consensus.cc:1081] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Signalling peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:02:54.212844  1614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:40034
I20260709 13:02:54.213438  1614 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:54.213770  1614 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:54.215672  8868 tablet_bootstrap.cc:492] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:54.216789  8868 tablet_bootstrap.cc:492] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:02:54.217540  8868 ts_tablet_manager.cc:1403] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.222s	user 0.051s	sys 0.002s
I20260709 13:02:54.221175  8868 raft_consensus.cc:359] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:54.222070  1632 tablet_copy_source_session.cc:215] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:54.234834  8868 raft_consensus.cc:740] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:02:54.235625  8868 consensus_queue.cc:260] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:54.246865  8638 raft_consensus.cc:993] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:54.247341  8638 raft_consensus.cc:1081] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:54.229939  1614 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:54.251530  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5814bf31e900408885160ea0f89d6189"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39612
I20260709 13:02:54.252167  1542 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:54.252538  1542 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:54.241317  8907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded1641387fd4fd4be29caddb22781fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:54.255494  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:54.256170  1544 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:54.262022  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:54.262619  1693 raft_consensus.cc:3055] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:54.262884  1693 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:54.272095  1544 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:54.272825  8868 ts_tablet_manager.cc:1434] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 13:02:54.274433  1585 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:54.275489  1542 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:54.276525  8776 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:54.277195  8776 raft_consensus.cc:697] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:54.278368  1542 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Requested vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:54.279440  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:54.280042  1688 raft_consensus.cc:3055] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:54.280319  1688 raft_consensus.cc:740] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:54.279832  8776 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:54.281028  1688 consensus_queue.cc:260] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:54.284123  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:54.284694  2240 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:54.265034  1693 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:54.291682  1693 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:54.294870  1632 tablet_copy_service.cc:342] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-c528a0f6bdb44c4187c750d0b1429ba1 received from {username='slave'} at 127.0.0.1:50552
I20260709 13:02:54.295567  1632 tablet_copy_service.cc:434] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-c528a0f6bdb44c4187c750d0b1429ba1 on tablet c528a0f6bdb44c4187c750d0b1429ba1 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:54.282159  1688 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:54.306134  8906 tablet_copy_client.cc:806] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:54.306797  8906 tablet_copy_client.cc:670] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:54.321520  1693 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:02:54.322046  1614 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:54.324386  8856 raft_consensus.cc:993] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291: : Instructing follower dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:02:54.339995  8856 raft_consensus.cc:1081] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Signalling peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 to start an election
I20260709 13:02:54.336297  8906 tablet_copy_client.cc:538] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:54.345260  1688 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
I20260709 13:02:54.345422  8907 tablet_copy_client.cc:806] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:54.350507  1614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
 from {username='slave'} at 127.0.0.1:40022
I20260709 13:02:54.346837  1512 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:54.351146  1614 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:54.351621  1614 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:54.357280  8855 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:54.357851  8855 raft_consensus.cc:697] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 17 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:54.358686  8855 consensus_queue.cc:237] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:54.362282  1441 catalog_manager.cc:5697] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 17 to 18, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:54.368667  8907 tablet_copy_client.cc:670] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:54.374024  2240 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 17.
I20260709 13:02:54.376852  8907 tablet_copy_client.cc:538] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:54.392481  2246 raft_consensus.cc:1217] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 LEARNER]: Deduplicated request from leader. Original: 17.12->[17.13-17.13]   Dedup: 17.13->[]
I20260709 13:02:54.411013  1614 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:54.411464  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46476
I20260709 13:02:54.418727  1617 raft_consensus.cc:606] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Received request to transfer leadership
I20260709 13:02:54.421782  8907 tablet_bootstrap.cc:492] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:02:54.423444  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:54.432528  2246 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:54.436466  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46476
I20260709 13:02:54.435997  1443 catalog_manager.cc:5697] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 16 to 17, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:54.437093  1616 raft_consensus.cc:606] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Received request to transfer leadership
W20260709 13:02:54.439821  1430 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 5d987fd742df4898acd2aaa15097431c already in progress
I20260709 13:02:54.446071  2246 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:54.423949  1614 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:54.425808  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1a194f4d834ee6aa037d727b8f9e2a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:54.416117  8906 tablet_bootstrap.cc:492] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:02:54.447275  1546 raft_consensus.cc:3055] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:54.447466  1586 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:54.447615  1546 raft_consensus.cc:740] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:54.449194  1546 consensus_queue.cc:260] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:54.450407  1546 raft_consensus.cc:3060] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:54.453647  8877 raft_consensus.cc:2804] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:54.454200  8877 raft_consensus.cc:697] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:54.467329  8877 consensus_queue.cc:237] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:54.475970  1546 raft_consensus.cc:2468] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:02:54.503939  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46476
I20260709 13:02:54.504581  1614 raft_consensus.cc:606] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Received request to transfer leadership
W20260709 13:02:54.509341  1493 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:02:54.509755  1493 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 5d987fd742df4898acd2aaa15097431c already in progress
W20260709 13:02:54.510039  1493 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 5d987fd742df4898acd2aaa15097431c already in progress
I20260709 13:02:54.517936  1443 catalog_manager.cc:5697] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 18 to 19, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:54.641299  8637 raft_consensus.cc:1064] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:02:54.647370  8637 consensus_queue.cc:237] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:54.678536  8906 tablet_bootstrap.cc:492] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:54.690806  8906 tablet_bootstrap.cc:492] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:02:54.691560  8906 ts_tablet_manager.cc:1403] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.276s	user 0.034s	sys 0.022s
I20260709 13:02:54.731396  8906 raft_consensus.cc:359] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:54.732657  8906 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:02:54.740563  2246 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [term 16 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:54.745235  1614 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:54.753227  1688 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:54.754928  8914 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:54.767313  8877 raft_consensus.cc:993] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:54.767915  8776 raft_consensus.cc:1081] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:54.769733  1691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:45660
I20260709 13:02:54.781363  8638 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:54.783365  1694 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:54.783577  8638 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:54.784539  8906 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:54.784994  8855 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:54.795701  8906 ts_tablet_manager.cc:1434] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.104s	user 0.009s	sys 0.000s
W20260709 13:02:54.790904  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 106404us
I20260709 13:02:54.820217  2246 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:54.822085  8867 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:54.856591  1691 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:54.857023  1691 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:54.855859  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 74887.6us
I20260709 13:02:54.870939  1691 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:54.875635  2243 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [term 17 LEARNER]: Advancing to term 18
I20260709 13:02:54.899822  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-5d987fd742df4898acd2aaa15097431c received from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:54.900292  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-5d987fd742df4898acd2aaa15097431c on tablet 5d987fd742df4898acd2aaa15097431c with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:54.906216  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:54.906867  1546 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:54.911793  1691 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:54.916682  1544 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:54.917747  2243 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [term 18 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:54.919121  8914 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:54.938709  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d987fd742df4898acd2aaa15097431c" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:54.938841  1546 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:02:54.939338  1617 raft_consensus.cc:3055] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:54.939599  1542 raft_consensus.cc:1240] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Rejecting Update request from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:54.939716  1617 raft_consensus.cc:740] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:54.941625  1659 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:54.940625  1617 consensus_queue.cc:260] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:54.944518  1617 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:54.947702  1543 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:02:54.951385  8771 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:02:54.955103  8907 tablet_bootstrap.cc:492] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=1 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:54.957183  8907 tablet_bootstrap.cc:492] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:02:54.958580  8907 ts_tablet_manager.cc:1403] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.537s	user 0.036s	sys 0.032s
I20260709 13:02:54.942837  8929 raft_consensus.cc:2804] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:54.968266  8929 raft_consensus.cc:697] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 19 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:54.969256  8929 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:54.978704  1617 raft_consensus.cc:2468] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
W20260709 13:02:55.012696  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 67771.2us
I20260709 13:02:55.140306  8907 raft_consensus.cc:359] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:55.141646  8907 raft_consensus.cc:740] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:02:55.142846  8907 consensus_queue.cc:260] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:55.186759  8637 raft_consensus.cc:2955] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:55.224443  8935 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 13:02:55.227514  1620 raft_consensus.cc:2955] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:55.215224   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:55.231178  2245 raft_consensus.cc:1275] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:02:55.300166  8907 ts_tablet_manager.cc:1434] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.333s	user 0.008s	sys 0.001s
I20260709 13:02:55.312848  1441 catalog_manager.cc:5697] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 18 to 19, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 19 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:55.352594  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 71718.6us
I20260709 13:02:55.327554  2240 raft_consensus.cc:2955] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:02:55.416854  8950 log.cc:927] Time spent T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:55.450228  2246 raft_consensus.cc:1217] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 23 LEARNER]: Deduplicated request from leader. Original: 23.14->[23.15-23.15]   Dedup: 23.15->[]
I20260709 13:02:55.458662  8879 consensus_queue.cc:1048] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
W20260709 13:02:55.499078  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 51328.1us
W20260709 13:02:55.512588  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 48248.5us
W20260709 13:02:55.517335  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 58294.7us
W20260709 13:02:55.527540  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 126843us
I20260709 13:02:55.566401  8959 raft_consensus.cc:1064] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:02:55.573807  8959 consensus_queue.cc:237] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:55.605923  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 105972us
I20260709 13:02:55.608016  1542 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:55.610965  1543 raft_consensus.cc:2955] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:55.629511  1620 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:55.656684  8969 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:55.711531  8924 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:55.699414  1445 catalog_manager.cc:5697] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index 11 to 12, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:55.722033  2243 raft_consensus.cc:3060] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [term 18 LEARNER]: Advancing to term 19
I20260709 13:02:55.778782  1693 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:55.780369  2245 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:55.784399  2243 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [term 19 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:55.785574  8877 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:55.786814  8954 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:55.791034  1545 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:55.792375  8877 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:02:55.804569  8969 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:55.809700  1632 tablet_copy_service.cc:342] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-ded1641387fd4fd4be29caddb22781fb received from {username='slave'} at 127.0.0.1:50552
I20260709 13:02:55.810371  1632 tablet_copy_service.cc:434] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-ded1641387fd4fd4be29caddb22781fb on tablet ded1641387fd4fd4be29caddb22781fb with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:55.830786  8771 raft_consensus.cc:1064] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:02:55.876577  1694 consensus_queue.cc:237] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:55.833702  8771 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 13, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:55.894071  1617 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:55.895812  8969 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:02:55.897130  8978 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:02:55.919183  8953 raft_consensus.cc:1064] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:02:55.950663  8954 raft_consensus.cc:2955] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:55.934662  8975 raft_consensus.cc:2955] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:55.947294  1620 raft_consensus.cc:2955] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:02:55.952030  8982 log.cc:927] Time spent T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:02:55.972219  1622 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:55.965163  1693 raft_consensus.cc:2955] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:55.978893  8771 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:55.979347  1545 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:02:56.005347  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 170486us
I20260709 13:02:56.009613  2241 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:56.011431  2241 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [term 19 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:55.955209  8953 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 13, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:56.020231  8638 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:56.021783  8638 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:56.023938  8924 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:56.016047  2243 raft_consensus.cc:2955] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.042526  2240 raft_consensus.cc:2955] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.058544  1543 raft_consensus.cc:2955] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.059918  8771 raft_consensus.cc:2955] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 12 to 15, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.107847  1543 raft_consensus.cc:2955] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 12 to 15, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.105154  2243 raft_consensus.cc:2955] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 12 to 15, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.139904  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b42f5c0b467d44b1878074fc21fa8f41 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:56.151068  1438 catalog_manager.cc:5697] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 13 to 14, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.177841  1441 catalog_manager.cc:5697] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index 12 to 13, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New cstate: current_term: 16 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.203509  1694 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:02:56.204813  2243 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 23 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:02:56.206423  8936 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:56.209537  1622 raft_consensus.cc:2955] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 12 to 15, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.212965  1539 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:02:56.217648  8936 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 13:02:56.224393  8877 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:56.241495  1438 catalog_manager.cc:5697] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 12 to 15, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.260790  1531 tablet_service.cc:1558] Processing DeleteTablet for tablet b42f5c0b467d44b1878074fc21fa8f41 with delete_type TABLET_DATA_TOMBSTONED (TS d7158d6c3b634dc7abb69eac58eba291 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:39608
I20260709 13:02:56.274331  1617 consensus_queue.cc:237] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:56.297143  1696 consensus_queue.cc:237] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:56.307107  2241 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:02:56.309104  8961 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:56.323304  8638 raft_consensus.cc:2955] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 19 LEADER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.334165  2240 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:02:56.327586  2241 raft_consensus.cc:2955] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.363545  1539 raft_consensus.cc:1275] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:02:56.373050  1539 raft_consensus.cc:1275] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:02:56.383782  8969 consensus_queue.cc:1048] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:56.367338  8948 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:02:56.410907  8936 consensus_queue.cc:1048] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:56.438719  1539 raft_consensus.cc:2955] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.444629  1441 catalog_manager.cc:5697] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 15 to 16, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New cstate: current_term: 19 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.456053  8935 raft_consensus.cc:2955] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.463994  2240 raft_consensus.cc:2955] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.481033  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5d987fd742df4898acd2aaa15097431c with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:56.481887  8962 raft_consensus.cc:2955] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index 15 to 16, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.489419  1696 raft_consensus.cc:2955] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.517732  1545 raft_consensus.cc:2955] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.519575  8987 tablet_replica.cc:333] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:02:56.520702  8987 raft_consensus.cc:2243] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.522372  2243 raft_consensus.cc:2955] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.531000  1542 raft_consensus.cc:2955] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.562951  8987 raft_consensus.cc:2272] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.577345  1606 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d987fd742df4898acd2aaa15097431c with delete_type TABLET_DATA_TOMBSTONED (TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:46476
I20260709 13:02:56.578868  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c528a0f6bdb44c4187c750d0b1429ba1 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:56.585633  8987 ts_tablet_manager.cc:1916] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:56.586500  1438 catalog_manager.cc:5697] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index 15 to 16, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:56.597185  1441 catalog_manager.cc:5697] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 14 to 15, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New cstate: current_term: 17 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.603137  1614 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:56.635975  1684 tablet_service.cc:1558] Processing DeleteTablet for tablet c528a0f6bdb44c4187c750d0b1429ba1 with delete_type TABLET_DATA_TOMBSTONED (TS 822e08445eae4a33b2f2fe92060192c6 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:34244
I20260709 13:02:56.639648  2241 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:02:56.645243  8935 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:02:56.647822  8990 tablet_replica.cc:333] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:02:56.655330  1693 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:02:56.657153  8945 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:02:56.662578  8877 raft_consensus.cc:2955] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.665218  2241 raft_consensus.cc:2955] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.712908  1696 raft_consensus.cc:2955] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.723694  8987 ts_tablet_manager.cc:1929] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:02:56.724346  8987 log.cc:1199] T b42f5c0b467d44b1878074fc21fa8f41 P d7158d6c3b634dc7abb69eac58eba291: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root/wals/b42f5c0b467d44b1878074fc21fa8f41
I20260709 13:02:56.732214  1429 catalog_manager.cc:5028] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): tablet b42f5c0b467d44b1878074fc21fa8f41 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:02:56.734680   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:56.749794  8990 raft_consensus.cc:2243] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.750725  8990 raft_consensus.cc:2272] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.760161  8990 ts_tablet_manager.cc:1916] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:56.760528  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ded1641387fd4fd4be29caddb22781fb with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:56.765244  8991 tablet_replica.cc:333] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:02:56.766758  8991 raft_consensus.cc:2243] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.767659  8991 raft_consensus.cc:2272] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.790298  8991 ts_tablet_manager.cc:1916] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:56.783600  1445 catalog_manager.cc:5697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 16 to 17, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New cstate: current_term: 23 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:02:56.821368  1531 tablet_service.cc:1558] Processing DeleteTablet for tablet ded1641387fd4fd4be29caddb22781fb with delete_type TABLET_DATA_TOMBSTONED (TS d7158d6c3b634dc7abb69eac58eba291 not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:39608
I20260709 13:02:56.822321  8987 tablet_replica.cc:333] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:02:56.823355  8987 raft_consensus.cc:2243] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.824424  8987 raft_consensus.cc:2272] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.828047  8987 ts_tablet_manager.cc:1916] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:56.835083  1545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5814bf31e900408885160ea0f89d6189"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:36596
I20260709 13:02:56.835738  1545 raft_consensus.cc:606] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 17 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:56.838449  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7803266de9984fac88726b08bee73921"
dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:42334
I20260709 13:02:56.839063  1614 raft_consensus.cc:606] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:02:56.841885  1696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:44410
I20260709 13:02:56.842391  1696 raft_consensus.cc:606] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Received request to transfer leadership to TS e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:56.851076   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:02:56.852874   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:56.865309  8990 ts_tablet_manager.cc:1929] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.15
I20260709 13:02:56.887468  8990 log.cc:1199] T 5d987fd742df4898acd2aaa15097431c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root/wals/5d987fd742df4898acd2aaa15097431c
I20260709 13:02:56.889303  1430 catalog_manager.cc:5028] TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): tablet 5d987fd742df4898acd2aaa15097431c (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:02:56.900638  8987 ts_tablet_manager.cc:1929] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.16
I20260709 13:02:56.901229  8987 log.cc:1199] T ded1641387fd4fd4be29caddb22781fb P d7158d6c3b634dc7abb69eac58eba291: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root/wals/ded1641387fd4fd4be29caddb22781fb
I20260709 13:02:56.902951  1429 catalog_manager.cc:5028] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): tablet ded1641387fd4fd4be29caddb22781fb (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:02:56.921242  8991 ts_tablet_manager.cc:1929] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.14
I20260709 13:02:56.921841  8991 log.cc:1199] T c528a0f6bdb44c4187c750d0b1429ba1 P 822e08445eae4a33b2f2fe92060192c6: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root/wals/c528a0f6bdb44c4187c750d0b1429ba1
I20260709 13:02:56.923864  1431 catalog_manager.cc:5028] TS 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): tablet c528a0f6bdb44c4187c750d0b1429ba1 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:02:57.121698  8920 raft_consensus.cc:993] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:02:57.122321  8920 raft_consensus.cc:1081] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Signalling peer e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:02:57.142462  2241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:45882
I20260709 13:02:57.143213  2241 raft_consensus.cc:493] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:57.143666  2241 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:57.211112  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 53659.6us
I20260709 13:02:57.219647  2241 raft_consensus.cc:515] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:57.253548  2241 leader_election.cc:290] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:57.261431  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:57.262315  1614 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:57.302282  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 66018.5us
W20260709 13:02:57.316190  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 83574.1us
I20260709 13:02:57.333561  8956 raft_consensus.cc:993] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:57.334065  8856 raft_consensus.cc:1081] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 17 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:57.338884  1696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5814bf31e900408885160ea0f89d6189"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:45652
I20260709 13:02:57.339588  1696 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:57.339986  1696 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:57.348587  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f5c0b467d44b1878074fc21fa8f41" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:57.349231  1693 raft_consensus.cc:3055] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:57.349557  1693 raft_consensus.cc:740] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:57.350901  1693 consensus_queue.cc:260] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:57.352584  1693 raft_consensus.cc:3060] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:57.362914  1696 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:57.369647  1696 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:02:57.374480  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:57.375124  1542 raft_consensus.cc:3055] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:57.375460  1542 raft_consensus.cc:740] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:57.376266  1542 consensus_queue.cc:260] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:57.377578  1542 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:57.396696  1542 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:57.435715  8936 raft_consensus.cc:993] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:57.436360  8936 raft_consensus.cc:1081] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:02:57.454473  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7803266de9984fac88726b08bee73921"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39628
I20260709 13:02:57.455116  1542 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:57.455482  1542 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:57.462829  1542 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:57.470027  1542 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 24 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:57.473474  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:57.474335  1620 raft_consensus.cc:3055] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:02:57.474754  1620 raft_consensus.cc:740] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:02:57.476524  1620 consensus_queue.cc:260] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:57.478158  1620 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:57.850163  1620 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 24.
I20260709 13:02:57.863709   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:57.870273  1693 consensus_meta.cc:287] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6: Time spent flushing consensus metadata: real 0.517s	user 0.014s	sys 0.007s
I20260709 13:02:57.891284  1693 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
W20260709 13:02:57.850437  1614 consensus_meta.cc:287] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Time spent flushing consensus metadata: real 0.588s	user 0.006s	sys 0.018s
I20260709 13:02:57.895604  1614 raft_consensus.cc:2468] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 17.
I20260709 13:02:57.922310  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:57.928220  1693 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:57.933986  2211 leader_election.cc:304] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:57.940385  8997 raft_consensus.cc:2804] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:57.940989  8997 raft_consensus.cc:697] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:57.944562  8997 consensus_queue.cc:237] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:02:57.957557  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 471617us
I20260709 13:02:57.972916  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5814bf31e900408885160ea0f89d6189" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:02:57.973665  2243 raft_consensus.cc:3060] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:57.980883  2243 raft_consensus.cc:2468] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:02:58.006424  1659 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:58.018365  1693 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 24.
I20260709 13:02:58.018862  8966 raft_consensus.cc:2804] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:58.019516  8966 raft_consensus.cc:697] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:58.020435  8966 consensus_queue.cc:237] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:58.027925  1511 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:02:58.030815  8942 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:58.031476  8942 raft_consensus.cc:697] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 24 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:58.032457  8942 consensus_queue.cc:237] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:58.062247  1438 catalog_manager.cc:5697] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 16 to 17, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 17 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.067473  1545 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:58.095435  1439 catalog_manager.cc:5697] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 17 to 18, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:58.186795  1511 consensus_peers.cc:597] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 646909798f0047ef9e8073d28a784525. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:58.188874  1688 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:02:58.189380  1622 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:02:58.190169  8998 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:58.191043  9002 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:58.191810  1445 catalog_manager.cc:5697] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 23 to 24, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 24 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.240021  9002 raft_consensus.cc:2955] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:58.255848  1688 raft_consensus.cc:2955] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:58.262135  1622 raft_consensus.cc:2955] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:58.353524  1441 catalog_manager.cc:5697] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index -1 to 14, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 22 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:58.362753  1622 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:58.395694  1688 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:58.397758  8936 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:02:58.401841  1586 consensus_peers.cc:597] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d0a7e28ddafe4ac389f2603e93af8dba. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:58.415711  1545 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:58.417534  8953 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:58.429841  1622 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:58.431893  8945 raft_consensus.cc:2955] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:58.441576  8943 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:58.436630  1694 raft_consensus.cc:2955] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:58.466060  1688 raft_consensus.cc:1275] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:02:58.467337  1568 debug-util.cc:398] Leaking SignalData structure 0x7b0800264d60 after lost signal to thread 434
W20260709 13:02:58.468668  1568 debug-util.cc:398] Leaking SignalData structure 0x7b08003317e0 after lost signal to thread 1479
W20260709 13:02:58.470295  1568 debug-util.cc:398] Leaking SignalData structure 0x7b0800093a40 after lost signal to thread 1571
W20260709 13:02:58.472391  1568 debug-util.cc:398] Leaking SignalData structure 0x7b080026e860 after lost signal to thread 1646
W20260709 13:02:58.473644  1568 debug-util.cc:398] Leaking SignalData structure 0x7b080034da60 after lost signal to thread 1720
W20260709 13:02:58.480489  1568 debug-util.cc:398] Leaking SignalData structure 0x7b080022dfa0 after lost signal to thread 2270
I20260709 13:02:58.481837  1542 consensus_queue.cc:237] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:58.482760  8943 consensus_queue.cc:1048] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:58.496753  1688 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:02:58.505280  2240 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:58.506508  8856 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:58.509832  8920 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:02:58.528332  1568 debug-util.cc:398] Leaking SignalData structure 0x7b08003caee0 after lost signal to thread 8898
I20260709 13:02:58.559826  1614 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:02:58.563076  1511 consensus_peers.cc:597] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cdca03ab6655412d9f1d4fea1f1acf78. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:58.574892  9003 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:58.591382  1694 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:58.592758  1542 raft_consensus.cc:1275] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:58.599852  8942 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:02:58.613013  8969 consensus_queue.cc:1048] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:02:58.626573  1438 catalog_manager.cc:5697] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index -1 to 14, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 20 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:58.678817  1622 raft_consensus.cc:1275] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:02:58.686578  8998 consensus_queue.cc:1048] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 13:02:58.809788  8856 raft_consensus.cc:2955] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:58.817358  1545 raft_consensus.cc:2955] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
W20260709 13:02:58.823192  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 118593us
I20260709 13:02:58.822813  1691 raft_consensus.cc:2955] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
W20260709 13:02:58.896083  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 51275.2us
W20260709 13:02:58.910924  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 246632us
I20260709 13:02:58.909376  1438 catalog_manager.cc:5697] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index -1 to 10, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 13 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:58.916229  9041 ts_tablet_manager.cc:933] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 13:02:58.937291  1614 raft_consensus.cc:2955] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:58.985255  9049 ts_tablet_manager.cc:933] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:58.988327  9049 tablet_copy_client.cc:323] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39981
W20260709 13:02:59.078246  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 123244us
W20260709 13:02:59.081663  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 131892us
I20260709 13:02:59.084112  1632 tablet_copy_service.cc:140] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Received BeginTabletCopySession request for tablet d0a7e28ddafe4ac389f2603e93af8dba from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50552)
I20260709 13:02:59.084669  1632 tablet_copy_service.cc:161] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Beginning new tablet copy session on tablet d0a7e28ddafe4ac389f2603e93af8dba from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50552: session id = e8a64798e5f94de8909707bcbd11804a-d0a7e28ddafe4ac389f2603e93af8dba
W20260709 13:02:59.089010  9009 log.cc:927] Time spent T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:02:59.082926  9041 tablet_copy_client.cc:323] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:41871
W20260709 13:02:59.094992  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 111045us
I20260709 13:02:59.100342  1557 tablet_copy_service.cc:140] P d7158d6c3b634dc7abb69eac58eba291: Received BeginTabletCopySession request for tablet 646909798f0047ef9e8073d28a784525 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:42858)
I20260709 13:02:59.100927  1557 tablet_copy_service.cc:161] P d7158d6c3b634dc7abb69eac58eba291: Beginning new tablet copy session on tablet 646909798f0047ef9e8073d28a784525 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:42858: session id = e8a64798e5f94de8909707bcbd11804a-646909798f0047ef9e8073d28a784525
I20260709 13:02:59.100443  1632 tablet_copy_source_session.cc:215] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:59.111024  1557 tablet_copy_source_session.cc:215] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:59.123065   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:59.184880  9049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a7e28ddafe4ac389f2603e93af8dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:59.195350  9041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 646909798f0047ef9e8073d28a784525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:59.205304  9059 ts_tablet_manager.cc:933] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 13:02:59.227726  1691 consensus_queue.cc:237] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
W20260709 13:02:59.237353  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 51998.8us
I20260709 13:02:59.273587  9059 tablet_copy_client.cc:323] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:41871
I20260709 13:02:59.282042  1557 tablet_copy_service.cc:140] P d7158d6c3b634dc7abb69eac58eba291: Received BeginTabletCopySession request for tablet cdca03ab6655412d9f1d4fea1f1acf78 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:42858)
I20260709 13:02:59.282665  1557 tablet_copy_service.cc:161] P d7158d6c3b634dc7abb69eac58eba291: Beginning new tablet copy session on tablet cdca03ab6655412d9f1d4fea1f1acf78 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:42858: session id = e8a64798e5f94de8909707bcbd11804a-cdca03ab6655412d9f1d4fea1f1acf78
I20260709 13:02:59.284385  9049 tablet_copy_client.cc:806] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:59.285012  9049 tablet_copy_client.cc:670] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:59.285439  1622 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:59.290208  8969 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:59.294389  1557 tablet_copy_source_session.cc:215] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:59.296685  1547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:36596
I20260709 13:02:59.299947  1547 raft_consensus.cc:606] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Received request to transfer leadership to TS 822e08445eae4a33b2f2fe92060192c6
I20260709 13:02:59.297544  1539 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:59.302802  9041 tablet_copy_client.cc:806] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:59.309190  8969 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:02:59.313954  1660 consensus_peers.cc:597] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 00924ae4c66740e59de627a44de33c38. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:59.316790  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:44410
I20260709 13:02:59.317077  9059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdca03ab6655412d9f1d4fea1f1acf78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:59.328977  1691 raft_consensus.cc:606] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 22 LEADER]: Received request to transfer leadership to TS e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:59.330585   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:59.332898   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:59.334278  9049 tablet_copy_client.cc:538] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:59.345907  9059 tablet_copy_client.cc:806] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:59.346468  9041 tablet_copy_client.cc:670] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:59.346582  9059 tablet_copy_client.cc:670] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:59.357744  8966 raft_consensus.cc:993] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:02:59.358307  8966 raft_consensus.cc:1081] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 22 LEADER]: Signalling peer e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:02:59.363323  2243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:45882
I20260709 13:02:59.366662  2243 raft_consensus.cc:493] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.367296  2243 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:59.367595  9049 tablet_bootstrap.cc:492] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:02:59.380929  2243 raft_consensus.cc:515] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:59.382099  9041 tablet_copy_client.cc:538] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:59.378894  9053 raft_consensus.cc:2955] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:59.386716  2243 leader_election.cc:290] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 23 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:59.387794  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:02:59.388399  1691 raft_consensus.cc:3055] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:59.388425  9059 tablet_copy_client.cc:538] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:59.388912  1691 raft_consensus.cc:740] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:59.389758  1691 consensus_queue.cc:260] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:59.393219  9041 tablet_bootstrap.cc:492] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:02:59.387025  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2222d3d1694f2d93fb2f0702805e3e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:59.394572  1539 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:59.390966  1691 raft_consensus.cc:3060] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:59.394774  1622 raft_consensus.cc:2955] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:59.403425  1691 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 23.
I20260709 13:02:59.409787  2211 leader_election.cc:304] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:02:59.411198  9056 raft_consensus.cc:2804] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:59.412945  9056 raft_consensus.cc:697] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 23 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:02:59.413949  9056 consensus_queue.cc:237] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:02:59.420967  1547 raft_consensus.cc:2955] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:02:59.424427  1539 raft_consensus.cc:2468] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 23.
I20260709 13:02:59.468832  9033 raft_consensus.cc:993] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291: : Instructing follower 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:59.469489  8856 raft_consensus.cc:1081] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Signalling peer 822e08445eae4a33b2f2fe92060192c6 to start an election
I20260709 13:02:59.435192  9059 tablet_bootstrap.cc:492] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:02:59.476413  1694 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
 from {username='slave'} at 127.0.0.1:45652
I20260709 13:02:59.477023  1694 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.477355  1694 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:59.477993  1441 catalog_manager.cc:5697] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index -1 to 11, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 18 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.518224  1694 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:59.521337  1439 catalog_manager.cc:5697] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 22 to 23, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 23 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.528988  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:02:59.529671  1547 raft_consensus.cc:3055] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:59.529940  1547 raft_consensus.cc:740] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:02:59.535830  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:02:59.536450  1622 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:59.530663  1547 consensus_queue.cc:260] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:02:59.544696  1694 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:02:59.548712  1547 raft_consensus.cc:3060] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:59.551919  1622 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:02:59.561146  1547 raft_consensus.cc:2468] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:02:59.563289  1659 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291; no voters: 
I20260709 13:02:59.570555  9035 raft_consensus.cc:2804] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:59.593281  9035 raft_consensus.cc:697] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 21 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:02:59.594234  9035 consensus_queue.cc:237] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:02:59.619481  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 56325.7us
W20260709 13:02:59.760576  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 64568.6us
I20260709 13:02:59.786872  1438 catalog_manager.cc:5697] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 20 to 21, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.823182  9049 tablet_bootstrap.cc:492] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:59.824321  9049 tablet_bootstrap.cc:492] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:02:59.825114  9049 ts_tablet_manager.cc:1403] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.482s	user 0.052s	sys 0.012s
I20260709 13:02:59.828356  9049 raft_consensus.cc:359] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:59.831046  9049 raft_consensus.cc:740] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:02:59.840655  9071 ts_tablet_manager.cc:933] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:02:59.837877  9049 consensus_queue.cc:260] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:02:59.849169  9049 ts_tablet_manager.cc:1434] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:02:59.854866  1632 tablet_copy_service.cc:342] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-d0a7e28ddafe4ac389f2603e93af8dba received from {username='slave'} at 127.0.0.1:50552
I20260709 13:02:59.855433  1632 tablet_copy_service.cc:434] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-d0a7e28ddafe4ac389f2603e93af8dba on tablet d0a7e28ddafe4ac389f2603e93af8dba with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:02:59.911840  1694 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:02:59.925478  9057 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:02:59.956940  2243 raft_consensus.cc:1217] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 20 LEARNER]: Deduplicated request from leader. Original: 20.13->[20.14-20.14]   Dedup: 20.14->[]
I20260709 13:02:59.995417  9071 tablet_copy_client.cc:323] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 13:03:00.007246  1706 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet 00924ae4c66740e59de627a44de33c38 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 13:03:00.007742  1706 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet 00924ae4c66740e59de627a44de33c38 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-00924ae4c66740e59de627a44de33c38
I20260709 13:03:00.016613  1706 tablet_copy_source_session.cc:215] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:00.038707  1545 raft_consensus.cc:1275] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:03:00.046855  9057 consensus_queue.cc:1048] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:03:00.052089  9059 tablet_bootstrap.cc:492] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:00.053174  9059 tablet_bootstrap.cc:492] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:03:00.054165  9059 ts_tablet_manager.cc:1403] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.619s	user 0.050s	sys 0.018s
I20260709 13:03:00.060088  9071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00924ae4c66740e59de627a44de33c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:00.065733  1622 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:00.084949  9058 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:00.082849  9059 raft_consensus.cc:359] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:00.094946  9059 raft_consensus.cc:740] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:03:00.095681  9059 consensus_queue.cc:260] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:00.127465  9059 ts_tablet_manager.cc:1434] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:03:00.152997  1557 tablet_copy_service.cc:342] P d7158d6c3b634dc7abb69eac58eba291: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-cdca03ab6655412d9f1d4fea1f1acf78 received from {username='slave'} at 127.0.0.1:42858
I20260709 13:03:00.153525  1557 tablet_copy_service.cc:434] P d7158d6c3b634dc7abb69eac58eba291: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-cdca03ab6655412d9f1d4fea1f1acf78 on tablet cdca03ab6655412d9f1d4fea1f1acf78 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:03:00.175753  1539 raft_consensus.cc:1275] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:00.186661  9035 consensus_queue.cc:1048] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
W20260709 13:03:00.188184  9041 log.cc:927] Time spent T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:03:00.203402  9041 tablet_bootstrap.cc:492] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:00.204360  9041 tablet_bootstrap.cc:492] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:03:00.205088  9041 ts_tablet_manager.cc:1403] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.812s	user 0.052s	sys 0.048s
I20260709 13:03:00.244894  9071 tablet_copy_client.cc:806] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:00.252300  9071 tablet_copy_client.cc:670] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:00.280272  9071 tablet_copy_client.cc:538] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:00.280841  9041 raft_consensus.cc:359] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:00.311612  9041 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:03:00.312350  9041 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:00.314961  9041 ts_tablet_manager.cc:1434] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.110s	user 0.005s	sys 0.000s
I20260709 13:03:00.316902  1557 tablet_copy_service.cc:342] P d7158d6c3b634dc7abb69eac58eba291: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-646909798f0047ef9e8073d28a784525 received from {username='slave'} at 127.0.0.1:42858
I20260709 13:03:00.317284  1557 tablet_copy_service.cc:434] P d7158d6c3b634dc7abb69eac58eba291: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-646909798f0047ef9e8073d28a784525 on tablet 646909798f0047ef9e8073d28a784525 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:03:00.334060   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:00.364758  9071 tablet_bootstrap.cc:492] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:03:00.427573  9050 raft_consensus.cc:1064] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:03:00.431365  9050 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:00.457566  1694 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:00.461323  2240 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 20 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:00.463524  8935 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:00.465950  1545 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:00.467516  8935 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:00.473978  9050 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:00.498598  2241 raft_consensus.cc:1217] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [term 22 LEARNER]: Deduplicated request from leader. Original: 22.13->[22.14-22.14]   Dedup: 22.14->[]
I20260709 13:03:00.532552  9050 raft_consensus.cc:2955] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:00.537140  1545 raft_consensus.cc:2955] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:00.556603  1696 raft_consensus.cc:2955] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:00.589831  1438 catalog_manager.cc:5697] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index 14 to 15, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:00.592865  2240 raft_consensus.cc:1217] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:03:00.647886  2240 raft_consensus.cc:2955] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:00.670333  9071 tablet_bootstrap.cc:492] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:00.671412  9071 tablet_bootstrap.cc:492] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:03:00.672196  9071 ts_tablet_manager.cc:1403] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.308s	user 0.041s	sys 0.004s
I20260709 13:03:00.675163  9071 raft_consensus.cc:359] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:00.676066  9071 raft_consensus.cc:740] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:03:00.676769  9071 consensus_queue.cc:260] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:00.686122  9071 ts_tablet_manager.cc:1434] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:03:00.692694  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-00924ae4c66740e59de627a44de33c38 received from {username='slave'} at 127.0.0.1:50480
I20260709 13:03:00.693189  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-00924ae4c66740e59de627a44de33c38 on tablet 00924ae4c66740e59de627a44de33c38 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:03:00.853206  1622 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:00.860857  2240 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:00.861207  1694 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:00.868268  9089 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:00.870981  9051 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:00.885659  9050 raft_consensus.cc:2955] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:00.898676  1694 raft_consensus.cc:2955] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:00.900058  2240 raft_consensus.cc:2955] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:00.917459  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d0a7e28ddafe4ac389f2603e93af8dba with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:00.952405  2245 raft_consensus.cc:1217] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 13:03:00.954641  1445 catalog_manager.cc:5697] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 15 to 16, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New cstate: current_term: 20 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:00.957216  9002 raft_consensus.cc:1064] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:03:00.983690  1531 tablet_service.cc:1558] Processing DeleteTablet for tablet d0a7e28ddafe4ac389f2603e93af8dba with delete_type TABLET_DATA_TOMBSTONED (TS d7158d6c3b634dc7abb69eac58eba291 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:39608
I20260709 13:03:00.969880  9002 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 12, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:01.033059  1694 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:03:01.033394  9069 raft_consensus.cc:1064] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:03:01.034619  9068 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:01.050792  2245 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [term 22 LEARNER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:03:01.052987  8998 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:01.055934  1622 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:03:01.064841  9068 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:01.067544  9069 consensus_queue.cc:237] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:01.148685  9068 raft_consensus.cc:2955] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.150693  2245 raft_consensus.cc:2955] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.177865  1694 raft_consensus.cc:2955] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.190433  1445 catalog_manager.cc:5697] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 14 to 15, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.217432  1542 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:01.234896  2245 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:03:01.238905  9092 tablet_replica.cc:333] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:01.242136  1696 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:03:01.244596  9068 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:01.265462  9002 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:01.307883  9094 raft_consensus.cc:2955] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.324508  9092 raft_consensus.cc:2243] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.335326  9092 raft_consensus.cc:2272] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.338538  1694 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:01.339186  2240 raft_consensus.cc:2955] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.351204  9092 ts_tablet_manager.cc:1916] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:01.359211  8998 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:01.359596  1429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 646909798f0047ef9e8073d28a784525 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:01.364480  1617 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:01.366905  2245 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 13 LEARNER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:01.367930  9068 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:01.383694  9002 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:01.373651  1694 raft_consensus.cc:2955] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.381832  1445 catalog_manager.cc:5697] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 15 to 16, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New cstate: current_term: 22 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.404737  1606 tablet_service.cc:1558] Processing DeleteTablet for tablet 646909798f0047ef9e8073d28a784525 with delete_type TABLET_DATA_TOMBSTONED (TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:46476
I20260709 13:03:01.504962  9094 raft_consensus.cc:2955] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.509397  1617 raft_consensus.cc:2955] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.524752  9106 tablet_replica.cc:333] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:01.526158  9106 raft_consensus.cc:2243] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.528054  9099 raft_consensus.cc:1064] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:03:01.531365  9099 consensus_queue.cc:237] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:01.535951  9106 pending_rounds.cc:70] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Trying to abort 1 pending ops.
I20260709 13:03:01.545975  9092 ts_tablet_manager.cc:1929] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.15
I20260709 13:03:01.549355  1438 catalog_manager.cc:5697] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index 10 to 11, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.564365   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:01.548108  2240 raft_consensus.cc:2955] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.578029  9092 log.cc:1199] T d0a7e28ddafe4ac389f2603e93af8dba P d7158d6c3b634dc7abb69eac58eba291: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-0-root/wals/d0a7e28ddafe4ac389f2603e93af8dba
I20260709 13:03:01.580869  1429 catalog_manager.cc:5028] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): tablet d0a7e28ddafe4ac389f2603e93af8dba (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:03:01.599002  1694 raft_consensus.cc:2955] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.559028  9106 pending_rounds.cc:77] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting op as it isn't in flight: id { term: 22 index: 15 } timestamp: 7305634533205471232 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "646909798f0047ef9e8073d28a784525" old_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } } new_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } } }
I20260709 13:03:01.622349  9106 raft_consensus.cc:2917] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Aborting config change with OpId 22.15: Aborted: Op aborted
I20260709 13:03:01.622812  9106 raft_consensus.cc:2889] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:03:01.623183  9106 raft_consensus.cc:2272] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.644663  1545 consensus_queue.cc:237] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:01.650427  9106 ts_tablet_manager.cc:1916] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:01.654469  2240 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a [term 18 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:01.655567  1617 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:01.657023  1547 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:01.668089  9102 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:01.683665  2240 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:01.685979  9002 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:01.688001  1617 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:01.690157  9069 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:01.670706  9102 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:01.699332  9035 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:01.722568  9094 raft_consensus.cc:2955] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.727985  2245 raft_consensus.cc:2955] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.734695  1617 raft_consensus.cc:2955] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.759591  9106 ts_tablet_manager.cc:1929] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 22.15
I20260709 13:03:01.764601  9106 log.cc:1199] T 646909798f0047ef9e8073d28a784525 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root/wals/646909798f0047ef9e8073d28a784525
I20260709 13:03:01.773869  1430 catalog_manager.cc:5028] TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): tablet 646909798f0047ef9e8073d28a784525 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:03:01.800387  1439 catalog_manager.cc:5697] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index 11 to 12, VOTER 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) evicted. New cstate: current_term: 13 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.810814  1694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1365c85d063446a6a6a589798b355741"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
new_leader_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:44410
I20260709 13:03:01.811478  1694 raft_consensus.cc:606] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Received request to transfer leadership to TS d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:01.809665  9058 raft_consensus.cc:2955] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.814152  1429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cdca03ab6655412d9f1d4fea1f1acf78 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:01.820021  1614 raft_consensus.cc:2955] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.840559  1684 tablet_service.cc:1558] Processing DeleteTablet for tablet cdca03ab6655412d9f1d4fea1f1acf78 with delete_type TABLET_DATA_TOMBSTONED (TS 822e08445eae4a33b2f2fe92060192c6 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:34244
I20260709 13:03:01.841341   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:03:01.844324  9112 tablet_replica.cc:333] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:01.864001  2245 raft_consensus.cc:2955] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.879318  9112 raft_consensus.cc:2243] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.880518  9112 raft_consensus.cc:2272] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.847503   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:01.887563  9112 ts_tablet_manager.cc:1916] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:01.937752  9112 ts_tablet_manager.cc:1929] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:03:01.938764  9112 log.cc:1199] T cdca03ab6655412d9f1d4fea1f1acf78 P 822e08445eae4a33b2f2fe92060192c6: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-2-root/wals/cdca03ab6655412d9f1d4fea1f1acf78
I20260709 13:03:01.966674  1545 raft_consensus.cc:2955] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:02.004194  1439 catalog_manager.cc:5697] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: config changed from index 11 to 12, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:01.948776  1431 catalog_manager.cc:5028] TS 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): tablet cdca03ab6655412d9f1d4fea1f1acf78 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
W20260709 13:03:02.014998  1431 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 66222.4us
W20260709 13:03:02.031710  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 107626us
W20260709 13:03:02.048987  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 103079us
I20260709 13:03:02.114185  1694 consensus_queue.cc:237] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:02.125978  2240 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:02.128069  9058 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:02.140105  9101 raft_consensus.cc:2955] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:02.145844  1542 raft_consensus.cc:1275] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:02.157104  2245 raft_consensus.cc:2955] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:02.186446  9102 consensus_queue.cc:1048] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:02.198930  1438 catalog_manager.cc:5697] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 12 to 13, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New cstate: current_term: 18 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:02.212384  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 00924ae4c66740e59de627a44de33c38 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:02.217005  1606 tablet_service.cc:1558] Processing DeleteTablet for tablet 00924ae4c66740e59de627a44de33c38 with delete_type TABLET_DATA_TOMBSTONED (TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:46476
I20260709 13:03:02.217983  9106 tablet_replica.cc:333] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:02.225718  1539 raft_consensus.cc:2955] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:02.232311  9106 raft_consensus.cc:2243] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.233265  9106 raft_consensus.cc:2272] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.237922  9106 ts_tablet_manager.cc:1916] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:02.246755  9102 raft_consensus.cc:993] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:03:02.247291  9102 raft_consensus.cc:1081] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Signalling peer d7158d6c3b634dc7abb69eac58eba291 to start an election
I20260709 13:03:02.249527  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1365c85d063446a6a6a589798b355741"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
 from {username='slave'} at 127.0.0.1:39612
I20260709 13:03:02.250114  1542 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:02.250468  1542 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:02.286325  9106 ts_tablet_manager.cc:1929] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 13:03:02.286895  9106 log.cc:1199] T 00924ae4c66740e59de627a44de33c38 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root/wals/00924ae4c66740e59de627a44de33c38
I20260709 13:03:02.290325  1430 catalog_manager.cc:5028] TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): tablet 00924ae4c66740e59de627a44de33c38 (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:03:02.292786  1542 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:02.297716  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:03:02.298280  1617 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:02.313946  1617 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:03:02.314872  1542 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:02.315167  1511 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:03:02.316686  9002 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:02.317210  9002 raft_consensus.cc:697] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 19 LEADER]: Becoming Leader. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:03:02.318105  9002 consensus_queue.cc:237] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:02.332168  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:03:02.332969  1694 raft_consensus.cc:3055] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:02.333415  1694 raft_consensus.cc:740] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:03:02.334467  1694 consensus_queue.cc:260] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:02.336822  1694 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:02.341730  1438 catalog_manager.cc:5697] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: term changed from 18 to 19, leader changed from 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195) to d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:02.376477  1694 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7158d6c3b634dc7abb69eac58eba291 in term 19.
I20260709 13:03:02.865499  1617 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:02.868813  9097 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:02.886531   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:02.902215  1691 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:02.913200  9002 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:03.351078  1615 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:03.378225  1691 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:03:03.382547  9114 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:03:03.386137  1586 consensus_peers.cc:597] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 63e2429c350c4d36a523ed1c4955ef23. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.416779  1539 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 25 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:03:03.426980  9114 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:03.513890  9114 raft_consensus.cc:2955] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 25 LEADER]: Committing config change with OpId 25.16: config changed from index -1 to 16, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:03:03.540414  1691 raft_consensus.cc:2955] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index -1 to 16, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:03:03.623330  1539 consensus_queue.cc:237] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:03.650132  1438 catalog_manager.cc:5697] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index -1 to 16, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 25 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
W20260709 13:03:03.657819  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 47946.7us
I20260709 13:03:03.662828  1545 raft_consensus.cc:2955] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index -1 to 16, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:03:03.710858  1691 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:03:03.715780  1511 consensus_peers.cc:597] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a69de749cce497b83e6489ad367017a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.718187  9094 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:03.729334  1615 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:03:03.730980  9094 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:03.793753  9094 raft_consensus.cc:2955] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:03:03.817095  1691 raft_consensus.cc:2955] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:03:03.849851  9137 ts_tablet_manager.cc:933] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:03.855664  1617 raft_consensus.cc:2955] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:03:03.871615  1691 consensus_queue.cc:237] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:03.892234  9137 tablet_copy_client.cc:323] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39981
I20260709 13:03:03.897543  1632 tablet_copy_service.cc:140] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Received BeginTabletCopySession request for tablet 63e2429c350c4d36a523ed1c4955ef23 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50552)
I20260709 13:03:03.898186  1632 tablet_copy_service.cc:161] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Beginning new tablet copy session on tablet 63e2429c350c4d36a523ed1c4955ef23 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50552: session id = e8a64798e5f94de8909707bcbd11804a-63e2429c350c4d36a523ed1c4955ef23
I20260709 13:03:03.948385  1445 catalog_manager.cc:5697] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index -1 to 13, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 21 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:03.949826  1632 tablet_copy_source_session.cc:215] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:03.975044  9137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63e2429c350c4d36a523ed1c4955ef23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:03.982559  1614 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:03.984225  9058 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:03.987536  1545 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:03.990574  9101 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:03:04.006429  1660 consensus_peers.cc:597] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 927e42de9e944ae8a2d45f30be59d5df. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:04.028656  9035 raft_consensus.cc:2955] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:03:04.041326  1539 raft_consensus.cc:2955] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:03:04.042078  1614 raft_consensus.cc:2955] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:03:04.054056   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:04.055210  9137 tablet_copy_client.cc:806] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:04.055948  9137 tablet_copy_client.cc:670] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:04.069888  1438 catalog_manager.cc:5697] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index -1 to 13, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 20 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:04.071058  1617 consensus_queue.cc:237] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:04.079624  9137 tablet_copy_client.cc:538] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:03:04.112919  1586 consensus_peers.cc:597] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413): Couldn't send request to peer e8a64798e5f94de8909707bcbd11804a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c5daaba0e764f4ca8876bda9d220973. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:04.113499  1694 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:04.116989  9127 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:04.117756  1539 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:04.124589  9131 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:04.179172  9131 raft_consensus.cc:2955] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:03:04.187029  1696 raft_consensus.cc:2955] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:03:04.218685  9147 ts_tablet_manager.cc:933] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
I20260709 13:03:04.220996  1539 raft_consensus.cc:2955] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:03:04.241191  1438 catalog_manager.cc:5697] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index -1 to 11, NON_VOTER e8a64798e5f94de8909707bcbd11804a (127.0.107.196) added. New cstate: current_term: 19 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } }
I20260709 13:03:04.217388  9137 tablet_bootstrap.cc:492] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:03:04.264119  9147 tablet_copy_client.cc:323] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:41871
I20260709 13:03:04.274854  1557 tablet_copy_service.cc:140] P d7158d6c3b634dc7abb69eac58eba291: Received BeginTabletCopySession request for tablet 5a69de749cce497b83e6489ad367017a from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:42858)
I20260709 13:03:04.276420  1557 tablet_copy_service.cc:161] P d7158d6c3b634dc7abb69eac58eba291: Beginning new tablet copy session on tablet 5a69de749cce497b83e6489ad367017a from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:42858: session id = e8a64798e5f94de8909707bcbd11804a-5a69de749cce497b83e6489ad367017a
I20260709 13:03:04.286351  1557 tablet_copy_source_session.cc:215] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:04.307333  9147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a69de749cce497b83e6489ad367017a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.310101  1545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "646909798f0047ef9e8073d28a784525"
dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
mode: GRACEFUL
new_leader_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:36596
I20260709 13:03:04.310815  1545 raft_consensus.cc:606] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 22 LEADER]: Received request to transfer leadership to TS e8a64798e5f94de8909707bcbd11804a
I20260709 13:03:04.321349   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:03:04.323020   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:04.393148  9147 tablet_copy_client.cc:806] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:04.395632  9147 tablet_copy_client.cc:670] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:04.412822  9147 tablet_copy_client.cc:538] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:04.425958  9147 tablet_bootstrap.cc:492] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:03:04.463971  9124 raft_consensus.cc:993] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291: : Instructing follower e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:03:04.464584  9097 raft_consensus.cc:1081] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 22 LEADER]: Signalling peer e8a64798e5f94de8909707bcbd11804a to start an election
I20260709 13:03:04.466410  2241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "646909798f0047ef9e8073d28a784525"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:45866
I20260709 13:03:04.466979  2241 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:04.467351  2241 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:04.481488  2241 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:04.491003  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: true dest_uuid: "d7158d6c3b634dc7abb69eac58eba291"
I20260709 13:03:04.491689  1539 raft_consensus.cc:3055] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:04.491954  1539 raft_consensus.cc:740] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d7158d6c3b634dc7abb69eac58eba291, State: Running, Role: LEADER
I20260709 13:03:04.492630  1539 consensus_queue.cc:260] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:04.493709  1539 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:04.503213  1539 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 23.
I20260709 13:03:04.509450  2209 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:03:04.509895  2241 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 23 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:04.512024  9150 ts_tablet_manager.cc:933] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:04.511818  9130 raft_consensus.cc:2804] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:04.512617  9130 raft_consensus.cc:697] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [term 23 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:03:04.513168  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:03:04.513819  1694 raft_consensus.cc:3060] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:04.513622  9130 consensus_queue.cc:237] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:04.532600  9137 tablet_bootstrap.cc:492] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:04.548758  1694 raft_consensus.cc:2468] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 23.
I20260709 13:03:04.541973  1439 catalog_manager.cc:5697] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 22 to 23, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 23 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:04.541620  9150 tablet_copy_client.cc:323] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:34459
I20260709 13:03:04.566584  1706 tablet_copy_service.cc:140] P 822e08445eae4a33b2f2fe92060192c6: Received BeginTabletCopySession request for tablet 927e42de9e944ae8a2d45f30be59d5df from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50480)
I20260709 13:03:04.549510  9137 tablet_bootstrap.cc:492] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:03:04.567090  1706 tablet_copy_service.cc:161] P 822e08445eae4a33b2f2fe92060192c6: Beginning new tablet copy session on tablet 927e42de9e944ae8a2d45f30be59d5df from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50480: session id = e8a64798e5f94de8909707bcbd11804a-927e42de9e944ae8a2d45f30be59d5df
I20260709 13:03:04.567873  9137 ts_tablet_manager.cc:1403] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.394s	user 0.045s	sys 0.011s
I20260709 13:03:04.575289  1706 tablet_copy_source_session.cc:215] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:04.576225  9137 raft_consensus.cc:359] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 25 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:04.582593  9137 raft_consensus.cc:740] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 25 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:03:04.583402  9137 consensus_queue.cc:260] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:04.585665  9150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927e42de9e944ae8a2d45f30be59d5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.586463  9137 ts_tablet_manager.cc:1434] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:03:04.588999  1632 tablet_copy_service.cc:342] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-63e2429c350c4d36a523ed1c4955ef23 received from {username='slave'} at 127.0.0.1:50552
I20260709 13:03:04.589421  1632 tablet_copy_service.cc:434] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-63e2429c350c4d36a523ed1c4955ef23 on tablet 63e2429c350c4d36a523ed1c4955ef23 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:03:04.601840  9147 tablet_bootstrap.cc:492] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:04.607663  9147 tablet_bootstrap.cc:492] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:03:04.609546  9147 ts_tablet_manager.cc:1403] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.184s	user 0.046s	sys 0.017s
I20260709 13:03:04.633844  9147 raft_consensus.cc:359] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:04.637058  9147 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:03:04.638165  9147 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:04.637473  9150 tablet_copy_client.cc:806] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:04.639597  9150 tablet_copy_client.cc:670] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:04.644929  9147 ts_tablet_manager.cc:1434] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.005s
I20260709 13:03:04.645354  9150 tablet_copy_client.cc:538] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:04.650425  1557 tablet_copy_service.cc:342] P d7158d6c3b634dc7abb69eac58eba291: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-5a69de749cce497b83e6489ad367017a received from {username='slave'} at 127.0.0.1:42858
I20260709 13:03:04.650970  1557 tablet_copy_service.cc:434] P d7158d6c3b634dc7abb69eac58eba291: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-5a69de749cce497b83e6489ad367017a on tablet 5a69de749cce497b83e6489ad367017a with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:03:04.673875  9147 ts_tablet_manager.cc:933] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a: Initiating tablet copy from peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:04.678857  9150 tablet_bootstrap.cc:492] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:03:04.721539  9147 tablet_copy_client.cc:323] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39981
I20260709 13:03:04.724177  1632 tablet_copy_service.cc:140] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Received BeginTabletCopySession request for tablet 7c5daaba0e764f4ca8876bda9d220973 from peer e8a64798e5f94de8909707bcbd11804a ({username='slave'} at 127.0.0.1:50552)
I20260709 13:03:04.724788  1632 tablet_copy_service.cc:161] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Beginning new tablet copy session on tablet 7c5daaba0e764f4ca8876bda9d220973 from peer e8a64798e5f94de8909707bcbd11804a at {username='slave'} at 127.0.0.1:50552: session id = e8a64798e5f94de8909707bcbd11804a-7c5daaba0e764f4ca8876bda9d220973
I20260709 13:03:04.754820  1632 tablet_copy_source_session.cc:215] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:04.765731  9147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5daaba0e764f4ca8876bda9d220973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.765719  2241 raft_consensus.cc:1217] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 21 LEARNER]: Deduplicated request from leader. Original: 21.12->[21.13-21.13]   Dedup: 21.13->[]
I20260709 13:03:04.807096  9147 tablet_copy_client.cc:806] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:04.807787  9147 tablet_copy_client.cc:670] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:04.818315  9147 tablet_copy_client.cc:538] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:04.829051  9147 tablet_bootstrap.cc:492] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a: Bootstrap starting.
I20260709 13:03:04.879293  9150 tablet_bootstrap.cc:492] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:04.880945  9150 tablet_bootstrap.cc:492] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:03:04.882303  9150 ts_tablet_manager.cc:1403] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.203s	user 0.035s	sys 0.016s
I20260709 13:03:04.897365  1691 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:03:04.899350  9130 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:04.923892  9150 raft_consensus.cc:359] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:04.924979  9150 raft_consensus.cc:740] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:03:04.925686  9150 consensus_queue.cc:260] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:05.013471  9150 ts_tablet_manager.cc:1434] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.131s	user 0.007s	sys 0.001s
I20260709 13:03:05.027170  1706 tablet_copy_service.cc:342] P 822e08445eae4a33b2f2fe92060192c6: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-927e42de9e944ae8a2d45f30be59d5df received from {username='slave'} at 127.0.0.1:50480
I20260709 13:03:05.027657  1706 tablet_copy_service.cc:434] P 822e08445eae4a33b2f2fe92060192c6: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-927e42de9e944ae8a2d45f30be59d5df on tablet 927e42de9e944ae8a2d45f30be59d5df with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:03:05.039551  2240 raft_consensus.cc:1217] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [term 20 LEARNER]: Deduplicated request from leader. Original: 20.12->[20.13-20.13]   Dedup: 20.13->[]
W20260709 13:03:05.051379  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 97590.1us
I20260709 13:03:05.055251  1545 raft_consensus.cc:1275] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:03:05.063311  2240 raft_consensus.cc:1217] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 25 LEARNER]: Deduplicated request from leader. Original: 25.15->[25.16-25.16]   Dedup: 25.16->[]
I20260709 13:03:05.071892  9147 tablet_bootstrap.cc:492] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:05.072868  9147 tablet_bootstrap.cc:492] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a: Bootstrap complete.
I20260709 13:03:05.073594  9147 ts_tablet_manager.cc:1403] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a: Time spent bootstrapping tablet: real 0.245s	user 0.038s	sys 0.011s
I20260709 13:03:05.084707  9147 raft_consensus.cc:359] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:05.085570  9147 raft_consensus.cc:740] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Initialized, Role: LEARNER
I20260709 13:03:05.086201  9147 consensus_queue.cc:260] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } }
I20260709 13:03:05.088515  9147 ts_tablet_manager.cc:1434] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:03:05.076617  9107 consensus_queue.cc:1048] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.008s
I20260709 13:03:05.090703  1632 tablet_copy_service.cc:342] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Request end of tablet copy session e8a64798e5f94de8909707bcbd11804a-7c5daaba0e764f4ca8876bda9d220973 received from {username='slave'} at 127.0.0.1:50552
I20260709 13:03:05.091100  1632 tablet_copy_service.cc:434] P dcc91bf6e3bd468bbbbfc26e3a7c5e01: ending tablet copy session e8a64798e5f94de8909707bcbd11804a-7c5daaba0e764f4ca8876bda9d220973 on tablet 7c5daaba0e764f4ca8876bda9d220973 with peer e8a64798e5f94de8909707bcbd11804a
I20260709 13:03:05.161242  2240 raft_consensus.cc:1217] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a [term 19 LEARNER]: Deduplicated request from leader. Original: 19.10->[19.11-19.11]   Dedup: 19.11->[]
I20260709 13:03:05.271952  9124 raft_consensus.cc:1064] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:03:05.274761  9124 consensus_queue.cc:237] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 11, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:05.315403  1696 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:05.316180  2241 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 21 LEARNER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:05.318048  9097 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:05.324254   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:05.352138  9165 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:05.355469  1617 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Refusing update from remote peer d7158d6c3b634dc7abb69eac58eba291: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:05.357599  9166 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:05.491765  9114 raft_consensus.cc:1064] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:03:05.494576  9114 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 14, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:05.506067  9124 raft_consensus.cc:2955] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 13 to 14, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:05.512910  1696 raft_consensus.cc:2955] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:05.524544  1617 raft_consensus.cc:2955] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:05.543383  2243 raft_consensus.cc:2955] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:05.548524  1438 catalog_manager.cc:5697] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index 13 to 14, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "d7158d6c3b634dc7abb69eac58eba291" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.578226  1694 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:03:05.578299  2240 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 25 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:03:05.580075  9127 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:05.589840  9114 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:05.600939  9169 raft_consensus.cc:1064] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:03:05.603989  9169 consensus_queue.cc:237] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:05.612293  1545 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 25 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:03:05.616707  9127 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:05.626574  9131 raft_consensus.cc:2955] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 25 LEADER]: Committing config change with OpId 25.17: config changed from index 16 to 17, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:05.641531  9114 raft_consensus.cc:1064] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: attempting to promote NON_VOTER e8a64798e5f94de8909707bcbd11804a to VOTER
I20260709 13:03:05.650630  1694 raft_consensus.cc:2955] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 16 to 17, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:05.666311  9114 consensus_queue.cc:237] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 9, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:05.738632  2243 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [term 20 LEARNER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:03:05.740397  9170 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:05.744182  1614 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:03:05.747625  1545 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:03:05.750090  9035 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:05.763959  2241 raft_consensus.cc:2955] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 16 to 17, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:05.771567  1541 raft_consensus.cc:2955] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 16 to 17, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:05.801745  1694 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:05.821604  9184 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:05.834298   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:03:05.844312  1585 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:05.811197  9170 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
W20260709 13:03:05.935364  1659 consensus_peers.cc:597] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:05.937494  1659 consensus_peers.cc:597] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:05.947790  1659 consensus_peers.cc:597] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:05.969930  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 101059us
I20260709 13:03:05.980268  1438 catalog_manager.cc:5697] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 reported cstate change: config changed from index 16 to 17, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 25 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } attrs { replace: true } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:03:06.005496  2209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 158691us
I20260709 13:03:06.007804  2241 raft_consensus.cc:1275] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a [term 19 LEARNER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:03:06.013687  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 128522us
W20260709 13:03:06.019189  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 175041us
I20260709 13:03:06.024430  9114 consensus_queue.cc:1048] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
W20260709 13:03:06.046859  2209 consensus_peers.cc:597] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.056767  1659 consensus_peers.cc:597] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.061134  2209 consensus_peers.cc:597] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.078887  1429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 67092.4us
W20260709 13:03:06.082747  2211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34459, user_credentials={real_user=slave}} blocked reactor thread for 59954.4us
W20260709 13:03:06.086400  2209 consensus_peers.cc:597] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.091744  2209 consensus_peers.cc:597] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.104298  1585 consensus_peers.cc:597] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.108918  1659 consensus_peers.cc:597] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.109351  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 50244.5us
W20260709 13:03:06.100256  1429 catalog_manager.cc:4755] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): ChangeConfig:REMOVE_PEER RPC failed for tablet 5a69de749cce497b83e6489ad367017a: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:06.110785  1620 raft_consensus.cc:2955] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:06.115715  9035 raft_consensus.cc:2955] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 13 to 14, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:03:06.143656  1659 consensus_peers.cc:597] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.149353  1659 consensus_peers.cc:597] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.151587  1659 consensus_peers.cc:597] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:06.170291  2240 raft_consensus.cc:2955] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:03:06.181143  1585 consensus_peers.cc:597] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.186652  1585 consensus_peers.cc:597] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.192270  1585 consensus_peers.cc:597] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.198051  1585 consensus_peers.cc:597] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:06.191913  1439 catalog_manager.cc:5697] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 13 to 14, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:06.203476  1620 consensus_queue.cc:237] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:06.215799  1691 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:03:06.217850  9185 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:03:06.206346  2209 consensus_peers.cc:597] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.223057  1585 consensus_peers.cc:597] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:06.224511  9127 raft_consensus.cc:2955] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index 11 to 12, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:03:06.227568  1585 consensus_peers.cc:597] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:06.229461  9114 raft_consensus.cc:2955] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 25 LEADER]: Committing config change with OpId 25.18: config changed from index 17 to 18, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:06.230870  1691 raft_consensus.cc:2955] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 17 to 18, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:06.235432  1696 raft_consensus.cc:2955] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:03:06.244980  1585 consensus_peers.cc:597] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:06.247016  2240 raft_consensus.cc:1275] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 25 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:03:06.246649  2241 raft_consensus.cc:2955] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:06.253260  9186 consensus_queue.cc:1048] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:03:06.263353  2240 raft_consensus.cc:2955] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 17 to 18, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:06.275012  1687 consensus_queue.cc:237] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:06.285506  2243 raft_consensus.cc:1275] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:06.289075  9200 consensus_queue.cc:1048] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:06.295279  1439 catalog_manager.cc:5697] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 11 to 12, e8a64798e5f94de8909707bcbd11804a (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:06.301373  9035 raft_consensus.cc:2955] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:06.315307  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 63e2429c350c4d36a523ed1c4955ef23 with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:06.302878  2243 raft_consensus.cc:2955] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:06.308162  1441 catalog_manager.cc:5697] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: config changed from index 17 to 18, VOTER d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) evicted. New cstate: current_term: 25 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
W20260709 13:03:06.328797  2209 consensus_peers.cc:597] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:06.360716   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:06.372689   431 tablet_replica.cc:333] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.373752   431 raft_consensus.cc:2243] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:06.380522   431 raft_consensus.cc:2272] T 1becd217447147aeb09608ec3f5c123b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.383503   431 tablet_replica.cc:333] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.384370   431 raft_consensus.cc:2243] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.385032   431 raft_consensus.cc:2272] T 00924ae4c66740e59de627a44de33c38 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:06.387573  1659 consensus_peers.cc:597] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.388479  1659 consensus_peers.cc:597] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:06.396107  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 927e42de9e944ae8a2d45f30be59d5df with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:06.406173   431 tablet_replica.cc:333] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.410682   431 raft_consensus.cc:2243] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.411451   431 raft_consensus.cc:2272] T 9355ac91422346bb9f5dfa3c1424df25 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.436874  1445 catalog_manager.cc:5697] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a reported cstate change: config changed from index 14 to 15, VOTER dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) evicted. New cstate: current_term: 20 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:06.441927   431 tablet_replica.cc:333] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.443135   431 raft_consensus.cc:2243] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.443836   431 raft_consensus.cc:2272] T 17d7fbb63fde4df88c4345a9532b4738 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.449113   431 tablet_replica.cc:333] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.455638  1606 tablet_service.cc:1558] Processing DeleteTablet for tablet 927e42de9e944ae8a2d45f30be59d5df with delete_type TABLET_DATA_TOMBSTONED (TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:46476
W20260709 13:03:06.466697  2209 consensus_peers.cc:597] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:06.470741   431 raft_consensus.cc:2243] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:03:06.471340  2209 consensus_peers.cc:597] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:06.472100   431 raft_consensus.cc:2272] T 9831a5f16aac472b8ce4f707c039e298 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:06.472162  2209 consensus_peers.cc:597] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.474371  2209 consensus_peers.cc:597] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:06.475128   431 tablet_replica.cc:333] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
W20260709 13:03:06.481899  1659 consensus_peers.cc:597] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.485035  1659 consensus_peers.cc:597] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.485860  1659 consensus_peers.cc:597] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:06.516234   431 raft_consensus.cc:2243] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:06.518718  9201 tablet_replica.cc:333] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
W20260709 13:03:06.520062  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.519991  9201 raft_consensus.cc:2243] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.523810  9201 raft_consensus.cc:2272] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.544783   431 raft_consensus.cc:2272] T 67f0dcf1e89644688ea3e2603f9a37d0 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.553017  9201 ts_tablet_manager.cc:1916] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:06.562513   431 tablet_replica.cc:333] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.573130   431 raft_consensus.cc:2243] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.573964   431 raft_consensus.cc:2272] T 4b6f3b457deb4725b437c627cc3a5cd7 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.579275   431 tablet_replica.cc:333] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.580214   431 raft_consensus.cc:2243] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.586184   431 raft_consensus.cc:2272] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P d7158d6c3b634dc7abb69eac58eba291 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.590523   431 tablet_replica.cc:333] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.596019   431 raft_consensus.cc:2243] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.596834   431 raft_consensus.cc:2272] T 5ca86ee366e14bdd8686ea8e5b48be10 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.612738   431 tablet_replica.cc:333] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.616533   431 raft_consensus.cc:2243] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.618698   431 raft_consensus.cc:2272] T ad3e3b7b46ab493c8eda918df77def64 P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.624217   431 tablet_replica.cc:333] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.631508   431 raft_consensus.cc:2243] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.632473   431 raft_consensus.cc:2272] T 6817bc4013144ede80163d16316d4860 P d7158d6c3b634dc7abb69eac58eba291 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.635169   431 tablet_replica.cc:333] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.642647   431 raft_consensus.cc:2243] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.643368   431 raft_consensus.cc:2272] T 32470c2737744478bac199459790b787 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.653604   431 tablet_replica.cc:333] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.663915   431 raft_consensus.cc:2243] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:06.665450   431 raft_consensus.cc:2272] T 4ceaee3af9aa446a8796bde98fd46779 P d7158d6c3b634dc7abb69eac58eba291 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.668205   431 tablet_replica.cc:333] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.669075   431 raft_consensus.cc:2243] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.669831   431 raft_consensus.cc:2272] T 7c5daaba0e764f4ca8876bda9d220973 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.672542   431 tablet_replica.cc:333] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.676465   431 raft_consensus.cc:2243] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.677054   431 raft_consensus.cc:2272] T 02b29fae0aae48f28944958f7ef007fa P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.679708   431 tablet_replica.cc:333] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.691885   431 raft_consensus.cc:2243] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.692730   431 raft_consensus.cc:2272] T 89f88fe569c2476cb298d5e6b745bb5c P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.695307   431 tablet_replica.cc:333] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.696097   431 raft_consensus.cc:2243] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:06.697366   431 raft_consensus.cc:2272] T 5a69de749cce497b83e6489ad367017a P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.699936   431 tablet_replica.cc:333] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.701023   431 raft_consensus.cc:2243] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:06.702101   431 raft_consensus.cc:2272] T cdca03ab6655412d9f1d4fea1f1acf78 P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.711176   431 tablet_replica.cc:333] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.712054   431 raft_consensus.cc:2243] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.712515   431 pending_rounds.cc:70] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291: Trying to abort 1 pending ops.
I20260709 13:03:06.712805   431 pending_rounds.cc:77] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291: Aborting op as it isn't in flight: id { term: 20 index: 14 } timestamp: 7305634552226578432 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "927e42de9e944ae8a2d45f30be59d5df" old_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: true } } } new_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } attrs { replace: true } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } } }
I20260709 13:03:06.723207   431 raft_consensus.cc:2917] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Aborting config change with OpId 20.14: Aborted: Op aborted
I20260709 13:03:06.724138   431 raft_consensus.cc:2889] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:03:06.724967   431 raft_consensus.cc:2272] T 927e42de9e944ae8a2d45f30be59d5df P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.738144   431 tablet_replica.cc:333] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.740150   431 raft_consensus.cc:2243] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.748309   431 raft_consensus.cc:2272] T 5d987fd742df4898acd2aaa15097431c P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.751405   431 tablet_replica.cc:333] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.763506   431 raft_consensus.cc:2243] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.764221   431 raft_consensus.cc:2272] T 03423b07f7be422db9d20b7313be1bab P d7158d6c3b634dc7abb69eac58eba291 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.767174   431 tablet_replica.cc:333] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.775951   431 raft_consensus.cc:2243] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:06.777238   431 raft_consensus.cc:2272] T 4142f46c85974609aa207df00c3d031e P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.780292   431 tablet_replica.cc:333] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.781178   431 raft_consensus.cc:2243] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.787635   431 raft_consensus.cc:2272] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.790956   431 tablet_replica.cc:333] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.791774   431 raft_consensus.cc:2243] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.792699   431 raft_consensus.cc:2272] T 7aca6dcf002947d6841150860825871b P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.803872   431 tablet_replica.cc:333] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.804683   431 raft_consensus.cc:2243] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.805286   431 raft_consensus.cc:2272] T 0f253020cc7a4b66aa6c8f66a42d44c6 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.808642   431 tablet_replica.cc:333] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.809474   431 raft_consensus.cc:2243] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.810277   431 raft_consensus.cc:2272] T 2d351fa3549448eda026a66b8c124d58 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.817880   431 tablet_replica.cc:333] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.818784   431 raft_consensus.cc:2243] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.819780   431 raft_consensus.cc:2272] T 158ebfb5c6324189947e23e5386968e4 P d7158d6c3b634dc7abb69eac58eba291 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.823431   431 tablet_replica.cc:333] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.835891   431 raft_consensus.cc:2243] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:06.837244   431 raft_consensus.cc:2272] T b19a10a05aa24743a6d1222179fd4af4 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.837888  9166 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:06.838528  9166 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:06.840818  9166 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:06.842607  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:06.845520  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11a3619de25451bbe5a091f271cfa6b" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:03:06.847184  1511 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:03:06.848346  9166 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:06.850286   431 tablet_replica.cc:333] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.851065  9201 ts_tablet_manager.cc:1929] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.14
I20260709 13:03:06.851140   431 raft_consensus.cc:2243] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.852766   431 raft_consensus.cc:2272] T b11a3619de25451bbe5a091f271cfa6b P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.855477   431 tablet_replica.cc:333] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.872014   431 raft_consensus.cc:2243] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.877434  9201 log.cc:1199] T 927e42de9e944ae8a2d45f30be59d5df P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Deleting WAL directory at /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601945298557-431-0/minicluster-data/ts-1-root/wals/927e42de9e944ae8a2d45f30be59d5df
I20260709 13:03:06.901736  1430 catalog_manager.cc:5028] TS dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): tablet 927e42de9e944ae8a2d45f30be59d5df (table test-workload [id=b4707bb388214cfa862131e3f63f3467]) successfully deleted
I20260709 13:03:06.907622   431 raft_consensus.cc:2272] T 685ae4154c6d4c3abdaf18547da9ffe2 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.941658   431 tablet_replica.cc:333] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.942489   431 raft_consensus.cc:2243] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:06.943653   431 raft_consensus.cc:2272] T 1365c85d063446a6a6a589798b355741 P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.952034   431 tablet_replica.cc:333] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.952823   431 raft_consensus.cc:2243] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:06.953902   431 raft_consensus.cc:2272] T 2efa93934d6a4a8182f175ae59fc177e P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.974100  9166 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:06.974651  9166 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:06.978206  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:03:06.980892  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5efbd7e50442858cc9d27a08f50b3e" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:06.983752  1512 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:06.976730  9166 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:06.984774  9173 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:06.988721   431 tablet_replica.cc:333] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:06.989571   431 raft_consensus.cc:2243] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.990152   431 raft_consensus.cc:2272] T 1a2222d3d1694f2d93fb2f0702805e3e P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.013154   431 tablet_replica.cc:333] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:07.014083   431 raft_consensus.cc:2243] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.027038   431 raft_consensus.cc:2272] T 4f5673bb37ab4e1b9ae5af2d2091b347 P d7158d6c3b634dc7abb69eac58eba291 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.064227  9166 raft_consensus.cc:493] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:03:07.064889  9166 raft_consensus.cc:515] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:07.069116  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:07.069707  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "646909798f0047ef9e8073d28a784525" candidate_uuid: "d7158d6c3b634dc7abb69eac58eba291" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:07.067149  9166 leader_election.cc:290] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:07.071507  1512 leader_election.cc:304] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7158d6c3b634dc7abb69eac58eba291; no voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a
I20260709 13:03:07.072603  9166 raft_consensus.cc:2749] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:07.074052   431 tablet_replica.cc:333] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:07.075627   431 raft_consensus.cc:2243] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.076272   431 raft_consensus.cc:2272] T 646909798f0047ef9e8073d28a784525 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.079208   431 tablet_replica.cc:333] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:07.080066   431 raft_consensus.cc:2243] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.081194   431 raft_consensus.cc:2272] T 710dba62795546819d9b3fd89ad4e8fe P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.084053   431 tablet_replica.cc:333] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:07.086575   431 raft_consensus.cc:2243] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.087121   431 raft_consensus.cc:2272] T bd6921d4b2d8478f99effa533f8d9f3d P d7158d6c3b634dc7abb69eac58eba291 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.094528   431 tablet_replica.cc:333] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:07.095355   431 raft_consensus.cc:2243] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.096177   431 raft_consensus.cc:2272] T 63e2429c350c4d36a523ed1c4955ef23 P d7158d6c3b634dc7abb69eac58eba291 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.098948   431 tablet_replica.cc:333] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:07.099758   431 raft_consensus.cc:2243] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.100893   431 raft_consensus.cc:2272] T 7803266de9984fac88726b08bee73921 P d7158d6c3b634dc7abb69eac58eba291 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.116660   431 tablet_replica.cc:333] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:07.117408   431 raft_consensus.cc:2243] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.118559   431 raft_consensus.cc:2272] T c4270ae85dd544aeb602acb371def068 P d7158d6c3b634dc7abb69eac58eba291 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.121440   431 tablet_replica.cc:333] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:07.122213   431 raft_consensus.cc:2243] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.123010   431 raft_consensus.cc:2272] T 5ee97fe9eef14f818a1f9178885dfc31 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.125902   431 tablet_replica.cc:333] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:07.126578   431 raft_consensus.cc:2243] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.139513   431 raft_consensus.cc:2272] T c528a0f6bdb44c4187c750d0b1429ba1 P d7158d6c3b634dc7abb69eac58eba291 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.144246   431 tablet_replica.cc:333] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:07.144963   431 raft_consensus.cc:2243] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.145514   431 raft_consensus.cc:2272] T fa1a194f4d834ee6aa037d727b8f9e2a P d7158d6c3b634dc7abb69eac58eba291 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.165011   431 tablet_replica.cc:333] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:07.165690   431 raft_consensus.cc:2243] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.166760   431 raft_consensus.cc:2272] T e52504b3c7614b43be2a7cf1be42ad66 P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.169495   431 tablet_replica.cc:333] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:07.170226   431 raft_consensus.cc:2243] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.170846   431 raft_consensus.cc:2272] T 5814bf31e900408885160ea0f89d6189 P d7158d6c3b634dc7abb69eac58eba291 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.173712   431 tablet_replica.cc:333] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291: stopping tablet replica
I20260709 13:03:07.174346   431 raft_consensus.cc:2243] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.175014   431 raft_consensus.cc:2272] T 7b5efbd7e50442858cc9d27a08f50b3e P d7158d6c3b634dc7abb69eac58eba291 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:07.327723  1429 catalog_manager.cc:4755] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): ChangeConfig:REMOVE_PEER RPC failed for tablet 5a69de749cce497b83e6489ad367017a: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:07.539953  9184 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:07.540578  9184 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:07.544566  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:07.543025  9184 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:07.556854  1585 leader_election.cc:336] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:07.557497  1585 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:07.558395  9184 raft_consensus.cc:2749] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:07.571727  9184 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:07.572350  9184 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:07.576009  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:07.586083  9184 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:07.592780  9205 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:07.593448  9205 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:07.595870  9205 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:07.596887  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:03:07.602854  2209 leader_election.cc:336] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:07.603379  2209 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:07.604099  9205 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:07.608033  1585 leader_election.cc:336] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:07.608584  1585 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:07.609804  9185 raft_consensus.cc:2749] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:07.712790   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:03:07.743532  9101 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:07.744094  9101 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:07.745939  9101 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:07.750409  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:03:07.751076  1614 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:03:07.752255  1660 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:03:07.753962  9170 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:07.754333  9170 raft_consensus.cc:493] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:07.754711  9170 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:07.757853  1659 leader_election.cc:336] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:07.776748  9169 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:07.777346  9169 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:07.782614  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:03:07.783329  1620 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:03:07.784493  1660 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
W20260709 13:03:07.786356  1659 leader_election.cc:336] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:07.787459  9101 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:07.787940  9101 raft_consensus.cc:493] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:07.788278  9101 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:07.795341  9169 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:07.799199  9170 raft_consensus.cc:515] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:07.802731  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0dcf1e89644688ea3e2603f9a37d0" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:03:07.803380  1614 raft_consensus.cc:3060] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:07.807209  1659 leader_election.cc:336] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:07.822978  1614 raft_consensus.cc:2468] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:03:07.848047  9170 leader_election.cc:290] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:07.830462  9101 raft_consensus.cc:515] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:03:07.857339  1659 leader_election.cc:336] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:07.858655  9215 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:07.858951  9185 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:07.863821  9185 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:07.866168  9185 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:07.871381  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:07.862000  9215 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:07.879904  9205 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:07.880461  9205 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:07.885041  1585 leader_election.cc:336] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:07.885571  1585 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:07.886379  9184 raft_consensus.cc:2749] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:07.891443  1659 leader_election.cc:336] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:07.893553  9215 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:07.861337  9101 leader_election.cc:290] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:07.897233  9205 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:07.899420  2209 leader_election.cc:336] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:07.859480  1660 leader_election.cc:304] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:07.903427  9214 raft_consensus.cc:2804] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:07.903556  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1becd217447147aeb09608ec3f5c123b" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:03:07.903970  9214 raft_consensus.cc:697] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:03:07.904150  1620 raft_consensus.cc:3060] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:07.904855  9214 consensus_queue.cc:237] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:07.911665  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:07.912348  2245 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 18.
I20260709 13:03:07.915184  1620 raft_consensus.cc:2468] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:03:07.934141  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:07.945653  2211 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:07.946777  9205 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:07.958211  1438 catalog_manager.cc:5697] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 17 to 18, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:07.965323  1660 leader_election.cc:304] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:07.967017  9215 raft_consensus.cc:2804] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:07.967573  9215 raft_consensus.cc:697] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 19 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:03:07.968561  9215 consensus_queue.cc:237] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:07.978938  9214 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:07.979652  9214 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:07.984010  9214 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:07.987479  1660 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:07.988216  9214 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:07.988603  9214 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:07.988961  9214 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:07.996078  1659 leader_election.cc:336] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:07.999498  9205 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.000110  9205 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.003332  9205 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:08.004760  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:03:08.007426  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:08.007902  2245 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
I20260709 13:03:08.012351  9215 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:03:08.012645  2209 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.013091  2209 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:08.012890  9215 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.013803  9205 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:08.022624  1659 leader_election.cc:336] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.027756  9186 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.028396  9186 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.035418  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:08.038594  9186 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:08.039740  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:08.040509  2243 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 21.
I20260709 13:03:08.042487  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:08.049715  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:08.051110  9215 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:08.051991  1660 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.070508  9215 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:08.021673  9214 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:08.056707  1585 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.060647  9205 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.071018  9215 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.072325  9215 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:08.072314  9205 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.073124  9214 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:08.076637  1660 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:03:08.081997  9215 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.082958  9214 raft_consensus.cc:2749] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:08.074867  9205 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:08.084985  1585 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.085775  9186 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:08.086903  9169 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.087442  9169 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:08.088356  2209 leader_election.cc:336] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.089597  9169 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:08.091629  9186 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.092115  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:03:08.092165  9186 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.093283  1620 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 13.
I20260709 13:03:08.094534  9186 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:03:08.079272  1659 leader_election.cc:336] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.095810  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831a5f16aac472b8ce4f707c039e298" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:03:08.095955  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:08.096342  2243 raft_consensus.cc:3060] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:08.096452  2245 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 13.
I20260709 13:03:08.084556  9215 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:08.098191  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4142f46c85974609aa207df00c3d031e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:03:08.100744  2245 raft_consensus.cc:3060] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:08.098500  2241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:08.103330  9205 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.103896  9205 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.110358  2245 raft_consensus.cc:2468] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:03:08.098647  2210 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.099326  9184 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.111600  9184 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:08.099817  9169 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.116689  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:08.117660  9216 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:08.118053  9216 raft_consensus.cc:493] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.118407  9216 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.119962  9184 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:08.114121  9169 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:08.115909  9205 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:08.122279  9169 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:08.133062  2209 leader_election.cc:336] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.115288  1660 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:03:08.140259  2243 raft_consensus.cc:2468] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:03:08.144271  2211 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.145676  9101 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.146216  9101 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:08.146682  9214 raft_consensus.cc:2804] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:08.147302  9214 raft_consensus.cc:697] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 21 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:03:08.148237  9101 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:08.148169  9214 consensus_queue.cc:237] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.148808  9101 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.149272  9101 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:08.150404  9190 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:08.151050  9101 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:08.152673  1659 leader_election.cc:336] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:08.153623  1659 leader_election.cc:336] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.154140  1659 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
W20260709 13:03:08.155808  1585 leader_election.cc:336] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.158636  9190 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.159107  9190 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.159420  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:03:08.161852  9190 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:08.157859  1585 leader_election.cc:336] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:08.163865  1585 consensus_peers.cc:597] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:08.168612  9170 raft_consensus.cc:2749] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:08.173924  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:08.178164  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:03:08.179325  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:03:08.151161  9169 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.144477  9205 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:03:08.169801  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 71724.5us
W20260709 13:03:08.186728  1659 leader_election.cc:336] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.157946  9215 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.191309  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:08.191978  1696 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 21.
I20260709 13:03:08.192747  9215 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.184852  9169 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.193567  1587 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.194339  9185 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:08.195791  9169 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:08.188915  9170 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.197866  9170 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:08.195070  9215 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:08.200037  9170 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:08.189276  9216 raft_consensus.cc:515] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.203871  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdca03ab6655412d9f1d4fea1f1acf78" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:03:08.204444  1614 raft_consensus.cc:3060] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.212114  1614 raft_consensus.cc:2468] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 14.
I20260709 13:03:08.186199  1586 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.213590  2210 leader_election.cc:304] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:03:08.214286  9185 raft_consensus.cc:2764] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:08.189992  9205 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.218343  9205 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:08.220793  9205 raft_consensus.cc:2804] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:08.222043  9205 raft_consensus.cc:697] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:03:08.223094  9205 consensus_queue.cc:237] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:08.225914  2209 leader_election.cc:336] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:08.226539  2209 leader_election.cc:336] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:08.227154  2209 leader_election.cc:336] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.207408  9216 leader_election.cc:290] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 14 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:08.213413  1660 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:08.229835  1660 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.229710  9215 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:08.234454  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.234539  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:08.235213  2245 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 20.
W20260709 13:03:08.237289  1659 leader_election.cc:336] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.237936  1659 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:08.240092  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:08.240406  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:03:08.240494  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:03:08.240834  2245 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
I20260709 13:03:08.241338  1620 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 22.
I20260709 13:03:08.244421  9223 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:08.244931  9223 raft_consensus.cc:493] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.245442  9223 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:08.244982  9169 raft_consensus.cc:2804] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:08.248406  1614 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
W20260709 13:03:08.249397  1659 leader_election.cc:336] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.249908  1659 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:08.255899  9214 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:08.257457  9186 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.258045  9186 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:08.260643  9186 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:08.267135  1585 leader_election.cc:336] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.268740  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:08.269436  1696 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 18.
I20260709 13:03:08.270745  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:08.271418  1696 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 20.
I20260709 13:03:08.272707  9169 raft_consensus.cc:697] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 19 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:03:08.273981  1587 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.274413  9214 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:08.273717  9169 consensus_queue.cc:237] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.278652  9221 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:08.281351  9221 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.281734  9221 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:08.270994  1660 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:03:08.286806  1659 leader_election.cc:336] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:08.289992  1659 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.290921  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:03:08.288035  9170 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:08.294740  9170 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.295109  9170 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:08.292409  1659 leader_election.cc:336] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.320676  9223 raft_consensus.cc:515] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.323194  1660 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.328334  9101 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:08.328914  9101 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.329288  9101 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:08.336426  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 45561.4us
I20260709 13:03:08.341415  9101 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.326501  9214 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:08.344705  2211 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.352409  9205 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:08.352895  9205 raft_consensus.cc:493] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.353341  9205 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:08.351084  9101 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:03:08.356004  1659 consensus_peers.cc:597] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.357316  1585 consensus_peers.cc:597] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:08.345176  9214 raft_consensus.cc:493] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.372548  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:03:08.373184  1620 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:08.373073  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:03:08.374806  2243 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:08.375911  1659 consensus_peers.cc:597] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.376368  1659 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.367585  9214 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:08.385179  1585 consensus_peers.cc:597] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:08.387063  9223 leader_election.cc:290] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:08.390729  9214 raft_consensus.cc:515] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:08.391152  9221 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:08.411902  9184 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.412268  1620 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 22.
I20260709 13:03:08.412437  9184 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:08.413792  9221 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:08.414615  9184 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:08.416887  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710dba62795546819d9b3fd89ad4e8fe" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:03:08.417454  1696 raft_consensus.cc:3060] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:08.419018  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:08.419804  1691 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:03:08.420982  1587 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:03:08.421742  9222 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.422197  9222 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:08.424036  9214 leader_election.cc:290] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:08.424232  9222 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:08.425141  9170 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:08.425968  2209 consensus_peers.cc:597] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:08.426239  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:08.449514  9170 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:08.429281  1696 raft_consensus.cc:2468] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 19.
I20260709 13:03:08.451521  1587 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:03:08.431619  2243 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 22.
I20260709 13:03:08.436442  9184 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:08.434382  1441 catalog_manager.cc:5697] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 13 to 14, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 14 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.444169  9205 raft_consensus.cc:515] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:08.434113  9226 log.cc:927] Time spent T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.088s	user 0.006s	sys 0.002s
W20260709 13:03:08.445292  1659 leader_election.cc:336] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:08.456642  2209 consensus_peers.cc:597] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:08.460817  9222 raft_consensus.cc:2804] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:08.473949  1438 catalog_manager.cc:5697] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 20 to 21, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.477725  1438 catalog_manager.cc:5697] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 18 to 19, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 19 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.478777  1438 catalog_manager.cc:5697] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 18 to 19, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 19 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.460266  9184 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
W20260709 13:03:08.498482  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 89043.5us
I20260709 13:03:08.488998  9170 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.499137  9222 raft_consensus.cc:697] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:03:08.512964  9222 consensus_queue.cc:237] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:08.496960  9184 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:08.519089  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4270ae85dd544aeb602acb371def068" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:03:08.519951  2243 raft_consensus.cc:3060] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:08.538861  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa93934d6a4a8182f175ae59fc177e" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:03:08.539551  1696 raft_consensus.cc:3060] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:08.539670  2243 raft_consensus.cc:2468] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 21.
W20260709 13:03:08.540536  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 49062.5us
I20260709 13:03:08.539085  1660 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
W20260709 13:03:08.538347  1585 leader_election.cc:336] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:08.544900  1585 leader_election.cc:336] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.547842  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceaee3af9aa446a8796bde98fd46779" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01"
I20260709 13:03:08.548772  1620 raft_consensus.cc:3060] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:08.549425  1585 leader_election.cc:336] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.549963  1585 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.566536  1696 raft_consensus.cc:2468] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 22.
I20260709 13:03:08.569429  9101 raft_consensus.cc:2804] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:08.605131  9101 raft_consensus.cc:697] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 22 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
W20260709 13:03:08.589304  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 50339.9us
I20260709 13:03:08.592458  9235 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.568260  9236 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:08.573905  1620 raft_consensus.cc:2468] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 23.
I20260709 13:03:08.608767  2243 raft_consensus.cc:1275] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 13:03:08.598402  1585 consensus_peers.cc:597] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:08.590356  9205 leader_election.cc:290] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:08.533221  9170 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:08.589771  1614 raft_consensus.cc:1275] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:08.627322  9101 consensus_queue.cc:237] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.629729  1620 raft_consensus.cc:1275] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:03:08.640003  1429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 138175us
W20260709 13:03:08.643360  1659 consensus_peers.cc:597] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.643997  1659 leader_election.cc:336] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.632195  9234 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.652802  1660 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.656500  9214 raft_consensus.cc:2804] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:08.656994  9214 raft_consensus.cc:697] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 21 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:03:08.657807  9214 consensus_queue.cc:237] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:08.663602  2209 leader_election.cc:336] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.631458  9235 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:08.671270  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19a10a05aa24743a6d1222179fd4af4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:03:08.672499  1696 raft_consensus.cc:3060] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:08.672083  2211 leader_election.cc:304] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.674150  9205 raft_consensus.cc:2804] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:08.674703  9205 raft_consensus.cc:697] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 22 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:03:08.675581  9205 consensus_queue.cc:237] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.679529  1696 raft_consensus.cc:2468] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 21.
W20260709 13:03:08.679605  1429 catalog_manager.cc:4755] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): ChangeConfig:REMOVE_PEER RPC failed for tablet 5a69de749cce497b83e6489ad367017a: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.668787  9229 consensus_queue.cc:1048] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.031s
I20260709 13:03:08.699868  9235 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:08.661805  9234 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:08.701551  9170 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:08.708528  9184 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:03:08.711076  1659 consensus_peers.cc:597] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:08.723392  1659 consensus_peers.cc:597] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.723804  1659 consensus_peers.cc:597] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:08.717136  1585 consensus_peers.cc:597] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.725835  1585 consensus_peers.cc:597] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.718317  2209 leader_election.cc:336] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:08.733558  2209 consensus_peers.cc:597] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.738082  2209 consensus_peers.cc:597] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:08.702970  9234 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:08.755486  1585 leader_election.cc:336] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:08.756160  1585 consensus_peers.cc:597] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.762750  1659 leader_election.cc:336] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:08.763805  1659 leader_election.cc:336] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:08.769054  1659 consensus_peers.cc:597] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:08.769853  9184 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:08.772691  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:08.798342  1696 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 23.
W20260709 13:03:08.777734  2209 consensus_peers.cc:597] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:08.781697  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1365c85d063446a6a6a589798b355741" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:03:08.781906  1660 leader_election.cc:304] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.799481  1687 raft_consensus.cc:3060] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:08.800526  1587 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.801736  9184 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:08.802110  9184 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.802461  9184 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:08.803081  9229 raft_consensus.cc:2804] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:08.802695  1438 catalog_manager.cc:5697] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 18 to 19, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.804049  9101 consensus_queue.cc:1048] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:08.803598  9229 raft_consensus.cc:697] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 23 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:03:08.803844  9232 consensus_queue.cc:1048] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:08.806026  9229 consensus_queue.cc:237] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:08.809315  2211 leader_election.cc:304] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.812382  9184 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:08.815142  9184 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 24 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:08.816005  9227 raft_consensus.cc:2804] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:08.816552  9227 raft_consensus.cc:697] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 21 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
I20260709 13:03:08.817392  9227 consensus_queue.cc:237] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:08.823204  1687 raft_consensus.cc:2468] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 20.
I20260709 13:03:08.831686  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7803266de9984fac88726b08bee73921" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:03:08.833420  1620 raft_consensus.cc:2468] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 24.
I20260709 13:03:08.832104  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52504b3c7614b43be2a7cf1be42ad66" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:03:08.834388  1696 raft_consensus.cc:3060] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:08.834561  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5673bb37ab4e1b9ae5af2d2091b347" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" is_pre_election: true
I20260709 13:03:08.835145  1614 raft_consensus.cc:2468] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
W20260709 13:03:08.851104  1585 consensus_peers.cc:597] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:08.878666  1696 raft_consensus.cc:2468] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc91bf6e3bd468bbbbfc26e3a7c5e01 in term 24.
I20260709 13:03:08.910785  2240 raft_consensus.cc:1275] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:08.912737  1587 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:03:08.913575  1587 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 
I20260709 13:03:08.915226  9186 raft_consensus.cc:2804] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:08.915359  9238 raft_consensus.cc:2804] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:08.915902  9238 raft_consensus.cc:697] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:03:08.916407  9186 raft_consensus.cc:697] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 LEADER]: Becoming Leader. State: Replica: dcc91bf6e3bd468bbbbfc26e3a7c5e01, State: Running, Role: LEADER
I20260709 13:03:08.956478  1660 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
W20260709 13:03:08.957471  9250 log.cc:927] Time spent T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.005s
I20260709 13:03:08.957856  9170 raft_consensus.cc:2804] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:08.958298  9170 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.958684  9170 raft_consensus.cc:3060] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:08.959579  1617 raft_consensus.cc:1275] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:03:08.963688  9216 consensus_queue.cc:1048] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:08.967787  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:08.969676  9186 consensus_queue.cc:237] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:03:08.976891  2209 consensus_peers.cc:597] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.982061  1659 consensus_peers.cc:597] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:08.984942  9232 raft_consensus.cc:2804] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:08.985363  9232 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d7158d6c3b634dc7abb69eac58eba291)
I20260709 13:03:08.985731  9232 raft_consensus.cc:3060] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:08.985965  1585 leader_election.cc:336] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:08.916828  9238 consensus_queue.cc:237] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:03:08.990212  2209 consensus_peers.cc:597] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.990747  2209 consensus_peers.cc:597] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:08.992264  2209 consensus_peers.cc:597] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.997633  1659 consensus_peers.cc:597] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:08.998561  1659 consensus_peers.cc:597] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.998960  1659 consensus_peers.cc:597] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.999552  1659 consensus_peers.cc:597] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:09.006570  1585 leader_election.cc:336] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:09.011086  1438 catalog_manager.cc:5697] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 21 to 22, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 22 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:09.054371  2209 consensus_peers.cc:597] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:09.057546  9253 log.cc:927] Time spent T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:03:09.058295  1659 consensus_peers.cc:597] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:09.060468  1441 catalog_manager.cc:5697] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 20 to 21, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.035743  9214 consensus_queue.cc:1048] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:03:09.070776  1441 catalog_manager.cc:5697] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 21 to 22, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 22 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:09.092463  2209 consensus_peers.cc:597] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:09.106321  1441 catalog_manager.cc:5697] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 22 to 23, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 23 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.100663  9170 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:03:09.115186  1659 consensus_peers.cc:597] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:09.116245   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:03:09.120751  1696 raft_consensus.cc:1275] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:03:09.124264  2209 consensus_peers.cc:597] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:09.136353  9185 consensus_queue.cc:1048] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:09.140475  1438 catalog_manager.cc:5697] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 20 to 21, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 21 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.142158  1445 catalog_manager.cc:5697] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 23 to 24, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 24 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:09.145442  1659 consensus_peers.cc:597] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:09.148838  9170 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:09.158860  2210 consensus_peers.cc:597] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.164839  2210 consensus_peers.cc:597] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:09.180321  9232 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:09.182436  9232 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:09.191823  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 153499us
W20260709 13:03:09.194648  1659 consensus_peers.cc:597] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:09.200331  2245 raft_consensus.cc:1275] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:03:09.208879  1585 consensus_peers.cc:597] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.216073  1659 leader_election.cc:336] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:09.216655  1659 leader_election.cc:336] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:09.219756  2210 consensus_peers.cc:597] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:09.227982  1693 raft_consensus.cc:1275] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:03:09.233466  9261 consensus_queue.cc:1048] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:09.237918  9190 consensus_queue.cc:1048] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:03:09.260334  1660 consensus_peers.cc:597] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:09.270632  1438 catalog_manager.cc:5697] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 reported cstate change: term changed from 19 to 20, leader changed from d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193) to dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:09.276103  1660 consensus_peers.cc:597] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.278789  1660 consensus_peers.cc:597] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.279757  1660 leader_election.cc:336] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:09.280352  1660 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:09.281386  9101 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:03:09.283376  1660 consensus_peers.cc:597] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.285118  1660 leader_election.cc:336] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:09.288183  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:09.293092  9260 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:09.299723  1694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a69de749cce497b83e6489ad367017a"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34244
I20260709 13:03:09.300364  1694 raft_consensus.cc:606] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 22 LEADER]: Received request to transfer leadership
I20260709 13:03:09.313511  2245 raft_consensus.cc:1275] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:03:09.314133  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a69de749cce497b83e6489ad367017a"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34244
I20260709 13:03:09.314687  1687 raft_consensus.cc:606] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 22 LEADER]: Received request to transfer leadership
I20260709 13:03:09.318295  1696 raft_consensus.cc:1275] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 13:03:09.331848  2210 consensus_peers.cc:597] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:09.337668  9101 raft_consensus.cc:993] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: : Instructing follower e8a64798e5f94de8909707bcbd11804a to start an election
W20260709 13:03:09.337567  1660 consensus_peers.cc:597] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.338876  1660 consensus_peers.cc:597] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.339490  1660 consensus_peers.cc:597] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:09.346494  9190 consensus_queue.cc:1048] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:03:09.344422  9261 consensus_queue.cc:1048] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.012s
I20260709 13:03:09.362520  9101 raft_consensus.cc:1081] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 22 LEADER]: Signalling peer e8a64798e5f94de8909707bcbd11804a to start an election
W20260709 13:03:09.363600  2210 consensus_peers.cc:597] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:09.377036  1687 raft_consensus.cc:1275] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:09.380437  9186 consensus_queue.cc:1048] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
W20260709 13:03:09.386574  1659 consensus_peers.cc:597] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.387169  1659 consensus_peers.cc:597] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:09.392777  2243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a69de749cce497b83e6489ad367017a"
dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
 from {username='slave'} at 127.0.0.1:45882
I20260709 13:03:09.393345  2243 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:09.393723  2243 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:09.399752  2210 consensus_peers.cc:597] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.400089  1660 consensus_peers.cc:597] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.406476  1660 consensus_peers.cc:597] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:09.417922  2243 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:09.424530  2210 consensus_peers.cc:597] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.435865  9272 log.cc:927] Time spent T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:03:09.449584  1585 consensus_peers.cc:597] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:09.456759  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a69de749cce497b83e6489ad367017a"
dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34244
I20260709 13:03:09.457428  1693 raft_consensus.cc:606] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 22 LEADER]: Received request to transfer leadership
W20260709 13:03:09.456514  2209 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:09.459299  2210 consensus_peers.cc:597] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.474134  2209 consensus_peers.cc:597] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.477905  1660 consensus_peers.cc:597] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.478551  1660 consensus_peers.cc:597] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.479115  1660 consensus_peers.cc:597] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.480708  1493 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:03:09.481094  1493 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 5a69de749cce497b83e6489ad367017a already in progress
W20260709 13:03:09.481364  1493 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 5a69de749cce497b83e6489ad367017a already in progress
I20260709 13:03:09.485572  2243 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 23 election: Requested vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:09.497056  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:03:09.497749  1688 raft_consensus.cc:3055] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:09.498082  1688 raft_consensus.cc:740] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:03:09.498903  1688 consensus_queue.cc:260] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:09.515203  1688 raft_consensus.cc:3060] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:09.517521  2210 consensus_peers.cc:597] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.520514  2210 consensus_peers.cc:597] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.521090  2210 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:09.521472  2210 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:09.525319  9227 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:09.529708  1694 raft_consensus.cc:1275] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Refusing update from remote peer dcc91bf6e3bd468bbbbfc26e3a7c5e01: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:03:09.532927  9240 consensus_queue.cc:1048] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:03:09.548848  2210 consensus_peers.cc:597] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.555914  2210 consensus_peers.cc:597] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:09.562502  1688 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 23.
W20260709 13:03:09.574332  1585 consensus_peers.cc:597] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:09.819244   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:09.829907   431 tablet_replica.cc:333] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:09.841972   431 raft_consensus.cc:2243] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:09.847921   431 raft_consensus.cc:2272] T b5871ff5fd9c4673b5650490648edf26 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.864509   431 tablet_replica.cc:333] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:09.865341   431 raft_consensus.cc:2243] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.865906   431 raft_consensus.cc:2272] T 479456ab418d44c4983d2bb37eb0e700 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.868611   431 tablet_replica.cc:333] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:09.869391   431 raft_consensus.cc:2243] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:09.870455   431 raft_consensus.cc:2272] T ded1641387fd4fd4be29caddb22781fb P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.883422  9239 raft_consensus.cc:493] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:09.883941  9239 raft_consensus.cc:515] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:09.886032  9239 leader_election.cc:290] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:09.888123  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b29fae0aae48f28944958f7ef007fa" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:09.895371   431 tablet_replica.cc:333] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:09.896347   431 raft_consensus.cc:2243] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.896878   431 pending_rounds.cc:70] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Trying to abort 1 pending ops.
I20260709 13:03:09.897105   431 pending_rounds.cc:77] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting op as it isn't in flight: id { term: 19 index: 13 } timestamp: 7305634561937219584 op_type: NO_OP noop_request { }
I20260709 13:03:09.897434   431 raft_consensus.cc:2889] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:09.897753   431 raft_consensus.cc:2272] T 1becd217447147aeb09608ec3f5c123b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:09.899223  1585 leader_election.cc:336] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:09.900731  1585 leader_election.cc:304] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:09.901788  9278 raft_consensus.cc:2749] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:09.928550   431 tablet_replica.cc:333] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:09.929405   431 raft_consensus.cc:2243] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.929977   431 raft_consensus.cc:2272] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.940891   431 tablet_replica.cc:333] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:09.941645   431 raft_consensus.cc:2243] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:09.966334   431 raft_consensus.cc:2272] T 4b6f3b457deb4725b437c627cc3a5cd7 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.976246   431 tablet_replica.cc:333] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:09.977099   431 raft_consensus.cc:2243] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.977699   431 pending_rounds.cc:70] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Trying to abort 1 pending ops.
I20260709 13:03:09.977929   431 pending_rounds.cc:77] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting op as it isn't in flight: id { term: 18 index: 13 } timestamp: 7305634561694076928 op_type: NO_OP noop_request { }
I20260709 13:03:09.978251   431 raft_consensus.cc:2889] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:09.978572   431 raft_consensus.cc:2272] T 67f0dcf1e89644688ea3e2603f9a37d0 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.985674   431 tablet_replica.cc:333] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:09.986442   431 raft_consensus.cc:2243] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.987049   431 raft_consensus.cc:2272] T 9355ac91422346bb9f5dfa3c1424df25 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.989646   431 tablet_replica.cc:333] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:09.990415   431 raft_consensus.cc:2243] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:10.009524   431 raft_consensus.cc:2272] T d0a7e28ddafe4ac389f2603e93af8dba P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.012501   431 tablet_replica.cc:333] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.019613   431 raft_consensus.cc:2243] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.020257   431 raft_consensus.cc:2272] T 17d7fbb63fde4df88c4345a9532b4738 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.022801   431 tablet_replica.cc:333] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.023624   431 raft_consensus.cc:2243] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:10.024653   431 raft_consensus.cc:2272] T 5ca86ee366e14bdd8686ea8e5b48be10 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.039083   431 tablet_replica.cc:333] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.040140   431 raft_consensus.cc:2243] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.040772   431 raft_consensus.cc:2272] T c97fa1eb9d6548d3852cfed83b346e69 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.059446   431 tablet_replica.cc:333] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.060387   431 raft_consensus.cc:2243] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:10.061429   431 raft_consensus.cc:2272] T 6c40365464684a5d86c2918b7b0160d4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.064296   431 tablet_replica.cc:333] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.065024   431 raft_consensus.cc:2243] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:10.066036   431 raft_consensus.cc:2272] T e4b724996f86487f991c761b011e8aaf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.092806   431 tablet_replica.cc:333] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.093652   431 raft_consensus.cc:2243] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.094321   431 raft_consensus.cc:2272] T 05911a041e044f48bce12648b58061be P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.097189   431 tablet_replica.cc:333] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.097909   431 raft_consensus.cc:2243] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.098531   431 raft_consensus.cc:2272] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.104784  9239 raft_consensus.cc:493] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8a64798e5f94de8909707bcbd11804a)
I20260709 13:03:10.105401  9239 raft_consensus.cc:515] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:10.107525  9239 leader_election.cc:290] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:10.113680  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ebfb5c6324189947e23e5386968e4" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:10.117118   431 tablet_replica.cc:333] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.117996   431 raft_consensus.cc:2243] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:10.125550  1585 leader_election.cc:336] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:10.126021  1585 leader_election.cc:304] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: d7158d6c3b634dc7abb69eac58eba291, e8a64798e5f94de8909707bcbd11804a
I20260709 13:03:10.135033  9239 raft_consensus.cc:2749] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.135458   431 pending_rounds.cc:70] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Trying to abort 1 pending ops.
I20260709 13:03:10.135782   431 pending_rounds.cc:77] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: Aborting op as it isn't in flight: id { term: 14 index: 13 } timestamp: 7305634562986344448 op_type: NO_OP noop_request { }
I20260709 13:03:10.136130   431 raft_consensus.cc:2889] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:10.136471   431 raft_consensus.cc:2272] T cdca03ab6655412d9f1d4fea1f1acf78 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.143826   431 tablet_replica.cc:333] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.144624   431 raft_consensus.cc:2243] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.145475   431 raft_consensus.cc:2272] T 6817bc4013144ede80163d16316d4860 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.160701   431 tablet_replica.cc:333] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.161559   431 raft_consensus.cc:2243] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.162376   431 raft_consensus.cc:2272] T b42f5c0b467d44b1878074fc21fa8f41 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.181818  9278 raft_consensus.cc:493] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:10.182392  9278 raft_consensus.cc:515] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:10.184538  9278 leader_election.cc:290] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:10.185135   431 tablet_replica.cc:333] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.185575  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6921d4b2d8478f99effa533f8d9f3d" candidate_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:10.185956   431 raft_consensus.cc:2243] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.186599   431 raft_consensus.cc:2272] T 32470c2737744478bac199459790b787 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:10.189042  1585 leader_election.cc:336] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:10.189510  1585 leader_election.cc:304] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:10.192310  9239 raft_consensus.cc:2749] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:10.197603   431 tablet_replica.cc:333] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.198380   431 raft_consensus.cc:2243] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.199060   431 raft_consensus.cc:2272] T 4ceaee3af9aa446a8796bde98fd46779 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.201694   431 tablet_replica.cc:333] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.202466   431 raft_consensus.cc:2243] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:10.219992   431 raft_consensus.cc:2272] T 7c5daaba0e764f4ca8876bda9d220973 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.222795   431 tablet_replica.cc:333] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.223690   431 raft_consensus.cc:2243] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.224318   431 raft_consensus.cc:2272] T 02b29fae0aae48f28944958f7ef007fa P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.227265   431 tablet_replica.cc:333] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.228075   431 raft_consensus.cc:2243] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.228957   431 raft_consensus.cc:2272] T 89f88fe569c2476cb298d5e6b745bb5c P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.241650   431 tablet_replica.cc:333] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.242482   431 raft_consensus.cc:2243] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.243428   431 raft_consensus.cc:2272] T 5a69de749cce497b83e6489ad367017a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.250712   431 tablet_replica.cc:333] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.251508   431 raft_consensus.cc:2243] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.252049   431 raft_consensus.cc:2272] T 9e0db569e82e490f9de2c0a9300c24bf P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.261336   431 tablet_replica.cc:333] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.262076   431 raft_consensus.cc:2243] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.262739   431 raft_consensus.cc:2272] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.265264   431 tablet_replica.cc:333] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.265947   431 raft_consensus.cc:2243] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.266566   431 raft_consensus.cc:2272] T 7aca6dcf002947d6841150860825871b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.269363   431 tablet_replica.cc:333] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.270363   431 raft_consensus.cc:2243] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.270989   431 raft_consensus.cc:2272] T 0f253020cc7a4b66aa6c8f66a42d44c6 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.289947   431 tablet_replica.cc:333] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.291447   431 raft_consensus.cc:2243] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:03:10.292507   431 raft_consensus.cc:2272] T 520ee35af44d4a529e945654996352cc P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.295311   431 tablet_replica.cc:333] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.296129   431 raft_consensus.cc:2243] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:10.297106   431 raft_consensus.cc:2272] T b11a3619de25451bbe5a091f271cfa6b P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.299690   431 tablet_replica.cc:333] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.300417   431 raft_consensus.cc:2243] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:10.301357   431 raft_consensus.cc:2272] T 1365c85d063446a6a6a589798b355741 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.321573   431 tablet_replica.cc:333] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.322409   431 raft_consensus.cc:2243] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.322942   431 raft_consensus.cc:2272] T 4f5673bb37ab4e1b9ae5af2d2091b347 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.326301   431 tablet_replica.cc:333] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.327036   431 raft_consensus.cc:2243] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.327621   431 raft_consensus.cc:2272] T 13edebc31dfe4957b3870b909ea5330e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.330327   431 tablet_replica.cc:333] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.337826   431 raft_consensus.cc:2243] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:10.339105   431 raft_consensus.cc:2272] T 710dba62795546819d9b3fd89ad4e8fe P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.341645   431 tablet_replica.cc:333] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.342357   431 raft_consensus.cc:2243] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:03:10.343299   431 raft_consensus.cc:2272] T 63e2429c350c4d36a523ed1c4955ef23 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.345785   431 tablet_replica.cc:333] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.346495   431 raft_consensus.cc:2243] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.347018   431 raft_consensus.cc:2272] T 7803266de9984fac88726b08bee73921 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.349602   431 tablet_replica.cc:333] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.350263   431 raft_consensus.cc:2243] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.350816   431 raft_consensus.cc:2272] T bd6921d4b2d8478f99effa533f8d9f3d P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.360635   431 tablet_replica.cc:333] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.361460   431 raft_consensus.cc:2243] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.362058   431 raft_consensus.cc:2272] T 158ebfb5c6324189947e23e5386968e4 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.364812   431 tablet_replica.cc:333] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.365551   431 raft_consensus.cc:2243] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:10.366603   431 raft_consensus.cc:2272] T 5ee97fe9eef14f818a1f9178885dfc31 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.369164   431 tablet_replica.cc:333] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.369848   431 raft_consensus.cc:2243] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:10.370877   431 raft_consensus.cc:2272] T c528a0f6bdb44c4187c750d0b1429ba1 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.379628   431 tablet_replica.cc:333] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.380427   431 raft_consensus.cc:2243] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:10.381425   431 raft_consensus.cc:2272] T fa1a194f4d834ee6aa037d727b8f9e2a P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.384109   431 tablet_replica.cc:333] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.386425   431 raft_consensus.cc:2243] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:10.387532   431 raft_consensus.cc:2272] T 7b5efbd7e50442858cc9d27a08f50b3e P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.390177   431 tablet_replica.cc:333] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01: stopping tablet replica
I20260709 13:03:10.390851   431 raft_consensus.cc:2243] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:03:10.392066   431 raft_consensus.cc:2272] T e52504b3c7614b43be2a7cf1be42ad66 P dcc91bf6e3bd468bbbbfc26e3a7c5e01 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:10.703547  1659 consensus_peers.cc:597] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:10.767956  2209 consensus_peers.cc:597] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:10.848595  1429 catalog_manager.cc:4755] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 63e2429c350c4d36a523ed1c4955ef23: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:10.850847  1431 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5a69de749cce497b83e6489ad367017a with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER failed with leader 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 822e08445eae4a33b2f2fe92060192c6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } } }
I20260709 13:03:10.866783  9227 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:10.867726  9227 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:10.873792  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
W20260709 13:03:10.876269  1659 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111) [suppressed 483 similar messages]
I20260709 13:03:10.883677  9261 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.884239  9261 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:10.886251  9261 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:10.893468  2210 leader_election.cc:336] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:10.894006  2210 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:10.896147  9249 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:10.898836  1659 consensus_peers.cc:597] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:10.900422  9227 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:10.905047  1659 leader_election.cc:336] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:10.928768  1660 leader_election.cc:336] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:10.929612  1660 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:10.934165  9227 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:10.934747  9261 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:10.934810  9227 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:10.942806  2210 leader_election.cc:336] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:10.943490  9227 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:10.953354  1659 consensus_peers.cc:597] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:10.962774  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:10.964785  2211 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:10.966770  9249 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:10.979730  1659 consensus_peers.cc:597] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:10.981071  2209 consensus_peers.cc:597] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:11.014631  9261 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.015200  9261 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:11.017402  9261 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:11.034796  9261 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.035353  9261 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.037684  9261 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:03:11.040489  1660 leader_election.cc:336] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:11.043512  1660 leader_election.cc:336] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:11.051965  1659 consensus_peers.cc:597] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:11.052500  1659 consensus_peers.cc:597] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:11.052855  1659 leader_election.cc:336] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:11.053203  1659 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:11.065733  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:11.066504  2245 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 23.
I20260709 13:03:11.068032  9215 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:11.074076  9261 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.074707  9261 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.080719  9261 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:03:11.083482  1660 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.084733  1660 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:11.086014  9215 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:11.086448  9215 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.086889  9215 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:03:11.097712  1659 consensus_peers.cc:597] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:11.104393  2209 consensus_peers.cc:597] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:11.106014  1659 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:11.108865  9283 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.112426  1659 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:11.112622  9283 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.116910  9283 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:11.129683  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:11.130430  2245 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 23.
I20260709 13:03:11.122771  9215 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.153469  9215 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:11.159941  9287 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:11.165550  2210 leader_election.cc:336] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:11.172086  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:40413, user_credentials={real_user=slave}} blocked reactor thread for 86330.4us
I20260709 13:03:11.173905  9261 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.186098  9261 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.188472  9261 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:03:11.200181  1659 consensus_peers.cc:597] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:11.200487  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:11.201170  1688 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 20.
I20260709 13:03:11.175383  9283 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.211997  9283 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.214488  9283 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:11.231415  9283 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.233536  9283 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.236349  9283 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:11.241484  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded1641387fd4fd4be29caddb22781fb" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:03:11.242081  2245 raft_consensus.cc:3060] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:03:11.248625  1660 leader_election.cc:336] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:11.249284  1660 leader_election.cc:336] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.249996  2211 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:11.252153  9249 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:11.252562  9249 raft_consensus.cc:493] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.252957  9249 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:11.253448  9261 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.253662  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:11.253968  9261 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.255971  9261 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:03:11.258963  2210 leader_election.cc:336] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:11.259637  2210 leader_election.cc:336] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:11.261312  2209 consensus_peers.cc:597] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:11.261790  2209 leader_election.cc:336] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:11.262171  2209 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:11.262948  9252 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:11.271392  9283 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.271955  9283 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.275504  9283 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:11.277457  2245 raft_consensus.cc:2468] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 24.
I20260709 13:03:11.278891  9249 raft_consensus.cc:515] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.280653  2243 raft_consensus.cc:2393] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 21: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:03:11.284489  9249 leader_election.cc:290] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:11.297040  2210 leader_election.cc:336] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:11.297636  2210 leader_election.cc:336] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.300261  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:11.301194  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:11.301437  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a7e28ddafe4ac389f2603e93af8dba" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:03:11.301963  1694 raft_consensus.cc:3060] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:11.311373  1659 consensus_peers.cc:597] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:11.314299  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:11.314992  2243 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:03:11.317600  9286 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.318177  9286 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.320212  9286 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:11.322191  9286 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.322717  9286 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.326357  9286 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:11.326905  9285 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.327528  9285 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:11.329591  9285 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:11.335678  1694 raft_consensus.cc:2468] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 21.
W20260709 13:03:11.336704  1659 leader_election.cc:336] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:11.343890  1660 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:11.344736  9286 raft_consensus.cc:2804] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:11.345907  9286 raft_consensus.cc:697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 24 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:03:11.346848  9286 consensus_queue.cc:237] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.350425  1660 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:03:11.353609  9285 raft_consensus.cc:2749] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:11.360040  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:03:11.362249  9285 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:11.362680  9285 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.363161  9285 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:11.370428  9285 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.372033  2211 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:11.373188  2211 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:11.374166  9249 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:11.374816  9249 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:11.379395  9285 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:11.384407  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:11.385089  2243 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:03:11.386948  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:11.387522  2243 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 16.
I20260709 13:03:11.388303  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5871ff5fd9c4673b5650490648edf26" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:03:11.388839  2245 raft_consensus.cc:3060] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:11.390377  1438 catalog_manager.cc:5697] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 23 to 24, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 24 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:11.394603  1659 consensus_peers.cc:597] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:11.394783  2211 leader_election.cc:304] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:11.397173  9249 raft_consensus.cc:2804] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:11.397740  9249 raft_consensus.cc:697] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 21 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:03:11.404644  1660 leader_election.cc:336] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.398824  9249 consensus_queue.cc:237] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.412142  2245 raft_consensus.cc:2468] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
W20260709 13:03:11.413039  1659 consensus_peers.cc:597] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:11.420516  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:03:11.421936  9286 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:11.422320  9286 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.422684  9286 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:11.431458  9286 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.433382  9286 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:11.432991  1441 catalog_manager.cc:5697] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 20 to 21, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 21 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:11.434249  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:03:11.438017  1660 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:03:11.440255  9285 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:11.440663  9285 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.441013  9285 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:11.442144  9215 raft_consensus.cc:2804] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:11.442802  9215 raft_consensus.cc:697] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:03:11.443763  9215 consensus_queue.cc:237] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:11.449613  2209 consensus_peers.cc:597] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:11.450157  2209 consensus_peers.cc:597] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:11.458408  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b724996f86487f991c761b011e8aaf" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:03:11.459419  2245 raft_consensus.cc:3060] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:11.462947  9227 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.463740  9261 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.463567  9227 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.464239  9261 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:11.465662  9227 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:11.466132  9261 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:11.471942  1659 consensus_peers.cc:597] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:11.474032  2209 consensus_peers.cc:597] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:11.474589  2209 leader_election.cc:336] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:11.474934  1659 leader_election.cc:336] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:11.480507  2210 leader_election.cc:336] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.480999  2210 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:11.481772  9249 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:11.450927  9285 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.483654  2245 raft_consensus.cc:2468] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:03:11.483894  9285 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:03:11.494433  1660 leader_election.cc:336] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:11.495136  1660 leader_election.cc:336] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:11.497632  2209 consensus_peers.cc:597] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:11.499459  1660 leader_election.cc:336] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.499897  1660 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:03:11.500761  1660 leader_election.cc:336] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.505931  1660 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:03:11.502498  9285 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:11.509671  9261 raft_consensus.cc:2804] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:11.510144  9261 raft_consensus.cc:697] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:03:11.510962  9261 consensus_queue.cc:237] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.526695  9215 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.527278  9215 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:11.529256  9215 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:11.534631  1659 leader_election.cc:336] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:11.536439  9227 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.537003  9227 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.541374  9227 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:11.516880  1660 consensus_peers.cc:597] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:11.544656  1660 leader_election.cc:336] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:11.545576  1660 leader_election.cc:336] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.545797  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40365464684a5d86c2918b7b0160d4" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:03:11.546013  1660 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:11.546489  2243 raft_consensus.cc:3060] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:11.548417  2209 consensus_peers.cc:597] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:11.549736  2209 consensus_peers.cc:597] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:11.550163  2209 leader_election.cc:336] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:11.550614  9261 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:11.555207  2210 leader_election.cc:336] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.555739  2210 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:11.556377  9261 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.556895  9261 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:11.558888  9261 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:11.565516  9215 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.566064  9215 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.568845  9215 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:11.569613  2243 raft_consensus.cc:2468] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 17.
I20260709 13:03:11.572736  9261 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.573454  9261 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:11.572271  1659 leader_election.cc:336] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:11.575731  9261 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
W20260709 13:03:11.579471  1659 leader_election.cc:336] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:11.581871  9227 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:11.587594  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:11.588265  1687 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 19.
I20260709 13:03:11.596884  9227 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.597513  9227 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.599680  9227 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:11.607504  1659 consensus_peers.cc:597] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:11.608072  2245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:11.608713  2245 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
I20260709 13:03:11.609505  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:11.610093  2240 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 25.
I20260709 13:03:11.623881  1660 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:03:11.628324  9215 raft_consensus.cc:2804] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:11.628136  1438 catalog_manager.cc:5697] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 16 to 17, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.629307  9215 raft_consensus.cc:697] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Becoming Leader. State: Replica: 822e08445eae4a33b2f2fe92060192c6, State: Running, Role: LEADER
I20260709 13:03:11.629956  1438 catalog_manager.cc:5697] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 16 to 17, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.630295  9215 consensus_queue.cc:237] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:11.639870  1659 consensus_peers.cc:597] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:11.634897  1660 leader_election.cc:336] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:11.647353  2210 leader_election.cc:336] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.663750  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:11.664541  1687 raft_consensus.cc:2468] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 25.
I20260709 13:03:11.672335  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:03:11.677090  9227 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:03:11.677484  2210 consensus_peers.cc:597] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:11.677634  9227 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.676088  1438 catalog_manager.cc:5697] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 reported cstate change: term changed from 16 to 17, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "822e08445eae4a33b2f2fe92060192c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.679436  9285 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:03:11.679855  9227 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:11.679940  9285 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.680577  9285 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:03:11.693635  2209 leader_election.cc:336] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:11.694001  9285 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.694212  9227 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.695225  9227 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.701537  9227 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:11.707062  2209 leader_election.cc:336] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:11.717275  2211 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:11.718281  9252 raft_consensus.cc:2804] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:03:11.718642  9252 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 25 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.718950  9252 raft_consensus.cc:3060] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:11.737892  9215 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.738690  9215 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:11.740036  9252 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 26 FOLLOWER]: Starting leader election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.741060  9215 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:11.741878  9227 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.758628  9227 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:11.749162  2209 consensus_peers.cc:597] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:11.761502  9227 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:11.762151  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41871, user_credentials={real_user=slave}} blocked reactor thread for 44629.5us
W20260709 13:03:11.762703  1659 consensus_peers.cc:597] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:11.746049  9285 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 26 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:11.763963  9227 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:03:11.766898  2209 leader_election.cc:336] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:11.767530  2209 consensus_peers.cc:597] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:11.765759  9227 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.770448  9227 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:11.771365  2210 consensus_peers.cc:597] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:11.772032  2210 leader_election.cc:336] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:11.750077  1660 leader_election.cc:336] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.759162  9252 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 26 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:11.773497  1659 consensus_peers.cc:597] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:11.778419  9215 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.776273  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:03:11.779670  1660 leader_election.cc:336] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.780136  9284 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:11.778973  9215 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:11.782614  1659 leader_election.cc:336] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:11.780452  1660 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:11.784572  9284 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:11.784920  9215 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:11.775454  2210 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:03:11.785897  1660 leader_election.cc:336] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:11.789752  2210 leader_election.cc:336] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.786399  1660 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:11.790901  9252 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:11.791199  1660 leader_election.cc:336] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.791800  9285 raft_consensus.cc:2749] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:11.807749  1660 consensus_peers.cc:597] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:11.808326  1660 consensus_peers.cc:597] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:11.790354  2210 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:11.813293  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:03:11.814050  1687 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate e8a64798e5f94de8909707bcbd11804a in current term 26: Already voted for candidate 822e08445eae4a33b2f2fe92060192c6 in this term.
I20260709 13:03:11.815694  1694 raft_consensus.cc:1275] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:03:11.816653  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:11.817305  1693 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 24.
W20260709 13:03:11.821497  1660 consensus_peers.cc:597] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:11.821938  1660 leader_election.cc:336] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.822329  1660 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:03:11.823180  1660 consensus_peers.cc:597] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:11.823607  1660 leader_election.cc:336] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.823578  2211 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
W20260709 13:03:11.824270  1660 leader_election.cc:336] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.823987  9249 consensus_queue.cc:1048] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:11.824581  9227 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:03:11.824764  1660 consensus_peers.cc:597] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:11.825011  9227 raft_consensus.cc:493] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Starting leader election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:11.825371  9227 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:11.822347  9252 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:11.827979  9285 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:11.833644  1660 consensus_peers.cc:597] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:11.835539  2210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39981, user_credentials={real_user=slave}} blocked reactor thread for 45848.6us
W20260709 13:03:11.836148  2210 consensus_peers.cc:597] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:11.836624  2210 consensus_peers.cc:597] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:11.841965  9227 raft_consensus.cc:515] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:11.848150  2210 leader_election.cc:336] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.848678  2210 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:11.849220  2243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e2429c350c4d36a523ed1c4955ef23" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a"
I20260709 13:03:11.849965  2243 raft_consensus.cc:2393] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 26: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:03:11.850721  2240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:11.851356  9227 leader_election.cc:290] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 election: Requested vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:11.851635  2240 raft_consensus.cc:2393] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822e08445eae4a33b2f2fe92060192c6 in current term 25: Already voted for candidate e8a64798e5f94de8909707bcbd11804a in this term.
I20260709 13:03:11.859596  9252 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:03:11.860328  1660 consensus_peers.cc:597] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:11.859596  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520ee35af44d4a529e945654996352cc" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6"
I20260709 13:03:11.862448  1693 raft_consensus.cc:3060] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:11.870122  1693 raft_consensus.cc:2468] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 25.
W20260709 13:03:11.877012  1660 consensus_peers.cc:597] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:11.877693  2210 leader_election.cc:336] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.879220  2210 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:03:11.879226  1660 consensus_peers.cc:597] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:11.880474  2210 consensus_peers.cc:597] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:11.881131  2211 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: 
I20260709 13:03:11.881708  9227 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:11.886606  9227 raft_consensus.cc:2804] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:03:11.887466  9227 raft_consensus.cc:697] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 25 LEADER]: Becoming Leader. State: Replica: e8a64798e5f94de8909707bcbd11804a, State: Running, Role: LEADER
W20260709 13:03:11.890261  2210 leader_election.cc:336] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:11.888490  9227 consensus_queue.cc:237] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:11.899948  1660 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:03:11.901157  1660 leader_election.cc:304] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: dcc91bf6e3bd468bbbbfc26e3a7c5e01, e8a64798e5f94de8909707bcbd11804a
I20260709 13:03:11.901868  9285 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:03:11.902566  9285 raft_consensus.cc:2749] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:11.909584  1660 consensus_peers.cc:597] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:11.916584  2243 raft_consensus.cc:1275] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:03:11.918191  2243 raft_consensus.cc:1275] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:03:11.938603  1659 consensus_peers.cc:597] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:11.944759  1659 consensus_peers.cc:597] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:11.954375  1660 consensus_peers.cc:597] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:11.956521  9284 consensus_queue.cc:1048] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:03:11.963930  1438 catalog_manager.cc:5697] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a reported cstate change: term changed from 24 to 25, leader changed from dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194) to e8a64798e5f94de8909707bcbd11804a (127.0.107.196). New cstate: current_term: 25 leader_uuid: "e8a64798e5f94de8909707bcbd11804a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:11.966821  9284 consensus_queue.cc:1048] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:03:11.976204  2210 consensus_peers.cc:597] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:11.979543  2210 leader_election.cc:336] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:11.986308  2210 consensus_peers.cc:597] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:12.024626  2210 consensus_peers.cc:597] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:12.025071  2243 raft_consensus.cc:1275] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
W20260709 13:03:12.025189  2210 consensus_peers.cc:597] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:12.033977  9284 consensus_queue.cc:1048] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:03:12.051579  2210 consensus_peers.cc:597] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:12.054525  2210 consensus_peers.cc:597] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:12.074025  2210 consensus_peers.cc:597] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:12.091781  2243 raft_consensus.cc:1275] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Refusing update from remote peer 822e08445eae4a33b2f2fe92060192c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:03:12.092223  1660 consensus_peers.cc:597] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:12.100915  9284 consensus_queue.cc:1048] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:03:12.106503  2210 consensus_peers.cc:597] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:12.148725  2209 consensus_peers.cc:597] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:12.223191  1660 consensus_peers.cc:597] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:12.227828  1660 consensus_peers.cc:597] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:12.357264  2210 consensus_peers.cc:597] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:12.647104  9215 raft_consensus.cc:493] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:12.647771  9215 raft_consensus.cc:515] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:12.650151  9215 leader_election.cc:290] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:12.770296  1659 leader_election.cc:336] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:12.775753  9284 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.776394  9284 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:12.780607  9284 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:12.810339  9227 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.811568  9227 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:12.819720  9227 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:12.825766  1660 leader_election.cc:336] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:12.836414  1660 leader_election.cc:304] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:12.839784  9284 raft_consensus.cc:2749] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:12.839123  1659 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:12.848704  1694 raft_consensus.cc:1275] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Refusing update from remote peer e8a64798e5f94de8909707bcbd11804a: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:03:12.851953  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "e8a64798e5f94de8909707bcbd11804a" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "822e08445eae4a33b2f2fe92060192c6" is_pre_election: true
I20260709 13:03:12.852686  1693 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a64798e5f94de8909707bcbd11804a in term 23.
I20260709 13:03:12.857406  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a69de749cce497b83e6489ad367017a" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:12.858112  2246 raft_consensus.cc:2468] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 23.
I20260709 13:03:12.861402   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:03:12.864403  2210 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:12.879125  2209 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:12.885200  2209 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:12.887665  9308 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:12.894335  9308 consensus_queue.cc:1048] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [LEADER]: Connected to new peer: Peer: permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 13:03:12.912269  1660 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:12.912935  1660 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:12.913789  9261 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:13.053054  9309 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:13.053658  9309 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:13.056973  9309 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:13.060649  2209 leader_election.cc:336] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:13.087456  2210 leader_election.cc:336] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:13.087980  2210 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:13.089586  9309 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:13.109759   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:03:13.146906  9284 raft_consensus.cc:493] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.147523  9284 raft_consensus.cc:515] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
W20260709 13:03:13.162478  1659 leader_election.cc:336] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:13.162056  9284 leader_election.cc:290] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:13.170965  1660 leader_election.cc:336] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:13.171510  1660 leader_election.cc:304] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:13.173192  9284 raft_consensus.cc:2749] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:03:13.204123  2211 consensus_peers.cc:597] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.247035  2209 consensus_peers.cc:597] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:13.266510   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:13.286455   431 tablet_replica.cc:333] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.288321   431 raft_consensus.cc:2243] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:03:13.295190  2211 consensus_peers.cc:597] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.295886  2211 consensus_peers.cc:597] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.296396  2211 consensus_peers.cc:597] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.299484   431 raft_consensus.cc:2272] T b5871ff5fd9c4673b5650490648edf26 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.307288   431 tablet_replica.cc:333] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.308261   431 raft_consensus.cc:2243] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.309324   431 raft_consensus.cc:2272] T 00924ae4c66740e59de627a44de33c38 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.321388   431 tablet_replica.cc:333] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.322288   431 raft_consensus.cc:2243] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.323324   431 raft_consensus.cc:2272] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P 822e08445eae4a33b2f2fe92060192c6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.335453  9284 raft_consensus.cc:493] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:13.336028  9284 raft_consensus.cc:515] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:13.338359  9284 leader_election.cc:290] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:13.344769  1659 leader_election.cc:336] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:13.346135  2211 consensus_peers.cc:597] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.346619  9284 raft_consensus.cc:493] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
W20260709 13:03:13.346801  2211 consensus_peers.cc:597] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.347502  2211 consensus_peers.cc:597] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.348079  2211 consensus_peers.cc:597] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.352154  9284 raft_consensus.cc:515] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:13.356608  9284 leader_election.cc:290] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:13.358378  1659 consensus_peers.cc:597] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:13.362156  1659 leader_election.cc:336] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:13.363711  9261 raft_consensus.cc:493] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.364301  9261 raft_consensus.cc:515] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:13.367043  9261 leader_election.cc:290] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:13.378532  1659 leader_election.cc:336] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:13.381789   431 tablet_replica.cc:333] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.384521   431 raft_consensus.cc:2243] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.388175   431 raft_consensus.cc:2272] T 1becd217447147aeb09608ec3f5c123b P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.389763  9284 raft_consensus.cc:493] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:13.390232  9284 raft_consensus.cc:515] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:13.393296  9284 leader_election.cc:290] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:13.400658  1659 leader_election.cc:336] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:13.406531  9309 raft_consensus.cc:493] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:13.407078  9309 raft_consensus.cc:515] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:13.409348  9309 leader_election.cc:290] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:13.413237  2210 leader_election.cc:336] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:13.415256  2209 leader_election.cc:336] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:13.416209   431 tablet_replica.cc:333] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.416260  2209 leader_election.cc:304] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:13.417361   431 raft_consensus.cc:2243] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.417790  9309 raft_consensus.cc:2749] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:13.418816   431 raft_consensus.cc:2272] T ded1641387fd4fd4be29caddb22781fb P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.421593   431 tablet_replica.cc:333] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.422444   431 raft_consensus.cc:2243] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:03:13.424465  1660 leader_election.cc:336] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:13.425300  1660 leader_election.cc:304] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:13.426064  9261 raft_consensus.cc:2749] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:13.427166  1660 leader_election.cc:336] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:13.427649  1660 leader_election.cc:304] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:13.428408  9261 raft_consensus.cc:2749] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:13.430135  1660 leader_election.cc:336] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:13.431071  1660 leader_election.cc:304] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:13.432570  9261 raft_consensus.cc:2749] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:13.433975  9309 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:13.434504  9309 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:13.436653  9309 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:13.437668  2211 consensus_peers.cc:597] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.441447  1660 leader_election.cc:336] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:13.442543  1660 leader_election.cc:304] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:03:13.442090  2210 leader_election.cc:336] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:13.444020  2209 leader_election.cc:336] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:13.444558  9261 raft_consensus.cc:2749] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:13.443420   431 raft_consensus.cc:2272] T 479456ab418d44c4983d2bb37eb0e700 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.445860  2209 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:13.447253  9309 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:13.448221  2211 consensus_peers.cc:597] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.449743   431 tablet_replica.cc:333] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.450855   431 raft_consensus.cc:2243] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.452652   431 raft_consensus.cc:2272] T 9355ac91422346bb9f5dfa3c1424df25 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.456173   431 tablet_replica.cc:333] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.457127   431 raft_consensus.cc:2243] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.458067   431 raft_consensus.cc:2272] T d0a7e28ddafe4ac389f2603e93af8dba P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.484915  1659 consensus_peers.cc:597] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:13.488118   431 tablet_replica.cc:333] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.490471   431 raft_consensus.cc:2243] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.492133   431 raft_consensus.cc:2272] T 17d7fbb63fde4df88c4345a9532b4738 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.495256   431 tablet_replica.cc:333] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.496227   431 raft_consensus.cc:2243] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.497483   431 raft_consensus.cc:2272] T 6c40365464684a5d86c2918b7b0160d4 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.501369   431 tablet_replica.cc:333] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
W20260709 13:03:13.503499  2211 consensus_peers.cc:597] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.502483   431 raft_consensus.cc:2243] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.505280   431 raft_consensus.cc:2272] T e4b724996f86487f991c761b011e8aaf P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.508190   431 tablet_replica.cc:333] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.509241   431 raft_consensus.cc:2243] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.510464   431 raft_consensus.cc:2272] T 67f0dcf1e89644688ea3e2603f9a37d0 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.524140   431 tablet_replica.cc:333] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.525097   431 raft_consensus.cc:2243] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.525889   431 raft_consensus.cc:2272] T c97fa1eb9d6548d3852cfed83b346e69 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.529691   431 tablet_replica.cc:333] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.531128   431 raft_consensus.cc:2243] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.531912   431 raft_consensus.cc:2272] T 5ca86ee366e14bdd8686ea8e5b48be10 P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.535501   431 tablet_replica.cc:333] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.536659   431 raft_consensus.cc:2243] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.537371   431 raft_consensus.cc:2272] T 05911a041e044f48bce12648b58061be P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.540273   431 tablet_replica.cc:333] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.541145   431 raft_consensus.cc:2243] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.542555   431 raft_consensus.cc:2272] T 9831a5f16aac472b8ce4f707c039e298 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.545845   431 tablet_replica.cc:333] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.546823   431 raft_consensus.cc:2243] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.548151   431 raft_consensus.cc:2272] T ad3e3b7b46ab493c8eda918df77def64 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.551586   431 tablet_replica.cc:333] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.553093   431 raft_consensus.cc:2243] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.553836   431 pending_rounds.cc:70] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Trying to abort 1 pending ops.
I20260709 13:03:13.554229   431 pending_rounds.cc:77] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6: Aborting op as it isn't in flight: id { term: 22 index: 15 } timestamp: 7305634564667969536 op_type: NO_OP noop_request { }
I20260709 13:03:13.554652   431 raft_consensus.cc:2889] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:13.555055   431 raft_consensus.cc:2272] T 5a69de749cce497b83e6489ad367017a P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.564275   431 tablet_replica.cc:333] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.566179   431 raft_consensus.cc:2243] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.568470   431 raft_consensus.cc:2272] T b42f5c0b467d44b1878074fc21fa8f41 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.574185   431 tablet_replica.cc:333] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.576355   431 raft_consensus.cc:2243] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.615024  9307 raft_consensus.cc:493] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:13.617539   431 pending_rounds.cc:70] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Trying to abort 1 pending ops.
I20260709 13:03:13.616915  9307 raft_consensus.cc:515] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:13.618188   431 pending_rounds.cc:77] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6: Aborting op as it isn't in flight: id { term: 23 index: 13 } timestamp: 7305634565898366976 op_type: NO_OP noop_request { }
I20260709 13:03:13.619084   431 raft_consensus.cc:2889] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 23 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:13.619971   431 raft_consensus.cc:2272] T 4ceaee3af9aa446a8796bde98fd46779 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.627936  9307 leader_election.cc:290] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), e8a64798e5f94de8909707bcbd11804a (127.0.107.196:40413)
I20260709 13:03:13.630875   431 tablet_replica.cc:333] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.632680  2246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5daaba0e764f4ca8876bda9d220973" candidate_uuid: "822e08445eae4a33b2f2fe92060192c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e8a64798e5f94de8909707bcbd11804a" is_pre_election: true
I20260709 13:03:13.633818  2246 raft_consensus.cc:2468] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822e08445eae4a33b2f2fe92060192c6 in term 19.
W20260709 13:03:13.647102  1659 leader_election.cc:336] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:13.658504   431 raft_consensus.cc:2243] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:13.658594  2209 consensus_peers.cc:597] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:13.661414   431 raft_consensus.cc:2272] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.665254   431 tablet_replica.cc:333] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.666662   431 raft_consensus.cc:2243] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.683434   431 raft_consensus.cc:2272] T 02b29fae0aae48f28944958f7ef007fa P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.687105   431 tablet_replica.cc:333] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.688315   431 raft_consensus.cc:2243] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.690101   431 raft_consensus.cc:2272] T 9e0db569e82e490f9de2c0a9300c24bf P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.694934  1660 leader_election.cc:336] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:13.695106  2267 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0f80 after lost signal to thread 434
I20260709 13:03:13.695470  1660 leader_election.cc:304] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6, e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:03:13.696301  1660 raft_consensus.cc:2686] T 7c5daaba0e764f4ca8876bda9d220973 P 822e08445eae4a33b2f2fe92060192c6: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:03:13.696902  2267 debug-util.cc:398] Leaking SignalData structure 0x7b0800356080 after lost signal to thread 1479
W20260709 13:03:13.699296  2267 debug-util.cc:398] Leaking SignalData structure 0x7b08002ca5c0 after lost signal to thread 1720
W20260709 13:03:13.701324  2267 debug-util.cc:398] Leaking SignalData structure 0x7b08003b7140 after lost signal to thread 2270
I20260709 13:03:13.709275   431 tablet_replica.cc:333] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.710309   431 raft_consensus.cc:2243] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.722759   431 raft_consensus.cc:2272] T 927e42de9e944ae8a2d45f30be59d5df P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.730284  9307 raft_consensus.cc:493] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:13.731127  9307 raft_consensus.cc:515] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } }
I20260709 13:03:13.733697  9308 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:13.734450  9307 leader_election.cc:290] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:13.734591  9308 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:13.735399  1659 consensus_peers.cc:597] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:13.741658  2209 leader_election.cc:336] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:13.741923   431 tablet_replica.cc:333] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
W20260709 13:03:13.742326  1659 leader_election.cc:336] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:13.743059   431 raft_consensus.cc:2243] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.744160   431 raft_consensus.cc:2272] T 03423b07f7be422db9d20b7313be1bab P 822e08445eae4a33b2f2fe92060192c6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.761790   431 tablet_replica.cc:333] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.770095  9308 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:13.763120   431 raft_consensus.cc:2243] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.774634   431 raft_consensus.cc:2272] T 5d987fd742df4898acd2aaa15097431c P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.778160   431 tablet_replica.cc:333] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.779450   431 raft_consensus.cc:2243] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.782603   431 raft_consensus.cc:2272] T 4142f46c85974609aa207df00c3d031e P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.783764  2210 leader_election.cc:336] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:13.784291  2210 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:13.785300  9318 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:13.800383   431 tablet_replica.cc:333] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.801646   431 raft_consensus.cc:2243] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.804194   431 raft_consensus.cc:2272] T 7aca6dcf002947d6841150860825871b P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.808228   431 tablet_replica.cc:333] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.809541   431 raft_consensus.cc:2243] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.810508   431 raft_consensus.cc:2272] T 520ee35af44d4a529e945654996352cc P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.822196  1659 consensus_peers.cc:597] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:13.826406   431 tablet_replica.cc:333] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.827514   431 raft_consensus.cc:2243] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:03:13.830955  1660 leader_election.cc:336] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:13.835389   431 raft_consensus.cc:2272] T 685ae4154c6d4c3abdaf18547da9ffe2 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.839001  2209 consensus_peers.cc:597] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:13.839908   431 tablet_replica.cc:333] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.841075   431 raft_consensus.cc:2243] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.842128   431 raft_consensus.cc:2272] T 1365c85d063446a6a6a589798b355741 P 822e08445eae4a33b2f2fe92060192c6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.831518  1660 leader_election.cc:304] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822e08445eae4a33b2f2fe92060192c6; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:13.851058   431 tablet_replica.cc:333] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.852118   431 raft_consensus.cc:2243] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.855679  9261 raft_consensus.cc:2749] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:13.858139   431 raft_consensus.cc:2272] T 2efa93934d6a4a8182f175ae59fc177e P 822e08445eae4a33b2f2fe92060192c6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.862696   431 tablet_replica.cc:333] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.863677   431 raft_consensus.cc:2243] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.864725   431 raft_consensus.cc:2272] T 13edebc31dfe4957b3870b909ea5330e P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.868005   431 tablet_replica.cc:333] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.876396   431 raft_consensus.cc:2243] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.878454   431 raft_consensus.cc:2272] T 646909798f0047ef9e8073d28a784525 P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.884049   431 tablet_replica.cc:333] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.891685   431 raft_consensus.cc:2243] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.903774   431 raft_consensus.cc:2272] T 1a2222d3d1694f2d93fb2f0702805e3e P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.907017   431 tablet_replica.cc:333] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.907920   431 raft_consensus.cc:2243] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.909155   431 raft_consensus.cc:2272] T 4f5673bb37ab4e1b9ae5af2d2091b347 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.912616   431 tablet_replica.cc:333] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
W20260709 13:03:13.913415  2209 consensus_peers.cc:597] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:13.913769   431 raft_consensus.cc:2243] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.920568   431 raft_consensus.cc:2272] T e52504b3c7614b43be2a7cf1be42ad66 P 822e08445eae4a33b2f2fe92060192c6 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.928318   431 tablet_replica.cc:333] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.940080   431 raft_consensus.cc:2243] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.942503   431 raft_consensus.cc:2272] T c4270ae85dd544aeb602acb371def068 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.946523   431 tablet_replica.cc:333] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.947547   431 raft_consensus.cc:2243] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.949146   431 raft_consensus.cc:2272] T 710dba62795546819d9b3fd89ad4e8fe P 822e08445eae4a33b2f2fe92060192c6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.960049   431 tablet_replica.cc:333] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.961089   431 raft_consensus.cc:2243] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.962706   431 raft_consensus.cc:2272] T bd6921d4b2d8478f99effa533f8d9f3d P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.966523   431 tablet_replica.cc:333] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.973315   431 raft_consensus.cc:2243] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 26 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:13.973454  2209 consensus_peers.cc:597] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:13.980741   431 raft_consensus.cc:2272] T 63e2429c350c4d36a523ed1c4955ef23 P 822e08445eae4a33b2f2fe92060192c6 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.984372   431 tablet_replica.cc:333] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.990048   431 raft_consensus.cc:2243] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.991331   431 raft_consensus.cc:2272] T 7803266de9984fac88726b08bee73921 P 822e08445eae4a33b2f2fe92060192c6 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.994750   431 tablet_replica.cc:333] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:13.998224   431 raft_consensus.cc:2243] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.999917   431 raft_consensus.cc:2272] T 2d351fa3549448eda026a66b8c124d58 P 822e08445eae4a33b2f2fe92060192c6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.014230   431 tablet_replica.cc:333] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:14.015050   431 raft_consensus.cc:2243] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.016201   431 raft_consensus.cc:2272] T b19a10a05aa24743a6d1222179fd4af4 P 822e08445eae4a33b2f2fe92060192c6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.019052  9308 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:14.019874  9308 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:14.019343   431 tablet_replica.cc:333] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:14.025192   431 raft_consensus.cc:2243] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.025461  9320 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.026165  9320 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:14.026734   431 raft_consensus.cc:2272] T 5814bf31e900408885160ea0f89d6189 P 822e08445eae4a33b2f2fe92060192c6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.028651  9320 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:14.030176   431 tablet_replica.cc:333] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6: stopping tablet replica
I20260709 13:03:14.030983   431 raft_consensus.cc:2243] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:14.039983  2211 leader_election.cc:336] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:14.048002  2210 leader_election.cc:336] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:14.049204  2210 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
W20260709 13:03:14.046979  2209 leader_election.cc:336] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:14.051718   431 raft_consensus.cc:2272] T 7b5efbd7e50442858cc9d27a08f50b3e P 822e08445eae4a33b2f2fe92060192c6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.046190  9308 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:14.058509  9308 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:03:14.066370  2210 leader_election.cc:336] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:14.068427  2210 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:14.073056  9308 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:14.100970  2210 consensus_peers.cc:597] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:14.273062  2209 consensus_peers.cc:597] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:14.290066  2209 consensus_peers.cc:597] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:14.309353  2209 consensus_peers.cc:597] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:14.310110  2210 consensus_peers.cc:597] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:14.355822  2210 consensus_peers.cc:597] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:14.368234  2210 consensus_peers.cc:597] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:14.369856  2209 consensus_peers.cc:597] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:14.398286  2210 consensus_peers.cc:597] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:14.457159  2209 consensus_peers.cc:597] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:14.484563  2209 consensus_peers.cc:597] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:14.544095  2209 consensus_peers.cc:597] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:14.545493  2210 consensus_peers.cc:597] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:14.590936  9308 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:14.591729  9308 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:14.596294  9308 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:14.600709  2211 leader_election.cc:336] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
W20260709 13:03:14.602402  2210 leader_election.cc:336] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:14.602870  2210 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:14.603642  9320 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:14.609234  9320 raft_consensus.cc:493] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:14.609871  9320 raft_consensus.cc:515] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:14.617609  9320 leader_election.cc:290] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:14.622344  2211 leader_election.cc:336] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
W20260709 13:03:14.622954  2210 leader_election.cc:336] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:14.623596  2210 leader_election.cc:304] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:14.624329  9320 raft_consensus.cc:2749] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:14.655802  9320 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:14.656533  9320 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:14.658857  9320 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:14.660410  9320 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:14.661137  9320 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:14.665437  2211 leader_election.cc:336] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
W20260709 13:03:14.666000  2210 leader_election.cc:336] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:14.666427  2210 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:14.667217  9308 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:14.675287  9320 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:14.676342  2211 leader_election.cc:336] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
W20260709 13:03:14.678890  2210 leader_election.cc:336] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:14.679430  2210 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:14.680207  9308 raft_consensus.cc:493] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:14.680799  9308 raft_consensus.cc:515] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:14.687345  2209 leader_election.cc:336] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:14.688599  9308 leader_election.cc:290] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:14.690325  9308 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:14.692544  2211 leader_election.cc:336] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
I20260709 13:03:14.692996  2211 leader_election.cc:304] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:14.693739  9320 raft_consensus.cc:2749] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:14.706561  2210 consensus_peers.cc:597] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:14.720935  9320 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:14.721568  9320 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:14.732507  2210 consensus_peers.cc:597] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:14.733650  2209 leader_election.cc:336] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:14.734692  9308 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:14.735392  9308 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:14.742455  9308 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:14.743770  2209 leader_election.cc:336] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:14.733750  9320 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:14.760294  2211 leader_election.cc:336] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
I20260709 13:03:14.760872  2211 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:14.762305  9320 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:14.763700  2211 leader_election.cc:336] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
I20260709 13:03:14.774854  9320 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:14.775693  9320 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:14.782197  9320 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:14.782306  2210 leader_election.cc:336] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:14.782919  2211 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:14.784613  9320 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:14.788223  9320 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:14.789445  9320 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:14.794760  9320 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:14.801360  2210 leader_election.cc:336] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:14.804215  2211 leader_election.cc:336] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
I20260709 13:03:14.805363  2211 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:14.806655  9320 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:14.811204  2211 leader_election.cc:336] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
I20260709 13:03:14.811771  2211 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:14.812981  9320 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:14.830551  9321 raft_consensus.cc:493] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:14.831200  9321 raft_consensus.cc:515] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:14.833389  9321 leader_election.cc:290] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:14.834945  2209 consensus_peers.cc:597] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:14.844444  2210 consensus_peers.cc:597] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:14.838208  2209 leader_election.cc:336] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:14.851629  2211 leader_election.cc:336] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
W20260709 13:03:14.866024  2210 consensus_peers.cc:597] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:14.855049  2211 leader_election.cc:304] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:14.875299  9320 raft_consensus.cc:2749] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:14.879417  9320 raft_consensus.cc:493] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:14.880174  9320 raft_consensus.cc:515] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:14.882401  9320 leader_election.cc:290] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:14.894053  2209 leader_election.cc:336] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:14.914686  2210 consensus_peers.cc:597] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:14.921334  2211 leader_election.cc:336] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
I20260709 13:03:14.925011  2211 leader_election.cc:304] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:14.926956  9320 raft_consensus.cc:2749] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:14.939630  9320 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:14.940912  9320 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:14.973827  2209 leader_election.cc:336] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:14.978339  2211 leader_election.cc:336] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
I20260709 13:03:14.981161  2211 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:03:14.981812  2210 consensus_peers.cc:597] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:14.976325  9320 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:14.983546  9308 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:15.019923  9308 raft_consensus.cc:493] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:15.020610  9308 raft_consensus.cc:515] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:15.023519  9308 leader_election.cc:290] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:15.031986  2211 leader_election.cc:336] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
W20260709 13:03:15.043771  1431 catalog_manager.cc:4755] TS 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): ChangeConfig:REMOVE_PEER RPC failed for tablet 5a69de749cce497b83e6489ad367017a: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
W20260709 13:03:15.054175  2210 leader_election.cc:336] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:15.054837  2210 leader_election.cc:304] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:15.055668  9320 raft_consensus.cc:2749] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:15.055948  2210 consensus_peers.cc:597] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:15.131178  9320 raft_consensus.cc:493] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:15.131889  9320 raft_consensus.cc:515] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:15.134373  9320 leader_election.cc:290] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:15.142956  2209 leader_election.cc:336] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:15.147426  2211 leader_election.cc:336] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
I20260709 13:03:15.147993  2211 leader_election.cc:304] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:15.149245  9320 raft_consensus.cc:2749] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:15.151912  2210 consensus_peers.cc:597] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:15.209223  9320 raft_consensus.cc:493] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:15.209823  9320 raft_consensus.cc:515] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:15.219149  2211 leader_election.cc:336] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
W20260709 13:03:15.223343  2209 leader_election.cc:336] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:15.224377  2209 leader_election.cc:304] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:15.223870  9320 leader_election.cc:290] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:15.225370  9308 raft_consensus.cc:2749] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:15.295166  9320 raft_consensus.cc:493] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:15.295872  9320 raft_consensus.cc:515] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:15.311834  2211 leader_election.cc:336] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
I20260709 13:03:15.314735  9308 raft_consensus.cc:493] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:15.315415  9308 raft_consensus.cc:515] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:15.317803  9308 leader_election.cc:290] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:15.318786  9320 leader_election.cc:290] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459), d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871)
W20260709 13:03:15.330471  2209 leader_election.cc:336] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:15.332408  2209 leader_election.cc:336] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:15.336221  2209 leader_election.cc:304] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:03:15.336958  2211 leader_election.cc:336] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
I20260709 13:03:15.339509  2211 leader_election.cc:304] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:15.340139  9320 raft_consensus.cc:2749] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:15.341332  9308 raft_consensus.cc:2749] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:15.418432   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1717)
W20260709 13:03:15.435037  2211 consensus_peers.cc:597] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:15.646050  9326 raft_consensus.cc:493] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:15.646682  9326 raft_consensus.cc:515] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:15.648980  9326 leader_election.cc:290] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:15.658546  2210 leader_election.cc:336] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
W20260709 13:03:15.659318  2209 leader_election.cc:336] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:15.659749  2209 leader_election.cc:304] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:15.660503  9326 raft_consensus.cc:2749] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:15.676512  2211 consensus_peers.cc:597] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:15.703209  2211 consensus_peers.cc:597] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:15.714388  2211 consensus_peers.cc:597] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:15.742342  2211 consensus_peers.cc:597] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:15.832520  2211 consensus_peers.cc:597] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:15.842056  2211 consensus_peers.cc:597] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:15.877734  9320 raft_consensus.cc:493] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.878558  9320 raft_consensus.cc:515] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } attrs { replace: true } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:15.881837  9320 leader_election.cc:290] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:15.886059  2211 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111) [suppressed 599 similar messages]
W20260709 13:03:15.897847  2209 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:15.900018  2211 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
I20260709 13:03:15.902056  2211 leader_election.cc:304] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:15.904829  9320 raft_consensus.cc:2749] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:15.914873  2210 leader_election.cc:336] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:15.917694  9320 raft_consensus.cc:493] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.922854  9320 raft_consensus.cc:515] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:15.925334  9320 leader_election.cc:290] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:15.929538  2211 consensus_peers.cc:597] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:15.943892  2211 leader_election.cc:336] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
I20260709 13:03:15.953752  9320 raft_consensus.cc:493] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:15.954514  9320 raft_consensus.cc:515] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:15.959475  9320 leader_election.cc:290] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:15.960111  2210 leader_election.cc:336] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:15.968655  2210 leader_election.cc:304] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:15.972347  9320 raft_consensus.cc:2749] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:03:15.967032  2211 consensus_peers.cc:597] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:15.978259  2209 consensus_peers.cc:597] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:15.982611  2209 leader_election.cc:336] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:15.989337  2211 consensus_peers.cc:597] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:15.990202  2210 leader_election.cc:336] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:15.992314  2210 leader_election.cc:304] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:15.993630  9320 raft_consensus.cc:2749] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:16.163559  9320 raft_consensus.cc:493] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:16.164141  9320 raft_consensus.cc:515] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:16.168243  9320 leader_election.cc:290] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
W20260709 13:03:16.178743  2209 leader_election.cc:336] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
W20260709 13:03:16.179448  2209 consensus_peers.cc:597] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:16.188090  2210 leader_election.cc:336] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:16.189288  2210 leader_election.cc:304] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:16.191425  9326 raft_consensus.cc:2749] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:16.192277  9326 raft_consensus.cc:493] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:16.192752  9326 raft_consensus.cc:515] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:16.194959  9326 leader_election.cc:290] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:16.200618  2211 leader_election.cc:336] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
W20260709 13:03:16.206640  2210 leader_election.cc:336] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:16.207136  2210 leader_election.cc:304] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:16.217788  9320 raft_consensus.cc:2749] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:16.299938   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:03:16.315754  2209 consensus_peers.cc:597] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:16.338225  2211 consensus_peers.cc:597] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a -> Peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Couldn't send request to peer 822e08445eae4a33b2f2fe92060192c6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:16.382241  9320 raft_consensus.cc:493] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:16.382848  9320 raft_consensus.cc:515] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:16.385058  9320 leader_election.cc:290] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:16.395581  2211 leader_election.cc:336] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
W20260709 13:03:16.416194  2210 leader_election.cc:336] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:16.416826  2210 leader_election.cc:304] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:16.417670  9327 raft_consensus.cc:2749] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:16.438971  2209 consensus_peers.cc:597] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:16.439631  2209 consensus_peers.cc:597] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:16.440775  9327 raft_consensus.cc:493] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:16.441372  9327 raft_consensus.cc:515] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:16.443771  9327 leader_election.cc:290] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:16.449875  2211 leader_election.cc:336] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
W20260709 13:03:16.464785  2210 leader_election.cc:336] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:16.465365  2210 leader_election.cc:304] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:16.466286  9327 raft_consensus.cc:2749] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:16.480213   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:03:16.525910  9320 raft_consensus.cc:493] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:16.526777  9320 raft_consensus.cc:515] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:16.533555  9320 leader_election.cc:290] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:16.537322  2211 leader_election.cc:336] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
I20260709 13:03:16.538255  9320 raft_consensus.cc:493] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:16.539417  9320 raft_consensus.cc:515] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
W20260709 13:03:16.538762  2209 leader_election.cc:336] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:16.541244  2209 leader_election.cc:304] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:03:16.548200  2211 leader_election.cc:336] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
I20260709 13:03:16.551527  9327 raft_consensus.cc:2749] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:16.552531  9327 raft_consensus.cc:493] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:16.552994  9327 raft_consensus.cc:515] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:16.554369   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:16.555190  9327 leader_election.cc:290] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:16.557652   431 tablet_replica.cc:333] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.558984   431 raft_consensus.cc:2243] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:16.560099  2210 consensus_peers.cc:597] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:16.560107   431 pending_rounds.cc:70] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a: Trying to abort 1 pending ops.
I20260709 13:03:16.561010   431 pending_rounds.cc:77] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a: Aborting op as it isn't in flight: id { term: 22 index: 15 } timestamp: 7305634564667969536 op_type: NO_OP noop_request { }
I20260709 13:03:16.561476   431 raft_consensus.cc:2889] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:16.561880   431 raft_consensus.cc:2272] T 5a69de749cce497b83e6489ad367017a P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.549026  9320 leader_election.cc:290] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
W20260709 13:03:16.572798  2211 leader_election.cc:336] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
I20260709 13:03:16.575433   431 tablet_replica.cc:333] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.576733   431 raft_consensus.cc:2243] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.577837   431 raft_consensus.cc:2272] T 00924ae4c66740e59de627a44de33c38 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:16.578164  2209 leader_election.cc:336] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:16.578717  2209 leader_election.cc:304] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
W20260709 13:03:16.579769  2209 leader_election.cc:336] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:16.580765  2209 leader_election.cc:304] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, d7158d6c3b634dc7abb69eac58eba291
I20260709 13:03:16.580278  9320 raft_consensus.cc:2749] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:16.581992   431 tablet_replica.cc:333] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.582087  9320 raft_consensus.cc:2749] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:16.583217   431 raft_consensus.cc:2243] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.585335   431 raft_consensus.cc:2272] T cdca03ab6655412d9f1d4fea1f1acf78 P e8a64798e5f94de8909707bcbd11804a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.591022   431 tablet_replica.cc:333] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.592000   431 raft_consensus.cc:2243] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.593248   431 raft_consensus.cc:2272] T 5d987fd742df4898acd2aaa15097431c P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.597406   431 tablet_replica.cc:333] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.598302   431 raft_consensus.cc:2243] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.599735   431 raft_consensus.cc:2272] T 5ee97fe9eef14f818a1f9178885dfc31 P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.603297   431 tablet_replica.cc:333] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.604207   431 raft_consensus.cc:2243] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.605113   431 raft_consensus.cc:2272] T 5814bf31e900408885160ea0f89d6189 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:16.606833  2209 consensus_peers.cc:597] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a -> Peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Couldn't send request to peer d7158d6c3b634dc7abb69eac58eba291. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:16.608036   431 tablet_replica.cc:333] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.608980   431 raft_consensus.cc:2243] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.609561   431 raft_consensus.cc:2272] T ad3e3b7b46ab493c8eda918df77def64 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.612766   431 tablet_replica.cc:333] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.613664   431 raft_consensus.cc:2243] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.614224   431 raft_consensus.cc:2272] T e4b724996f86487f991c761b011e8aaf P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.617215   431 tablet_replica.cc:333] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.618007   431 raft_consensus.cc:2243] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.619129   431 raft_consensus.cc:2272] T 03423b07f7be422db9d20b7313be1bab P e8a64798e5f94de8909707bcbd11804a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.622161   431 tablet_replica.cc:333] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.623039   431 raft_consensus.cc:2243] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.624547   431 raft_consensus.cc:2272] T d0a7e28ddafe4ac389f2603e93af8dba P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.628211   431 tablet_replica.cc:333] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.628996   431 raft_consensus.cc:2243] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.629665   431 raft_consensus.cc:2272] T fa1a194f4d834ee6aa037d727b8f9e2a P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.632706   431 tablet_replica.cc:333] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.633396   431 raft_consensus.cc:2243] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.634480   431 raft_consensus.cc:2272] T 05911a041e044f48bce12648b58061be P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.637459   431 tablet_replica.cc:333] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.638320   431 raft_consensus.cc:2243] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.639533   431 raft_consensus.cc:2272] T 1a2222d3d1694f2d93fb2f0702805e3e P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.642228   431 tablet_replica.cc:333] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.643275   431 raft_consensus.cc:2243] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.644023   431 raft_consensus.cc:2272] T 9c6a5febc6e54b13a4ed0d342e7b7f8f P e8a64798e5f94de8909707bcbd11804a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.647398   431 tablet_replica.cc:333] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.648315   431 raft_consensus.cc:2243] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.649621   431 raft_consensus.cc:2272] T 520ee35af44d4a529e945654996352cc P e8a64798e5f94de8909707bcbd11804a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.653102   431 tablet_replica.cc:333] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.653657  9320 raft_consensus.cc:493] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dcc91bf6e3bd468bbbbfc26e3a7c5e01)
I20260709 13:03:16.654034   431 raft_consensus.cc:2243] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.655521  9320 raft_consensus.cc:515] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d7158d6c3b634dc7abb69eac58eba291" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41871 } } peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:16.656400   431 raft_consensus.cc:2272] T 0f253020cc7a4b66aa6c8f66a42d44c6 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.659684   431 tablet_replica.cc:333] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.660692   431 raft_consensus.cc:2243] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.661931   431 raft_consensus.cc:2272] T 4f7d1afbc98a49f3a48b32b8d2b9b646 P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:16.663610  2210 leader_election.cc:336] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:16.664726  9320 leader_election.cc:290] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871), dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981)
I20260709 13:03:16.665252   431 tablet_replica.cc:333] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.666222   431 raft_consensus.cc:2243] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.666946   431 raft_consensus.cc:2272] T 2d351fa3549448eda026a66b8c124d58 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.670249   431 tablet_replica.cc:333] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
W20260709 13:03:16.670218  2209 leader_election.cc:336] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:16.670944  2209 leader_election.cc:304] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: d7158d6c3b634dc7abb69eac58eba291, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:16.671380   431 raft_consensus.cc:2243] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.671749  9320 raft_consensus.cc:2749] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:16.672622   431 raft_consensus.cc:2272] T b19a10a05aa24743a6d1222179fd4af4 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.675666   431 tablet_replica.cc:333] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.676542   431 raft_consensus.cc:2243] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.677558   431 raft_consensus.cc:2272] T c528a0f6bdb44c4187c750d0b1429ba1 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.681056   431 tablet_replica.cc:333] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.681979   431 raft_consensus.cc:2243] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.683249   431 raft_consensus.cc:2272] T 89f88fe569c2476cb298d5e6b745bb5c P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.686810   431 tablet_replica.cc:333] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.687630   431 raft_consensus.cc:2243] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.688328   431 raft_consensus.cc:2272] T b11a3619de25451bbe5a091f271cfa6b P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.691630   431 tablet_replica.cc:333] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.692457   431 raft_consensus.cc:2243] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.693645   431 raft_consensus.cc:2272] T 2efa93934d6a4a8182f175ae59fc177e P e8a64798e5f94de8909707bcbd11804a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.696434   431 tablet_replica.cc:333] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.697247   431 raft_consensus.cc:2243] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.697811   431 raft_consensus.cc:2272] T 685ae4154c6d4c3abdaf18547da9ffe2 P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.700548   431 tablet_replica.cc:333] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.701257   431 raft_consensus.cc:2243] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.701859   431 raft_consensus.cc:2272] T 6c40365464684a5d86c2918b7b0160d4 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.704605   431 tablet_replica.cc:333] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.705377   431 raft_consensus.cc:2243] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.706627   431 raft_consensus.cc:2272] T 6817bc4013144ede80163d16316d4860 P e8a64798e5f94de8909707bcbd11804a [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.709127  9320 raft_consensus.cc:493] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:16.709260   431 tablet_replica.cc:333] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.709713  9320 raft_consensus.cc:515] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:16.710338   431 raft_consensus.cc:2243] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.711067   431 raft_consensus.cc:2272] T 9831a5f16aac472b8ce4f707c039e298 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.713060  9327 raft_consensus.cc:493] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 822e08445eae4a33b2f2fe92060192c6)
I20260709 13:03:16.713573  9327 raft_consensus.cc:515] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dcc91bf6e3bd468bbbbfc26e3a7c5e01" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39981 } } peers { permanent_uuid: "822e08445eae4a33b2f2fe92060192c6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34459 } } peers { permanent_uuid: "e8a64798e5f94de8909707bcbd11804a" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 40413 } attrs { promote: false } }
I20260709 13:03:16.714077   431 tablet_replica.cc:333] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.715118   431 raft_consensus.cc:2243] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.715992  9327 leader_election.cc:290] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:16.716286   431 raft_consensus.cc:2272] T 927e42de9e944ae8a2d45f30be59d5df P e8a64798e5f94de8909707bcbd11804a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.720121   431 tablet_replica.cc:333] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.721045   431 raft_consensus.cc:2243] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.721776   431 raft_consensus.cc:2272] T 9e0db569e82e490f9de2c0a9300c24bf P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.724867   431 tablet_replica.cc:333] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
W20260709 13:03:16.725308  2210 leader_election.cc:336] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:16.725730   431 raft_consensus.cc:2243] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 26 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:16.725957  2210 leader_election.cc:336] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111)
I20260709 13:03:16.726656   431 raft_consensus.cc:2272] T 63e2429c350c4d36a523ed1c4955ef23 P e8a64798e5f94de8909707bcbd11804a [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:16.729712  2211 leader_election.cc:336] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
I20260709 13:03:16.730367  2211 leader_election.cc:304] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:16.731343  9327 raft_consensus.cc:2749] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:16.731498   431 tablet_replica.cc:333] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.728010  9320 leader_election.cc:290] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981), 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459)
I20260709 13:03:16.733114   431 raft_consensus.cc:2243] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:16.734217  2211 leader_election.cc:336] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 822e08445eae4a33b2f2fe92060192c6 (127.0.107.195:34459): Network error: Client connection negotiation failed: client connection to 127.0.107.195:34459: connect: Connection refused (error 111)
I20260709 13:03:16.734606   431 raft_consensus.cc:2272] T b5871ff5fd9c4673b5650490648edf26 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.734731  2211 leader_election.cc:304] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8a64798e5f94de8909707bcbd11804a; no voters: 822e08445eae4a33b2f2fe92060192c6, dcc91bf6e3bd468bbbbfc26e3a7c5e01
I20260709 13:03:16.736008  9320 raft_consensus.cc:2749] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:16.738194   431 tablet_replica.cc:333] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.739188   431 raft_consensus.cc:2243] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.740163   431 raft_consensus.cc:2272] T 7c5daaba0e764f4ca8876bda9d220973 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.744109   431 tablet_replica.cc:333] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.744975   431 raft_consensus.cc:2243] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.746323   431 raft_consensus.cc:2272] T b42f5c0b467d44b1878074fc21fa8f41 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.750011   431 tablet_replica.cc:333] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.750905   431 raft_consensus.cc:2243] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.751793   431 raft_consensus.cc:2272] T 4142f46c85974609aa207df00c3d031e P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.754954   431 tablet_replica.cc:333] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.755870   431 raft_consensus.cc:2243] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.757292   431 raft_consensus.cc:2272] T 158ebfb5c6324189947e23e5386968e4 P e8a64798e5f94de8909707bcbd11804a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.760744   431 tablet_replica.cc:333] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.761685   431 raft_consensus.cc:2243] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.763031   431 raft_consensus.cc:2272] T 32470c2737744478bac199459790b787 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:16.764642  2210 consensus_peers.cc:597] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a -> Peer dcc91bf6e3bd468bbbbfc26e3a7c5e01 (127.0.107.194:39981): Couldn't send request to peer dcc91bf6e3bd468bbbbfc26e3a7c5e01. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:16.767517   431 tablet_replica.cc:333] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.768497   431 raft_consensus.cc:2243] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.769479   431 raft_consensus.cc:2272] T 4b6f3b457deb4725b437c627cc3a5cd7 P e8a64798e5f94de8909707bcbd11804a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.773265   431 tablet_replica.cc:333] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.774149   431 raft_consensus.cc:2243] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.774849   431 raft_consensus.cc:2272] T 479456ab418d44c4983d2bb37eb0e700 P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.778160   431 tablet_replica.cc:333] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.778983   431 raft_consensus.cc:2243] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.780298   431 raft_consensus.cc:2272] T 6e3bc16a73cd42baba8ebfcbf2a0e93b P e8a64798e5f94de8909707bcbd11804a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.783474   431 tablet_replica.cc:333] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.784263   431 raft_consensus.cc:2243] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.785115   431 raft_consensus.cc:2272] T c4270ae85dd544aeb602acb371def068 P e8a64798e5f94de8909707bcbd11804a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.788313   431 tablet_replica.cc:333] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.789238   431 raft_consensus.cc:2243] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.790485   431 raft_consensus.cc:2272] T 646909798f0047ef9e8073d28a784525 P e8a64798e5f94de8909707bcbd11804a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.794199   431 tablet_replica.cc:333] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.794979   431 raft_consensus.cc:2243] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.796195   431 raft_consensus.cc:2272] T 13edebc31dfe4957b3870b909ea5330e P e8a64798e5f94de8909707bcbd11804a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.799332   431 tablet_replica.cc:333] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.800187   431 raft_consensus.cc:2243] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.801156   431 raft_consensus.cc:2272] T ded1641387fd4fd4be29caddb22781fb P e8a64798e5f94de8909707bcbd11804a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.804968   431 tablet_replica.cc:333] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a: stopping tablet replica
I20260709 13:03:16.805776   431 raft_consensus.cc:2243] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.807075   431 raft_consensus.cc:2272] T c97fa1eb9d6548d3852cfed83b346e69 P e8a64798e5f94de8909707bcbd11804a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.595099   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:03:17.718497   431 master.cc:562] Master@127.0.107.254:43923 shutting down...
W20260709 13:03:17.776429  1493 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:03:17.776836  1493 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:17.777076  1493 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:19.245540  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08001735c0 after lost signal to thread 434
W20260709 13:03:19.246066  1476 debug-util.cc:398] Leaking SignalData structure 0x7b080037d2e0 after lost signal to thread 1479
W20260709 13:03:23.255585  1429 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111) [suppressed 88 similar messages]
W20260709 13:03:23.258884  1429 catalog_manager.cc:4755] TS d7158d6c3b634dc7abb69eac58eba291 (127.0.107.193:41871): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 63e2429c350c4d36a523ed1c4955ef23: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41871: connect: Connection refused (error 111)
I20260709 13:03:23.443030   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:23.444672   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:23.445118   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P b9f5bb9ff31f4ba4a2568147b35a35db: stopping tablet replica
I20260709 13:03:23.681746   431 master.cc:584] Master@127.0.107.254:43923 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (233393 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:03:23.802239   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:41919
I20260709 13:03:23.803678   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:23.809784  9333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:23.810134  9335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:23.810252  9332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:23.811017   431 server_base.cc:1061] running on GCE node
I20260709 13:03:23.814287   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:23.814471   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:23.814679   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602203814637 us; error 0 us; skew 500 ppm
I20260709 13:03:23.815217   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:23.817703   431 webserver.cc:533] Webserver started at http://127.0.107.254:39693/ using document root <none> and password file <none>
I20260709 13:03:23.818199   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:23.818388   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:23.818674   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:23.820264   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/master-0-root/instance:
uuid: "594d46eb8a6d478899418a7e9af1d891"
format_stamp: "Formatted at 2026-07-09 13:03:23 on dist-test-slave-zhw8"
I20260709 13:03:23.824743   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:03:23.828550  9340 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:23.829315   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:03:23.829674   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/master-0-root
uuid: "594d46eb8a6d478899418a7e9af1d891"
format_stamp: "Formatted at 2026-07-09 13:03:23 on dist-test-slave-zhw8"
I20260709 13:03:23.829957   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:23.847970   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:23.849340   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:23.890313   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:41919
I20260709 13:03:23.890439  9391 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:41919 every 8 connection(s)
I20260709 13:03:23.894816  9392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:23.906157  9392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891: Bootstrap starting.
I20260709 13:03:23.911329  9392 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.916129  9392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891: No bootstrap required, opened a new log
I20260709 13:03:23.918586  9392 raft_consensus.cc:359] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594d46eb8a6d478899418a7e9af1d891" member_type: VOTER }
I20260709 13:03:23.919173  9392 raft_consensus.cc:385] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.919466  9392 raft_consensus.cc:740] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 594d46eb8a6d478899418a7e9af1d891, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.920207  9392 consensus_queue.cc:260] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594d46eb8a6d478899418a7e9af1d891" member_type: VOTER }
I20260709 13:03:23.920727  9392 raft_consensus.cc:399] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:23.921000  9392 raft_consensus.cc:493] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:23.921330  9392 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.927971  9392 raft_consensus.cc:515] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594d46eb8a6d478899418a7e9af1d891" member_type: VOTER }
I20260709 13:03:23.928591  9392 leader_election.cc:304] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 594d46eb8a6d478899418a7e9af1d891; no voters: 
I20260709 13:03:23.929819  9392 leader_election.cc:290] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:23.930183  9395 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:23.931624  9395 raft_consensus.cc:697] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [term 1 LEADER]: Becoming Leader. State: Replica: 594d46eb8a6d478899418a7e9af1d891, State: Running, Role: LEADER
I20260709 13:03:23.932395  9395 consensus_queue.cc:237] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594d46eb8a6d478899418a7e9af1d891" member_type: VOTER }
I20260709 13:03:23.933262  9392 sys_catalog.cc:565] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:23.943096  9397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 594d46eb8a6d478899418a7e9af1d891. Latest consensus state: current_term: 1 leader_uuid: "594d46eb8a6d478899418a7e9af1d891" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594d46eb8a6d478899418a7e9af1d891" member_type: VOTER } }
I20260709 13:03:23.944085  9397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:23.945756  9396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "594d46eb8a6d478899418a7e9af1d891" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594d46eb8a6d478899418a7e9af1d891" member_type: VOTER } }
I20260709 13:03:23.946326  9396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:23.949059  9405 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:23.953955  9405 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:23.955207   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:23.962824  9405 catalog_manager.cc:1383] Generated new cluster ID: 067ef346732a4b91bcec4e032d07a69e
I20260709 13:03:23.963193  9405 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:23.983335  9405 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:23.984643  9405 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:24.000934  9405 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891: Generated new TSK 0
I20260709 13:03:24.001556  9405 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:24.022154   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:24.029104  9413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:24.029942  9414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:24.032953  9416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:24.033635   431 server_base.cc:1061] running on GCE node
I20260709 13:03:24.035970   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:24.036211   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:24.036383   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602204036361 us; error 0 us; skew 500 ppm
I20260709 13:03:24.036916   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:24.039458   431 webserver.cc:533] Webserver started at http://127.0.107.193:38677/ using document root <none> and password file <none>
I20260709 13:03:24.039956   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:24.040158   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:24.040418   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:24.041680   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-0-root/instance:
uuid: "04edfe53c70f45e09190743b636a705f"
format_stamp: "Formatted at 2026-07-09 13:03:24 on dist-test-slave-zhw8"
I20260709 13:03:24.046422   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:03:24.050019  9421 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:24.050963   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:24.051342   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-0-root
uuid: "04edfe53c70f45e09190743b636a705f"
format_stamp: "Formatted at 2026-07-09 13:03:24 on dist-test-slave-zhw8"
I20260709 13:03:24.051656   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:24.074640   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:24.075876   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:24.077247   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:24.079617   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:24.079787   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:24.080157   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:24.080334   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:24.123431   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:39371
I20260709 13:03:24.123530  9483 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:39371 every 8 connection(s)
I20260709 13:03:24.129256   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:24.137192  9488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:24.138291  9489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:24.142689  9491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:24.144019  9484 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41919
I20260709 13:03:24.144047   431 server_base.cc:1061] running on GCE node
I20260709 13:03:24.144718  9484 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:24.145838  9484 heartbeater.cc:507] Master 127.0.107.254:41919 requested a full tablet report, sending...
I20260709 13:03:24.147353   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:24.147651   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:24.147887   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602204147864 us; error 0 us; skew 500 ppm
I20260709 13:03:24.148614   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:24.148797  9357 ts_manager.cc:194] Registered new tserver with Master: 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:24.150699  9357 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59416
I20260709 13:03:24.151568   431 webserver.cc:533] Webserver started at http://127.0.107.194:43809/ using document root <none> and password file <none>
I20260709 13:03:24.152370   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:24.152637   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:24.152999   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:24.154498   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-1-root/instance:
uuid: "7610e18c23c543f1a31b6d851bac1bb2"
format_stamp: "Formatted at 2026-07-09 13:03:24 on dist-test-slave-zhw8"
I20260709 13:03:24.159305   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:03:24.162878  9496 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:24.163700   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:24.163969   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-1-root
uuid: "7610e18c23c543f1a31b6d851bac1bb2"
format_stamp: "Formatted at 2026-07-09 13:03:24 on dist-test-slave-zhw8"
I20260709 13:03:24.164207   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:24.174458   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:24.175732   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:24.177163   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:24.179534   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:24.179721   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:24.180002   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:24.180164   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:24.224892   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:34349
I20260709 13:03:24.225005  9558 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:34349 every 8 connection(s)
I20260709 13:03:24.230588   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:24.238163  9562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:24.238926  9563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:24.242787  9565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:24.244837  9559 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41919
I20260709 13:03:24.244967   431 server_base.cc:1061] running on GCE node
I20260709 13:03:24.245297  9559 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:24.245956   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:03:24.246171  9559 heartbeater.cc:507] Master 127.0.107.254:41919 requested a full tablet report, sending...
W20260709 13:03:24.246220   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:24.246670   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602204246644 us; error 0 us; skew 500 ppm
I20260709 13:03:24.247362   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:24.248580  9357 ts_manager.cc:194] Registered new tserver with Master: 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:24.250066   431 webserver.cc:533] Webserver started at http://127.0.107.195:39057/ using document root <none> and password file <none>
I20260709 13:03:24.250224  9357 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59428
I20260709 13:03:24.250633   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:24.250897   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:24.251195   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:24.252405   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-2-root/instance:
uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
format_stamp: "Formatted at 2026-07-09 13:03:24 on dist-test-slave-zhw8"
I20260709 13:03:24.256914   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:24.260207  9570 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:24.261041   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:24.261379   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-2-root
uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
format_stamp: "Formatted at 2026-07-09 13:03:24 on dist-test-slave-zhw8"
I20260709 13:03:24.261665   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:24.287909   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:24.289166   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:24.290696   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:24.292958   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:24.293197   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:24.293438   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:24.293608   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:24.337245   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:45605
I20260709 13:03:24.337406  9632 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:45605 every 8 connection(s)
I20260709 13:03:24.342199   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:24.349866  9636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:24.350607  9637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:24.353513  9639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:24.354624   431 server_base.cc:1061] running on GCE node
I20260709 13:03:24.355073  9633 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41919
I20260709 13:03:24.355544  9633 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:24.355808   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:24.356088   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:24.356319   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602204356299 us; error 0 us; skew 500 ppm
I20260709 13:03:24.356503  9633 heartbeater.cc:507] Master 127.0.107.254:41919 requested a full tablet report, sending...
I20260709 13:03:24.357122   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:24.358952  9357 ts_manager.cc:194] Registered new tserver with Master: 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:24.359993   431 webserver.cc:533] Webserver started at http://127.0.107.196:33007/ using document root <none> and password file <none>
I20260709 13:03:24.360694   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:24.360800  9357 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59430
I20260709 13:03:24.360965   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:24.361363   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:24.362941   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-3-root/instance:
uuid: "eaba2f78a9274147a783ffa321939ed5"
format_stamp: "Formatted at 2026-07-09 13:03:24 on dist-test-slave-zhw8"
I20260709 13:03:24.367545   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:03:24.370966  9644 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:24.371734   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:24.372041   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-3-root
uuid: "eaba2f78a9274147a783ffa321939ed5"
format_stamp: "Formatted at 2026-07-09 13:03:24 on dist-test-slave-zhw8"
I20260709 13:03:24.372299   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:24.384843   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:24.386080   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:24.387588   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:24.389786   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:24.390017   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:24.390264   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:24.390437   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:24.435717   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:41541
I20260709 13:03:24.435818  9706 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:41541 every 8 connection(s)
I20260709 13:03:24.450609  9707 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41919
I20260709 13:03:24.451015  9707 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:24.451859  9707 heartbeater.cc:507] Master 127.0.107.254:41919 requested a full tablet report, sending...
I20260709 13:03:24.453995  9357 ts_manager.cc:194] Registered new tserver with Master: eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:24.455076   431 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016269126s
I20260709 13:03:24.455642  9357 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59434
I20260709 13:03:24.482259  9357 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59442:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:03:24.758332  9524 tablet_service.cc:1511] Processing CreateTablet for tablet 74c0e4e3fe184fd4af9e5a84ddc58828 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:24.759995  9524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c0e4e3fe184fd4af9e5a84ddc58828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.768319  9672 tablet_service.cc:1511] Processing CreateTablet for tablet 74c0e4e3fe184fd4af9e5a84ddc58828 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:24.769857  9672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c0e4e3fe184fd4af9e5a84ddc58828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.771028  9523 tablet_service.cc:1511] Processing CreateTablet for tablet 8df55ee6044645c183a597fd3f8b2aaf (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:24.772610  9523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8df55ee6044645c183a597fd3f8b2aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.775377  9671 tablet_service.cc:1511] Processing CreateTablet for tablet ee70c523613a48fc8f5cca7456742e7b (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:24.776823  9671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee70c523613a48fc8f5cca7456742e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.778757  9449 tablet_service.cc:1511] Processing CreateTablet for tablet 74c0e4e3fe184fd4af9e5a84ddc58828 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:24.780210  9449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c0e4e3fe184fd4af9e5a84ddc58828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.781376  9522 tablet_service.cc:1511] Processing CreateTablet for tablet d2bdb17a9faf45208000a631d0455183 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:24.782845  9522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2bdb17a9faf45208000a631d0455183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.784391  9447 tablet_service.cc:1511] Processing CreateTablet for tablet ee70c523613a48fc8f5cca7456742e7b (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:24.785830  9447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee70c523613a48fc8f5cca7456742e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.786777  9440 tablet_service.cc:1511] Processing CreateTablet for tablet 3fc5524c279b403bb8db8d843b728706 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:24.787722  9598 tablet_service.cc:1511] Processing CreateTablet for tablet 8df55ee6044645c183a597fd3f8b2aaf (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:24.788259  9440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fc5524c279b403bb8db8d843b728706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.788483  9446 tablet_service.cc:1511] Processing CreateTablet for tablet bd6508e7cfe8459d9903c00481fda73d (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:24.789243  9598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8df55ee6044645c183a597fd3f8b2aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.789939  9446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6508e7cfe8459d9903c00481fda73d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.792621  9597 tablet_service.cc:1511] Processing CreateTablet for tablet ee70c523613a48fc8f5cca7456742e7b (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:24.792747  9445 tablet_service.cc:1511] Processing CreateTablet for tablet 0adcede6679b495786781fa878243f44 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:24.794066  9597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee70c523613a48fc8f5cca7456742e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.794193  9445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0adcede6679b495786781fa878243f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.796504  9596 tablet_service.cc:1511] Processing CreateTablet for tablet d2bdb17a9faf45208000a631d0455183 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:24.798007  9596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2bdb17a9faf45208000a631d0455183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.797708  9443 tablet_service.cc:1511] Processing CreateTablet for tablet 0bbe6355bc344a7d883c246c2cc8adc1 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:24.800459  9595 tablet_service.cc:1511] Processing CreateTablet for tablet bd6508e7cfe8459d9903c00481fda73d (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:24.802858  9594 tablet_service.cc:1511] Processing CreateTablet for tablet 6b589ee51a3b4411a255ac63c57232f9 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:24.803722  9448 tablet_service.cc:1511] Processing CreateTablet for tablet 8df55ee6044645c183a597fd3f8b2aaf (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:24.805205  9593 tablet_service.cc:1511] Processing CreateTablet for tablet 4315cb1968e34e2e8539985ae04e2bd4 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:24.806833  9442 tablet_service.cc:1511] Processing CreateTablet for tablet 7c671c6618ad41ff8d9f7d3d121ed086 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:24.807534  9592 tablet_service.cc:1511] Processing CreateTablet for tablet 0bbe6355bc344a7d883c246c2cc8adc1 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:24.800460  9441 tablet_service.cc:1511] Processing CreateTablet for tablet 423b11e873bd4a57ad207fc15fcb995e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:24.796501  9444 tablet_service.cc:1511] Processing CreateTablet for tablet 6b589ee51a3b4411a255ac63c57232f9 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:24.811154  9670 tablet_service.cc:1511] Processing CreateTablet for tablet d2bdb17a9faf45208000a631d0455183 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:24.811307  9591 tablet_service.cc:1511] Processing CreateTablet for tablet 423b11e873bd4a57ad207fc15fcb995e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:24.812659  9670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2bdb17a9faf45208000a631d0455183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.814043  9590 tablet_service.cc:1511] Processing CreateTablet for tablet f1e8eed746fe4a8fbbdbcc76f7ab8260 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:24.814811  9521 tablet_service.cc:1511] Processing CreateTablet for tablet 0adcede6679b495786781fa878243f44 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:24.816201  9521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0adcede6679b495786781fa878243f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.816438  9519 tablet_service.cc:1511] Processing CreateTablet for tablet 0bbe6355bc344a7d883c246c2cc8adc1 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:24.816807  9589 tablet_service.cc:1511] Processing CreateTablet for tablet 3fc5524c279b403bb8db8d843b728706 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:24.817873  9519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bbe6355bc344a7d883c246c2cc8adc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.819358  9520 tablet_service.cc:1511] Processing CreateTablet for tablet 4315cb1968e34e2e8539985ae04e2bd4 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:24.820470  9518 tablet_service.cc:1511] Processing CreateTablet for tablet 7c671c6618ad41ff8d9f7d3d121ed086 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:24.822991  9589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fc5524c279b403bb8db8d843b728706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.824812  9517 tablet_service.cc:1511] Processing CreateTablet for tablet f1e8eed746fe4a8fbbdbcc76f7ab8260 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:24.820822  9520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4315cb1968e34e2e8539985ae04e2bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.840299  9517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e8eed746fe4a8fbbdbcc76f7ab8260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.827221  9668 tablet_service.cc:1511] Processing CreateTablet for tablet 6b589ee51a3b4411a255ac63c57232f9 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:24.841805  9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b589ee51a3b4411a255ac63c57232f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.827755  9515 tablet_service.cc:1511] Processing CreateTablet for tablet 270eabeaaff64040920c19c1ab4a2903 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:24.829444  9516 tablet_service.cc:1511] Processing CreateTablet for tablet 3fc5524c279b403bb8db8d843b728706 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:24.830384  9669 tablet_service.cc:1511] Processing CreateTablet for tablet 0adcede6679b495786781fa878243f44 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:24.844281  9518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c671c6618ad41ff8d9f7d3d121ed086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.845724  9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0adcede6679b495786781fa878243f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.849205  9595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6508e7cfe8459d9903c00481fda73d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.850037  9591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423b11e873bd4a57ad207fc15fcb995e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.853188  9515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 270eabeaaff64040920c19c1ab4a2903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.853273  9592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bbe6355bc344a7d883c246c2cc8adc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.854315  9516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fc5524c279b403bb8db8d843b728706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.833192  9524 tablet_service.cc:1511] Processing CreateTablet for tablet bd6508e7cfe8459d9903c00481fda73d (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:24.860441  9524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6508e7cfe8459d9903c00481fda73d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.879590  9443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bbe6355bc344a7d883c246c2cc8adc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.888937  9667 tablet_service.cc:1511] Processing CreateTablet for tablet 4315cb1968e34e2e8539985ae04e2bd4 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:24.890565  9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4315cb1968e34e2e8539985ae04e2bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.892596  9666 tablet_service.cc:1511] Processing CreateTablet for tablet 7c671c6618ad41ff8d9f7d3d121ed086 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:24.894014  9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c671c6618ad41ff8d9f7d3d121ed086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.896486  9665 tablet_service.cc:1511] Processing CreateTablet for tablet 423b11e873bd4a57ad207fc15fcb995e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:24.897377  9593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4315cb1968e34e2e8539985ae04e2bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.897881  9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423b11e873bd4a57ad207fc15fcb995e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.899663  9442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c671c6618ad41ff8d9f7d3d121ed086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.900489  9664 tablet_service.cc:1511] Processing CreateTablet for tablet f1e8eed746fe4a8fbbdbcc76f7ab8260 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:24.901942  9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e8eed746fe4a8fbbdbcc76f7ab8260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.904496  9663 tablet_service.cc:1511] Processing CreateTablet for tablet 270eabeaaff64040920c19c1ab4a2903 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:24.905529  9594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b589ee51a3b4411a255ac63c57232f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.907618  9590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e8eed746fe4a8fbbdbcc76f7ab8260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.911468  9444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b589ee51a3b4411a255ac63c57232f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.911592  9663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 270eabeaaff64040920c19c1ab4a2903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.931591  9448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8df55ee6044645c183a597fd3f8b2aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.933473  9440 tablet_service.cc:1511] Processing CreateTablet for tablet 270eabeaaff64040920c19c1ab4a2903 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:24.934808  9440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 270eabeaaff64040920c19c1ab4a2903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.939337  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423b11e873bd4a57ad207fc15fcb995e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.942261  9520 tablet_service.cc:1511] Processing CreateTablet for tablet 6432b6ee54144ac1963d46714288e802 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:24.943831  9727 tablet_bootstrap.cc:492] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
W20260709 13:03:24.946514  9404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:24.983724  9523 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7f960fa21840e4b44bfd4dd63d950f (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:24.985234  9520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6432b6ee54144ac1963d46714288e802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.998844  9668 tablet_service.cc:1511] Processing CreateTablet for tablet b099c00fd6634f1396a726b711f9e555 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:24.999701  9524 tablet_service.cc:1511] Processing CreateTablet for tablet 2e2c2487f2f644ce9cba2ec3f72b7993 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:25.000839  9596 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7f960fa21840e4b44bfd4dd63d950f (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:25.005574  9727 tablet_bootstrap.cc:654] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.005254  9595 tablet_service.cc:1511] Processing CreateTablet for tablet 6432b6ee54144ac1963d46714288e802 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:25.013551  9596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7f960fa21840e4b44bfd4dd63d950f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.047430  9667 tablet_service.cc:1511] Processing CreateTablet for tablet 2e2c2487f2f644ce9cba2ec3f72b7993 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:25.050024  9593 tablet_service.cc:1511] Processing CreateTablet for tablet 17a105ce4cd245e3ada74a6fa7b69ffd (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:25.014362  9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b099c00fd6634f1396a726b711f9e555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.023439  9523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7f960fa21840e4b44bfd4dd63d950f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.024849  9522 tablet_service.cc:1511] Processing CreateTablet for tablet 7e0b0663f9ce4c9db6d2da7a4405309b (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:25.055814  9671 tablet_service.cc:1511] Processing CreateTablet for tablet 6432b6ee54144ac1963d46714288e802 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:25.056562  9524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e2c2487f2f644ce9cba2ec3f72b7993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.032433  9445 tablet_service.cc:1511] Processing CreateTablet for tablet b099c00fd6634f1396a726b711f9e555 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:25.057710  9445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b099c00fd6634f1396a726b711f9e555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.035979  9729 tablet_bootstrap.cc:492] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:25.039938  9728 tablet_bootstrap.cc:492] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:25.063562  9522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e0b0663f9ce4c9db6d2da7a4405309b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.037474  9515 tablet_service.cc:1511] Processing CreateTablet for tablet 39889cbf037947ddabe6cf7bc7a8334a (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:25.032281  9449 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7f960fa21840e4b44bfd4dd63d950f (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:25.064908  9449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7f960fa21840e4b44bfd4dd63d950f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.068001  9515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39889cbf037947ddabe6cf7bc7a8334a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.069409  9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e2c2487f2f644ce9cba2ec3f72b7993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.071480  9591 tablet_service.cc:1511] Processing CreateTablet for tablet b099c00fd6634f1396a726b711f9e555 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:25.072691  9446 tablet_service.cc:1511] Processing CreateTablet for tablet 39889cbf037947ddabe6cf7bc7a8334a (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:25.075014  9446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39889cbf037947ddabe6cf7bc7a8334a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.041031  9521 tablet_service.cc:1511] Processing CreateTablet for tablet 17a105ce4cd245e3ada74a6fa7b69ffd (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:25.080180  9521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a105ce4cd245e3ada74a6fa7b69ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.088377  9597 tablet_service.cc:1511] Processing CreateTablet for tablet 871790aff5ff4037ad0c30f4e0276aa3 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:25.089452  9593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a105ce4cd245e3ada74a6fa7b69ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.090482  9447 tablet_service.cc:1511] Processing CreateTablet for tablet d23edaf5688c4b51a8f524e1fb7c928f (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:25.091810  9447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23edaf5688c4b51a8f524e1fb7c928f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.092885  9670 tablet_service.cc:1511] Processing CreateTablet for tablet 17a105ce4cd245e3ada74a6fa7b69ffd (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:25.094303  9670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a105ce4cd245e3ada74a6fa7b69ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.095878  9671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6432b6ee54144ac1963d46714288e802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.095561  9595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6432b6ee54144ac1963d46714288e802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.096896  9666 tablet_service.cc:1511] Processing CreateTablet for tablet 39889cbf037947ddabe6cf7bc7a8334a (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:25.098294  9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39889cbf037947ddabe6cf7bc7a8334a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.043823  9448 tablet_service.cc:1511] Processing CreateTablet for tablet 2e2c2487f2f644ce9cba2ec3f72b7993 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:25.100275  9448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e2c2487f2f644ce9cba2ec3f72b7993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.100275  9591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b099c00fd6634f1396a726b711f9e555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.100895  9665 tablet_service.cc:1511] Processing CreateTablet for tablet 871790aff5ff4037ad0c30f4e0276aa3 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:25.103210  9730 tablet_bootstrap.cc:492] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:25.113358  9728 tablet_bootstrap.cc:654] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.119797  9589 tablet_service.cc:1511] Processing CreateTablet for tablet 7449453f99c946a6a8ad01c0b5faadf9 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:25.069445  9442 tablet_service.cc:1511] Processing CreateTablet for tablet 871790aff5ff4037ad0c30f4e0276aa3 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:25.121137  9589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7449453f99c946a6a8ad01c0b5faadf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.121469  9442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871790aff5ff4037ad0c30f4e0276aa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.124365  9663 tablet_service.cc:1511] Processing CreateTablet for tablet d23edaf5688c4b51a8f524e1fb7c928f (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:25.116274  9598 tablet_service.cc:1511] Processing CreateTablet for tablet 7e0b0663f9ce4c9db6d2da7a4405309b (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:25.125231  9729 tablet_bootstrap.cc:654] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.126004  9598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e0b0663f9ce4c9db6d2da7a4405309b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.116338  9516 tablet_service.cc:1511] Processing CreateTablet for tablet 7449453f99c946a6a8ad01c0b5faadf9 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:25.131460  9516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7449453f99c946a6a8ad01c0b5faadf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.137017  9597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871790aff5ff4037ad0c30f4e0276aa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.140064  9727 tablet_bootstrap.cc:492] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:25.140661  9727 ts_tablet_manager.cc:1403] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.197s	user 0.005s	sys 0.010s
I20260709 13:03:25.143846  9441 tablet_service.cc:1511] Processing CreateTablet for tablet 7e0b0663f9ce4c9db6d2da7a4405309b (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:25.153918  9484 heartbeater.cc:499] Master 127.0.107.254:41919 was elected leader, sending a full tablet report...
I20260709 13:03:25.154421  9443 tablet_service.cc:1511] Processing CreateTablet for tablet 1c3d23cd333345c2a5010982e21b397e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:25.155807  9443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3d23cd333345c2a5010982e21b397e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.156442  9663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23edaf5688c4b51a8f524e1fb7c928f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.160545  9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871790aff5ff4037ad0c30f4e0276aa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.148244  9664 tablet_service.cc:1511] Processing CreateTablet for tablet 7449453f99c946a6a8ad01c0b5faadf9 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:25.167784  9727 raft_consensus.cc:359] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:25.168687  9727 raft_consensus.cc:385] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.169030  9727 raft_consensus.cc:740] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.169943  9727 consensus_queue.cc:260] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:25.172869  9592 tablet_service.cc:1511] Processing CreateTablet for tablet d23edaf5688c4b51a8f524e1fb7c928f (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:25.184522  9592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23edaf5688c4b51a8f524e1fb7c928f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.194768  9728 tablet_bootstrap.cc:492] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:25.195360  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e0b0663f9ce4c9db6d2da7a4405309b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.201285  9730 tablet_bootstrap.cc:654] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.205757  9728 ts_tablet_manager.cc:1403] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.166s	user 0.008s	sys 0.010s
I20260709 13:03:25.208745  9729 tablet_bootstrap.cc:492] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:25.213888  9522 tablet_service.cc:1511] Processing CreateTablet for tablet 1c3d23cd333345c2a5010982e21b397e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:25.217440  9729 ts_tablet_manager.cc:1403] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.182s	user 0.011s	sys 0.005s
I20260709 13:03:25.217794  9522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3d23cd333345c2a5010982e21b397e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.218130  9728 raft_consensus.cc:359] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:25.231899  9728 raft_consensus.cc:385] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.232342  9728 raft_consensus.cc:740] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.233350  9728 consensus_queue.cc:260] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:25.239494  9729 raft_consensus.cc:359] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:25.244553  9729 raft_consensus.cc:385] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.245020  9729 raft_consensus.cc:740] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.246112  9729 consensus_queue.cc:260] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:25.242635  9595 tablet_service.cc:1511] Processing CreateTablet for tablet 1c3d23cd333345c2a5010982e21b397e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:25.249145  9595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3d23cd333345c2a5010982e21b397e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.253027  9559 heartbeater.cc:499] Master 127.0.107.254:41919 was elected leader, sending a full tablet report...
I20260709 13:03:25.264746  9671 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe09b15d9f346838b395c7fd2da18ad (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:25.260525  9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7449453f99c946a6a8ad01c0b5faadf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.266809  9442 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe09b15d9f346838b395c7fd2da18ad (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:25.284430  9442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe09b15d9f346838b395c7fd2da18ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.301860  9671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe09b15d9f346838b395c7fd2da18ad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:25.310705  9341 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.196:41541, user_credentials={real_user=slave}} blocked reactor thread for 47295.6us
I20260709 13:03:25.313094  9666 tablet_service.cc:1511] Processing CreateTablet for tablet ad0797397ca74a699473bb7b07f063c8 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:25.314435  9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0797397ca74a699473bb7b07f063c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.323113  9667 tablet_service.cc:1511] Processing CreateTablet for tablet c12ad87eca574eefa5cbe3f34e13eb8e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:25.324481  9633 heartbeater.cc:499] Master 127.0.107.254:41919 was elected leader, sending a full tablet report...
I20260709 13:03:25.324563  9734 raft_consensus.cc:493] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.328631  9597 tablet_service.cc:1511] Processing CreateTablet for tablet ad0797397ca74a699473bb7b07f063c8 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:25.328722  9734 raft_consensus.cc:515] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:25.329998  9597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0797397ca74a699473bb7b07f063c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.325048  9524 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe09b15d9f346838b395c7fd2da18ad (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:25.337508  9524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe09b15d9f346838b395c7fd2da18ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.343101  9729 ts_tablet_manager.cc:1434] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.123s	user 0.006s	sys 0.010s
W20260709 13:03:25.343622  9634 tablet.cc:2406] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:25.344269  9729 tablet_bootstrap.cc:492] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:25.326538  9728 ts_tablet_manager.cc:1434] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.120s	user 0.006s	sys 0.006s
I20260709 13:03:25.326552  9522 tablet_service.cc:1511] Processing CreateTablet for tablet c12ad87eca574eefa5cbe3f34e13eb8e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:25.325497  9730 tablet_bootstrap.cc:492] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:25.347997  9730 ts_tablet_manager.cc:1403] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.245s	user 0.025s	sys 0.007s
I20260709 13:03:25.343868  9734 leader_election.cc:290] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:25.348098  9522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12ad87eca574eefa5cbe3f34e13eb8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.327642  9589 tablet_service.cc:1511] Processing CreateTablet for tablet c12ad87eca574eefa5cbe3f34e13eb8e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:25.355798  9737 raft_consensus.cc:493] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.356360  9589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12ad87eca574eefa5cbe3f34e13eb8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.356284  9737 raft_consensus.cc:515] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:25.350088  9728 tablet_bootstrap.cc:492] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:25.350634  9448 tablet_service.cc:1511] Processing CreateTablet for tablet 3188c3b2ea944412b8f9b38b34380bf0 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:25.358547  9448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3188c3b2ea944412b8f9b38b34380bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.361274  9727 ts_tablet_manager.cc:1434] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.220s	user 0.022s	sys 0.025s
I20260709 13:03:25.362649  9727 tablet_bootstrap.cc:492] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:25.364589  9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12ad87eca574eefa5cbe3f34e13eb8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.375713  9446 tablet_service.cc:1511] Processing CreateTablet for tablet ad0797397ca74a699473bb7b07f063c8 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:25.388489  9446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0797397ca74a699473bb7b07f063c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.396848  9665 tablet_service.cc:1511] Processing CreateTablet for tablet 09481da07933449cae77deb1569c9f9e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:25.398377  9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09481da07933449cae77deb1569c9f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.399513  9516 tablet_service.cc:1511] Processing CreateTablet for tablet 3188c3b2ea944412b8f9b38b34380bf0 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:25.400091  9737 leader_election.cc:290] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:25.400970  9516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3188c3b2ea944412b8f9b38b34380bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.402582  9736 raft_consensus.cc:493] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.403062  9736 raft_consensus.cc:515] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:25.354986  9730 raft_consensus.cc:359] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:25.407028  9736 leader_election.cc:290] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:25.430049  9730 raft_consensus.cc:385] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.449405  9447 tablet_service.cc:1511] Processing CreateTablet for tablet 09481da07933449cae77deb1569c9f9e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:25.437335  9730 raft_consensus.cc:740] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.465327  9728 tablet_bootstrap.cc:654] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.466771  9727 tablet_bootstrap.cc:654] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.476449  9595 tablet_service.cc:1511] Processing CreateTablet for tablet 3188c3b2ea944412b8f9b38b34380bf0 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:25.477320  9598 tablet_service.cc:1511] Processing CreateTablet for tablet b92fcf3ae6ad4cb7b6c86496a6f70cde (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:25.477792  9595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3188c3b2ea944412b8f9b38b34380bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.478622  9598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92fcf3ae6ad4cb7b6c86496a6f70cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.463603  9707 heartbeater.cc:499] Master 127.0.107.254:41919 was elected leader, sending a full tablet report...
I20260709 13:03:25.461421  9521 tablet_service.cc:1511] Processing CreateTablet for tablet 09481da07933449cae77deb1569c9f9e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:25.488425  9521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09481da07933449cae77deb1569c9f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.497498  9729 tablet_bootstrap.cc:654] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.492046  9447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09481da07933449cae77deb1569c9f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.524216  9666 tablet_service.cc:1511] Processing CreateTablet for tablet b92fcf3ae6ad4cb7b6c86496a6f70cde (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:25.525708  9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92fcf3ae6ad4cb7b6c86496a6f70cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.506980  9730 consensus_queue.cc:260] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:25.557068  9728 tablet_bootstrap.cc:492] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:25.557678  9728 ts_tablet_manager.cc:1403] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.208s	user 0.020s	sys 0.000s
I20260709 13:03:25.559782  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bdb17a9faf45208000a631d0455183" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
W20260709 13:03:25.561709  9571 leader_election.cc:343] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.562007  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bdb17a9faf45208000a631d0455183" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
W20260709 13:03:25.563710  9573 leader_election.cc:343] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.564145  9573 leader_election.cc:304] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:25.565827  9736 raft_consensus.cc:2749] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:25.560912  9728 raft_consensus.cc:359] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:25.567198  9728 raft_consensus.cc:385] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.567588  9728 raft_consensus.cc:740] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.568502  9728 consensus_queue.cc:260] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:25.568929  9441 tablet_service.cc:1511] Processing CreateTablet for tablet b92fcf3ae6ad4cb7b6c86496a6f70cde (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:25.571099  9728 ts_tablet_manager.cc:1434] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:03:25.573083  9728 tablet_bootstrap.cc:492] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:25.577234  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92fcf3ae6ad4cb7b6c86496a6f70cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.589087  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df55ee6044645c183a597fd3f8b2aaf" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:25.597681  9589 tablet_service.cc:1511] Processing CreateTablet for tablet dc5d1e1a6ffc47f994ee7cd91df4db54 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:25.599079  9589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5d1e1a6ffc47f994ee7cd91df4db54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.575021  9521 tablet_service.cc:1511] Processing CreateTablet for tablet dc5d1e1a6ffc47f994ee7cd91df4db54 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 13:03:25.606321  9499 leader_election.cc:343] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.606982  9521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5d1e1a6ffc47f994ee7cd91df4db54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.609076  9729 tablet_bootstrap.cc:492] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:25.609694  9729 ts_tablet_manager.cc:1403] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.266s	user 0.018s	sys 0.012s
I20260709 13:03:25.612389  9737 raft_consensus.cc:493] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.612910  9737 raft_consensus.cc:515] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:25.615625  9737 leader_election.cc:290] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:25.613001  9729 raft_consensus.cc:359] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:25.620110  9728 tablet_bootstrap.cc:654] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.630280  9667 tablet_service.cc:1511] Processing CreateTablet for tablet dc5d1e1a6ffc47f994ee7cd91df4db54 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:25.631920  9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5d1e1a6ffc47f994ee7cd91df4db54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.624644  9522 tablet_service.cc:1511] Processing CreateTablet for tablet 18d335e60a664ce6a7db36b70d7a0403 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:25.635291  9730 ts_tablet_manager.cc:1434] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.284s	user 0.008s	sys 0.013s
I20260709 13:03:25.622859  9729 raft_consensus.cc:385] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.641781  9522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18d335e60a664ce6a7db36b70d7a0403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.643190  9666 tablet_service.cc:1511] Processing CreateTablet for tablet ac05c2b77c014117ae5c53f3f8198342 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:25.644605  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5524c279b403bb8db8d843b728706" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:25.640825  9729 raft_consensus.cc:740] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
W20260709 13:03:25.646164  9424 leader_election.cc:343] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.646060  9729 consensus_queue.cc:260] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:25.648691  9597 tablet_service.cc:1511] Processing CreateTablet for tablet 18d335e60a664ce6a7db36b70d7a0403 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:25.650451  9597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18d335e60a664ce6a7db36b70d7a0403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.651957  9448 tablet_service.cc:1511] Processing CreateTablet for tablet ac05c2b77c014117ae5c53f3f8198342 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:25.653359  9448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac05c2b77c014117ae5c53f3f8198342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.656457  9665 tablet_service.cc:1511] Processing CreateTablet for tablet 8511189d31f8408a9103bf9cadddd6c7 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:25.656756  9516 tablet_service.cc:1511] Processing CreateTablet for tablet ac05c2b77c014117ae5c53f3f8198342 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:25.657981  9730 tablet_bootstrap.cc:492] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:25.660272  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcede6679b495786781fa878243f44" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:25.660710  9754 raft_consensus.cc:493] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.661424  9754 raft_consensus.cc:515] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
W20260709 13:03:25.662154  9422 leader_election.cc:343] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.658018  9516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac05c2b77c014117ae5c53f3f8198342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.662930  9595 tablet_service.cc:1511] Processing CreateTablet for tablet 8511189d31f8408a9103bf9cadddd6c7 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:25.657949  9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8511189d31f8408a9103bf9cadddd6c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.664258  9595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8511189d31f8408a9103bf9cadddd6c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.664554  9754 leader_election.cc:290] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:25.672991  9727 tablet_bootstrap.cc:492] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:25.679273  9727 ts_tablet_manager.cc:1403] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.317s	user 0.019s	sys 0.007s
I20260709 13:03:25.675187  9447 tablet_service.cc:1511] Processing CreateTablet for tablet 18d335e60a664ce6a7db36b70d7a0403 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:25.679569  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df55ee6044645c183a597fd3f8b2aaf" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:25.669003  9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac05c2b77c014117ae5c53f3f8198342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.685465  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5524c279b403bb8db8d843b728706" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:25.691622  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcede6679b495786781fa878243f44" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:25.692114  9447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18d335e60a664ce6a7db36b70d7a0403. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:25.692979  9498 leader_election.cc:343] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.703056  9729 ts_tablet_manager.cc:1434] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.093s	user 0.004s	sys 0.004s
I20260709 13:03:25.703524  9441 tablet_service.cc:1511] Processing CreateTablet for tablet 8511189d31f8408a9103bf9cadddd6c7 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:25.704908  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8511189d31f8408a9103bf9cadddd6c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.708297  9729 tablet_bootstrap.cc:492] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:25.699618  9730 tablet_bootstrap.cc:654] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.695216  9727 raft_consensus.cc:359] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:25.715351  9727 raft_consensus.cc:385] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.715701  9727 raft_consensus.cc:740] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.700332  9498 leader_election.cc:304] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:25.722633  9739 raft_consensus.cc:2749] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:25.722759  9424 leader_election.cc:343] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.716406  9727 consensus_queue.cc:260] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:25.723328  9424 leader_election.cc:304] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
W20260709 13:03:25.724565  9424 leader_election.cc:343] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.724987  9424 leader_election.cc:304] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:25.725875  9738 raft_consensus.cc:2749] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:25.726519  9738 raft_consensus.cc:2749] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:25.727166  9727 ts_tablet_manager.cc:1434] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 13:03:25.735625  9727 tablet_bootstrap.cc:492] T 4315cb1968e34e2e8539985ae04e2bd4 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:25.739153  9728 tablet_bootstrap.cc:492] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:25.739923  9728 ts_tablet_manager.cc:1403] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.167s	user 0.001s	sys 0.014s
I20260709 13:03:25.742870  9728 raft_consensus.cc:359] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:25.743710  9728 raft_consensus.cc:385] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.744052  9728 raft_consensus.cc:740] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.745923  9728 consensus_queue.cc:260] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:25.747934  9730 tablet_bootstrap.cc:492] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:25.748543  9730 ts_tablet_manager.cc:1403] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.091s	user 0.008s	sys 0.007s
I20260709 13:03:25.744299  9521 tablet_service.cc:1511] Processing CreateTablet for tablet 5a0333b232194ff09fbd6593bc528531 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:25.758615  9521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a0333b232194ff09fbd6593bc528531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.759804  9730 raft_consensus.cc:359] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:25.760599  9730 raft_consensus.cc:385] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.761019  9730 raft_consensus.cc:740] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.761317  9729 tablet_bootstrap.cc:654] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.761958  9730 consensus_queue.cc:260] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:25.748152  9728 ts_tablet_manager.cc:1434] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:03:25.764372  9728 tablet_bootstrap.cc:492] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:25.767540  9727 tablet_bootstrap.cc:654] T 4315cb1968e34e2e8539985ae04e2bd4 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.771939  9448 tablet_service.cc:1511] Processing CreateTablet for tablet 59aa3eb6cc3047579924350ba3f75d90 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:25.773344  9448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59aa3eb6cc3047579924350ba3f75d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.774117  9728 tablet_bootstrap.cc:654] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.754830  9589 tablet_service.cc:1511] Processing CreateTablet for tablet 5a0333b232194ff09fbd6593bc528531 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:25.779532  9730 ts_tablet_manager.cc:1434] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.004s
I20260709 13:03:25.781478  9589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a0333b232194ff09fbd6593bc528531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.781805  9730 tablet_bootstrap.cc:492] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:25.782460  9516 tablet_service.cc:1511] Processing CreateTablet for tablet 59aa3eb6cc3047579924350ba3f75d90 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:25.783759  9516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59aa3eb6cc3047579924350ba3f75d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.799619  9727 tablet_bootstrap.cc:492] T 4315cb1968e34e2e8539985ae04e2bd4 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:25.800371  9727 ts_tablet_manager.cc:1403] T 4315cb1968e34e2e8539985ae04e2bd4 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.000s
I20260709 13:03:25.799695  9597 tablet_service.cc:1511] Processing CreateTablet for tablet 59aa3eb6cc3047579924350ba3f75d90 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:25.800806  9730 tablet_bootstrap.cc:654] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.801568  9597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59aa3eb6cc3047579924350ba3f75d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.804051  9727 raft_consensus.cc:359] T 4315cb1968e34e2e8539985ae04e2bd4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:25.804780  9727 raft_consensus.cc:385] T 4315cb1968e34e2e8539985ae04e2bd4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.805065  9727 raft_consensus.cc:740] T 4315cb1968e34e2e8539985ae04e2bd4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.805794  9727 consensus_queue.cc:260] T 4315cb1968e34e2e8539985ae04e2bd4 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:25.806635  9447 tablet_service.cc:1511] Processing CreateTablet for tablet 4d50b9a85aa742458e037bd19f757196 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:25.807916  9447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d50b9a85aa742458e037bd19f757196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.808080  9666 tablet_service.cc:1511] Processing CreateTablet for tablet 5a0333b232194ff09fbd6593bc528531 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:25.809372  9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a0333b232194ff09fbd6593bc528531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.816541  9665 tablet_service.cc:1511] Processing CreateTablet for tablet 4d50b9a85aa742458e037bd19f757196 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:25.816955  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4315cb1968e34e2e8539985ae04e2bd4" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:25.817868  9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d50b9a85aa742458e037bd19f757196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.818229  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4315cb1968e34e2e8539985ae04e2bd4" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:25.818920  9534 raft_consensus.cc:2468] T 4315cb1968e34e2e8539985ae04e2bd4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 0.
I20260709 13:03:25.824281  9522 tablet_service.cc:1511] Processing CreateTablet for tablet 4d50b9a85aa742458e037bd19f757196 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:25.825632  9522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d50b9a85aa742458e037bd19f757196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.828826  9729 tablet_bootstrap.cc:492] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:25.829397  9729 ts_tablet_manager.cc:1403] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.121s	user 0.009s	sys 0.003s
I20260709 13:03:25.831579  9647 leader_election.cc:304] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:25.832623  9754 raft_consensus.cc:2804] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:03:25.832724  9647 leader_election.cc:343] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.833168  9754 raft_consensus.cc:493] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.833650  9754 raft_consensus.cc:3060] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.835673  9729 raft_consensus.cc:359] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:25.836313  9727 ts_tablet_manager.cc:1434] T 4315cb1968e34e2e8539985ae04e2bd4 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.002s
I20260709 13:03:25.852643  9524 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8d47fa67d245fb837b1492c15e9766 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:25.841347  9754 raft_consensus.cc:515] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:25.855775  9524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8d47fa67d245fb837b1492c15e9766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.855484  9589 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8d47fa67d245fb837b1492c15e9766 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:25.856774  9589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8d47fa67d245fb837b1492c15e9766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.849169  9441 tablet_service.cc:1511] Processing CreateTablet for tablet 89dc81bdfb864e568aba35ed5d9f24dd (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:25.857740  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89dc81bdfb864e568aba35ed5d9f24dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.857539  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4315cb1968e34e2e8539985ae04e2bd4" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:25.858246  9534 raft_consensus.cc:3060] T 4315cb1968e34e2e8539985ae04e2bd4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.859443  9754 leader_election.cc:290] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:25.860747  9739 raft_consensus.cc:493] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.861043  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4315cb1968e34e2e8539985ae04e2bd4" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:25.861224  9739 raft_consensus.cc:515] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:25.863857  9739 leader_election.cc:290] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:25.836474  9729 raft_consensus.cc:385] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.867390  9729 raft_consensus.cc:740] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
W20260709 13:03:25.867949  9647 leader_election.cc:343] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.868197  9729 consensus_queue.cc:260] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:25.854229  9727 tablet_bootstrap.cc:492] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:25.870625  9729 ts_tablet_manager.cc:1434] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.001s
I20260709 13:03:25.870730  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0e4e3fe184fd4af9e5a84ddc58828" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:25.871480  9459 raft_consensus.cc:2468] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:25.875559  9498 leader_election.cc:304] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:25.875874  9729 tablet_bootstrap.cc:492] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:25.884337  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0e4e3fe184fd4af9e5a84ddc58828" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:25.885228  9728 tablet_bootstrap.cc:492] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:25.885797  9728 ts_tablet_manager.cc:1403] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.122s	user 0.004s	sys 0.012s
W20260709 13:03:25.886053  9497 leader_election.cc:343] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.886061  9730 tablet_bootstrap.cc:492] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:25.886818  9730 ts_tablet_manager.cc:1403] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.105s	user 0.017s	sys 0.009s
I20260709 13:03:25.887053  9739 raft_consensus.cc:2804] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.887313  9727 tablet_bootstrap.cc:654] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.887498  9739 raft_consensus.cc:493] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.887974  9739 raft_consensus.cc:3060] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.889783  9728 raft_consensus.cc:359] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:25.890719  9728 raft_consensus.cc:385] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.892122  9730 raft_consensus.cc:359] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:25.854231  9665 tablet_service.cc:1511] Processing CreateTablet for tablet 89dc81bdfb864e568aba35ed5d9f24dd (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:25.898612  9730 raft_consensus.cc:385] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.899055  9730 raft_consensus.cc:740] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.899971  9730 consensus_queue.cc:260] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:25.896826  9597 tablet_service.cc:1511] Processing CreateTablet for tablet 89dc81bdfb864e568aba35ed5d9f24dd (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:25.902913  9597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89dc81bdfb864e568aba35ed5d9f24dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.903703  9739 raft_consensus.cc:515] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:25.906477  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0e4e3fe184fd4af9e5a84ddc58828" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:25.897512  9534 raft_consensus.cc:2468] T 4315cb1968e34e2e8539985ae04e2bd4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
I20260709 13:03:25.891167  9728 raft_consensus.cc:740] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.893873  9754 raft_consensus.cc:493] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:25.907845  9497 leader_election.cc:343] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.908224  9754 raft_consensus.cc:515] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:25.908980  9647 leader_election.cc:304] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:25.908574  9728 consensus_queue.cc:260] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:25.909941  9755 raft_consensus.cc:2804] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:25.910694  9754 leader_election.cc:290] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:25.912415  9729 tablet_bootstrap.cc:654] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.912629  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b589ee51a3b4411a255ac63c57232f9" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
W20260709 13:03:25.914767  9647 leader_election.cc:343] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.915804  9737 raft_consensus.cc:493] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.916280  9737 raft_consensus.cc:515] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:25.918322  9737 leader_election.cc:290] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:25.920148  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df55ee6044645c183a597fd3f8b2aaf" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:25.921214  9728 ts_tablet_manager.cc:1434] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.035s	user 0.011s	sys 0.000s
W20260709 13:03:25.921558  9424 leader_election.cc:343] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.922448  9728 tablet_bootstrap.cc:492] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:25.922817  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df55ee6044645c183a597fd3f8b2aaf" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:25.923478  9534 raft_consensus.cc:2468] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:25.924600  9424 leader_election.cc:304] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:25.925725  9737 raft_consensus.cc:2804] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.926083  9737 raft_consensus.cc:493] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.926432  9737 raft_consensus.cc:3060] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.926618  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b589ee51a3b4411a255ac63c57232f9" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
W20260709 13:03:25.928247  9646 leader_election.cc:343] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.928702  9646 leader_election.cc:304] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:25.929878  9754 raft_consensus.cc:2749] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:25.932945  9730 ts_tablet_manager.cc:1434] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:03:25.934613  9730 tablet_bootstrap.cc:492] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:25.899235  9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89dc81bdfb864e568aba35ed5d9f24dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.942152  9666 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8d47fa67d245fb837b1492c15e9766 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:25.943214  9730 tablet_bootstrap.cc:654] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.943570  9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8d47fa67d245fb837b1492c15e9766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.946910  9729 tablet_bootstrap.cc:492] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:25.947106  9754 raft_consensus.cc:493] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.947515  9729 ts_tablet_manager.cc:1403] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.003s
I20260709 13:03:25.947650  9754 raft_consensus.cc:515] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:25.948433  9447 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8d25c4566f4b24986e9c10ae6afa5e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:25.949716  9447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8d25c4566f4b24986e9c10ae6afa5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.949925  9754 leader_election.cc:290] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:25.952162  9729 raft_consensus.cc:359] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
W20260709 13:03:25.952836  9404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:25.955700  9736 raft_consensus.cc:493] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.952759  9727 tablet_bootstrap.cc:492] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:25.956205  9736 raft_consensus.cc:515] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:25.956660  9727 ts_tablet_manager.cc:1403] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.103s	user 0.022s	sys 0.026s
I20260709 13:03:25.956426  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b11e873bd4a57ad207fc15fcb995e" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:25.957827  9739 leader_election.cc:290] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
W20260709 13:03:25.958287  9646 leader_election.cc:343] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.964594  9728 tablet_bootstrap.cc:654] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.958712  9736 leader_election.cc:290] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:25.959760  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0e4e3fe184fd4af9e5a84ddc58828" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:25.966413  9459 raft_consensus.cc:3060] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.956426  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b11e873bd4a57ad207fc15fcb995e" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:25.963078  9727 raft_consensus.cc:359] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:25.967512  9727 raft_consensus.cc:385] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.967590  9608 raft_consensus.cc:2468] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 0.
I20260709 13:03:25.967893  9727 raft_consensus.cc:740] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.969008  9647 leader_election.cc:304] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:25.968782  9727 consensus_queue.cc:260] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:25.969823  9754 raft_consensus.cc:2804] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.970207  9754 raft_consensus.cc:493] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.960510  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b11e873bd4a57ad207fc15fcb995e" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:25.970538  9754 raft_consensus.cc:3060] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.971052  9727 ts_tablet_manager.cc:1434] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:03:25.972114  9727 tablet_bootstrap.cc:492] T bd6508e7cfe8459d9903c00481fda73d P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:25.973362  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b11e873bd4a57ad207fc15fcb995e" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
W20260709 13:03:25.974859  9572 leader_election.cc:343] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.952917  9729 raft_consensus.cc:385] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.977144  9729 raft_consensus.cc:740] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.943879  9737 raft_consensus.cc:515] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:25.980363  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df55ee6044645c183a597fd3f8b2aaf" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:25.981921  9755 raft_consensus.cc:697] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:25.981645  9754 raft_consensus.cc:515] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:25.983771  9682 raft_consensus.cc:2393] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8bf0e3504c4f46cf8c639da3e15caf68 in current term 1: Already voted for candidate eaba2f78a9274147a783ffa321939ed5 in this term.
I20260709 13:03:25.983592  9755 consensus_queue.cc:237] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:25.984380  9727 tablet_bootstrap.cc:654] T bd6508e7cfe8459d9903c00481fda73d P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.978104  9729 consensus_queue.cc:260] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:25.986438  9571 leader_election.cc:304] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:25.986770  9459 raft_consensus.cc:2468] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:25.992794  9608 raft_consensus.cc:3060] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.995855  9589 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8d25c4566f4b24986e9c10ae6afa5e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:25.997725  9589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8d25c4566f4b24986e9c10ae6afa5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.002000  9736 raft_consensus.cc:3060] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.003172  9498 leader_election.cc:304] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:26.004671  9739 raft_consensus.cc:2804] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:26.009184  9607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b11e873bd4a57ad207fc15fcb995e" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:26.011221  9754 leader_election.cc:290] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:26.012176  9737 leader_election.cc:290] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:26.012750  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df55ee6044645c183a597fd3f8b2aaf" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:26.013347  9534 raft_consensus.cc:3060] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.011694  9524 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8d25c4566f4b24986e9c10ae6afa5e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:26.016247  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b11e873bd4a57ad207fc15fcb995e" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:26.017498  9524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8d25c4566f4b24986e9c10ae6afa5e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:26.017719  9646 leader_election.cc:343] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.019512  9608 raft_consensus.cc:2468] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:26.031335  9729 ts_tablet_manager.cc:1434] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.002s
I20260709 13:03:26.032850  9729 tablet_bootstrap.cc:492] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:26.022802  9534 raft_consensus.cc:2468] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:26.040561  9424 leader_election.cc:304] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:26.041453  9737 raft_consensus.cc:2804] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:26.041944  9737 raft_consensus.cc:697] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:26.042667  9737 consensus_queue.cc:237] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.056917  9727 tablet_bootstrap.cc:492] T bd6508e7cfe8459d9903c00481fda73d P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:26.057492  9727 ts_tablet_manager.cc:1403] T bd6508e7cfe8459d9903c00481fda73d P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.086s	user 0.018s	sys 0.009s
I20260709 13:03:26.057161  9447 tablet_service.cc:1511] Processing CreateTablet for tablet 39a58824acb343fa8f9e1349207a54b1 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:26.057583  9730 tablet_bootstrap.cc:492] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:26.059201  9730 ts_tablet_manager.cc:1403] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.125s	user 0.026s	sys 0.045s
I20260709 13:03:26.059597  9447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39a58824acb343fa8f9e1349207a54b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.061664  9727 raft_consensus.cc:359] T bd6508e7cfe8459d9903c00481fda73d P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:26.062536  9727 raft_consensus.cc:385] T bd6508e7cfe8459d9903c00481fda73d P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.062373  9730 raft_consensus.cc:359] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:26.062932  9727 raft_consensus.cc:740] T bd6508e7cfe8459d9903c00481fda73d P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.051296  9739 raft_consensus.cc:697] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:26.064117  9727 consensus_queue.cc:260] T bd6508e7cfe8459d9903c00481fda73d P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:26.064405  9739 consensus_queue.cc:237] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:26.057636  9736 raft_consensus.cc:2749] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:26.065814  9522 tablet_service.cc:1511] Processing CreateTablet for tablet 39a58824acb343fa8f9e1349207a54b1 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:26.066710  9730 raft_consensus.cc:385] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.067067  9730 raft_consensus.cc:740] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.067180  9522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39a58824acb343fa8f9e1349207a54b1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:26.052958  9571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:41541, user_credentials={real_user=slave}} blocked reactor thread for 65842.7us
I20260709 13:03:26.079101  9727 ts_tablet_manager.cc:1434] T bd6508e7cfe8459d9903c00481fda73d P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 13:03:26.081601  9589 tablet_service.cc:1511] Processing CreateTablet for tablet aceba3614aec44bd97d0a2111129bae4 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:26.082861  9589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aceba3614aec44bd97d0a2111129bae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.083796  9441 tablet_service.cc:1511] Processing CreateTablet for tablet aceba3614aec44bd97d0a2111129bae4 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:26.085026  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aceba3614aec44bd97d0a2111129bae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.084858  9521 tablet_service.cc:1511] Processing CreateTablet for tablet 92d264be487e49f2b6cc37fefe738369 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:26.086146  9521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d264be487e49f2b6cc37fefe738369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.088241  9667 tablet_service.cc:1511] Processing CreateTablet for tablet aceba3614aec44bd97d0a2111129bae4 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:26.089551  9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aceba3614aec44bd97d0a2111129bae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.068771  9736 raft_consensus.cc:493] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.093604  9727 tablet_bootstrap.cc:492] T 270eabeaaff64040920c19c1ab4a2903 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:26.067904  9730 consensus_queue.cc:260] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:26.102361  9730 ts_tablet_manager.cc:1434] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.043s	user 0.002s	sys 0.005s
I20260709 13:03:26.101914  9356 catalog_manager.cc:5697] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:26.096894  9736 raft_consensus.cc:515] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:26.104625  9664 tablet_service.cc:1511] Processing CreateTablet for tablet 92d264be487e49f2b6cc37fefe738369 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:26.106062  9736 leader_election.cc:290] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:26.106213  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6508e7cfe8459d9903c00481fda73d" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:26.105903  9357 catalog_manager.cc:5697] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:26.107270  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6508e7cfe8459d9903c00481fda73d" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
W20260709 13:03:26.107676  9572 leader_election.cc:343] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.107904  9534 raft_consensus.cc:2468] T bd6508e7cfe8459d9903c00481fda73d P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:26.109086  9573 leader_election.cc:304] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:26.105933  9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d264be487e49f2b6cc37fefe738369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.110486  9730 tablet_bootstrap.cc:492] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:26.110841  9607 raft_consensus.cc:2468] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
I20260709 13:03:26.107086  9597 tablet_service.cc:1511] Processing CreateTablet for tablet 92d264be487e49f2b6cc37fefe738369 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:26.116729  9729 tablet_bootstrap.cc:654] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.117352  9730 tablet_bootstrap.cc:654] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.121732  9597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d264be487e49f2b6cc37fefe738369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.127496  9774 raft_consensus.cc:493] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.128492  9666 tablet_service.cc:1511] Processing CreateTablet for tablet 39a58824acb343fa8f9e1349207a54b1 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:26.138469  9774 raft_consensus.cc:515] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:26.140761  9447 tablet_service.cc:1511] Processing CreateTablet for tablet 03595cf8245743e5984b4c937130e90a (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:26.142144  9447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03595cf8245743e5984b4c937130e90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.142324  9774 leader_election.cc:290] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:26.144927  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bdb17a9faf45208000a631d0455183" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:26.144965  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bdb17a9faf45208000a631d0455183" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:26.146502  9608 raft_consensus.cc:2468] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:26.128132  9736 raft_consensus.cc:2804] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:26.148437  9499 leader_election.cc:304] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:26.135147  9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39a58824acb343fa8f9e1349207a54b1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:26.152858  9497 leader_election.cc:343] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.149789  9736 raft_consensus.cc:493] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.154455  9736 raft_consensus.cc:3060] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.164345  9595 tablet_service.cc:1511] Processing CreateTablet for tablet 03595cf8245743e5984b4c937130e90a (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:26.165740  9595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03595cf8245743e5984b4c937130e90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.166344  9647 leader_election.cc:304] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:26.167534  9755 raft_consensus.cc:2804] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:26.168012  9755 raft_consensus.cc:697] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:26.168251  9516 tablet_service.cc:1511] Processing CreateTablet for tablet 03595cf8245743e5984b4c937130e90a (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:26.168855  9755 consensus_queue.cc:237] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:26.169502  9516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03595cf8245743e5984b4c937130e90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.184393  9728 tablet_bootstrap.cc:492] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:26.184691  9727 tablet_bootstrap.cc:654] T 270eabeaaff64040920c19c1ab4a2903 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.185281  9728 ts_tablet_manager.cc:1403] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.263s	user 0.024s	sys 0.005s
I20260709 13:03:26.157932  9739 raft_consensus.cc:2804] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:26.190418  9739 raft_consensus.cc:493] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.190989  9739 raft_consensus.cc:3060] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.203332  9665 tablet_service.cc:1511] Processing CreateTablet for tablet cba0d047c0df4036a4702dbc607a318e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:26.203504  9355 catalog_manager.cc:5697] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:26.204721  9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba0d047c0df4036a4702dbc607a318e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.189739  9728 raft_consensus.cc:359] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.219910  9521 tablet_service.cc:1511] Processing CreateTablet for tablet cba0d047c0df4036a4702dbc607a318e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:26.221237  9521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba0d047c0df4036a4702dbc607a318e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.206830  9736 raft_consensus.cc:515] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:26.213677  9728 raft_consensus.cc:385] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.233894  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6508e7cfe8459d9903c00481fda73d" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
W20260709 13:03:26.235641  9572 leader_election.cc:343] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.235761  9730 tablet_bootstrap.cc:492] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:26.236591  9730 ts_tablet_manager.cc:1403] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.001s
I20260709 13:03:26.229619  9728 raft_consensus.cc:740] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.245102  9589 tablet_service.cc:1511] Processing CreateTablet for tablet 134aecc79f7c4b398afcbf65000e3267 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:26.246528  9589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 134aecc79f7c4b398afcbf65000e3267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.261245  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6508e7cfe8459d9903c00481fda73d" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:26.261981  9534 raft_consensus.cc:3060] T bd6508e7cfe8459d9903c00481fda73d P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.264019  9730 raft_consensus.cc:359] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.264863  9730 raft_consensus.cc:385] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.265178  9730 raft_consensus.cc:740] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.268610  9666 tablet_service.cc:1511] Processing CreateTablet for tablet 134aecc79f7c4b398afcbf65000e3267 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:26.269927  9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 134aecc79f7c4b398afcbf65000e3267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.270841  9534 raft_consensus.cc:2468] T bd6508e7cfe8459d9903c00481fda73d P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:26.271808  9441 tablet_service.cc:1511] Processing CreateTablet for tablet cba0d047c0df4036a4702dbc607a318e (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:26.272158  9573 leader_election.cc:304] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:26.273409  9769 raft_consensus.cc:2804] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:26.275027  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba0d047c0df4036a4702dbc607a318e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.257296  9736 leader_election.cc:290] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:26.276224  9730 consensus_queue.cc:260] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.278885  9730 ts_tablet_manager.cc:1434] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 13:03:26.286017  9729 tablet_bootstrap.cc:492] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:26.287885  9729 ts_tablet_manager.cc:1403] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.255s	user 0.005s	sys 0.013s
I20260709 13:03:26.286661  9447 tablet_service.cc:1511] Processing CreateTablet for tablet 134aecc79f7c4b398afcbf65000e3267 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:26.288959  9730 tablet_bootstrap.cc:492] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:26.288985  9447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 134aecc79f7c4b398afcbf65000e3267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.290989  9729 raft_consensus.cc:359] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:26.296802  9729 raft_consensus.cc:385] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.297235  9729 raft_consensus.cc:740] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.297973  9727 tablet_bootstrap.cc:492] T 270eabeaaff64040920c19c1ab4a2903 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:26.298501  9727 ts_tablet_manager.cc:1403] T 270eabeaaff64040920c19c1ab4a2903 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.218s	user 0.026s	sys 0.031s
I20260709 13:03:26.298113  9729 consensus_queue.cc:260] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:26.308158  9522 tablet_service.cc:1511] Processing CreateTablet for tablet 5d4f7949313a47fc9f7a799ef17d9999 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:26.309670  9522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d4f7949313a47fc9f7a799ef17d9999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.312870  9729 ts_tablet_manager.cc:1434] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:03:26.314096  9729 tablet_bootstrap.cc:492] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:26.304318  9769 raft_consensus.cc:697] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:26.284466  9728 consensus_queue.cc:260] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.325820  9730 tablet_bootstrap.cc:654] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.328172  9595 tablet_service.cc:1511] Processing CreateTablet for tablet 5d4f7949313a47fc9f7a799ef17d9999 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:26.328640  9727 raft_consensus.cc:359] T 270eabeaaff64040920c19c1ab4a2903 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.329615  9595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d4f7949313a47fc9f7a799ef17d9999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.329703  9727 raft_consensus.cc:385] T 270eabeaaff64040920c19c1ab4a2903 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.330207  9727 raft_consensus.cc:740] T 270eabeaaff64040920c19c1ab4a2903 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.330775  9729 tablet_bootstrap.cc:654] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.331331  9739 raft_consensus.cc:515] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:26.331581  9727 consensus_queue.cc:260] T 270eabeaaff64040920c19c1ab4a2903 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.333223  9728 ts_tablet_manager.cc:1434] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.147s	user 0.010s	sys 0.000s
I20260709 13:03:26.334338  9728 tablet_bootstrap.cc:492] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:26.334416  9607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bdb17a9faf45208000a631d0455183" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:26.335258  9607 raft_consensus.cc:3060] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.335598  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bdb17a9faf45208000a631d0455183" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
W20260709 13:03:26.337080  9497 leader_election.cc:343] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.337638  9739 leader_election.cc:290] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:26.343714  9441 tablet_service.cc:1511] Processing CreateTablet for tablet 2155d805d55a413c9f51874ce70d88b8 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:26.343839  9769 consensus_queue.cc:237] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:26.345430  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2155d805d55a413c9f51874ce70d88b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.346758  9667 tablet_service.cc:1511] Processing CreateTablet for tablet 5d4f7949313a47fc9f7a799ef17d9999 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:26.348582  9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d4f7949313a47fc9f7a799ef17d9999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.349265  9521 tablet_service.cc:1511] Processing CreateTablet for tablet 2155d805d55a413c9f51874ce70d88b8 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:26.350641  9521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2155d805d55a413c9f51874ce70d88b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.352816  9607 raft_consensus.cc:2468] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:26.354476  9499 leader_election.cc:304] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:26.356016  9739 raft_consensus.cc:2804] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:26.356861  9739 raft_consensus.cc:697] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:26.357972  9739 consensus_queue.cc:237] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:26.366076  9597 tablet_service.cc:1511] Processing CreateTablet for tablet 2155d805d55a413c9f51874ce70d88b8 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:26.367570  9597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2155d805d55a413c9f51874ce70d88b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.364892  9727 ts_tablet_manager.cc:1434] T 270eabeaaff64040920c19c1ab4a2903 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.066s	user 0.000s	sys 0.009s
I20260709 13:03:26.364812  9665 tablet_service.cc:1511] Processing CreateTablet for tablet 6708a2f76d0f4292b01c5bb066f7bcac (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:26.369603  9727 tablet_bootstrap.cc:492] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:26.370644  9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6708a2f76d0f4292b01c5bb066f7bcac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.381343  9782 raft_consensus.cc:493] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.381911  9782 raft_consensus.cc:515] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:26.384065  9782 leader_election.cc:290] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:26.385071  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4315cb1968e34e2e8539985ae04e2bd4" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:26.383491  9356 catalog_manager.cc:5697] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:26.385607  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4315cb1968e34e2e8539985ae04e2bd4" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:26.385890  9534 raft_consensus.cc:2393] T 4315cb1968e34e2e8539985ae04e2bd4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8bf0e3504c4f46cf8c639da3e15caf68 in current term 1: Already voted for candidate eaba2f78a9274147a783ffa321939ed5 in this term.
I20260709 13:03:26.390090  9573 leader_election.cc:304] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:26.390978  9782 raft_consensus.cc:3060] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.383491  9727 tablet_bootstrap.cc:654] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.417424  9727 tablet_bootstrap.cc:492] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:26.417995  9727 ts_tablet_manager.cc:1403] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.004s
I20260709 13:03:26.420578  9448 tablet_service.cc:1511] Processing CreateTablet for tablet 6708a2f76d0f4292b01c5bb066f7bcac (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:26.422276  9448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6708a2f76d0f4292b01c5bb066f7bcac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.402218  9782 raft_consensus.cc:2749] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:26.422289  9589 tablet_service.cc:1511] Processing CreateTablet for tablet bf988aa1c4094545b8b3a1568680bdfb (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:26.424933  9589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf988aa1c4094545b8b3a1568680bdfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.426045  9667 tablet_service.cc:1511] Processing CreateTablet for tablet bf988aa1c4094545b8b3a1568680bdfb (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:26.427313  9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf988aa1c4094545b8b3a1568680bdfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.416769  9355 catalog_manager.cc:5697] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:26.439146  9727 raft_consensus.cc:359] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.440477  9727 raft_consensus.cc:385] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.440840  9727 raft_consensus.cc:740] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.440995  9516 tablet_service.cc:1511] Processing CreateTablet for tablet 169b723604b749b1b0d240d60266f922 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:26.445804  9522 tablet_service.cc:1511] Processing CreateTablet for tablet 6708a2f76d0f4292b01c5bb066f7bcac (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:26.447594  9522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6708a2f76d0f4292b01c5bb066f7bcac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.454282  9755 raft_consensus.cc:493] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.459347  9755 raft_consensus.cc:515] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:26.461695  9755 leader_election.cc:290] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:26.469861  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee70c523613a48fc8f5cca7456742e7b" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:26.470193  9442 tablet_service.cc:1511] Processing CreateTablet for tablet bf988aa1c4094545b8b3a1568680bdfb (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:26.467129  9516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 169b723604b749b1b0d240d60266f922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.473206  9754 raft_consensus.cc:493] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.455782  9727 consensus_queue.cc:260] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.475674  9607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee70c523613a48fc8f5cca7456742e7b" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
W20260709 13:03:26.474973  9646 leader_election.cc:343] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.476554  9754 raft_consensus.cc:515] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.483486  9754 leader_election.cc:290] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
W20260709 13:03:26.489267  9647 leader_election.cc:343] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.489840  9647 leader_election.cc:304] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:26.492008  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270eabeaaff64040920c19c1ab4a2903" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
W20260709 13:03:26.483532  9497 consensus_peers.cc:597] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541): Couldn't send request to peer eaba2f78a9274147a783ffa321939ed5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:26.492736  9534 raft_consensus.cc:2468] T 270eabeaaff64040920c19c1ab4a2903 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 0.
I20260709 13:03:26.493328  9666 tablet_service.cc:1511] Processing CreateTablet for tablet 169b723604b749b1b0d240d60266f922 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:26.493806  9728 tablet_bootstrap.cc:654] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.493892  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270eabeaaff64040920c19c1ab4a2903" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:26.494527  9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 169b723604b749b1b0d240d60266f922. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:26.496011  9646 leader_election.cc:343] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.492666  9765 raft_consensus.cc:2749] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:26.497475  9442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf988aa1c4094545b8b3a1568680bdfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.500337  9647 leader_election.cc:304] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:26.505354  9730 tablet_bootstrap.cc:492] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:26.507545  9730 ts_tablet_manager.cc:1403] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.219s	user 0.047s	sys 0.060s
I20260709 13:03:26.508790  9765 raft_consensus.cc:2804] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:26.509274  9765 raft_consensus.cc:493] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.511018  9765 raft_consensus.cc:3060] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.516556  9737 raft_consensus.cc:493] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.517190  9737 raft_consensus.cc:515] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.517406  9524 tablet_service.cc:1511] Processing CreateTablet for tablet 2167c25a8fe74cf9b28526359b63c3b4 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:26.518364  9727 ts_tablet_manager.cc:1434] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.100s	user 0.008s	sys 0.004s
I20260709 13:03:26.518745  9524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2167c25a8fe74cf9b28526359b63c3b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.520156  9737 leader_election.cc:290] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:26.521395  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c671c6618ad41ff8d9f7d3d121ed086" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:26.521202  9765 raft_consensus.cc:515] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.522146  9534 raft_consensus.cc:2468] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:26.522153  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c671c6618ad41ff8d9f7d3d121ed086" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:26.523700  9765 leader_election.cc:290] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:26.524480  9729 tablet_bootstrap.cc:492] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:26.524626  9424 leader_election.cc:304] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:26.524971  9727 tablet_bootstrap.cc:492] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:26.525444  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270eabeaaff64040920c19c1ab4a2903" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:26.528844  9730 raft_consensus.cc:359] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:26.529686  9597 tablet_service.cc:1511] Processing CreateTablet for tablet 2167c25a8fe74cf9b28526359b63c3b4 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:26.536410  9597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2167c25a8fe74cf9b28526359b63c3b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.538149  9738 consensus_queue.cc:1048] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:26.531976  9737 raft_consensus.cc:2804] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:26.539423  9737 raft_consensus.cc:493] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.539841  9737 raft_consensus.cc:3060] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:26.532348  9422 leader_election.cc:343] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.504418  9354 catalog_manager.cc:5697] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:26.541677  9739 consensus_queue.cc:1048] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:26.543354  9534 raft_consensus.cc:3060] T 270eabeaaff64040920c19c1ab4a2903 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.551141  9730 raft_consensus.cc:385] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.551594  9730 raft_consensus.cc:740] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.552380  9730 consensus_queue.cc:260] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:26.554267  9442 tablet_service.cc:1511] Processing CreateTablet for tablet 2167c25a8fe74cf9b28526359b63c3b4 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:26.560647  9589 tablet_service.cc:1511] Processing CreateTablet for tablet 169b723604b749b1b0d240d60266f922 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:26.564080  9754 consensus_queue.cc:1048] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:26.564793  9730 ts_tablet_manager.cc:1434] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.001s
I20260709 13:03:26.559834  9729 ts_tablet_manager.cc:1403] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.246s	user 0.015s	sys 0.011s
I20260709 13:03:26.566146  9666 tablet_service.cc:1511] Processing CreateTablet for tablet b0dfcbdce939448eaaae078332420bfa (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:26.570057  9738 consensus_queue.cc:1048] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:26.571928  9442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2167c25a8fe74cf9b28526359b63c3b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.573057  9448 tablet_service.cc:1511] Processing CreateTablet for tablet b0dfcbdce939448eaaae078332420bfa (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:26.574389  9448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0dfcbdce939448eaaae078332420bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.574887  9754 consensus_queue.cc:1048] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:26.580096  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270eabeaaff64040920c19c1ab4a2903" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:26.569020  9729 raft_consensus.cc:359] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:26.580840  9729 raft_consensus.cc:385] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.581183  9729 raft_consensus.cc:740] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
W20260709 13:03:26.581630  9646 leader_election.cc:343] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.582515  9729 consensus_queue.cc:260] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:26.586910  9729 ts_tablet_manager.cc:1434] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:03:26.588117  9730 tablet_bootstrap.cc:492] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:26.593619  9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0dfcbdce939448eaaae078332420bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.607477  9728 tablet_bootstrap.cc:492] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:26.608253  9728 ts_tablet_manager.cc:1403] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.274s	user 0.011s	sys 0.005s
I20260709 13:03:26.618172  9534 raft_consensus.cc:2468] T 270eabeaaff64040920c19c1ab4a2903 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
I20260709 13:03:26.619650  9647 leader_election.cc:304] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:26.621346  9754 raft_consensus.cc:2804] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:26.621129  9737 raft_consensus.cc:515] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.621850  9754 raft_consensus.cc:697] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:26.622682  9754 consensus_queue.cc:237] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.588107  9729 tablet_bootstrap.cc:492] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
W20260709 13:03:26.627627  9646 consensus_peers.cc:597] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:26.628857  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c671c6618ad41ff8d9f7d3d121ed086" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
W20260709 13:03:26.630380  9422 leader_election.cc:343] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.641397  9769 raft_consensus.cc:493] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.641968  9769 raft_consensus.cc:515] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:26.674294  9589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 169b723604b749b1b0d240d60266f922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.677513  9737 leader_election.cc:290] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:26.687723  9521 tablet_service.cc:1511] Processing CreateTablet for tablet b0dfcbdce939448eaaae078332420bfa (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:26.692421  9521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0dfcbdce939448eaaae078332420bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.687732  9441 tablet_service.cc:1511] Processing CreateTablet for tablet b190b9b4fa544118981626f9985e1276 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:26.689211  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c671c6618ad41ff8d9f7d3d121ed086" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:26.693293  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b190b9b4fa544118981626f9985e1276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.694828  9728 raft_consensus.cc:359] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:26.695580  9728 raft_consensus.cc:385] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.695895  9728 raft_consensus.cc:740] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.700054  9532 raft_consensus.cc:3060] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.711946  9589 tablet_service.cc:1511] Processing CreateTablet for tablet b190b9b4fa544118981626f9985e1276 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:26.713181  9589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b190b9b4fa544118981626f9985e1276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.717366  9730 tablet_bootstrap.cc:654] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.719328  9728 consensus_queue.cc:260] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:26.721644  9728 ts_tablet_manager.cc:1434] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.113s	user 0.006s	sys 0.001s
I20260709 13:03:26.722697  9728 tablet_bootstrap.cc:492] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:26.724897  9665 tablet_service.cc:1511] Processing CreateTablet for tablet 247add59d191431987b50b009849ee54 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:26.726138  9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247add59d191431987b50b009849ee54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.726183  9441 tablet_service.cc:1511] Processing CreateTablet for tablet ae9be08bd7474b02b3fda228625577e4 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:26.727417  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae9be08bd7474b02b3fda228625577e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.727974  9727 tablet_bootstrap.cc:654] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.729737  9667 tablet_service.cc:1511] Processing CreateTablet for tablet 79e29bfdaf3d4298afcb82e5edf9d136 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:26.736109  9666 tablet_service.cc:1511] Processing CreateTablet for tablet b190b9b4fa544118981626f9985e1276 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:26.742398  9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e29bfdaf3d4298afcb82e5edf9d136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.756060  9447 tablet_service.cc:1511] Processing CreateTablet for tablet 79e29bfdaf3d4298afcb82e5edf9d136 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:26.757320  9447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e29bfdaf3d4298afcb82e5edf9d136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.764741  9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b190b9b4fa544118981626f9985e1276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.767132  9589 tablet_service.cc:1511] Processing CreateTablet for tablet 247add59d191431987b50b009849ee54 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:26.768476  9589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247add59d191431987b50b009849ee54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.769906  9522 tablet_service.cc:1511] Processing CreateTablet for tablet 79e29bfdaf3d4298afcb82e5edf9d136 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:26.771163  9522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e29bfdaf3d4298afcb82e5edf9d136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.772217  9524 tablet_service.cc:1511] Processing CreateTablet for tablet ae9be08bd7474b02b3fda228625577e4 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:26.773505  9524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae9be08bd7474b02b3fda228625577e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.775767  9516 tablet_service.cc:1511] Processing CreateTablet for tablet 247add59d191431987b50b009849ee54 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:26.776209  9665 tablet_service.cc:1511] Processing CreateTablet for tablet bcdb62158e6b4a6989246318d3d25d7c (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:26.757464  9737 raft_consensus.cc:493] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.777369  9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcdb62158e6b4a6989246318d3d25d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.781786  9532 raft_consensus.cc:2468] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:26.777016  9737 raft_consensus.cc:515] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:26.785225  9595 tablet_service.cc:1511] Processing CreateTablet for tablet ae9be08bd7474b02b3fda228625577e4 (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:26.786648  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6508e7cfe8459d9903c00481fda73d" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:26.788546  9597 tablet_service.cc:1511] Processing CreateTablet for tablet bcdb62158e6b4a6989246318d3d25d7c (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:26.787017  9595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae9be08bd7474b02b3fda228625577e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.777029  9516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247add59d191431987b50b009849ee54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.833396  9597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcdb62158e6b4a6989246318d3d25d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.793498  9737 leader_election.cc:290] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:26.846287  9424 leader_election.cc:304] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:26.852214  9769 leader_election.cc:290] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:26.861013  9738 raft_consensus.cc:2804] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:26.878093  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee70c523613a48fc8f5cca7456742e7b" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:26.878784  9682 raft_consensus.cc:2468] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:26.880584  9571 leader_election.cc:304] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:26.882383  9728 tablet_bootstrap.cc:654] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.882862  9729 tablet_bootstrap.cc:654] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.872608  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6508e7cfe8459d9903c00481fda73d" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:26.884011  9532 raft_consensus.cc:2393] T bd6508e7cfe8459d9903c00481fda73d P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04edfe53c70f45e09190743b636a705f in current term 1: Already voted for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in this term.
I20260709 13:03:26.900760  9442 tablet_service.cc:1511] Processing CreateTablet for tablet bcdb62158e6b4a6989246318d3d25d7c (DEFAULT_TABLE table=test-workload [id=ab3d99f7db19499e9c93a1814b38cfc1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:26.902334  9442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcdb62158e6b4a6989246318d3d25d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:26.903566  9738 raft_consensus.cc:697] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:26.903797  9424 leader_election.cc:304] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:26.904563  9738 consensus_queue.cc:237] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.905805  9797 raft_consensus.cc:3060] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.917115  9727 tablet_bootstrap.cc:492] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:26.917900  9727 ts_tablet_manager.cc:1403] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.394s	user 0.020s	sys 0.017s
I20260709 13:03:26.900589  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee70c523613a48fc8f5cca7456742e7b" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:26.918618  9769 raft_consensus.cc:2804] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:26.933143  9730 tablet_bootstrap.cc:492] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:26.933709  9730 ts_tablet_manager.cc:1403] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.346s	user 0.014s	sys 0.031s
I20260709 13:03:26.936885  9730 raft_consensus.cc:359] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.937613  9730 raft_consensus.cc:385] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.940119  9730 raft_consensus.cc:740] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.929056  9769 raft_consensus.cc:493] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.943845  9729 tablet_bootstrap.cc:492] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:26.942124  9769 raft_consensus.cc:3060] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.942190  9730 consensus_queue.cc:260] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.944556  9729 ts_tablet_manager.cc:1403] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.357s	user 0.015s	sys 0.007s
I20260709 13:03:26.941308  9797 raft_consensus.cc:2749] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:26.939915  9681 raft_consensus.cc:3060] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.949013  9730 ts_tablet_manager.cc:1434] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:03:26.950148  9730 tablet_bootstrap.cc:492] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:26.953728  9728 tablet_bootstrap.cc:492] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:26.954311  9728 ts_tablet_manager.cc:1403] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.232s	user 0.009s	sys 0.026s
I20260709 13:03:26.954679  9729 raft_consensus.cc:359] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:26.959683  9729 raft_consensus.cc:385] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.959995  9729 raft_consensus.cc:740] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.960760  9729 consensus_queue.cc:260] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
W20260709 13:03:26.963852  9404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:26.960943  9754 consensus_queue.cc:1048] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:26.955274  9774 consensus_queue.cc:1048] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:26.971813  9739 consensus_queue.cc:1048] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:26.972131  9728 raft_consensus.cc:359] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:26.972874  9728 raft_consensus.cc:385] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.973178  9728 raft_consensus.cc:740] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.973946  9728 consensus_queue.cc:260] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:26.958237  9356 catalog_manager.cc:5697] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:26.976279  9728 ts_tablet_manager.cc:1434] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.002s
I20260709 13:03:26.976397  9730 tablet_bootstrap.cc:654] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.977349  9728 tablet_bootstrap.cc:492] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:26.969295  9782 consensus_queue.cc:1048] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:03:26.959071  9769 raft_consensus.cc:515] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:26.963012  9729 ts_tablet_manager.cc:1434] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.018s	user 0.000s	sys 0.004s
I20260709 13:03:26.968734  9727 raft_consensus.cc:359] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
W20260709 13:03:26.968984  9572 leader_election.cc:343] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.980809  9729 tablet_bootstrap.cc:492] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:26.983394  9727 raft_consensus.cc:385] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.984668  9727 raft_consensus.cc:740] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.985365  9727 consensus_queue.cc:260] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:26.988385  9769 leader_election.cc:290] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:26.989840  9727 ts_tablet_manager.cc:1434] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.000s
I20260709 13:03:26.991132  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee70c523613a48fc8f5cca7456742e7b" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:26.992144  9682 raft_consensus.cc:3060] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.995508  9728 tablet_bootstrap.cc:654] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.000211  9812 consensus_queue.cc:1048] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:27.011376  9754 raft_consensus.cc:493] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.012255  9754 raft_consensus.cc:515] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.037104  9797 raft_consensus.cc:493] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.037945  9797 raft_consensus.cc:515] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.041692  9797 leader_election.cc:290] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:27.043277  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b11e873bd4a57ad207fc15fcb995e" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:27.051007  9730 tablet_bootstrap.cc:492] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:27.051736  9730 ts_tablet_manager.cc:1403] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.102s	user 0.012s	sys 0.004s
I20260709 13:03:27.053922  9727 tablet_bootstrap.cc:492] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:27.060891  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee70c523613a48fc8f5cca7456742e7b" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:27.061098  9730 raft_consensus.cc:359] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.061895  9730 raft_consensus.cc:385] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.062242  9730 raft_consensus.cc:740] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.064992  9754 leader_election.cc:290] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:27.065869  9682 raft_consensus.cc:2468] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:27.067113  9571 leader_election.cc:304] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:27.067404  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c671c6618ad41ff8d9f7d3d121ed086" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:27.069275  9729 tablet_bootstrap.cc:654] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.069358  9769 raft_consensus.cc:2804] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.068980  9355 catalog_manager.cc:5697] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.070070  9769 raft_consensus.cc:697] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:27.070990  9769 consensus_queue.cc:237] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.063555  9730 consensus_queue.cc:260] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
W20260709 13:03:27.077838  9572 leader_election.cc:343] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.079774  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b11e873bd4a57ad207fc15fcb995e" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:27.069314  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c671c6618ad41ff8d9f7d3d121ed086" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:27.082712  9534 raft_consensus.cc:2393] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaba2f78a9274147a783ffa321939ed5 in current term 1: Already voted for candidate 04edfe53c70f45e09190743b636a705f in this term.
I20260709 13:03:27.085306  9647 leader_election.cc:304] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:27.086077  9730 ts_tablet_manager.cc:1434] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.005s
I20260709 13:03:27.087298  9730 tablet_bootstrap.cc:492] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:27.089977  9754 raft_consensus.cc:3060] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.098625  9754 raft_consensus.cc:2749] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:27.100185  9424 leader_election.cc:304] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:27.101361  9797 raft_consensus.cc:2749] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:27.107383  9728 tablet_bootstrap.cc:492] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:27.107991  9728 ts_tablet_manager.cc:1403] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.131s	user 0.017s	sys 0.017s
I20260709 13:03:27.110177  9727 tablet_bootstrap.cc:654] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.115662  9729 tablet_bootstrap.cc:492] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:27.116173  9729 ts_tablet_manager.cc:1403] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.136s	user 0.023s	sys 0.019s
I20260709 13:03:27.111029  9728 raft_consensus.cc:359] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.117580  9728 raft_consensus.cc:385] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.117839  9728 raft_consensus.cc:740] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.118497  9728 consensus_queue.cc:260] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.118781  9729 raft_consensus.cc:359] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.119807  9729 raft_consensus.cc:385] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.120107  9729 raft_consensus.cc:740] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.120805  9729 consensus_queue.cc:260] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.121685  9728 ts_tablet_manager.cc:1434] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:03:27.121941  9727 tablet_bootstrap.cc:492] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:27.122530  9727 ts_tablet_manager.cc:1403] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.069s	user 0.005s	sys 0.013s
I20260709 13:03:27.122758  9728 tablet_bootstrap.cc:492] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:27.123023  9729 ts_tablet_manager.cc:1434] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:27.123970  9729 tablet_bootstrap.cc:492] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:27.125641  9727 raft_consensus.cc:359] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.126497  9727 raft_consensus.cc:385] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.126763  9727 raft_consensus.cc:740] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.127617  9727 consensus_queue.cc:260] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.129446  9728 tablet_bootstrap.cc:654] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.137569  9730 tablet_bootstrap.cc:654] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.134033  9729 tablet_bootstrap.cc:654] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.145617  9728 tablet_bootstrap.cc:492] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:27.146153  9782 raft_consensus.cc:493] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.146911  9727 ts_tablet_manager.cc:1434] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.006s
I20260709 13:03:27.146747  9782 raft_consensus.cc:515] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.147950  9727 tablet_bootstrap.cc:492] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:27.149387  9782 leader_election.cc:290] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:27.151726  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbe6355bc344a7d883c246c2cc8adc1" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:27.152606  9458 raft_consensus.cc:2468] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:27.154165  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbe6355bc344a7d883c246c2cc8adc1" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
W20260709 13:03:27.155778  9573 leader_election.cc:343] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.158705  9727 tablet_bootstrap.cc:654] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.158475  9572 leader_election.cc:304] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:27.159658  9769 raft_consensus.cc:2804] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.146138  9728 ts_tablet_manager.cc:1403] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.002s
I20260709 13:03:27.160338  9769 raft_consensus.cc:493] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.161332  9769 raft_consensus.cc:3060] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.163064  9728 raft_consensus.cc:359] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.163820  9728 raft_consensus.cc:385] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.164111  9728 raft_consensus.cc:740] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.165275  9729 tablet_bootstrap.cc:492] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:27.164872  9728 consensus_queue.cc:260] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.165745  9729 ts_tablet_manager.cc:1403] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.007s
I20260709 13:03:27.166990  9728 ts_tablet_manager.cc:1434] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:27.168228  9728 tablet_bootstrap.cc:492] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:27.168531  9729 raft_consensus.cc:359] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.169198  9729 raft_consensus.cc:385] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.169448  9729 raft_consensus.cc:740] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.163345  9730 tablet_bootstrap.cc:492] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:27.170392  9730 ts_tablet_manager.cc:1403] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.004s
I20260709 13:03:27.173141  9730 raft_consensus.cc:359] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.173766  9730 raft_consensus.cc:385] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.174032  9730 raft_consensus.cc:740] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.174688  9730 consensus_queue.cc:260] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.170475  9354 catalog_manager.cc:5697] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.176676  9730 ts_tablet_manager.cc:1434] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:27.176934  9727 tablet_bootstrap.cc:492] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:27.177480  9727 ts_tablet_manager.cc:1403] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.008s
I20260709 13:03:27.177124  9729 consensus_queue.cc:260] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.179384  9729 ts_tablet_manager.cc:1434] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:03:27.180156  9727 raft_consensus.cc:359] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.180836  9727 raft_consensus.cc:385] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.181095  9727 raft_consensus.cc:740] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.181177  9769 raft_consensus.cc:515] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.174437  9728 tablet_bootstrap.cc:654] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.181324  9730 tablet_bootstrap.cc:492] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:27.184044  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbe6355bc344a7d883c246c2cc8adc1" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:27.184665  9458 raft_consensus.cc:3060] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.189947  9729 tablet_bootstrap.cc:492] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:27.192742  9458 raft_consensus.cc:2468] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:27.194068  9572 leader_election.cc:304] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:27.195279  9782 raft_consensus.cc:2804] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.195789  9782 raft_consensus.cc:697] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:27.196630  9782 consensus_queue.cc:237] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.199801  9729 tablet_bootstrap.cc:654] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.181802  9727 consensus_queue.cc:260] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.205318  9769 leader_election.cc:290] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:27.206801  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbe6355bc344a7d883c246c2cc8adc1" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:27.207384  9727 ts_tablet_manager.cc:1434] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
W20260709 13:03:27.208897  9573 leader_election.cc:343] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.209184  9727 tablet_bootstrap.cc:492] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:27.212330  9730 tablet_bootstrap.cc:654] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.213127  9728 tablet_bootstrap.cc:492] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:27.215607  9728 ts_tablet_manager.cc:1403] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.004s
I20260709 13:03:27.212982  9458 raft_consensus.cc:3060] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:27.219041  9646 consensus_peers.cc:597] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.219314  9728 raft_consensus.cc:359] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.220054  9728 raft_consensus.cc:385] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.220335  9728 raft_consensus.cc:740] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.221347  9728 consensus_queue.cc:260] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.225634  9765 consensus_queue.cc:1048] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:27.228647  9728 ts_tablet_manager.cc:1434] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:03:27.230701  9728 tablet_bootstrap.cc:492] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:27.237186  9357 catalog_manager.cc:5697] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.241999  9727 tablet_bootstrap.cc:654] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.248531  9728 tablet_bootstrap.cc:654] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.263736  9728 tablet_bootstrap.cc:492] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:27.264163  9728 ts_tablet_manager.cc:1403] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.003s
I20260709 13:03:27.266659  9728 raft_consensus.cc:359] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.267277  9728 raft_consensus.cc:385] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.267552  9728 raft_consensus.cc:740] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.269560  9729 tablet_bootstrap.cc:492] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:27.270073  9729 ts_tablet_manager.cc:1403] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.001s
I20260709 13:03:27.272280  9730 tablet_bootstrap.cc:492] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:27.272792  9730 ts_tablet_manager.cc:1403] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.095s	user 0.014s	sys 0.000s
I20260709 13:03:27.275332  9782 raft_consensus.cc:493] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.275813  9782 raft_consensus.cc:515] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.275804  9730 raft_consensus.cc:359] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.276688  9730 raft_consensus.cc:385] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.276963  9730 raft_consensus.cc:740] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.277575  9730 consensus_queue.cc:260] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.278159  9727 tablet_bootstrap.cc:492] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:27.278707  9727 ts_tablet_manager.cc:1403] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.003s
I20260709 13:03:27.278868  9797 raft_consensus.cc:493] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.279362  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5524c279b403bb8db8d843b728706" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:27.280030  9458 raft_consensus.cc:2468] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:27.281227  9572 leader_election.cc:304] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:27.281378  9727 raft_consensus.cc:359] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.282087  9727 raft_consensus.cc:385] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.279362  9797 raft_consensus.cc:515] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.282409  9727 raft_consensus.cc:740] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.282366  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5524c279b403bb8db8d843b728706" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:27.283408  9769 raft_consensus.cc:2804] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.283340  9727 consensus_queue.cc:260] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.283529  9534 raft_consensus.cc:2468] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:27.283974  9769 raft_consensus.cc:493] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.284180  9797 leader_election.cc:290] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:27.284430  9769 raft_consensus.cc:3060] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.285415  9727 ts_tablet_manager.cc:1434] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:27.286132  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcede6679b495786781fa878243f44" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:27.286423  9727 tablet_bootstrap.cc:492] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:27.286744  9534 raft_consensus.cc:2468] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:27.286968  9729 raft_consensus.cc:359] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.287683  9729 raft_consensus.cc:385] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.287938  9729 raft_consensus.cc:740] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.287983  9424 leader_election.cc:304] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:27.288180  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcede6679b495786781fa878243f44" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:27.288841  9682 raft_consensus.cc:2468] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:27.288738  9729 consensus_queue.cc:260] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.289028  9797 raft_consensus.cc:2804] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.289636  9797 raft_consensus.cc:493] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.290081  9797 raft_consensus.cc:3060] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.290724  9729 ts_tablet_manager.cc:1434] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:03:27.278102  9782 leader_election.cc:290] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:27.274338  9728 consensus_queue.cc:260] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.293056  9727 tablet_bootstrap.cc:654] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.295024  9728 ts_tablet_manager.cc:1434] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:03:27.296037  9728 tablet_bootstrap.cc:492] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:27.301726  9728 tablet_bootstrap.cc:654] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.305119  9738 raft_consensus.cc:493] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.305680  9738 raft_consensus.cc:515] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.306568  9797 raft_consensus.cc:515] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.307785  9738 leader_election.cc:290] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:27.309247  9797 leader_election.cc:290] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:27.311087  9730 ts_tablet_manager.cc:1434] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:03:27.312062  9730 tablet_bootstrap.cc:492] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:27.313167  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b099c00fd6634f1396a726b711f9e555" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:27.314368  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcede6679b495786781fa878243f44" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:27.314939  9681 raft_consensus.cc:3060] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.317778  9730 tablet_bootstrap.cc:654] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:27.319090  9422 leader_election.cc:343] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.319276  9738 consensus_queue.cc:1048] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:27.319554  9754 raft_consensus.cc:493] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.320046  9754 raft_consensus.cc:515] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.319057  9769 raft_consensus.cc:515] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.322569  9754 leader_election.cc:290] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:27.323788  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcede6679b495786781fa878243f44" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:27.324136  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0e4e3fe184fd4af9e5a84ddc58828" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:27.324467  9532 raft_consensus.cc:3060] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.326754  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5524c279b403bb8db8d843b728706" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:27.327001  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b099c00fd6634f1396a726b711f9e555" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:27.327553  9458 raft_consensus.cc:3060] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.328500  9769 leader_election.cc:290] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:27.329145  9729 tablet_bootstrap.cc:492] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
W20260709 13:03:27.329396  9424 leader_election.cc:343] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.329670  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5524c279b403bb8db8d843b728706" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:27.329886  9424 leader_election.cc:304] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:27.330363  9533 raft_consensus.cc:3060] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.331884  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0e4e3fe184fd4af9e5a84ddc58828" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:27.333963  9647 leader_election.cc:304] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:27.334573  9738 raft_consensus.cc:2749] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:27.334820  9754 raft_consensus.cc:2749] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:27.337831  9533 raft_consensus.cc:2468] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:27.338558  9681 raft_consensus.cc:2468] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:27.339002  9573 leader_election.cc:304] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:27.339581  9422 leader_election.cc:304] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:27.340456  9738 raft_consensus.cc:2804] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.340936  9738 raft_consensus.cc:697] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:27.341305  9458 raft_consensus.cc:2468] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:27.341780  9738 consensus_queue.cc:237] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.344318  9727 tablet_bootstrap.cc:492] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:27.344946  9769 raft_consensus.cc:2804] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.345094  9727 ts_tablet_manager.cc:1403] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.003s
I20260709 13:03:27.348137  9769 raft_consensus.cc:697] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:27.349052  9769 consensus_queue.cc:237] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.349808  9727 raft_consensus.cc:359] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.350520  9727 raft_consensus.cc:385] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.350782  9727 raft_consensus.cc:740] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.351500  9727 consensus_queue.cc:260] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.353493  9727 ts_tablet_manager.cc:1434] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:27.354395  9727 tablet_bootstrap.cc:492] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:27.356576  9730 tablet_bootstrap.cc:492] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:27.357281  9730 ts_tablet_manager.cc:1403] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.000s
I20260709 13:03:27.359133  9729 tablet_bootstrap.cc:654] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.360103  9727 tablet_bootstrap.cc:654] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.361850  9532 raft_consensus.cc:2468] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:27.361001  9737 consensus_queue.cc:1048] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:03:27.387791  9354 catalog_manager.cc:5697] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.360090  9730 raft_consensus.cc:359] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.394691  9730 raft_consensus.cc:385] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.395079  9730 raft_consensus.cc:740] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.391664  9356 catalog_manager.cc:5697] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.396124  9730 consensus_queue.cc:260] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.367066  9728 tablet_bootstrap.cc:492] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:27.398666  9728 ts_tablet_manager.cc:1403] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.103s	user 0.006s	sys 0.010s
I20260709 13:03:27.398928  9730 ts_tablet_manager.cc:1434] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:03:27.399925  9730 tablet_bootstrap.cc:492] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:27.400274  9727 tablet_bootstrap.cc:492] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:27.400727  9727 ts_tablet_manager.cc:1403] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.022s
I20260709 13:03:27.404220  9727 raft_consensus.cc:359] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.404935  9727 raft_consensus.cc:385] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.405290  9727 raft_consensus.cc:740] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.404632  9728 raft_consensus.cc:359] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.406237  9728 raft_consensus.cc:385] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.412457  9728 raft_consensus.cc:740] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.405997  9727 consensus_queue.cc:260] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.407191  9737 raft_consensus.cc:493] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.413669  9737 raft_consensus.cc:515] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.415026  9729 tablet_bootstrap.cc:492] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:27.415616  9729 ts_tablet_manager.cc:1403] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.087s	user 0.006s	sys 0.009s
I20260709 13:03:27.416035  9737 leader_election.cc:290] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:27.417209  9817 raft_consensus.cc:493] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.417708  9817 raft_consensus.cc:515] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.414063  9754 raft_consensus.cc:493] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.417713  9728 consensus_queue.cc:260] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.419014  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270eabeaaff64040920c19c1ab4a2903" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:27.418996  9754 raft_consensus.cc:515] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.422992  9754 leader_election.cc:290] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:27.423734  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e8eed746fe4a8fbbdbcc76f7ab8260" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:27.424429  9605 raft_consensus.cc:2468] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:27.426260  9499 leader_election.cc:304] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:27.426403  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e8eed746fe4a8fbbdbcc76f7ab8260" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:27.427030  9605 raft_consensus.cc:2468] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 0.
I20260709 13:03:27.428320  9647 leader_election.cc:304] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:27.428939  9817 leader_election.cc:290] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:27.429265  9774 raft_consensus.cc:2804] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.429203  9754 raft_consensus.cc:2804] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.429798  9774 raft_consensus.cc:493] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.429883  9754 raft_consensus.cc:493] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.430272  9774 raft_consensus.cc:3060] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.430459  9754 raft_consensus.cc:3060] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.430861  9727 ts_tablet_manager.cc:1434] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:03:27.431474  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e8eed746fe4a8fbbdbcc76f7ab8260" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:27.432050  9727 tablet_bootstrap.cc:492] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:27.437273  9728 ts_tablet_manager.cc:1434] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.004s
I20260709 13:03:27.420083  9729 raft_consensus.cc:359] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.439913  9727 tablet_bootstrap.cc:654] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.440050  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e8eed746fe4a8fbbdbcc76f7ab8260" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:27.440515  9729 raft_consensus.cc:385] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.440969  9729 raft_consensus.cc:740] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.441695  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270eabeaaff64040920c19c1ab4a2903" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:27.441828  9729 consensus_queue.cc:260] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.439913  9730 tablet_bootstrap.cc:654] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.443651  9424 leader_election.cc:304] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:27.444980  9737 raft_consensus.cc:2749] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:27.447935  9729 ts_tablet_manager.cc:1434] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.003s
I20260709 13:03:27.449589  9729 tablet_bootstrap.cc:492] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:27.440119  9754 raft_consensus.cc:515] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.454591  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e8eed746fe4a8fbbdbcc76f7ab8260" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:27.455222  9605 raft_consensus.cc:3060] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.457152  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e8eed746fe4a8fbbdbcc76f7ab8260" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:27.462626  9605 raft_consensus.cc:2468] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
I20260709 13:03:27.463474  9754 leader_election.cc:290] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:27.464219  9647 leader_election.cc:304] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:27.470827  9729 tablet_bootstrap.cc:654] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.474617  9817 raft_consensus.cc:493] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.475203  9817 raft_consensus.cc:515] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.475961  9754 raft_consensus.cc:2804] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.476929  9754 raft_consensus.cc:697] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:27.449419  9774 raft_consensus.cc:515] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.450652  9728 tablet_bootstrap.cc:492] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:27.479760  9534 raft_consensus.cc:2393] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaba2f78a9274147a783ffa321939ed5 in current term 1: Already voted for candidate 7610e18c23c543f1a31b6d851bac1bb2 in this term.
I20260709 13:03:27.482060  9754 consensus_queue.cc:237] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.483188  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbe6355bc344a7d883c246c2cc8adc1" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:27.484148  9817 leader_election.cc:290] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:27.484033  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbe6355bc344a7d883c246c2cc8adc1" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:27.485772  9458 raft_consensus.cc:2393] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7610e18c23c543f1a31b6d851bac1bb2 in current term 1: Already voted for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in this term.
I20260709 13:03:27.486948  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e8eed746fe4a8fbbdbcc76f7ab8260" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:27.487708  9605 raft_consensus.cc:2393] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7610e18c23c543f1a31b6d851bac1bb2 in current term 1: Already voted for candidate eaba2f78a9274147a783ffa321939ed5 in this term.
I20260709 13:03:27.487625  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e8eed746fe4a8fbbdbcc76f7ab8260" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:27.489362  9498 leader_election.cc:304] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:27.489847  9497 leader_election.cc:304] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2; no voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:27.490921  9739 raft_consensus.cc:3060] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.492527  9730 tablet_bootstrap.cc:492] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:27.493225  9730 ts_tablet_manager.cc:1403] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.093s	user 0.016s	sys 0.010s
I20260709 13:03:27.494053  9817 raft_consensus.cc:2749] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:27.495385  9737 raft_consensus.cc:493] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.497125  9730 raft_consensus.cc:359] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.498143  9730 raft_consensus.cc:385] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.498514  9730 raft_consensus.cc:740] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.499460  9728 tablet_bootstrap.cc:654] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.499838  9730 consensus_queue.cc:260] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.495872  9737 raft_consensus.cc:515] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.502930  9730 ts_tablet_manager.cc:1434] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:03:27.504261  9730 tablet_bootstrap.cc:492] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:27.504859  9737 leader_election.cc:290] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:27.506314  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee70c523613a48fc8f5cca7456742e7b" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:27.507741  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee70c523613a48fc8f5cca7456742e7b" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:27.508731  9680 raft_consensus.cc:2393] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04edfe53c70f45e09190743b636a705f in current term 1: Already voted for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in this term.
I20260709 13:03:27.510210  9682 raft_consensus.cc:3060] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.512706  9730 tablet_bootstrap.cc:654] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.515924  9422 leader_election.cc:304] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:27.516431  9458 raft_consensus.cc:3060] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.520828  9739 raft_consensus.cc:2749] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:27.525189  9730 tablet_bootstrap.cc:492] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:27.525162  9774 leader_election.cc:290] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:27.525871  9730 ts_tablet_manager.cc:1403] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.002s
I20260709 13:03:27.529284  9737 raft_consensus.cc:2749] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:27.529430  9730 raft_consensus.cc:359] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.530505  9730 raft_consensus.cc:385] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.530857  9730 raft_consensus.cc:740] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.531761  9730 consensus_queue.cc:260] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.533924  9730 ts_tablet_manager.cc:1434] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:27.534304  9727 tablet_bootstrap.cc:492] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:27.533819  9769 consensus_queue.cc:1048] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:27.534982  9727 ts_tablet_manager.cc:1403] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.103s	user 0.032s	sys 0.028s
I20260709 13:03:27.535090  9730 tablet_bootstrap.cc:492] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:27.537837  9727 raft_consensus.cc:359] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.538563  9727 raft_consensus.cc:385] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.538921  9727 raft_consensus.cc:740] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.539647  9727 consensus_queue.cc:260] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.541940  9730 tablet_bootstrap.cc:654] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.548375  9729 tablet_bootstrap.cc:492] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:27.548866  9729 ts_tablet_manager.cc:1403] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.099s	user 0.020s	sys 0.000s
I20260709 13:03:27.551923  9729 raft_consensus.cc:359] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.552591  9729 raft_consensus.cc:385] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.553488  9727 ts_tablet_manager.cc:1434] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:03:27.554251  9730 tablet_bootstrap.cc:492] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:27.554775  9730 ts_tablet_manager.cc:1403] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:03:27.552865  9729 raft_consensus.cc:740] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.556337  9729 consensus_queue.cc:260] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.560406  9727 tablet_bootstrap.cc:492] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:27.560647  9730 raft_consensus.cc:359] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.561496  9730 raft_consensus.cc:385] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.561794  9730 raft_consensus.cc:740] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.562649  9730 consensus_queue.cc:260] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.563551  9729 ts_tablet_manager.cc:1434] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:03:27.564935  9729 tablet_bootstrap.cc:492] T b099c00fd6634f1396a726b711f9e555 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:27.565341  9730 ts_tablet_manager.cc:1434] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:27.566361  9730 tablet_bootstrap.cc:492] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:27.566830  9352 catalog_manager.cc:5697] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.567920  9727 tablet_bootstrap.cc:654] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.568308  9769 raft_consensus.cc:493] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.568851  9769 raft_consensus.cc:515] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.570932  9729 tablet_bootstrap.cc:654] T b099c00fd6634f1396a726b711f9e555 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.573947  9728 tablet_bootstrap.cc:492] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:27.575126  9728 ts_tablet_manager.cc:1403] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.125s	user 0.009s	sys 0.009s
I20260709 13:03:27.577422  9782 raft_consensus.cc:493] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.578152  9782 raft_consensus.cc:515] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.578720  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b589ee51a3b4411a255ac63c57232f9" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:27.586578  9681 raft_consensus.cc:2468] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:27.580842  9782 leader_election.cc:290] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:27.587879  9571 leader_election.cc:304] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:27.588924  9782 raft_consensus.cc:2804] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.589337  9782 raft_consensus.cc:493] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.589701  9782 raft_consensus.cc:3060] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.589779  9769 leader_election.cc:290] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:27.596448  9769 consensus_queue.cc:1048] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:27.581389  9727 tablet_bootstrap.cc:492] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:27.582310  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6432b6ee54144ac1963d46714288e802" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:27.597534  9534 raft_consensus.cc:2468] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:27.583298  9729 tablet_bootstrap.cc:492] T b099c00fd6634f1396a726b711f9e555 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:27.583220  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6432b6ee54144ac1963d46714288e802" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:27.598382  9730 tablet_bootstrap.cc:654] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.598711  9682 raft_consensus.cc:2468] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:27.598769  9573 leader_election.cc:304] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:27.599948  9727 ts_tablet_manager.cc:1403] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.010s
I20260709 13:03:27.600447  9729 ts_tablet_manager.cc:1403] T b099c00fd6634f1396a726b711f9e555 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.007s
I20260709 13:03:27.602149  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b589ee51a3b4411a255ac63c57232f9" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:27.602814  9459 raft_consensus.cc:2468] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:27.603855  9729 raft_consensus.cc:359] T b099c00fd6634f1396a726b711f9e555 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.604552  9729 raft_consensus.cc:385] T b099c00fd6634f1396a726b711f9e555 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.605122  9729 raft_consensus.cc:740] T b099c00fd6634f1396a726b711f9e555 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.604411  9727 raft_consensus.cc:359] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.605948  9727 raft_consensus.cc:385] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.605794  9729 consensus_queue.cc:260] T b099c00fd6634f1396a726b711f9e555 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.606269  9769 raft_consensus.cc:2804] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.606858  9769 raft_consensus.cc:493] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.607281  9769 raft_consensus.cc:3060] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.608016  9729 ts_tablet_manager.cc:1434] T b099c00fd6634f1396a726b711f9e555 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:27.606364  9727 raft_consensus.cc:740] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.610064  9727 consensus_queue.cc:260] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.616617  9782 raft_consensus.cc:515] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.618791  9782 leader_election.cc:290] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:27.618959  9729 tablet_bootstrap.cc:492] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:27.585176  9728 raft_consensus.cc:359] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.622767  9728 raft_consensus.cc:385] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.623082  9728 raft_consensus.cc:740] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.626008  9727 ts_tablet_manager.cc:1434] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:03:27.630321  9730 tablet_bootstrap.cc:492] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:27.630824  9730 ts_tablet_manager.cc:1403] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.001s
I20260709 13:03:27.632416  9769 raft_consensus.cc:515] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.634610  9728 consensus_queue.cc:260] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.636427  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6432b6ee54144ac1963d46714288e802" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:27.637245  9534 raft_consensus.cc:3060] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.638039  9730 raft_consensus.cc:359] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.638670  9730 raft_consensus.cc:385] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.638936  9730 raft_consensus.cc:740] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.639047  9769 leader_election.cc:290] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:27.641594  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b589ee51a3b4411a255ac63c57232f9" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:27.642176  9680 raft_consensus.cc:3060] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.642263  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6432b6ee54144ac1963d46714288e802" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:27.642637  9729 tablet_bootstrap.cc:654] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.642859  9682 raft_consensus.cc:3060] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.645730  9730 consensus_queue.cc:260] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.650298  9680 raft_consensus.cc:2468] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:27.653318  9774 raft_consensus.cc:493] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.653808  9774 raft_consensus.cc:515] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.654337  9571 leader_election.cc:304] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:27.655050  9730 ts_tablet_manager.cc:1434] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:03:27.656008  9774 leader_election.cc:290] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:27.656236  9730 tablet_bootstrap.cc:492] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:27.657567  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39889cbf037947ddabe6cf7bc7a8334a" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:27.658234  9782 raft_consensus.cc:2804] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:03:27.650872  9572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39371, user_credentials={real_user=slave}} blocked reactor thread for 49390.6us
I20260709 13:03:27.658234  9681 raft_consensus.cc:2468] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:27.659482  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39889cbf037947ddabe6cf7bc7a8334a" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:27.646972  9728 ts_tablet_manager.cc:1434] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.000s
I20260709 13:03:27.646682  9754 raft_consensus.cc:493] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.660715  9497 leader_election.cc:304] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:27.661029  9754 raft_consensus.cc:515] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.664381  9755 raft_consensus.cc:493] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.664894  9755 raft_consensus.cc:515] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.667011  9755 leader_election.cc:290] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:27.667567  9730 tablet_bootstrap.cc:654] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:27.667631  9498 leader_election.cc:343] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.667806  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2c2487f2f644ce9cba2ec3f72b7993" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:27.668293  9754 leader_election.cc:290] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:27.669319  9774 raft_consensus.cc:2804] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.669330  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2c2487f2f644ce9cba2ec3f72b7993" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:27.670171  9774 raft_consensus.cc:493] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.670615  9774 raft_consensus.cc:3060] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:27.671540  9647 leader_election.cc:343] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.672868  9728 tablet_bootstrap.cc:492] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
W20260709 13:03:27.672979  9646 leader_election.cc:343] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.673552  9646 leader_election.cc:304] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:27.678565  9755 raft_consensus.cc:2749] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:27.679654  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b589ee51a3b4411a255ac63c57232f9" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:27.680408  9459 raft_consensus.cc:3060] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.682708  9728 tablet_bootstrap.cc:654] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.686287  9534 raft_consensus.cc:2468] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:27.687155  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b099c00fd6634f1396a726b711f9e555" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:27.689186  9458 raft_consensus.cc:2468] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 0.
I20260709 13:03:27.687738  9739 raft_consensus.cc:493] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.690435  9739 raft_consensus.cc:515] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.692811  9739 leader_election.cc:290] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:27.660735  9782 raft_consensus.cc:697] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:27.694759  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7f960fa21840e4b44bfd4dd63d950f" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:27.688264  9682 raft_consensus.cc:2468] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:27.694262  9727 tablet_bootstrap.cc:492] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:27.696194  9571 leader_election.cc:304] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:27.695017  9782 consensus_queue.cc:237] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.697041  9769 raft_consensus.cc:2804] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.697557  9769 raft_consensus.cc:697] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:27.699560  9769 consensus_queue.cc:237] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.695487  9458 raft_consensus.cc:2468] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:27.693799  9728 tablet_bootstrap.cc:492] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:27.703177  9498 leader_election.cc:304] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:27.703753  9728 ts_tablet_manager.cc:1403] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.006s
I20260709 13:03:27.704006  9739 raft_consensus.cc:2804] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.704308  9739 raft_consensus.cc:493] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.704511  9739 raft_consensus.cc:3060] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.706390  9728 raft_consensus.cc:359] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.707439  9646 leader_election.cc:304] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:27.708462  9754 raft_consensus.cc:2804] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.708832  9754 raft_consensus.cc:493] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.709151  9754 raft_consensus.cc:3060] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.709761  9739 raft_consensus.cc:515] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.707046  9728 raft_consensus.cc:385] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.700176  9774 raft_consensus.cc:515] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.711344  9728 raft_consensus.cc:740] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.712090  9728 consensus_queue.cc:260] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.714074  9728 ts_tablet_manager.cc:1434] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:03:27.714775  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39889cbf037947ddabe6cf7bc7a8334a" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:27.715952  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39889cbf037947ddabe6cf7bc7a8334a" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
W20260709 13:03:27.716418  9498 leader_election.cc:343] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.716549  9682 raft_consensus.cc:3060] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.716975  9774 leader_election.cc:290] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:27.714970  9728 tablet_bootstrap.cc:492] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:27.721125  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7f960fa21840e4b44bfd4dd63d950f" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:27.721741  9457 raft_consensus.cc:3060] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.723472  9458 raft_consensus.cc:3060] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.729740  9754 raft_consensus.cc:515] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.731706  9857 raft_consensus.cc:493] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.732539  9754 leader_election.cc:290] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:27.732368  9857 raft_consensus.cc:515] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.740665  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a105ce4cd245e3ada74a6fa7b69ffd" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:27.741308  9680 raft_consensus.cc:2468] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:27.741706  9782 consensus_queue.cc:1048] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:27.742132  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7f960fa21840e4b44bfd4dd63d950f" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:27.743623  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b099c00fd6634f1396a726b711f9e555" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:27.744737  9728 tablet_bootstrap.cc:654] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.745000  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a105ce4cd245e3ada74a6fa7b69ffd" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:27.745512  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b099c00fd6634f1396a726b711f9e555" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:27.746589  9571 leader_election.cc:304] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:27.735916  9456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b099c00fd6634f1396a726b711f9e555" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:27.747462  9782 raft_consensus.cc:2804] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.747702  9456 raft_consensus.cc:3060] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.747877  9782 raft_consensus.cc:493] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.748283  9782 raft_consensus.cc:3060] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.751408  9459 raft_consensus.cc:2468] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
W20260709 13:03:27.752846  9573 leader_election.cc:343] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.753625  9858 consensus_queue.cc:1048] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:27.744534  9608 raft_consensus.cc:2468] T b099c00fd6634f1396a726b711f9e555 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 0.
I20260709 13:03:27.755175  9782 raft_consensus.cc:515] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.758041  9857 leader_election.cc:290] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:27.759616  9782 leader_election.cc:290] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:27.758764  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a105ce4cd245e3ada74a6fa7b69ffd" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:27.760748  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a105ce4cd245e3ada74a6fa7b69ffd" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:27.761312  9680 raft_consensus.cc:3060] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:27.761514  9573 leader_election.cc:343] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.767153  9456 raft_consensus.cc:2468] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
W20260709 13:03:27.768599  9499 leader_election.cc:343] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.770256  9646 leader_election.cc:304] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:27.736469  9727 tablet_bootstrap.cc:654] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.771714  9755 raft_consensus.cc:2804] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.772241  9755 raft_consensus.cc:697] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:27.773119  9755 consensus_queue.cc:237] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.775662  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7f960fa21840e4b44bfd4dd63d950f" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:27.784704  9457 raft_consensus.cc:2468] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:27.785936  9498 leader_election.cc:304] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:27.767798  9739 leader_election.cc:290] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:27.799165  9739 raft_consensus.cc:2804] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.800019  9739 raft_consensus.cc:697] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:27.801402  9739 consensus_queue.cc:237] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
W20260709 13:03:27.798497  9499 leader_election.cc:343] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.796815  9682 raft_consensus.cc:2468] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:27.826224  9729 tablet_bootstrap.cc:492] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:27.826901  9729 ts_tablet_manager.cc:1403] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.215s	user 0.025s	sys 0.028s
I20260709 13:03:27.834941  9497 leader_election.cc:304] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:27.836001  9774 raft_consensus.cc:2804] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.836681  9774 raft_consensus.cc:697] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:27.827848  9738 consensus_queue.cc:1048] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:03:27.837882  9774 consensus_queue.cc:237] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:27.839466  9804 consensus_queue.cc:1048] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:27.843775  9729 raft_consensus.cc:359] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.844928  9729 raft_consensus.cc:385] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.845357  9680 raft_consensus.cc:2468] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:27.845214  9729 raft_consensus.cc:740] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.845809  9769 consensus_queue.cc:1048] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:03:27.852792  9571 leader_election.cc:304] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:27.854367  9730 tablet_bootstrap.cc:492] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:27.854863  9730 ts_tablet_manager.cc:1403] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.199s	user 0.011s	sys 0.039s
I20260709 13:03:27.857944  9782 raft_consensus.cc:2804] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.858528  9782 raft_consensus.cc:697] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:27.859719  9782 consensus_queue.cc:237] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.857669  9730 raft_consensus.cc:359] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.863186  9730 raft_consensus.cc:385] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.863508  9730 raft_consensus.cc:740] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.865494  9730 consensus_queue.cc:260] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:27.865631  9857 consensus_queue.cc:1048] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:27.867900  9729 consensus_queue.cc:260] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.870813  9729 ts_tablet_manager.cc:1434] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 13:03:27.872071  9729 tablet_bootstrap.cc:492] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:27.876288  9730 ts_tablet_manager.cc:1434] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 13:03:27.892529  9730 tablet_bootstrap.cc:492] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:27.896809  9727 tablet_bootstrap.cc:492] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:27.897558  9727 ts_tablet_manager.cc:1403] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.203s	user 0.019s	sys 0.009s
I20260709 13:03:27.904727  9728 tablet_bootstrap.cc:492] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:27.905344  9728 ts_tablet_manager.cc:1403] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.191s	user 0.016s	sys 0.016s
I20260709 13:03:27.855404  9354 catalog_manager.cc:5697] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.929747  9727 raft_consensus.cc:359] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.931126  9727 raft_consensus.cc:385] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.931450  9727 raft_consensus.cc:740] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.937968  9730 tablet_bootstrap.cc:654] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.937879  9727 consensus_queue.cc:260] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:27.944671  9754 consensus_queue.cc:1048] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:03:27.966645  9727 ts_tablet_manager.cc:1434] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.000s
I20260709 13:03:27.968766  9729 tablet_bootstrap.cc:654] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.971100  9730 tablet_bootstrap.cc:492] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:27.971725  9730 ts_tablet_manager.cc:1403] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.095s	user 0.016s	sys 0.003s
I20260709 13:03:27.972152  9727 tablet_bootstrap.cc:492] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:27.954257  9782 raft_consensus.cc:493] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.962807  9352 catalog_manager.cc:5697] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.976893  9352 catalog_manager.cc:5697] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:27.983017  9404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:27.985144  9728 raft_consensus.cc:359] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.985878  9728 raft_consensus.cc:385] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.986193  9728 raft_consensus.cc:740] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.986836  9728 consensus_queue.cc:260] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:27.990585  9728 ts_tablet_manager.cc:1434] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.001s
I20260709 13:03:27.994302  9728 tablet_bootstrap.cc:492] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:27.998710  9774 raft_consensus.cc:493] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.999482  9774 raft_consensus.cc:515] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.005164  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0b0663f9ce4c9db6d2da7a4405309b" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
W20260709 13:03:28.013479  9499 leader_election.cc:343] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.014518  9774 leader_election.cc:290] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:27.972757  9782 raft_consensus.cc:515] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.022387  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0b0663f9ce4c9db6d2da7a4405309b" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:28.022043  9754 consensus_queue.cc:1048] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:28.026328  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7f960fa21840e4b44bfd4dd63d950f" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:28.027030  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7f960fa21840e4b44bfd4dd63d950f" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:28.027879  9458 raft_consensus.cc:2393] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8bf0e3504c4f46cf8c639da3e15caf68 in current term 1: Already voted for candidate 7610e18c23c543f1a31b6d851bac1bb2 in this term.
W20260709 13:03:28.028383  9498 leader_election.cc:343] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.028831  9498 leader_election.cc:304] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:28.030949  9774 raft_consensus.cc:2749] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:28.031633  9573 leader_election.cc:304] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:28.032517  9812 raft_consensus.cc:3060] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.023191  9782 leader_election.cc:290] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:28.044478  9727 tablet_bootstrap.cc:654] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.046003  9812 raft_consensus.cc:2749] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:28.047350  9728 tablet_bootstrap.cc:654] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.058801  9730 raft_consensus.cc:359] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.059648  9730 raft_consensus.cc:385] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.059921  9730 raft_consensus.cc:740] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.063925  9730 consensus_queue.cc:260] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.071326  9730 ts_tablet_manager.cc:1434] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.000s
I20260709 13:03:28.072528  9352 catalog_manager.cc:5697] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:28.072594  9730 tablet_bootstrap.cc:492] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:28.087692  9727 tablet_bootstrap.cc:492] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:28.088277  9727 ts_tablet_manager.cc:1403] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.120s	user 0.010s	sys 0.009s
I20260709 13:03:28.093540  9727 raft_consensus.cc:359] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.094216  9727 raft_consensus.cc:385] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.094485  9727 raft_consensus.cc:740] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.096827  9804 raft_consensus.cc:493] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.097604  9730 tablet_bootstrap.cc:654] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.097334  9804 raft_consensus.cc:515] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.099524  9804 leader_election.cc:290] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:28.095156  9727 consensus_queue.cc:260] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.102712  9727 ts_tablet_manager.cc:1434] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:03:28.103711  9727 tablet_bootstrap.cc:492] T 7449453f99c946a6a8ad01c0b5faadf9 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:28.105728  9357 catalog_manager.cc:5697] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:28.094493  9729 tablet_bootstrap.cc:492] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:28.107605  9729 ts_tablet_manager.cc:1403] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.236s	user 0.019s	sys 0.000s
I20260709 13:03:28.108127  9357 catalog_manager.cc:5697] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.109265  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3d23cd333345c2a5010982e21b397e" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:28.110328  9729 raft_consensus.cc:359] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.111018  9729 raft_consensus.cc:385] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:28.111109  9424 leader_election.cc:343] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.113363  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3d23cd333345c2a5010982e21b397e" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:28.111354  9729 raft_consensus.cc:740] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
W20260709 13:03:28.114857  9424 leader_election.cc:343] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.115091  9729 consensus_queue.cc:260] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.115381  9424 leader_election.cc:304] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:28.116834  9804 raft_consensus.cc:2749] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:28.117846  9729 ts_tablet_manager.cc:1434] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:28.118945  9729 tablet_bootstrap.cc:492] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:28.122241  9727 tablet_bootstrap.cc:654] T 7449453f99c946a6a8ad01c0b5faadf9 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.124650  9774 raft_consensus.cc:493] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.124919  9728 tablet_bootstrap.cc:492] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:28.125202  9774 raft_consensus.cc:515] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.125802  9728 ts_tablet_manager.cc:1403] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.133s	user 0.009s	sys 0.007s
I20260709 13:03:28.129562  9729 tablet_bootstrap.cc:654] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.129565  9728 raft_consensus.cc:359] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.132823  9728 raft_consensus.cc:385] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.133098  9728 raft_consensus.cc:740] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.133772  9728 consensus_queue.cc:260] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.136518  9730 tablet_bootstrap.cc:492] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:28.136898  9774 leader_election.cc:290] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:28.137058  9730 ts_tablet_manager.cc:1403] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.065s	user 0.023s	sys 0.017s
I20260709 13:03:28.138070  9728 ts_tablet_manager.cc:1434] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.002s
I20260709 13:03:28.143895  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a105ce4cd245e3ada74a6fa7b69ffd" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:28.145202  9729 tablet_bootstrap.cc:492] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:28.145928  9728 tablet_bootstrap.cc:492] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:28.139869  9730 raft_consensus.cc:359] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.140955  9812 consensus_queue.cc:1048] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:28.146615  9730 raft_consensus.cc:385] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.146966  9730 raft_consensus.cc:740] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.147749  9730 consensus_queue.cc:260] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.150089  9730 ts_tablet_manager.cc:1434] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:03:28.151726  9730 tablet_bootstrap.cc:492] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:28.158704  9730 tablet_bootstrap.cc:654] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.159406  9729 ts_tablet_manager.cc:1403] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.000s
I20260709 13:03:28.163190  9729 raft_consensus.cc:359] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.164075  9729 raft_consensus.cc:385] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.164350  9729 raft_consensus.cc:740] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.165318  9729 consensus_queue.cc:260] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.168673  9729 ts_tablet_manager.cc:1434] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:28.168859  9728 tablet_bootstrap.cc:654] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.169206  9804 raft_consensus.cc:493] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.169715  9804 raft_consensus.cc:515] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.169721  9729 tablet_bootstrap.cc:492] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:28.171924  9804 leader_election.cc:290] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:28.173182  9812 consensus_queue.cc:1048] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:28.176333  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871790aff5ff4037ad0c30f4e0276aa3" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:28.177212  9608 raft_consensus.cc:2468] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:28.177716  9729 tablet_bootstrap.cc:654] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.178714  9424 leader_election.cc:304] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:28.180848  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a105ce4cd245e3ada74a6fa7b69ffd" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:28.181869  9680 raft_consensus.cc:2393] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7610e18c23c543f1a31b6d851bac1bb2 in current term 1: Already voted for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in this term.
I20260709 13:03:28.184758  9497 leader_election.cc:304] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2; no voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:28.185091  9728 tablet_bootstrap.cc:492] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:28.185554  9728 ts_tablet_manager.cc:1403] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.003s
I20260709 13:03:28.185880  9774 raft_consensus.cc:3060] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.187783  9730 tablet_bootstrap.cc:492] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:28.188306  9730 ts_tablet_manager.cc:1403] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.004s
I20260709 13:03:28.188457  9728 raft_consensus.cc:359] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.188822  9812 consensus_queue.cc:1048] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:28.191186  9730 raft_consensus.cc:359] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.191947  9730 raft_consensus.cc:385] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.192353  9730 raft_consensus.cc:740] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.189136  9728 raft_consensus.cc:385] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.194511  9728 raft_consensus.cc:740] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.195363  9730 consensus_queue.cc:260] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.195904  9804 raft_consensus.cc:2804] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:28.196445  9804 raft_consensus.cc:493] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.196836  9804 raft_consensus.cc:3060] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.195267  9728 consensus_queue.cc:260] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.203639  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871790aff5ff4037ad0c30f4e0276aa3" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:28.208340  9680 raft_consensus.cc:2468] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:28.213495  9817 consensus_queue.cc:1048] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:28.216223  9769 consensus_queue.cc:1048] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:28.208897  9729 tablet_bootstrap.cc:492] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:28.207728  9728 ts_tablet_manager.cc:1434] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:03:28.218873  9729 ts_tablet_manager.cc:1403] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.005s
I20260709 13:03:28.223709  9606 raft_consensus.cc:3060] T b099c00fd6634f1396a726b711f9e555 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.229940  9804 raft_consensus.cc:515] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.224056  9774 raft_consensus.cc:2749] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:28.224997  9730 ts_tablet_manager.cc:1434] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.003s
I20260709 13:03:28.233601  9730 tablet_bootstrap.cc:492] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:28.237005  9737 raft_consensus.cc:493] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.237743  9737 raft_consensus.cc:515] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.232056  9728 tablet_bootstrap.cc:492] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:28.251940  9737 leader_election.cc:290] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:28.257416  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2c2487f2f644ce9cba2ec3f72b7993" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:28.258188  9534 raft_consensus.cc:2468] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:28.258440  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2c2487f2f644ce9cba2ec3f72b7993" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:28.259089  9680 raft_consensus.cc:2468] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:28.259508  9424 leader_election.cc:304] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:28.262101  9729 raft_consensus.cc:359] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.267726  9729 raft_consensus.cc:385] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.268065  9729 raft_consensus.cc:740] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.268880  9729 consensus_queue.cc:260] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.269342  9727 tablet_bootstrap.cc:492] T 7449453f99c946a6a8ad01c0b5faadf9 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:28.269958  9727 ts_tablet_manager.cc:1403] T 7449453f99c946a6a8ad01c0b5faadf9 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.166s	user 0.031s	sys 0.022s
I20260709 13:03:28.271721  9738 raft_consensus.cc:2804] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:28.272145  9738 raft_consensus.cc:493] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.272475  9738 raft_consensus.cc:3060] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.272814  9727 raft_consensus.cc:359] T 7449453f99c946a6a8ad01c0b5faadf9 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.273661  9727 raft_consensus.cc:385] T 7449453f99c946a6a8ad01c0b5faadf9 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.273952  9727 raft_consensus.cc:740] T 7449453f99c946a6a8ad01c0b5faadf9 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.275300  9730 tablet_bootstrap.cc:654] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.274920  9727 consensus_queue.cc:260] T 7449453f99c946a6a8ad01c0b5faadf9 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.278843  9804 leader_election.cc:290] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:28.281770  9457 raft_consensus.cc:3060] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.281647  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871790aff5ff4037ad0c30f4e0276aa3" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:28.283143  9680 raft_consensus.cc:3060] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.283183  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871790aff5ff4037ad0c30f4e0276aa3" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:28.284015  9608 raft_consensus.cc:3060] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.288146  9755 raft_consensus.cc:493] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.288738  9755 raft_consensus.cc:515] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.290861  9755 leader_election.cc:290] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:28.292130  9608 raft_consensus.cc:2468] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:28.292322  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09481da07933449cae77deb1569c9f9e" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:28.293354  9424 leader_election.cc:304] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:28.294163  9804 raft_consensus.cc:2804] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:28.294703  9804 raft_consensus.cc:697] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:28.295195  9680 raft_consensus.cc:2468] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:28.298223  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09481da07933449cae77deb1569c9f9e" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:28.303483  9769 consensus_queue.cc:1048] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:03:28.295662  9804 consensus_queue.cc:237] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.309852  9774 consensus_queue.cc:1048] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:03:28.317727  9730 tablet_bootstrap.cc:492] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:28.313221  9729 ts_tablet_manager.cc:1434] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.000s
I20260709 13:03:28.318380  9730 ts_tablet_manager.cc:1403] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.011s
I20260709 13:03:28.318977  9729 tablet_bootstrap.cc:492] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:28.298833  9739 consensus_queue.cc:1048] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:03:28.322183  9730 raft_consensus.cc:359] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.322887  9730 raft_consensus.cc:385] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.323145  9730 raft_consensus.cc:740] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.323827  9730 consensus_queue.cc:260] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.295713  9728 tablet_bootstrap.cc:654] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.326390  9730 ts_tablet_manager.cc:1434] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
W20260709 13:03:28.296959  9647 leader_election.cc:343] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.296500  9727 ts_tablet_manager.cc:1434] T 7449453f99c946a6a8ad01c0b5faadf9 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
W20260709 13:03:28.328516  9646 leader_election.cc:343] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.329146  9727 tablet_bootstrap.cc:492] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:28.329437  9769 raft_consensus.cc:493] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.329654  9646 leader_election.cc:304] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:28.329952  9769 raft_consensus.cc:515] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.331337  9765 raft_consensus.cc:2749] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:28.332782  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0b0663f9ce4c9db6d2da7a4405309b" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
W20260709 13:03:28.334280  9572 leader_election.cc:343] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.298370  9755 consensus_queue.cc:1048] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:03:28.335814  9727 tablet_bootstrap.cc:654] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.339951  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0b0663f9ce4c9db6d2da7a4405309b" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:28.340536  9730 tablet_bootstrap.cc:492] T 7449453f99c946a6a8ad01c0b5faadf9 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:28.340608  9534 raft_consensus.cc:2468] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:28.342038  9573 leader_election.cc:304] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:28.342989  9812 raft_consensus.cc:2804] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:28.343371  9812 raft_consensus.cc:493] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.343716  9812 raft_consensus.cc:3060] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.347081  9730 tablet_bootstrap.cc:654] T 7449453f99c946a6a8ad01c0b5faadf9 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.348346  9817 consensus_queue.cc:1048] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:28.305429  9738 raft_consensus.cc:515] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.361570  9755 consensus_queue.cc:1048] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:28.364524  9728 tablet_bootstrap.cc:492] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:28.365087  9728 ts_tablet_manager.cc:1403] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.133s	user 0.016s	sys 0.008s
I20260709 13:03:28.368078  9728 raft_consensus.cc:359] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.368924  9728 raft_consensus.cc:385] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.369249  9728 raft_consensus.cc:740] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.365072  9727 tablet_bootstrap.cc:492] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:28.372856  9727 ts_tablet_manager.cc:1403] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.003s
I20260709 13:03:28.371702  9769 leader_election.cc:290] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:28.376016  9728 consensus_queue.cc:260] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.377853  9727 raft_consensus.cc:359] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.378544  9727 raft_consensus.cc:385] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.378785  9727 raft_consensus.cc:740] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.379809  9727 consensus_queue.cc:260] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.382251  9738 leader_election.cc:290] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:28.382777  9728 ts_tablet_manager.cc:1434] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:03:28.383975  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2c2487f2f644ce9cba2ec3f72b7993" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:28.386251  9682 raft_consensus.cc:3060] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.383975  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2c2487f2f644ce9cba2ec3f72b7993" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:28.384589  9812 raft_consensus.cc:515] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.348655  9729 tablet_bootstrap.cc:654] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.386540  9728 tablet_bootstrap.cc:492] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:28.391358  9727 ts_tablet_manager.cc:1434] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.003s
I20260709 13:03:28.392462  9727 tablet_bootstrap.cc:492] T 1fe09b15d9f346838b395c7fd2da18ad P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:28.399412  9534 raft_consensus.cc:3060] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.405102  9682 raft_consensus.cc:2468] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:28.406863  9422 leader_election.cc:304] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:28.409147  9727 tablet_bootstrap.cc:654] T 1fe09b15d9f346838b395c7fd2da18ad P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.408982  9738 raft_consensus.cc:2804] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:28.425009  9738 raft_consensus.cc:697] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:28.426224  9738 consensus_queue.cc:237] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.416147  9728 tablet_bootstrap.cc:654] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.416953  9730 tablet_bootstrap.cc:492] T 7449453f99c946a6a8ad01c0b5faadf9 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:28.429582  9730 ts_tablet_manager.cc:1403] T 7449453f99c946a6a8ad01c0b5faadf9 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.089s	user 0.007s	sys 0.010s
I20260709 13:03:28.433226  9729 tablet_bootstrap.cc:492] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:28.433969  9729 ts_tablet_manager.cc:1403] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.115s	user 0.010s	sys 0.021s
I20260709 13:03:28.435861  9765 raft_consensus.cc:493] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.436695  9812 leader_election.cc:290] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:28.438333  9730 raft_consensus.cc:359] T 7449453f99c946a6a8ad01c0b5faadf9 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.439049  9730 raft_consensus.cc:385] T 7449453f99c946a6a8ad01c0b5faadf9 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.436419  9765 raft_consensus.cc:515] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.439357  9730 raft_consensus.cc:740] T 7449453f99c946a6a8ad01c0b5faadf9 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.441426  9765 leader_election.cc:290] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:28.442088  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0797397ca74a699473bb7b07f063c8" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
W20260709 13:03:28.443540  9647 leader_election.cc:343] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.440769  9730 consensus_queue.cc:260] T 7449453f99c946a6a8ad01c0b5faadf9 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.444762  9858 consensus_queue.cc:1048] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:28.444777  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0b0663f9ce4c9db6d2da7a4405309b" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
W20260709 13:03:28.448030  9572 leader_election.cc:343] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.448288  9755 raft_consensus.cc:493] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.446214  9730 ts_tablet_manager.cc:1434] T 7449453f99c946a6a8ad01c0b5faadf9 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.001s
I20260709 13:03:28.450074  9730 tablet_bootstrap.cc:492] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:28.448832  9755 raft_consensus.cc:515] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.447733  9729 raft_consensus.cc:359] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.451916  9729 raft_consensus.cc:385] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.452301  9729 raft_consensus.cc:740] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.453158  9729 consensus_queue.cc:260] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.443602  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0797397ca74a699473bb7b07f063c8" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:28.460194  9729 ts_tablet_manager.cc:1434] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.026s	user 0.012s	sys 0.002s
I20260709 13:03:28.459360  9804 raft_consensus.cc:493] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.460139  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0b0663f9ce4c9db6d2da7a4405309b" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:28.467010  9804 raft_consensus.cc:515] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.467512  9533 raft_consensus.cc:3060] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.478012  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23edaf5688c4b51a8f524e1fb7c928f" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:28.478724  9608 raft_consensus.cc:2468] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:28.479293  9729 tablet_bootstrap.cc:492] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:28.481410  9424 leader_election.cc:304] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:28.471089  9765 raft_consensus.cc:493] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.482288  9737 raft_consensus.cc:2804] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:28.486208  9737 raft_consensus.cc:493] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:28.487584  9646 leader_election.cc:343] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.489265  9804 leader_election.cc:290] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:28.487533  9765 raft_consensus.cc:515] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.492883  9737 raft_consensus.cc:3060] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.504908  9727 tablet_bootstrap.cc:492] T 1fe09b15d9f346838b395c7fd2da18ad P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:28.505599  9727 ts_tablet_manager.cc:1403] T 1fe09b15d9f346838b395c7fd2da18ad P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.113s	user 0.010s	sys 0.009s
I20260709 13:03:28.502938  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23edaf5688c4b51a8f524e1fb7c928f" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:28.495335  9646 leader_election.cc:304] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:28.512154  9682 raft_consensus.cc:2468] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:28.514863  9730 tablet_bootstrap.cc:654] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.521793  9754 raft_consensus.cc:2749] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:28.524863  9728 tablet_bootstrap.cc:492] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:28.510965  9755 leader_election.cc:290] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:28.525589  9728 ts_tablet_manager.cc:1403] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.139s	user 0.028s	sys 0.019s
I20260709 13:03:28.533746  9727 raft_consensus.cc:359] T 1fe09b15d9f346838b395c7fd2da18ad P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.527668  9534 raft_consensus.cc:2468] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:28.534624  9727 raft_consensus.cc:385] T 1fe09b15d9f346838b395c7fd2da18ad P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.537920  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe09b15d9f346838b395c7fd2da18ad" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:28.538929  9727 raft_consensus.cc:740] T 1fe09b15d9f346838b395c7fd2da18ad P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.542191  9737 raft_consensus.cc:515] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.542654  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23edaf5688c4b51a8f524e1fb7c928f" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:28.543478  9606 raft_consensus.cc:2468] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 0.
I20260709 13:03:28.545079  9727 consensus_queue.cc:260] T 1fe09b15d9f346838b395c7fd2da18ad P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.547083  9534 raft_consensus.cc:2468] T 1fe09b15d9f346838b395c7fd2da18ad P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 0.
I20260709 13:03:28.544756  9765 leader_election.cc:290] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:28.550521  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23edaf5688c4b51a8f524e1fb7c928f" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:28.551023  9727 ts_tablet_manager.cc:1434] T 1fe09b15d9f346838b395c7fd2da18ad P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.005s
I20260709 13:03:28.551110  9606 raft_consensus.cc:3060] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.552150  9727 tablet_bootstrap.cc:492] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:28.552125  9533 raft_consensus.cc:2468] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:28.557858  9728 raft_consensus.cc:359] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.558447  9728 raft_consensus.cc:385] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.558669  9728 raft_consensus.cc:740] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.559598  9728 consensus_queue.cc:260] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.560850  9573 leader_election.cc:304] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:28.561779  9857 raft_consensus.cc:2804] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:28.562222  9857 raft_consensus.cc:697] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:28.563350  9857 consensus_queue.cc:237] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.564612  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23edaf5688c4b51a8f524e1fb7c928f" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:28.565495  9459 raft_consensus.cc:2393] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaba2f78a9274147a783ffa321939ed5 in current term 1: Already voted for candidate 04edfe53c70f45e09190743b636a705f in this term.
I20260709 13:03:28.562204  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe09b15d9f346838b395c7fd2da18ad" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:28.554659  9737 leader_election.cc:290] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
W20260709 13:03:28.568152  9646 leader_election.cc:343] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.572150  9679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23edaf5688c4b51a8f524e1fb7c928f" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:28.572502  9729 tablet_bootstrap.cc:654] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.572840  9679 raft_consensus.cc:3060] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.583015  9679 raft_consensus.cc:2468] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:28.584759  9647 leader_election.cc:304] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
W20260709 13:03:28.587049  9906 log.cc:927] Time spent T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f: Append to log took a long time: real 0.126s	user 0.002s	sys 0.003s
I20260709 13:03:28.587199  9728 ts_tablet_manager.cc:1434] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:03:28.588186  9728 tablet_bootstrap.cc:492] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:28.589615  9765 raft_consensus.cc:2764] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:03:28.590313  9769 raft_consensus.cc:493] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.590780  9769 raft_consensus.cc:515] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.598315  9422 leader_election.cc:304] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:28.600626  9728 tablet_bootstrap.cc:654] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.602674  9916 raft_consensus.cc:2804] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:28.594164  9769 leader_election.cc:290] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:28.603752  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7449453f99c946a6a8ad01c0b5faadf9" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:28.604665  9680 raft_consensus.cc:2468] T 7449453f99c946a6a8ad01c0b5faadf9 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:28.606360  9571 leader_election.cc:304] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:28.607329  9769 raft_consensus.cc:2804] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:28.607766  9769 raft_consensus.cc:493] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.608147  9769 raft_consensus.cc:3060] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.605043  9916 raft_consensus.cc:697] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:28.583110  9606 raft_consensus.cc:2468] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:28.612051  9916 consensus_queue.cc:237] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.614960  9647 leader_election.cc:304] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:28.616482  9765 raft_consensus.cc:2804] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:28.617125  9765 raft_consensus.cc:493] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.616541  9357 catalog_manager.cc:5697] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:28.617535  9765 raft_consensus.cc:3060] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.618438  9357 catalog_manager.cc:5697] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.619899  9727 tablet_bootstrap.cc:654] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.611155  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7449453f99c946a6a8ad01c0b5faadf9" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:28.636377  9729 tablet_bootstrap.cc:492] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:28.636860  9729 ts_tablet_manager.cc:1403] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.158s	user 0.016s	sys 0.007s
I20260709 13:03:28.637616  9730 tablet_bootstrap.cc:492] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:28.638049  9730 ts_tablet_manager.cc:1403] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.188s	user 0.017s	sys 0.006s
I20260709 13:03:28.625950  9533 raft_consensus.cc:2468] T 7449453f99c946a6a8ad01c0b5faadf9 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:28.641007  9769 raft_consensus.cc:515] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.641094  9730 raft_consensus.cc:359] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.642004  9730 raft_consensus.cc:385] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.642285  9730 raft_consensus.cc:740] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.642896  9730 consensus_queue.cc:260] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.643174  9769 leader_election.cc:290] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:28.644501  9765 raft_consensus.cc:515] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.646840  9679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7449453f99c946a6a8ad01c0b5faadf9" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:28.647488  9679 raft_consensus.cc:3060] T 7449453f99c946a6a8ad01c0b5faadf9 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.648012  9765 leader_election.cc:290] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:28.649600  9729 raft_consensus.cc:359] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.650183  9729 raft_consensus.cc:385] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.650404  9729 raft_consensus.cc:740] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.650945  9729 consensus_queue.cc:260] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.652333  9728 tablet_bootstrap.cc:492] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:28.652947  9729 ts_tablet_manager.cc:1434] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:03:28.654196  9728 ts_tablet_manager.cc:1403] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.066s	user 0.005s	sys 0.011s
I20260709 13:03:28.654660  9729 tablet_bootstrap.cc:492] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:28.655480  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe09b15d9f346838b395c7fd2da18ad" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:28.653348  9730 ts_tablet_manager.cc:1434] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:03:28.656798  9730 tablet_bootstrap.cc:492] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:28.645145  9354 catalog_manager.cc:5697] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:28.656876  9646 leader_election.cc:343] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.660411  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe09b15d9f346838b395c7fd2da18ad" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:28.660853  9534 raft_consensus.cc:3060] T 1fe09b15d9f346838b395c7fd2da18ad P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.663205  9730 tablet_bootstrap.cc:654] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.664036  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7449453f99c946a6a8ad01c0b5faadf9" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:28.664592  9533 raft_consensus.cc:3060] T 7449453f99c946a6a8ad01c0b5faadf9 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.665206  9728 raft_consensus.cc:359] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.671106  9729 tablet_bootstrap.cc:654] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.674203  9817 raft_consensus.cc:493] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.674630  9817 raft_consensus.cc:515] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.676450  9817 leader_election.cc:290] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:28.677063  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3d23cd333345c2a5010982e21b397e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:28.677737  9457 raft_consensus.cc:2468] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:28.678036  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3d23cd333345c2a5010982e21b397e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:28.678689  9608 raft_consensus.cc:2468] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:28.679862  9498 leader_election.cc:304] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:28.680670  9817 raft_consensus.cc:2804] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:28.680788  9730 tablet_bootstrap.cc:492] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:28.681087  9817 raft_consensus.cc:493] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.681457  9730 ts_tablet_manager.cc:1403] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.005s
I20260709 13:03:28.681478  9817 raft_consensus.cc:3060] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.684172  9728 raft_consensus.cc:385] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.685058  9730 raft_consensus.cc:359] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.685593  9728 raft_consensus.cc:740] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.686515  9730 raft_consensus.cc:385] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.686887  9730 raft_consensus.cc:740] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.685658  9352 catalog_manager.cc:5697] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.687711  9730 consensus_queue.cc:260] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.687932  9728 consensus_queue.cc:260] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.690310  9679 raft_consensus.cc:2468] T 7449453f99c946a6a8ad01c0b5faadf9 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:28.691514  9571 leader_election.cc:304] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:28.692344  9857 raft_consensus.cc:2804] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:28.692826  9857 raft_consensus.cc:697] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:28.694039  9730 ts_tablet_manager.cc:1434] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:03:28.693656  9857 consensus_queue.cc:237] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.695031  9730 tablet_bootstrap.cc:492] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:28.697160  9728 ts_tablet_manager.cc:1434] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 13:03:28.700417  9728 tablet_bootstrap.cc:492] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:28.706514  9730 tablet_bootstrap.cc:654] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.701287  9534 raft_consensus.cc:2468] T 1fe09b15d9f346838b395c7fd2da18ad P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
I20260709 13:03:28.716516  9647 leader_election.cc:304] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:28.717298  9755 raft_consensus.cc:2804] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:28.717839  9755 raft_consensus.cc:697] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:28.718356  9730 tablet_bootstrap.cc:492] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:28.718912  9730 ts_tablet_manager.cc:1403] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.008s
I20260709 13:03:28.718626  9755 consensus_queue.cc:237] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.720611  9728 tablet_bootstrap.cc:654] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.723593  9730 raft_consensus.cc:359] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.724155  9765 raft_consensus.cc:493] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.724349  9730 raft_consensus.cc:385] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.701282  9817 raft_consensus.cc:515] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.724705  9765 raft_consensus.cc:515] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.724802  9730 raft_consensus.cc:740] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.726649  9765 leader_election.cc:290] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:28.726369  9730 consensus_queue.cc:260] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.727360  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3d23cd333345c2a5010982e21b397e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:28.727939  9457 raft_consensus.cc:3060] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.729156  9730 ts_tablet_manager.cc:1434] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:28.730291  9730 tablet_bootstrap.cc:492] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:28.732738  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12ad87eca574eefa5cbe3f34e13eb8e" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
W20260709 13:03:28.735140  9647 leader_election.cc:343] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.735587  9457 raft_consensus.cc:2468] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:28.736716  9498 leader_election.cc:304] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:28.735814  9357 catalog_manager.cc:5697] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:28.737586  9739 raft_consensus.cc:2804] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:28.738078  9739 raft_consensus.cc:697] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:28.738901  9739 consensus_queue.cc:237] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.742882  9730 tablet_bootstrap.cc:654] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.735613  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12ad87eca574eefa5cbe3f34e13eb8e" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:28.744309  9916 consensus_queue.cc:1048] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:28.749493  9354 catalog_manager.cc:5697] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:28.753558  9647 leader_election.cc:343] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.754081  9647 leader_election.cc:304] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:28.757903  9765 raft_consensus.cc:2749] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:28.763013  9730 tablet_bootstrap.cc:492] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:28.763762  9730 ts_tablet_manager.cc:1403] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.007s
I20260709 13:03:28.767030  9730 raft_consensus.cc:359] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.767890  9730 raft_consensus.cc:385] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.768221  9730 raft_consensus.cc:740] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.769001  9730 consensus_queue.cc:260] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.771564  9730 ts_tablet_manager.cc:1434] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:28.772874  9730 tablet_bootstrap.cc:492] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:28.781189  9730 tablet_bootstrap.cc:654] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.787504  9765 raft_consensus.cc:493] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.788079  9765 raft_consensus.cc:515] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.789281  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3d23cd333345c2a5010982e21b397e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:28.790091  9606 raft_consensus.cc:3060] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.790423  9765 leader_election.cc:290] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:28.788080  9817 leader_election.cc:290] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:28.793267  9533 raft_consensus.cc:2468] T 7449453f99c946a6a8ad01c0b5faadf9 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:28.793485  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5d1e1a6ffc47f994ee7cd91df4db54" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:28.794400  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5d1e1a6ffc47f994ee7cd91df4db54" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
W20260709 13:03:28.795583  9647 leader_election.cc:343] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:28.796916  9647 leader_election.cc:343] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.797426  9647 leader_election.cc:304] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:28.798458  9765 raft_consensus.cc:2749] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:28.797580  9606 raft_consensus.cc:2468] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:28.804824  9729 tablet_bootstrap.cc:492] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:28.805347  9729 ts_tablet_manager.cc:1403] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.151s	user 0.025s	sys 0.021s
I20260709 13:03:28.807336  9765 raft_consensus.cc:493] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.807559  9916 consensus_queue.cc:1048] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:28.807953  9765 raft_consensus.cc:515] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.808192  9729 raft_consensus.cc:359] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.808892  9729 raft_consensus.cc:385] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.809173  9729 raft_consensus.cc:740] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.811582  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fcf3ae6ad4cb7b6c86496a6f70cde" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
W20260709 13:03:28.813472  9646 leader_election.cc:343] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.813894  9730 tablet_bootstrap.cc:492] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:28.814358  9730 ts_tablet_manager.cc:1403] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.006s
I20260709 13:03:28.813617  9727 tablet_bootstrap.cc:492] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:28.816990  9730 raft_consensus.cc:359] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.817159  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fcf3ae6ad4cb7b6c86496a6f70cde" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:28.817625  9765 leader_election.cc:290] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
W20260709 13:03:28.818454  9647 leader_election.cc:343] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.818921  9647 leader_election.cc:304] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:28.819428  9727 ts_tablet_manager.cc:1403] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.267s	user 0.015s	sys 0.031s
I20260709 13:03:28.820137  9730 raft_consensus.cc:385] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.820207  9754 raft_consensus.cc:2749] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:28.820477  9730 raft_consensus.cc:740] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.821308  9730 consensus_queue.cc:260] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.823387  9730 ts_tablet_manager.cc:1434] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:28.824349  9730 tablet_bootstrap.cc:492] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:28.825096  9728 tablet_bootstrap.cc:492] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:28.825690  9728 ts_tablet_manager.cc:1403] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.125s	user 0.010s	sys 0.019s
I20260709 13:03:28.828469  9728 raft_consensus.cc:359] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.829145  9728 raft_consensus.cc:385] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.829411  9728 raft_consensus.cc:740] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.830173  9730 tablet_bootstrap.cc:654] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.823272  9727 raft_consensus.cc:359] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.835755  9727 raft_consensus.cc:385] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.836082  9727 raft_consensus.cc:740] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.837321  9729 consensus_queue.cc:260] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.839612  9729 ts_tablet_manager.cc:1434] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:03:28.841709  9729 tablet_bootstrap.cc:492] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:28.841202  9728 consensus_queue.cc:260] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.844664  9357 catalog_manager.cc:5697] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:28.848171  9729 tablet_bootstrap.cc:654] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.852154  9730 tablet_bootstrap.cc:492] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:28.852632  9730 ts_tablet_manager.cc:1403] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.004s
I20260709 13:03:28.855636  9728 ts_tablet_manager.cc:1434] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:03:28.841192  9727 consensus_queue.cc:260] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.860724  9728 tablet_bootstrap.cc:492] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:28.862047  9730 raft_consensus.cc:359] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.861567  9727 ts_tablet_manager.cc:1434] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.002s
I20260709 13:03:28.862751  9730 raft_consensus.cc:385] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.863086  9730 raft_consensus.cc:740] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.864425  9730 consensus_queue.cc:260] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.866528  9730 ts_tablet_manager.cc:1434] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:03:28.867363  9730 tablet_bootstrap.cc:492] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:28.869570  9728 tablet_bootstrap.cc:654] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.864331  9727 tablet_bootstrap.cc:492] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:28.880584  9730 tablet_bootstrap.cc:654] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.880756  9727 tablet_bootstrap.cc:654] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.880854  9729 tablet_bootstrap.cc:492] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:28.881328  9916 raft_consensus.cc:493] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.881569  9729 ts_tablet_manager.cc:1403] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.004s
I20260709 13:03:28.881858  9916 raft_consensus.cc:515] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.884377  9729 raft_consensus.cc:359] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.884653  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0797397ca74a699473bb7b07f063c8" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:28.885087  9729 raft_consensus.cc:385] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.885237  9916 leader_election.cc:290] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:28.885421  9729 raft_consensus.cc:740] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
W20260709 13:03:28.886065  9424 leader_election.cc:343] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.886358  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0797397ca74a699473bb7b07f063c8" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:28.887073  9680 raft_consensus.cc:2468] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:28.887907  9729 consensus_queue.cc:260] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.888497  9422 leader_election.cc:304] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:28.889819  9916 raft_consensus.cc:2804] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:28.890628  9916 raft_consensus.cc:493] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.890957  9916 raft_consensus.cc:3060] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.894999  9730 tablet_bootstrap.cc:492] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:28.895586  9730 ts_tablet_manager.cc:1403] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.002s
I20260709 13:03:28.898123  9730 raft_consensus.cc:359] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.898860  9730 raft_consensus.cc:385] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.890134  9728 tablet_bootstrap.cc:492] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:28.898116  9916 raft_consensus.cc:515] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.899897  9728 ts_tablet_manager.cc:1403] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.004s
I20260709 13:03:28.899200  9730 raft_consensus.cc:740] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.901458  9916 leader_election.cc:290] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:28.900853  9730 consensus_queue.cc:260] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.902522  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0797397ca74a699473bb7b07f063c8" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:28.902812  9728 raft_consensus.cc:359] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.903646  9728 raft_consensus.cc:385] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.903919  9728 raft_consensus.cc:740] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.904184  9730 ts_tablet_manager.cc:1434] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:03:28.902522  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0797397ca74a699473bb7b07f063c8" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:28.903075  9727 tablet_bootstrap.cc:492] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:28.904783  9680 raft_consensus.cc:3060] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.906124  9727 ts_tablet_manager.cc:1403] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.005s
W20260709 13:03:28.905207  9424 leader_election.cc:343] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.909055  9727 raft_consensus.cc:359] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.909816  9727 raft_consensus.cc:385] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.905356  9730 tablet_bootstrap.cc:492] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:28.911360  9728 consensus_queue.cc:260] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.910892  9729 ts_tablet_manager.cc:1434] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:03:28.911224  9754 raft_consensus.cc:493] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.912560  9754 raft_consensus.cc:515] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.914706  9754 leader_election.cc:290] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:28.915951  9729 tablet_bootstrap.cc:492] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:28.916365  9680 raft_consensus.cc:2468] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:28.917457  9730 tablet_bootstrap.cc:654] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.918756  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8511189d31f8408a9103bf9cadddd6c7" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:28.919333  9727 raft_consensus.cc:740] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.920173  9727 consensus_queue.cc:260] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:28.921036  9422 leader_election.cc:304] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:28.922312  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8511189d31f8408a9103bf9cadddd6c7" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:28.923321  9728 ts_tablet_manager.cc:1434] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:03:28.924412  9727 ts_tablet_manager.cc:1434] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:03:28.930719  9727 tablet_bootstrap.cc:492] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
W20260709 13:03:28.920187  9647 leader_election.cc:343] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.926770  9804 raft_consensus.cc:2804] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:28.932192  9804 raft_consensus.cc:697] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
W20260709 13:03:28.932906  9646 leader_election.cc:343] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.933063  9804 consensus_queue.cc:237] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.933421  9646 leader_election.cc:304] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:28.934990  9728 tablet_bootstrap.cc:492] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:28.935374  9755 raft_consensus.cc:2749] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:28.939605  9738 consensus_queue.cc:1048] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:28.941185  9729 tablet_bootstrap.cc:654] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.943158  9738 consensus_queue.cc:1048] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:28.946385  9728 tablet_bootstrap.cc:654] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.959131  9727 tablet_bootstrap.cc:654] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.966137  9357 catalog_manager.cc:5697] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.977030  9728 tablet_bootstrap.cc:492] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:28.977614  9728 ts_tablet_manager.cc:1403] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.004s
I20260709 13:03:28.980567  9728 raft_consensus.cc:359] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.981794  9730 tablet_bootstrap.cc:492] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:28.981827  9817 raft_consensus.cc:493] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.982419  9730 ts_tablet_manager.cc:1403] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.007s
I20260709 13:03:28.982514  9817 raft_consensus.cc:515] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.985242  9730 raft_consensus.cc:359] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.985942  9730 raft_consensus.cc:385] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.986209  9730 raft_consensus.cc:740] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.986914  9730 consensus_queue.cc:260] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:28.981230  9728 raft_consensus.cc:385] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.988396  9728 raft_consensus.cc:740] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.990540  9728 consensus_queue.cc:260] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:28.984815  9817 leader_election.cc:290] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:28.993752  9729 tablet_bootstrap.cc:492] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:28.994264  9729 ts_tablet_manager.cc:1403] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.004s
I20260709 13:03:28.995131  9457 raft_consensus.cc:3060] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.996533  9728 ts_tablet_manager.cc:1434] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:03:28.996984  9729 raft_consensus.cc:359] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.997587  9728 tablet_bootstrap.cc:492] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:28.997613  9729 raft_consensus.cc:385] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.998086  9729 raft_consensus.cc:740] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.998585  9679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09481da07933449cae77deb1569c9f9e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:28.998814  9729 consensus_queue.cc:260] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:28.999270  9679 raft_consensus.cc:2468] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:29.000355  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09481da07933449cae77deb1569c9f9e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:29.000944  9729 ts_tablet_manager.cc:1434] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:29.003189  9729 tablet_bootstrap.cc:492] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:29.006213  9730 ts_tablet_manager.cc:1434] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:03:29.000998  9497 leader_election.cc:304] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:29.007200  9730 tablet_bootstrap.cc:492] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:29.007800  9739 raft_consensus.cc:2804] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.008186  9739 raft_consensus.cc:493] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.008502  9739 raft_consensus.cc:3060] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.008671  9769 raft_consensus.cc:493] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.009210  9769 raft_consensus.cc:515] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:29.000991  9458 raft_consensus.cc:2468] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:29.011552  9769 leader_election.cc:290] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:29.012313  9679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0797397ca74a699473bb7b07f063c8" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:29.013064  9679 raft_consensus.cc:2393] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8bf0e3504c4f46cf8c639da3e15caf68 in current term 1: Already voted for candidate 04edfe53c70f45e09190743b636a705f in this term.
I20260709 13:03:29.013288  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0797397ca74a699473bb7b07f063c8" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:29.014907  9572 leader_election.cc:304] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:29.016532  9857 raft_consensus.cc:3060] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.017014  9730 tablet_bootstrap.cc:654] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.020860  9728 tablet_bootstrap.cc:654] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.020882  9858 consensus_queue.cc:1048] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:03:29.041429  9727 tablet_bootstrap.cc:492] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:29.042379  9727 ts_tablet_manager.cc:1403] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.112s	user 0.012s	sys 0.003s
I20260709 13:03:29.062541  9729 tablet_bootstrap.cc:654] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.064914  9737 consensus_queue.cc:1048] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:29.068814  9857 raft_consensus.cc:2749] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:29.080479  9728 tablet_bootstrap.cc:492] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:29.080581  9727 raft_consensus.cc:359] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:29.081528  9728 ts_tablet_manager.cc:1403] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.084s	user 0.008s	sys 0.006s
I20260709 13:03:29.081617  9727 raft_consensus.cc:385] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.082239  9727 raft_consensus.cc:740] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.087539  9858 consensus_queue.cc:1048] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:29.087651  9728 raft_consensus.cc:359] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:29.088680  9728 raft_consensus.cc:385] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.089102  9728 raft_consensus.cc:740] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.089983  9728 consensus_queue.cc:260] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:29.082950  9727 consensus_queue.cc:260] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:29.099665  9858 consensus_queue.cc:1048] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:29.102757  9729 tablet_bootstrap.cc:492] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:29.055349  9739 raft_consensus.cc:515] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:29.101629  9727 ts_tablet_manager.cc:1434] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.002s
I20260709 13:03:29.105170  9728 ts_tablet_manager.cc:1434] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.002s
I20260709 13:03:29.103288  9729 ts_tablet_manager.cc:1403] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.003s
I20260709 13:03:29.118134  9727 tablet_bootstrap.cc:492] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:29.119442  9728 tablet_bootstrap.cc:492] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
W20260709 13:03:29.103129  9404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:29.129431  9727 tablet_bootstrap.cc:654] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.137951  9739 leader_election.cc:290] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:29.139225  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09481da07933449cae77deb1569c9f9e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:29.139892  9457 raft_consensus.cc:3060] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.142289  9679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09481da07933449cae77deb1569c9f9e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:29.142838  9755 raft_consensus.cc:493] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.142918  9679 raft_consensus.cc:3060] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.143433  9755 raft_consensus.cc:515] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:29.145684  9755 leader_election.cc:290] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:29.151516  9730 tablet_bootstrap.cc:492] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:29.152156  9730 ts_tablet_manager.cc:1403] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.145s	user 0.017s	sys 0.010s
I20260709 13:03:29.154278  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05c2b77c014117ae5c53f3f8198342" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
W20260709 13:03:29.156809  9646 leader_election.cc:343] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.151177  9679 raft_consensus.cc:2468] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:29.167393  9728 tablet_bootstrap.cc:654] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.163823  9730 raft_consensus.cc:359] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:29.169654  9730 raft_consensus.cc:385] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.170013  9730 raft_consensus.cc:740] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.162668  9916 raft_consensus.cc:493] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.171131  9916 raft_consensus.cc:515] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:29.173369  9916 leader_election.cc:290] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:29.173908  9738 consensus_queue.cc:1048] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:29.175302  9730 consensus_queue.cc:260] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:29.177752  9497 leader_election.cc:304] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:29.180429  9679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fcf3ae6ad4cb7b6c86496a6f70cde" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:29.180691  9457 raft_consensus.cc:2468] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:29.181200  9679 raft_consensus.cc:2468] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:29.168426  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05c2b77c014117ae5c53f3f8198342" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:29.184616  9729 raft_consensus.cc:359] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:29.185338  9729 raft_consensus.cc:385] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.185626  9729 raft_consensus.cc:740] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.192631  9729 consensus_queue.cc:260] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:29.194008  9858 raft_consensus.cc:493] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.194582  9858 raft_consensus.cc:515] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:29.195132  9729 ts_tablet_manager.cc:1434] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.000s
I20260709 13:03:29.196228  9729 tablet_bootstrap.cc:492] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:29.196851  9858 leader_election.cc:290] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:29.197664  9858 raft_consensus.cc:493] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.200388  9857 consensus_queue.cc:1048] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:29.200825  9422 leader_election.cc:304] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
W20260709 13:03:29.203480  9647 leader_election.cc:343] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.204326  9647 leader_election.cc:304] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:29.206350  9755 raft_consensus.cc:2749] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:29.206449  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fcf3ae6ad4cb7b6c86496a6f70cde" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:29.207273  9680 raft_consensus.cc:2468] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:29.208444  9817 raft_consensus.cc:493] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.208978  9817 raft_consensus.cc:515] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:29.211742  9804 raft_consensus.cc:2804] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.212102  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fcf3ae6ad4cb7b6c86496a6f70cde" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:29.212369  9804 raft_consensus.cc:493] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.212539  9817 leader_election.cc:290] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:29.212903  9606 raft_consensus.cc:2468] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:29.213346  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fcf3ae6ad4cb7b6c86496a6f70cde" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:29.203598  9738 raft_consensus.cc:493] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.217866  9730 ts_tablet_manager.cc:1434] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 13:03:29.219142  9730 tablet_bootstrap.cc:492] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:29.220573  9571 leader_election.cc:304] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:29.198130  9858 raft_consensus.cc:515] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:29.212922  9804 raft_consensus.cc:3060] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.214731  9739 raft_consensus.cc:2804] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:29.227831  9782 raft_consensus.cc:2804] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.223712  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12ad87eca574eefa5cbe3f34e13eb8e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:29.231523  9727 tablet_bootstrap.cc:492] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:29.242265  9727 ts_tablet_manager.cc:1403] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.124s	user 0.035s	sys 0.013s
I20260709 13:03:29.244807  9739 raft_consensus.cc:697] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:29.222150  9738 raft_consensus.cc:515] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:29.241959  9782 raft_consensus.cc:493] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.245759  9608 raft_consensus.cc:2468] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:29.256415  9782 raft_consensus.cc:3060] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.264464  9738 leader_election.cc:290] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:29.265542  9499 leader_election.cc:304] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:29.266501  9817 raft_consensus.cc:2804] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.266916  9817 raft_consensus.cc:493] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.266639  9727 raft_consensus.cc:359] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:29.267412  9817 raft_consensus.cc:3060] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.267549  9727 raft_consensus.cc:385] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.267939  9727 raft_consensus.cc:740] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.268970  9774 consensus_queue.cc:1048] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:29.266824  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3188c3b2ea944412b8f9b38b34380bf0" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:29.270727  9458 raft_consensus.cc:2468] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:29.271837  9572 leader_election.cc:304] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:29.272701  9857 raft_consensus.cc:2804] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.273095  9857 raft_consensus.cc:493] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.273803  9727 consensus_queue.cc:260] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:29.273486  9857 raft_consensus.cc:3060] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.278924  9738 raft_consensus.cc:493] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.279160  9730 tablet_bootstrap.cc:654] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.279472  9738 raft_consensus.cc:515] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:29.280778  9459 raft_consensus.cc:3060] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.282107  9728 tablet_bootstrap.cc:492] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:29.282697  9728 ts_tablet_manager.cc:1403] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.165s	user 0.023s	sys 0.023s
I20260709 13:03:29.282862  9738 leader_election.cc:290] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:29.285248  9728 raft_consensus.cc:359] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:29.285893  9728 raft_consensus.cc:385] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.286170  9728 raft_consensus.cc:740] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.286916  9728 consensus_queue.cc:260] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:29.296131  9729 tablet_bootstrap.cc:654] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.290478  9765 raft_consensus.cc:493] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.298374  9857 raft_consensus.cc:515] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:29.279871  9739 consensus_queue.cc:237] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:29.299023  9765 raft_consensus.cc:515] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:29.303341  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3188c3b2ea944412b8f9b38b34380bf0" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:29.304973  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12ad87eca574eefa5cbe3f34e13eb8e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:29.308138  9728 ts_tablet_manager.cc:1434] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:03:29.309091  9728 tablet_bootstrap.cc:492] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:29.309145  9679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe09b15d9f346838b395c7fd2da18ad" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:29.315274  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe09b15d9f346838b395c7fd2da18ad" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:29.315771  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3188c3b2ea944412b8f9b38b34380bf0" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:29.316423  9533 raft_consensus.cc:2468] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:29.317250  9606 raft_consensus.cc:2393] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04edfe53c70f45e09190743b636a705f in current term 1: Already voted for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in this term.
I20260709 13:03:29.316102  9532 raft_consensus.cc:2393] T 1fe09b15d9f346838b395c7fd2da18ad P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04edfe53c70f45e09190743b636a705f in current term 1: Already voted for candidate eaba2f78a9274147a783ffa321939ed5 in this term.
I20260709 13:03:29.310509  9680 raft_consensus.cc:2468] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:29.319409  9754 raft_consensus.cc:493] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.325933  9424 leader_election.cc:304] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:29.327582  9765 leader_election.cc:290] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:29.329493  9857 leader_election.cc:290] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:29.331355  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3188c3b2ea944412b8f9b38b34380bf0" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:29.347329  9728 tablet_bootstrap.cc:654] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.336477  9754 raft_consensus.cc:515] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:29.347630  9755 consensus_queue.cc:1048] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:29.349426  9754 leader_election.cc:290] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:29.356954  9424 leader_election.cc:304] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:29.357425  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3188c3b2ea944412b8f9b38b34380bf0" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:29.360524  9533 raft_consensus.cc:3060] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.362912  9959 raft_consensus.cc:2749] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:29.363898  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3188c3b2ea944412b8f9b38b34380bf0" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:29.373564  9456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d50b9a85aa742458e037bd19f757196" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:29.374281  9959 consensus_queue.cc:1048] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:29.378683  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0333b232194ff09fbd6593bc528531" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:29.339344  9765 raft_consensus.cc:493] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.344975  9458 raft_consensus.cc:3060] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.355006  9858 leader_election.cc:290] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:29.379068  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d50b9a85aa742458e037bd19f757196" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:29.397078  9727 ts_tablet_manager.cc:1434] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.154s	user 0.019s	sys 0.018s
I20260709 13:03:29.410823  9727 tablet_bootstrap.cc:492] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:29.358680  9782 raft_consensus.cc:515] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:29.392590  9754 consensus_queue.cc:1048] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:03:29.409191  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0333b232194ff09fbd6593bc528531" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:29.398972  9765 raft_consensus.cc:515] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:29.426059  9765 leader_election.cc:290] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:29.429708  9817 raft_consensus.cc:515] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
W20260709 13:03:29.417405  9646 leader_election.cc:343] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.433440  9782 leader_election.cc:290] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:29.433705  9968 consensus_queue.cc:1048] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:29.434438  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fcf3ae6ad4cb7b6c86496a6f70cde" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:29.435784  9963 raft_consensus.cc:493] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.436057  9456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fcf3ae6ad4cb7b6c86496a6f70cde" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:29.436304  9963 raft_consensus.cc:515] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:29.435046  9680 raft_consensus.cc:3060] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.438340  9963 leader_election.cc:290] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:29.440428  9533 raft_consensus.cc:2468] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:29.423789  9804 raft_consensus.cc:515] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:29.443306  9457 raft_consensus.cc:2393] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8bf0e3504c4f46cf8c639da3e15caf68 in current term 1: Already voted for candidate 04edfe53c70f45e09190743b636a705f in this term.
I20260709 13:03:29.443437  9804 leader_election.cc:290] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:29.444692  9727 tablet_bootstrap.cc:654] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.447602  9680 raft_consensus.cc:2468] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
W20260709 13:03:29.448307  9647 leader_election.cc:343] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.448841  9765 raft_consensus.cc:493] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.449180  9571 leader_election.cc:304] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:29.449536  9730 tablet_bootstrap.cc:492] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:29.449359  9765 raft_consensus.cc:515] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
W20260709 13:03:29.449976  9647 leader_election.cc:343] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.450382  9782 raft_consensus.cc:2804] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:29.440409  9729 tablet_bootstrap.cc:492] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:29.450484  9647 leader_election.cc:304] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:29.451187  9729 ts_tablet_manager.cc:1403] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.255s	user 0.012s	sys 0.010s
I20260709 13:03:29.450999  9782 raft_consensus.cc:697] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:29.452160  9782 consensus_queue.cc:237] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:29.452823  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dc81bdfb864e568aba35ed5d9f24dd" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:29.453039  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8d47fa67d245fb837b1492c15e9766" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
W20260709 13:03:29.454377  9646 leader_election.cc:343] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.455125  9765 leader_election.cc:290] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:29.450069  9730 ts_tablet_manager.cc:1403] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.231s	user 0.019s	sys 0.007s
I20260709 13:03:29.461634  9729 raft_consensus.cc:359] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:29.462404  9729 raft_consensus.cc:385] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.465663  9729 raft_consensus.cc:740] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.452283  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fcf3ae6ad4cb7b6c86496a6f70cde" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:29.468915  9729 consensus_queue.cc:260] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:29.462369  9754 raft_consensus.cc:2749] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:29.461690  9499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45605, user_credentials={real_user=slave}} blocked reactor thread for 61948.6us
I20260709 13:03:29.479867  9730 raft_consensus.cc:359] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:29.480705  9730 raft_consensus.cc:385] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.481014  9730 raft_consensus.cc:740] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.480383  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fcf3ae6ad4cb7b6c86496a6f70cde" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:29.484546  9729 ts_tablet_manager.cc:1434] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.006s
I20260709 13:03:29.488060  9729 tablet_bootstrap.cc:492] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:29.490046  9728 tablet_bootstrap.cc:492] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:29.490513  9728 ts_tablet_manager.cc:1403] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.182s	user 0.016s	sys 0.026s
I20260709 13:03:29.499089  9680 raft_consensus.cc:2393] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 04edfe53c70f45e09190743b636a705f in current term 1: Already voted for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in this term.
I20260709 13:03:29.494774  9817 leader_election.cc:290] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:29.508212  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d335e60a664ce6a7db36b70d7a0403" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:29.514119  9573 leader_election.cc:304] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:29.528692  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12ad87eca574eefa5cbe3f34e13eb8e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:29.529058  9858 raft_consensus.cc:2804] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:29.529507  9606 raft_consensus.cc:3060] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.529932  9858 raft_consensus.cc:697] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:29.531145  9458 raft_consensus.cc:2468] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:29.531839  9737 raft_consensus.cc:2764] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:03:29.532315  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dc81bdfb864e568aba35ed5d9f24dd" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:29.532404  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8d47fa67d245fb837b1492c15e9766" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:29.538333  9727 tablet_bootstrap.cc:492] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:29.538879  9727 ts_tablet_manager.cc:1403] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.131s	user 0.019s	sys 0.017s
I20260709 13:03:29.539069  9730 consensus_queue.cc:260] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:29.534341  9858 consensus_queue.cc:237] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:29.540653  9730 ts_tablet_manager.cc:1434] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.083s	user 0.009s	sys 0.000s
I20260709 13:03:29.543005  9730 tablet_bootstrap.cc:492] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:29.541559  9727 raft_consensus.cc:359] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:29.547184  9727 raft_consensus.cc:385] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.529178  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d335e60a664ce6a7db36b70d7a0403" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:29.557400  9727 raft_consensus.cc:740] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.562122  9352 catalog_manager.cc:5697] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:29.570398  9679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12ad87eca574eefa5cbe3f34e13eb8e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:29.571385  9679 raft_consensus.cc:3060] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.585449  9727 consensus_queue.cc:260] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:29.588217  9727 ts_tablet_manager.cc:1434] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 13:03:29.589424  9727 tablet_bootstrap.cc:492] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
W20260709 13:03:29.610366  9498 leader_election.cc:343] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.620887  9728 raft_consensus.cc:359] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:29.621978  9728 raft_consensus.cc:385] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.622308  9728 raft_consensus.cc:740] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
W20260709 13:03:29.623824  9972 log.cc:927] Time spent T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:03:29.624096  9606 raft_consensus.cc:2468] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:29.631129  9729 tablet_bootstrap.cc:654] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.631887  9728 consensus_queue.cc:260] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
W20260709 13:03:29.599581  9647 leader_election.cc:343] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.636138  9728 ts_tablet_manager.cc:1434] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.145s	user 0.009s	sys 0.000s
I20260709 13:03:29.643111  9737 consensus_queue.cc:1048] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:29.634680  9499 leader_election.cc:343] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.650342  9499 leader_election.cc:304] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:29.653218  9728 tablet_bootstrap.cc:492] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:29.649637  9647 leader_election.cc:304] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
W20260709 13:03:29.655076  9647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:34349, user_credentials={real_user=slave}} blocked reactor thread for 62710.6us
I20260709 13:03:29.656546  9755 raft_consensus.cc:2749] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:29.658432  9727 tablet_bootstrap.cc:654] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.662026  9958 raft_consensus.cc:493] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.662564  9958 raft_consensus.cc:515] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:29.664799  9958 leader_election.cc:290] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:29.665357  9963 raft_consensus.cc:2749] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:29.666085  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d335e60a664ce6a7db36b70d7a0403" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:29.666793  9533 raft_consensus.cc:2468] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
W20260709 13:03:29.667775  9647 leader_election.cc:343] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.668103  9424 leader_election.cc:304] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:29.669117  9958 raft_consensus.cc:2804] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.669548  9958 raft_consensus.cc:493] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.669947  9958 raft_consensus.cc:3060] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.672508  9679 raft_consensus.cc:2468] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:29.672644  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d335e60a664ce6a7db36b70d7a0403" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
W20260709 13:03:29.674574  9424 leader_election.cc:343] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.676192  9730 tablet_bootstrap.cc:654] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.676555  9499 leader_election.cc:304] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:29.677390  9963 raft_consensus.cc:2804] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:29.677884  9963 raft_consensus.cc:697] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:29.677909  9958 raft_consensus.cc:515] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:29.678820  9963 consensus_queue.cc:237] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
W20260709 13:03:29.680706  9647 leader_election.cc:343] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.681335  9647 leader_election.cc:304] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:29.684300  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d335e60a664ce6a7db36b70d7a0403" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:29.684973  9533 raft_consensus.cc:3060] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.694893  9728 tablet_bootstrap.cc:654] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.703708  9737 raft_consensus.cc:493] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.705289  9737 raft_consensus.cc:515] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:29.707996  9737 leader_election.cc:290] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:29.708757  9958 leader_election.cc:290] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:29.694366  9755 raft_consensus.cc:2749] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:29.710530  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d335e60a664ce6a7db36b70d7a0403" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:29.711082  9422 leader_election.cc:304] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:29.711483  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05c2b77c014117ae5c53f3f8198342" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
W20260709 13:03:29.712071  9424 leader_election.cc:343] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.712594  9958 raft_consensus.cc:2749] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:03:29.713971  9424 leader_election.cc:343] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.714012  9533 raft_consensus.cc:2468] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:29.718894  9424 leader_election.cc:304] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:29.721920  9916 raft_consensus.cc:2804] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:29.722443  9916 raft_consensus.cc:697] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:29.723735  9916 consensus_queue.cc:237] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:29.734288  9729 tablet_bootstrap.cc:492] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:29.734962  9729 ts_tablet_manager.cc:1403] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.247s	user 0.018s	sys 0.002s
I20260709 13:03:29.742069  9727 tablet_bootstrap.cc:492] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:29.742646  9727 ts_tablet_manager.cc:1403] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.153s	user 0.013s	sys 0.024s
I20260709 13:03:29.742903  9729 raft_consensus.cc:359] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:29.743643  9729 raft_consensus.cc:385] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.743902  9729 raft_consensus.cc:740] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.745744  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05c2b77c014117ae5c53f3f8198342" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:29.746546  9682 raft_consensus.cc:2468] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:29.744550  9729 consensus_queue.cc:260] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:29.749796  9728 tablet_bootstrap.cc:492] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:29.750303  9728 ts_tablet_manager.cc:1403] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.009s
I20260709 13:03:29.751645  9729 ts_tablet_manager.cc:1434] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:03:29.748984  9727 raft_consensus.cc:359] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:29.752501  9727 raft_consensus.cc:385] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.753176  9727 raft_consensus.cc:740] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.754925  9727 consensus_queue.cc:260] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
W20260709 13:03:29.757125  9647 leader_election.cc:343] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.757658  9647 leader_election.cc:304] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:29.753059  9728 raft_consensus.cc:359] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:29.758767  9728 raft_consensus.cc:385] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.759060  9728 raft_consensus.cc:740] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.759800  9728 consensus_queue.cc:260] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:29.760845  9755 raft_consensus.cc:2749] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:29.752768  9729 tablet_bootstrap.cc:492] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:29.761390  9727 ts_tablet_manager.cc:1434] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 13:03:29.762187  9728 ts_tablet_manager.cc:1434] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:03:29.764784  9728 tablet_bootstrap.cc:492] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:29.764889  9727 tablet_bootstrap.cc:492] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:29.763376  9730 tablet_bootstrap.cc:492] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:29.770292  9730 ts_tablet_manager.cc:1403] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.228s	user 0.016s	sys 0.001s
I20260709 13:03:29.773756  9739 consensus_queue.cc:1048] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:29.774302  9963 raft_consensus.cc:493] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.774863  9963 raft_consensus.cc:515] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:29.776029  9858 raft_consensus.cc:493] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.776525  9858 raft_consensus.cc:515] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:29.777026  9728 tablet_bootstrap.cc:654] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.777401  9963 leader_election.cc:290] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:29.778600  9858 leader_election.cc:290] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:29.779788  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8511189d31f8408a9103bf9cadddd6c7" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:29.780169  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8511189d31f8408a9103bf9cadddd6c7" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:29.780761  9681 raft_consensus.cc:2468] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:29.782339  9571 leader_election.cc:304] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:29.782673  9727 tablet_bootstrap.cc:654] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.783568  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5d1e1a6ffc47f994ee7cd91df4db54" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:29.784214  9608 raft_consensus.cc:2468] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:29.785027  9858 raft_consensus.cc:2804] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.785480  9858 raft_consensus.cc:493] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:29.786345  9572 leader_election.cc:343] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.792335  9422 leader_election.cc:304] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:29.793190  9499 leader_election.cc:304] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:29.793584  9804 raft_consensus.cc:2804] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.794140  9730 raft_consensus.cc:359] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:29.794785  9730 raft_consensus.cc:385] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.795028  9730 raft_consensus.cc:740] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.793980  9804 raft_consensus.cc:493] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.795476  9963 raft_consensus.cc:2804] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.795630  9765 raft_consensus.cc:493] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.795912  9963 raft_consensus.cc:493] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.796320  9963 raft_consensus.cc:3060] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.796240  9765 raft_consensus.cc:515] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:29.798441  9765 leader_election.cc:290] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:29.795655  9804 raft_consensus.cc:3060] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.804893  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a58824acb343fa8f9e1349207a54b1" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:29.785993  9858 raft_consensus.cc:3060] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.807929  9729 tablet_bootstrap.cc:654] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:29.813820  9646 leader_election.cc:343] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.820063  9970 consensus_queue.cc:1048] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:29.821065  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5d1e1a6ffc47f994ee7cd91df4db54" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:29.821774  9681 raft_consensus.cc:2468] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:29.867887  9730 consensus_queue.cc:260] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:29.868674  9727 tablet_bootstrap.cc:492] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:29.869254  9727 ts_tablet_manager.cc:1403] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.009s
I20260709 13:03:29.870826  9730 ts_tablet_manager.cc:1434] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.100s	user 0.005s	sys 0.000s
I20260709 13:03:29.818853  9354 catalog_manager.cc:5697] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.871974  9730 tablet_bootstrap.cc:492] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:29.872123  9727 raft_consensus.cc:359] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:29.872890  9727 raft_consensus.cc:385] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.873188  9727 raft_consensus.cc:740] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.874694  9354 catalog_manager.cc:5697] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:29.878574  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a58824acb343fa8f9e1349207a54b1" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:29.878783  9963 raft_consensus.cc:515] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
W20260709 13:03:29.879410  9497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:41541, user_credentials={real_user=slave}} blocked reactor thread for 51169.1us
I20260709 13:03:29.881618  9728 tablet_bootstrap.cc:492] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:29.882110  9728 ts_tablet_manager.cc:1403] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.118s	user 0.019s	sys 0.007s
I20260709 13:03:29.870985  9804 raft_consensus.cc:515] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:29.884493  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5d1e1a6ffc47f994ee7cd91df4db54" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:29.884811  9728 raft_consensus.cc:359] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:29.885203  9608 raft_consensus.cc:3060] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.885560  9804 leader_election.cc:290] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:29.885532  9728 raft_consensus.cc:385] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.886382  9728 raft_consensus.cc:740] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.886430  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05c2b77c014117ae5c53f3f8198342" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:29.887086  9682 raft_consensus.cc:3060] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.887142  9728 consensus_queue.cc:260] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:29.894340  9682 raft_consensus.cc:2468] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:29.897897  9422 leader_election.cc:304] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:29.883167  9963 leader_election.cc:290] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:29.896036  9679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5d1e1a6ffc47f994ee7cd91df4db54" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:29.899071  9679 raft_consensus.cc:3060] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.899199  9804 raft_consensus.cc:2804] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:29.901710  9804 raft_consensus.cc:697] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:29.902693  9804 consensus_queue.cc:237] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
W20260709 13:03:29.905205  9647 leader_election.cc:343] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.906481  9679 raft_consensus.cc:2468] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:29.909098  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05c2b77c014117ae5c53f3f8198342" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:29.917335  9533 raft_consensus.cc:3060] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.912223  9728 ts_tablet_manager.cc:1434] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:03:29.915584  9647 leader_election.cc:304] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:29.910791  9727 consensus_queue.cc:260] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:29.920064  9357 catalog_manager.cc:5697] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.923705  9728 tablet_bootstrap.cc:492] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:29.910188  9608 raft_consensus.cc:2468] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:29.928211  9964 raft_consensus.cc:493] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.928803  9964 raft_consensus.cc:515] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:29.929381  9499 leader_election.cc:304] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:29.930348  9970 raft_consensus.cc:2804] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:29.930868  9970 raft_consensus.cc:697] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:29.931764  9970 consensus_queue.cc:237] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:29.923516  9765 raft_consensus.cc:2749] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:29.939662  9858 raft_consensus.cc:515] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:29.944330  9769 consensus_queue.cc:1048] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:29.953397  9858 leader_election.cc:290] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:29.955265  9964 leader_election.cc:290] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:29.956908  9782 consensus_queue.cc:1048] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:29.960829  9730 tablet_bootstrap.cc:654] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.961958  9679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8511189d31f8408a9103bf9cadddd6c7" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:29.962595  9679 raft_consensus.cc:3060] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.963340  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d264be487e49f2b6cc37fefe738369" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:29.962525  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8511189d31f8408a9103bf9cadddd6c7" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:29.964443  9457 raft_consensus.cc:3060] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:29.970216  9647 leader_election.cc:343] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.975304  9729 tablet_bootstrap.cc:492] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:29.976187  9729 ts_tablet_manager.cc:1403] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.224s	user 0.032s	sys 0.007s
I20260709 13:03:29.976972  9727 ts_tablet_manager.cc:1434] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.107s	user 0.007s	sys 0.002s
I20260709 13:03:29.982177  9727 tablet_bootstrap.cc:492] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:29.982929  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d264be487e49f2b6cc37fefe738369" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
W20260709 13:03:29.986055  9647 leader_election.cc:343] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.986534  9647 leader_election.cc:304] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:29.988399  9730 tablet_bootstrap.cc:492] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:29.988868  9730 ts_tablet_manager.cc:1403] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.117s	user 0.021s	sys 0.003s
I20260709 13:03:29.991300  9729 raft_consensus.cc:359] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:29.991638  9964 raft_consensus.cc:2749] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:29.991509  9730 raft_consensus.cc:359] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:29.992014  9729 raft_consensus.cc:385] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.992362  9730 raft_consensus.cc:385] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.988042  9352 catalog_manager.cc:5697] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.992718  9730 raft_consensus.cc:740] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.992519  9729 raft_consensus.cc:740] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.994477  9729 consensus_queue.cc:260] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:29.995792  9730 consensus_queue.cc:260] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:29.999146  9730 ts_tablet_manager.cc:1434] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:30.001248  9533 raft_consensus.cc:2468] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:30.006747  9729 ts_tablet_manager.cc:1434] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:03:29.998075  9804 raft_consensus.cc:493] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.010285  9804 raft_consensus.cc:515] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:30.004271  9679 raft_consensus.cc:2468] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:30.012856  9571 leader_election.cc:304] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:30.013722  9858 raft_consensus.cc:2804] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:30.014225  9858 raft_consensus.cc:697] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:30.014655  9728 tablet_bootstrap.cc:654] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.015107  9858 consensus_queue.cc:237] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:30.015689  9782 consensus_queue.cc:1048] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:29.999817  9457 raft_consensus.cc:2468] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:30.018014  9729 tablet_bootstrap.cc:492] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:30.026290  9804 leader_election.cc:290] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:30.028807  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aa3eb6cc3047579924350ba3f75d90" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
W20260709 13:03:30.033903  9424 leader_election.cc:343] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:30.039927  9730 tablet_bootstrap.cc:492] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:30.045749  9729 tablet_bootstrap.cc:654] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.055836  9357 catalog_manager.cc:5697] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:30.084440  9730 tablet_bootstrap.cc:654] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.093638  9728 tablet_bootstrap.cc:492] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:30.094305  9728 ts_tablet_manager.cc:1403] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.175s	user 0.024s	sys 0.032s
I20260709 13:03:30.097381  9728 raft_consensus.cc:359] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:30.097936  9728 raft_consensus.cc:385] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.098186  9728 raft_consensus.cc:740] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.098702  9728 consensus_queue.cc:260] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:30.100539  9728 ts_tablet_manager.cc:1434] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:30.101723  9728 tablet_bootstrap.cc:492] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:30.107612  9728 tablet_bootstrap.cc:654] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.108412  9727 tablet_bootstrap.cc:654] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.120314  9857 consensus_queue.cc:1048] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:30.075321  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aa3eb6cc3047579924350ba3f75d90" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:30.133440  9533 raft_consensus.cc:2468] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:30.134579  9354 catalog_manager.cc:5697] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:30.146004  9424 leader_election.cc:304] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:30.147320  9958 raft_consensus.cc:2804] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:30.147749  9958 raft_consensus.cc:493] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.148098  9958 raft_consensus.cc:3060] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.155723  9729 tablet_bootstrap.cc:492] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:30.156477  9729 ts_tablet_manager.cc:1403] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.149s	user 0.043s	sys 0.031s
I20260709 13:03:30.166816  9608 raft_consensus.cc:3060] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.168833  9963 consensus_queue.cc:1048] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:30.204015  9729 raft_consensus.cc:359] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:30.205569  9729 raft_consensus.cc:385] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.206501  9729 raft_consensus.cc:740] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.200291  9356 catalog_manager.cc:5697] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:30.208348  9730 tablet_bootstrap.cc:492] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:30.208864  9730 ts_tablet_manager.cc:1403] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.169s	user 0.020s	sys 0.016s
I20260709 13:03:30.210065  9958 raft_consensus.cc:515] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:30.208400  9963 consensus_queue.cc:1048] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:03:30.213794  9730 raft_consensus.cc:359] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:30.217068  9730 raft_consensus.cc:385] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.217355  9730 raft_consensus.cc:740] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.207211  9729 consensus_queue.cc:260] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:30.218077  9730 consensus_queue.cc:260] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:30.222421  9728 tablet_bootstrap.cc:492] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:30.222954  9728 ts_tablet_manager.cc:1403] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.121s	user 0.013s	sys 0.003s
I20260709 13:03:30.227859  9730 ts_tablet_manager.cc:1434] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:03:30.228674  9730 tablet_bootstrap.cc:492] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:30.230125  9727 tablet_bootstrap.cc:492] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:30.230242  9729 ts_tablet_manager.cc:1434] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.003s
I20260709 13:03:30.230711  9727 ts_tablet_manager.cc:1403] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.253s	user 0.013s	sys 0.009s
I20260709 13:03:30.233366  9729 tablet_bootstrap.cc:492] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:30.238683  9727 raft_consensus.cc:359] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:30.239619  9727 raft_consensus.cc:385] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.239883  9727 raft_consensus.cc:740] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.240420  9727 consensus_queue.cc:260] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:30.242769  9727 ts_tablet_manager.cc:1434] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:03:30.241544  9765 raft_consensus.cc:493] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.250222  9769 raft_consensus.cc:493] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.250440  9765 raft_consensus.cc:515] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:30.250787  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aa3eb6cc3047579924350ba3f75d90" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:30.250749  9769 raft_consensus.cc:515] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:30.251514  9533 raft_consensus.cc:3060] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.252720  9765 leader_election.cc:290] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:30.256006  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0d047c0df4036a4702dbc607a318e" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:30.256409  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0d047c0df4036a4702dbc607a318e" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
W20260709 13:03:30.257869  9647 leader_election.cc:343] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:30.259126  9646 leader_election.cc:343] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:30.259723  9646 leader_election.cc:304] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:30.260736  9755 raft_consensus.cc:2749] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:30.265398  9958 leader_election.cc:290] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:30.267501  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aa3eb6cc3047579924350ba3f75d90" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:30.270742  9533 raft_consensus.cc:2468] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:30.271289  9958 raft_consensus.cc:493] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.273732  9963 raft_consensus.cc:493] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.274283  9963 raft_consensus.cc:515] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
W20260709 13:03:30.276238  9424 leader_election.cc:343] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:30.276502  9963 leader_election.cc:290] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:30.275938  9958 raft_consensus.cc:515] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:30.274878  9916 consensus_queue.cc:1048] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:30.277911  9679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0333b232194ff09fbd6593bc528531" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:30.278560  9679 raft_consensus.cc:2468] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:30.279516  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d50b9a85aa742458e037bd19f757196" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:30.280170  9681 raft_consensus.cc:2468] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:30.280704  9769 leader_election.cc:290] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:30.283378  9728 raft_consensus.cc:359] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:30.284101  9728 raft_consensus.cc:385] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.284372  9728 raft_consensus.cc:740] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.285069  9728 consensus_queue.cc:260] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:30.287644  9497 leader_election.cc:304] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:30.287837  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d50b9a85aa742458e037bd19f757196" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:30.289480  9729 tablet_bootstrap.cc:654] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.289708  9970 raft_consensus.cc:2804] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:30.290126  9970 raft_consensus.cc:493] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.290766  9970 raft_consensus.cc:3060] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.291585  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d335e60a664ce6a7db36b70d7a0403" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:30.293748  9728 ts_tablet_manager.cc:1434] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 13:03:30.293761  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0333b232194ff09fbd6593bc528531" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:30.294736  9728 tablet_bootstrap.cc:492] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:30.294792  9605 raft_consensus.cc:2468] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:30.283399  9422 leader_election.cc:304] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:30.296329  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d335e60a664ce6a7db36b70d7a0403" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:30.296768  9916 raft_consensus.cc:2804] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:30.297024  9532 raft_consensus.cc:2468] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:30.297209  9916 raft_consensus.cc:493] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.297565  9916 raft_consensus.cc:3060] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.280701  9958 leader_election.cc:290] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:30.303973  9573 leader_election.cc:304] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:30.314512  9728 tablet_bootstrap.cc:654] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.325497  9970 raft_consensus.cc:515] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:30.348584  9970 leader_election.cc:290] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:30.350338  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0333b232194ff09fbd6593bc528531" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:30.350988  9606 raft_consensus.cc:3060] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.352243  9970 consensus_queue.cc:1048] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:30.354851  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0333b232194ff09fbd6593bc528531" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:30.355484  9681 raft_consensus.cc:3060] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.361572  9606 raft_consensus.cc:2468] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:30.364506  9730 tablet_bootstrap.cc:654] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.366168  9499 leader_election.cc:304] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:30.366624  9970 consensus_queue.cc:1048] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:30.367877  9968 raft_consensus.cc:2804] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:30.368538  9968 raft_consensus.cc:697] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:30.368788  9916 raft_consensus.cc:515] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:30.369729  9968 consensus_queue.cc:237] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:30.372341  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d50b9a85aa742458e037bd19f757196" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:30.373116  9682 raft_consensus.cc:3060] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.378077  9727 tablet_bootstrap.cc:492] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:30.385308  9737 consensus_queue.cc:1048] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:30.396147  9424 leader_election.cc:343] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:30.397698  9424 leader_election.cc:304] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:30.398996 10011 raft_consensus.cc:2804] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:30.399693 10011 raft_consensus.cc:697] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:30.400837 10011 consensus_queue.cc:237] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:30.411386  9728 tablet_bootstrap.cc:492] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:30.412072  9728 ts_tablet_manager.cc:1403] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.118s	user 0.035s	sys 0.030s
I20260709 13:03:30.385617  9681 raft_consensus.cc:2468] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:30.428493  9916 leader_election.cc:290] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:30.432894  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d50b9a85aa742458e037bd19f757196" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:30.437542  9682 raft_consensus.cc:2468] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
W20260709 13:03:30.449201  9424 leader_election.cc:343] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:30.451010  9769 raft_consensus.cc:2804] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:30.467955  9422 leader_election.cc:304] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:30.468971  9737 raft_consensus.cc:2804] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:30.469493  9737 raft_consensus.cc:697] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:30.470299  9737 consensus_queue.cc:237] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:30.471757  9730 tablet_bootstrap.cc:492] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:30.472285  9730 ts_tablet_manager.cc:1403] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.244s	user 0.016s	sys 0.005s
I20260709 13:03:30.477517  9730 raft_consensus.cc:359] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:30.477990  9769 raft_consensus.cc:493] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:30.478232  9730 raft_consensus.cc:385] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.478508  9769 raft_consensus.cc:3060] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.478574  9730 raft_consensus.cc:740] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.479147  9728 raft_consensus.cc:359] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:30.479851  9728 raft_consensus.cc:385] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.480113  9728 raft_consensus.cc:740] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.480477  9730 consensus_queue.cc:260] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:30.485580  9730 ts_tablet_manager.cc:1434] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:03:30.486343  9729 tablet_bootstrap.cc:492] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:30.486852  9729 ts_tablet_manager.cc:1403] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.256s	user 0.008s	sys 0.005s
I20260709 13:03:30.486986  9728 consensus_queue.cc:260] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:30.529130  9730 tablet_bootstrap.cc:492] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
W20260709 13:03:30.533182  9404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:30.537840  9730 tablet_bootstrap.cc:654] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.540968  9728 ts_tablet_manager.cc:1434] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.128s	user 0.011s	sys 0.002s
I20260709 13:03:30.548672  9728 tablet_bootstrap.cc:492] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:30.548749  9357 catalog_manager.cc:5697] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:30.555308  9356 catalog_manager.cc:5697] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:30.562341  9727 tablet_bootstrap.cc:654] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.563916  9769 raft_consensus.cc:515] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:30.565944  9608 raft_consensus.cc:1240] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Rejecting Update request from peer 04edfe53c70f45e09190743b636a705f for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:30.563477  9755 raft_consensus.cc:493] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.569839  9755 raft_consensus.cc:515] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:30.572208  9755 leader_election.cc:290] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:30.578938  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d335e60a664ce6a7db36b70d7a0403" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:30.581024  9769 leader_election.cc:290] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:30.583194  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134aecc79f7c4b398afcbf65000e3267" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:30.585003  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134aecc79f7c4b398afcbf65000e3267" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:30.585841  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d335e60a664ce6a7db36b70d7a0403" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:30.586699  9531 raft_consensus.cc:3060] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:30.589816  9647 leader_election.cc:343] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:30.618484  9646 leader_election.cc:343] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:30.619062  9646 leader_election.cc:304] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:30.634019  9728 tablet_bootstrap.cc:654] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:30.627352 10020 log.cc:927] Time spent T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:03:30.627462  9755 raft_consensus.cc:2749] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:30.629705  9958 consensus_queue.cc:1048] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:03:30.648809 10011 consensus_queue.cc:1048] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:03:30.654277  9531 raft_consensus.cc:2468] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 2.
I20260709 13:03:30.655753  9573 leader_election.cc:304] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:30.694898  9727 tablet_bootstrap.cc:492] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:30.699033  9727 ts_tablet_manager.cc:1403] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.321s	user 0.026s	sys 0.012s
I20260709 13:03:30.657346  9804 raft_consensus.cc:493] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.701812  9730 tablet_bootstrap.cc:492] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:30.702419  9730 ts_tablet_manager.cc:1403] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.174s	user 0.041s	sys 0.051s
I20260709 13:03:30.702627  9782 raft_consensus.cc:2804] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:30.706266  9782 raft_consensus.cc:697] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:30.701843  9916 consensus_queue.cc:1059] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:03:30.703444  9804 raft_consensus.cc:515] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:30.708959 10011 raft_consensus.cc:3055] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:30.711592 10011 raft_consensus.cc:740] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:30.712196  9804 leader_election.cc:290] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:30.712379 10011 consensus_queue.cc:260] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:30.708103  9782 consensus_queue.cc:237] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:30.710044 10003 consensus_queue.cc:1048] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:03:30.713212  9730 raft_consensus.cc:359] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:30.716569  9730 raft_consensus.cc:385] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.716849  9730 raft_consensus.cc:740] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.719758  9729 raft_consensus.cc:359] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:30.720503  9531 raft_consensus.cc:1240] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Rejecting Update request from peer 04edfe53c70f45e09190743b636a705f for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:03:30.720502  9729 raft_consensus.cc:385] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.720551  9730 consensus_queue.cc:260] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:30.721345  9729 raft_consensus.cc:740] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.722010  9729 consensus_queue.cc:260] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:30.725296  9730 ts_tablet_manager.cc:1434] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:03:30.714326 10011 raft_consensus.cc:3060] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.726393  9730 tablet_bootstrap.cc:492] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
W20260709 13:03:30.709303  9573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:34349, user_credentials={real_user=slave}} blocked reactor thread for 53671us
I20260709 13:03:30.729306  9729 ts_tablet_manager.cc:1434] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.242s	user 0.007s	sys 0.002s
I20260709 13:03:30.731860  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dc81bdfb864e568aba35ed5d9f24dd" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:30.732533  9682 raft_consensus.cc:2468] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:30.739698  9422 leader_election.cc:304] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:30.745553  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dc81bdfb864e568aba35ed5d9f24dd" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:30.752797  9727 raft_consensus.cc:359] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:30.753801  9727 raft_consensus.cc:385] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.754124  9727 raft_consensus.cc:740] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.755759  9857 consensus_queue.cc:1048] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:30.754953  9727 consensus_queue.cc:260] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:30.766942  9729 tablet_bootstrap.cc:492] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
W20260709 13:03:30.768024  9424 leader_election.cc:343] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:30.771700  9730 tablet_bootstrap.cc:654] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.772603  9728 tablet_bootstrap.cc:492] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:30.773907  9729 tablet_bootstrap.cc:654] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.775203  9964 raft_consensus.cc:493] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.775317  9727 ts_tablet_manager.cc:1434] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 13:03:30.780894  9727 tablet_bootstrap.cc:492] T 5e8d47fa67d245fb837b1492c15e9766 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:30.777283  9728 ts_tablet_manager.cc:1403] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.229s	user 0.023s	sys 0.005s
I20260709 13:03:30.781181  9357 catalog_manager.cc:5697] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:30.779512  9964 raft_consensus.cc:515] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:30.788986  9964 leader_election.cc:290] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:30.791777  9728 raft_consensus.cc:359] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:30.792580  9728 raft_consensus.cc:385] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.792846  9728 raft_consensus.cc:740] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.793469  9728 consensus_queue.cc:260] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:30.794126  9727 tablet_bootstrap.cc:654] T 5e8d47fa67d245fb837b1492c15e9766 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.761817  9804 raft_consensus.cc:2804] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:30.800688  9728 ts_tablet_manager.cc:1434] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:03:30.807883  9728 tablet_bootstrap.cc:492] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:30.803433  9804 raft_consensus.cc:493] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.842569  9607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aceba3614aec44bd97d0a2111129bae4" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:30.844238  9964 raft_consensus.cc:493] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.847733  9964 raft_consensus.cc:515] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:30.853682  9964 leader_election.cc:290] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:30.854775  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aceba3614aec44bd97d0a2111129bae4" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:30.856460  9970 consensus_queue.cc:1048] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:30.866037  9607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4f7949313a47fc9f7a799ef17d9999" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:30.869407  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4f7949313a47fc9f7a799ef17d9999" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:30.870077  9352 catalog_manager.cc:5697] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:30.873473  9646 leader_election.cc:343] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:30.849018  9804 raft_consensus.cc:3060] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:30.881031  9647 leader_election.cc:343] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:30.882236  9647 leader_election.cc:343] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:30.882813  9647 leader_election.cc:304] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:30.884037  9964 raft_consensus.cc:2749] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:30.891793  9647 leader_election.cc:343] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:30.892241  9647 leader_election.cc:304] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:30.899461  9730 tablet_bootstrap.cc:492] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:30.900017  9730 ts_tablet_manager.cc:1403] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.174s	user 0.060s	sys 0.041s
I20260709 13:03:30.894824  9964 raft_consensus.cc:2749] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:30.902688  9730 raft_consensus.cc:359] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:30.903424  9730 raft_consensus.cc:385] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.903683  9730 raft_consensus.cc:740] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.904559  9730 consensus_queue.cc:260] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:30.907068  9730 ts_tablet_manager.cc:1434] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:30.908033  9730 tablet_bootstrap.cc:492] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:30.908403 10011 raft_consensus.cc:493] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.908521  9958 consensus_queue.cc:1048] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:30.908957 10011 raft_consensus.cc:515] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:30.914094 10011 leader_election.cc:290] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:30.916962  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8d25c4566f4b24986e9c10ae6afa5e" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:30.917273  9730 tablet_bootstrap.cc:654] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.917882  9963 consensus_queue.cc:1048] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:30.918694  9916 consensus_queue.cc:1048] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:30.920783  9737 raft_consensus.cc:493] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.920603  9804 raft_consensus.cc:515] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:30.921320  9737 raft_consensus.cc:515] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
W20260709 13:03:30.922566  9424 leader_election.cc:343] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:30.924537 10003 raft_consensus.cc:493] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.924816  9607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dc81bdfb864e568aba35ed5d9f24dd" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:30.925149 10003 raft_consensus.cc:515] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:30.931034  9804 leader_election.cc:290] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:30.931581  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8d25c4566f4b24986e9c10ae6afa5e" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:30.931468  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aa3eb6cc3047579924350ba3f75d90" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:30.932587 10003 leader_election.cc:290] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
W20260709 13:03:30.944440  9424 leader_election.cc:343] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:30.944873  9729 tablet_bootstrap.cc:492] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:30.945041  9607 raft_consensus.cc:3060] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.945431  9729 ts_tablet_manager.cc:1403] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.179s	user 0.017s	sys 0.013s
I20260709 13:03:30.945868  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aa3eb6cc3047579924350ba3f75d90" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:30.948055  9728 tablet_bootstrap.cc:654] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.948350  9729 raft_consensus.cc:359] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:30.949081  9729 raft_consensus.cc:385] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.949352  9729 raft_consensus.cc:740] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.946103  9737 leader_election.cc:290] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:30.950016  9729 consensus_queue.cc:260] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:30.955732  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dc81bdfb864e568aba35ed5d9f24dd" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:30.956467  9680 raft_consensus.cc:3060] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.958061  9729 ts_tablet_manager.cc:1434] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:03:30.959017  9729 tablet_bootstrap.cc:492] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:30.961416  9573 leader_election.cc:304] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
W20260709 13:03:30.964002  9424 leader_election.cc:343] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:30.964234  9680 raft_consensus.cc:2468] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:30.964543  9424 leader_election.cc:304] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:30.965402  9804 raft_consensus.cc:2749] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:30.961410  9730 tablet_bootstrap.cc:492] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:30.971539  9730 ts_tablet_manager.cc:1403] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.009s
I20260709 13:03:30.972633  9729 tablet_bootstrap.cc:654] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.980562  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a58824acb343fa8f9e1349207a54b1" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:30.985832 10003 raft_consensus.cc:2749] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:30.985855  9730 raft_consensus.cc:359] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:30.991571  9730 raft_consensus.cc:385] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.992035  9730 raft_consensus.cc:740] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.993085  9730 consensus_queue.cc:260] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:30.985999  9422 leader_election.cc:304] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:30.998878 10011 raft_consensus.cc:2804] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:30.999506 10011 raft_consensus.cc:697] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:31.000301 10011 consensus_queue.cc:237] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
W20260709 13:03:30.996331  9424 leader_election.cc:343] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:30.987656  9737 consensus_queue.cc:1048] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:03:30.988233  9533 raft_consensus.cc:3060] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.018751  9730 ts_tablet_manager.cc:1434] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.001s
I20260709 13:03:31.020200  9730 tablet_bootstrap.cc:492] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:30.989555  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a58824acb343fa8f9e1349207a54b1" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:31.038895  9730 tablet_bootstrap.cc:654] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.029013  9682 raft_consensus.cc:2468] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:31.061683  9422 leader_election.cc:304] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:31.065572  9737 raft_consensus.cc:2804] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:31.066020  9737 raft_consensus.cc:493] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.066363  9737 raft_consensus.cc:3060] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.068071  9357 catalog_manager.cc:5697] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:31.072611  9958 consensus_queue.cc:1048] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:31.077149  9727 tablet_bootstrap.cc:492] T 5e8d47fa67d245fb837b1492c15e9766 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:31.077683  9727 ts_tablet_manager.cc:1403] T 5e8d47fa67d245fb837b1492c15e9766 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.297s	user 0.010s	sys 0.022s
I20260709 13:03:31.081344  9727 raft_consensus.cc:359] T 5e8d47fa67d245fb837b1492c15e9766 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:31.082022  9727 raft_consensus.cc:385] T 5e8d47fa67d245fb837b1492c15e9766 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.082298  9727 raft_consensus.cc:740] T 5e8d47fa67d245fb837b1492c15e9766 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.082938  9727 consensus_queue.cc:260] T 5e8d47fa67d245fb837b1492c15e9766 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:31.085196  9727 ts_tablet_manager.cc:1434] T 5e8d47fa67d245fb837b1492c15e9766 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:31.086092  9727 tablet_bootstrap.cc:492] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:31.089166  9729 tablet_bootstrap.cc:492] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:31.089211  9728 tablet_bootstrap.cc:492] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:31.091497  9728 ts_tablet_manager.cc:1403] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.289s	user 0.010s	sys 0.007s
I20260709 13:03:31.098757  9737 raft_consensus.cc:515] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.101928  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a58824acb343fa8f9e1349207a54b1" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:31.102710  9678 raft_consensus.cc:3060] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.103673 10003 raft_consensus.cc:493] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.104219 10003 raft_consensus.cc:515] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:31.107192  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8d47fa67d245fb837b1492c15e9766" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:31.107718  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8d47fa67d245fb837b1492c15e9766" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:31.107923  9532 raft_consensus.cc:2468] T 5e8d47fa67d245fb837b1492c15e9766 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:31.108387  9680 raft_consensus.cc:2468] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:31.109899  9571 leader_election.cc:304] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:31.110891 10004 raft_consensus.cc:2804] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:31.111285 10004 raft_consensus.cc:493] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.111619 10004 raft_consensus.cc:3060] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.089864  9729 ts_tablet_manager.cc:1403] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.131s	user 0.012s	sys 0.004s
I20260709 13:03:31.116149  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a58824acb343fa8f9e1349207a54b1" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
W20260709 13:03:31.117592  9424 leader_election.cc:343] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.118073 10003 leader_election.cc:290] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:31.122507  9737 leader_election.cc:290] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:31.123334 10004 raft_consensus.cc:515] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:31.126593  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8d47fa67d245fb837b1492c15e9766" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:31.127482  9680 raft_consensus.cc:3060] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.109717  9728 raft_consensus.cc:359] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.129891  9728 raft_consensus.cc:385] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.130314  9728 raft_consensus.cc:740] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.126585  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8d47fa67d245fb837b1492c15e9766" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:31.132174  9532 raft_consensus.cc:3060] T 5e8d47fa67d245fb837b1492c15e9766 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.131758  9728 consensus_queue.cc:260] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.128808  9729 raft_consensus.cc:359] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.133630  9729 raft_consensus.cc:385] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.134151  9729 raft_consensus.cc:740] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.137931  9728 ts_tablet_manager.cc:1434] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.002s
I20260709 13:03:31.139307  9678 raft_consensus.cc:2468] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:31.139725  9533 raft_consensus.cc:1275] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Refusing update from remote peer 8bf0e3504c4f46cf8c639da3e15caf68: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:31.140635  9422 leader_election.cc:304] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:31.141201  9680 raft_consensus.cc:2468] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:31.141443 10003 consensus_queue.cc:1048] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:31.142480  9571 leader_election.cc:304] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:31.143155  9804 raft_consensus.cc:2804] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:31.143328 10004 leader_election.cc:290] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:31.143380 10002 raft_consensus.cc:2804] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:31.144114 10002 raft_consensus.cc:697] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:31.144460  9804 raft_consensus.cc:697] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:31.144984 10002 consensus_queue.cc:237] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:31.147874  9728 tablet_bootstrap.cc:492] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:31.150983  9532 raft_consensus.cc:2468] T 5e8d47fa67d245fb837b1492c15e9766 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:31.145390  9804 consensus_queue.cc:237] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.135010  9729 consensus_queue.cc:260] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.155946  9730 tablet_bootstrap.cc:492] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:31.156563  9730 ts_tablet_manager.cc:1403] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.137s	user 0.010s	sys 0.013s
I20260709 13:03:31.161352  9729 ts_tablet_manager.cc:1434] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:03:31.161533  9730 raft_consensus.cc:359] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.162331  9730 raft_consensus.cc:385] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.162429  9729 tablet_bootstrap.cc:492] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:31.162686  9730 raft_consensus.cc:740] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.164085 10004 raft_consensus.cc:493] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.165275 10004 raft_consensus.cc:515] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.170821  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8d25c4566f4b24986e9c10ae6afa5e" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:31.171533  9459 raft_consensus.cc:2468] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 0.
I20260709 13:03:31.173110  9572 leader_election.cc:304] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:31.173964 10003 raft_consensus.cc:2804] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:31.174466 10003 raft_consensus.cc:493] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.174719  9728 tablet_bootstrap.cc:654] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.174834 10003 raft_consensus.cc:3060] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.185722  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8d25c4566f4b24986e9c10ae6afa5e" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
W20260709 13:03:31.187268  9573 leader_election.cc:343] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.187837  9459 raft_consensus.cc:1275] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Refusing update from remote peer 8bf0e3504c4f46cf8c639da3e15caf68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:31.188364 10004 leader_election.cc:290] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:31.189443  9729 tablet_bootstrap.cc:654] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.173648  9730 consensus_queue.cc:260] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.192265 10004 consensus_queue.cc:1048] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:31.193171  9730 ts_tablet_manager.cc:1434] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:03:31.194152  9730 tablet_bootstrap.cc:492] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:31.182762 10003 raft_consensus.cc:515] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.197175  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8d25c4566f4b24986e9c10ae6afa5e" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
W20260709 13:03:31.198596  9573 leader_election.cc:343] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.200418  9728 tablet_bootstrap.cc:492] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:31.200922  9728 ts_tablet_manager.cc:1403] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.002s
I20260709 13:03:31.197206 10003 leader_election.cc:290] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:31.207381  9354 catalog_manager.cc:5697] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.208541  9728 raft_consensus.cc:359] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.209234  9728 raft_consensus.cc:385] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.209496  9728 raft_consensus.cc:740] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.210208  9728 consensus_queue.cc:260] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.210855  9727 tablet_bootstrap.cc:654] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.214057  9730 tablet_bootstrap.cc:654] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.215983  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8d25c4566f4b24986e9c10ae6afa5e" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:31.218528  9457 raft_consensus.cc:3060] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.219815  9728 ts_tablet_manager.cc:1434] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 13:03:31.220819  9728 tablet_bootstrap.cc:492] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:31.226559  9728 tablet_bootstrap.cc:654] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.243952  9728 tablet_bootstrap.cc:492] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:31.244601  9728 ts_tablet_manager.cc:1403] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 13:03:31.249619  9729 tablet_bootstrap.cc:492] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:31.250221  9729 ts_tablet_manager.cc:1403] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.006s
I20260709 13:03:31.243058  9457 raft_consensus.cc:2468] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:31.253960  9729 raft_consensus.cc:359] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.254299  9572 leader_election.cc:304] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:31.254792  9729 raft_consensus.cc:385] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.255043  9727 tablet_bootstrap.cc:492] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:31.255173  9729 raft_consensus.cc:740] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.255168 10004 raft_consensus.cc:2804] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:31.255581  9727 ts_tablet_manager.cc:1403] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.170s	user 0.012s	sys 0.000s
I20260709 13:03:31.256135 10004 raft_consensus.cc:697] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:31.256096  9729 consensus_queue.cc:260] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.250792  9357 catalog_manager.cc:5697] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.258019  9728 raft_consensus.cc:359] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.258764  9728 raft_consensus.cc:385] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.259044  9728 raft_consensus.cc:740] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.259935  9729 ts_tablet_manager.cc:1434] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:03:31.259976  9728 consensus_queue.cc:260] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.260838  9729 tablet_bootstrap.cc:492] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:31.261418  9727 raft_consensus.cc:359] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:31.262169  9727 raft_consensus.cc:385] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.262193  9728 ts_tablet_manager.cc:1434] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:03:31.262681  9727 raft_consensus.cc:740] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.263783  9728 tablet_bootstrap.cc:492] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:31.263509 10004 consensus_queue.cc:237] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.267225  9727 consensus_queue.cc:260] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:31.269764  9727 ts_tablet_manager.cc:1434] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:03:31.274194  9728 tablet_bootstrap.cc:654] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.276430  9727 tablet_bootstrap.cc:492] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:31.279341  9730 tablet_bootstrap.cc:492] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:31.279932  9730 ts_tablet_manager.cc:1403] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.003s
I20260709 13:03:31.283474  9730 raft_consensus.cc:359] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.286612  9727 tablet_bootstrap.cc:654] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.291697  9728 tablet_bootstrap.cc:492] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:31.291685  9730 raft_consensus.cc:385] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.292405  9728 ts_tablet_manager.cc:1403] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.004s
I20260709 13:03:31.292282  9730 raft_consensus.cc:740] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.293741  9730 consensus_queue.cc:260] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.297242  9730 ts_tablet_manager.cc:1434] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:03:31.300005  9730 tablet_bootstrap.cc:492] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:31.296872  9728 raft_consensus.cc:359] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.288285  9729 tablet_bootstrap.cc:654] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.305037  9728 raft_consensus.cc:385] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.305364  9728 raft_consensus.cc:740] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.306074  9728 consensus_queue.cc:260] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.307976  9354 catalog_manager.cc:5697] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:31.311805  9727 tablet_bootstrap.cc:492] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:31.311971  9765 raft_consensus.cc:493] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.313110  9727 ts_tablet_manager.cc:1403] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.009s
I20260709 13:03:31.312949  9765 raft_consensus.cc:515] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.316504  9804 raft_consensus.cc:493] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.314981  9730 tablet_bootstrap.cc:654] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.317003  9804 raft_consensus.cc:515] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.315289  9728 ts_tablet_manager.cc:1434] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:03:31.318578  9728 tablet_bootstrap.cc:492] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:31.319042  9804 leader_election.cc:290] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:31.319577  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6708a2f76d0f4292b01c5bb066f7bcac" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:31.320489  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0d047c0df4036a4702dbc607a318e" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:31.321130  9678 raft_consensus.cc:2468] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:31.317299  9765 leader_election.cc:290] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
W20260709 13:03:31.321161  9646 leader_election.cc:343] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.322693  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6708a2f76d0f4292b01c5bb066f7bcac" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
W20260709 13:03:31.324414  9647 leader_election.cc:343] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.324858  9647 leader_election.cc:304] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:31.326082  9422 leader_election.cc:304] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:31.326877  9765 raft_consensus.cc:2749] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:31.323014  9727 raft_consensus.cc:359] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.328125  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0d047c0df4036a4702dbc607a318e" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:31.331918  9727 raft_consensus.cc:385] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.332777  9727 raft_consensus.cc:740] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.327481  9804 raft_consensus.cc:2804] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:31.333571  9727 consensus_queue.cc:260] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.334123  9804 raft_consensus.cc:493] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:31.333734  9424 leader_election.cc:343] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.334570  9804 raft_consensus.cc:3060] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.324405  9729 tablet_bootstrap.cc:492] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:31.339733  9729 ts_tablet_manager.cc:1403] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.003s
I20260709 13:03:31.331009  9728 tablet_bootstrap.cc:654] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.336061  9727 ts_tablet_manager.cc:1434] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:03:31.353468  9727 tablet_bootstrap.cc:492] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:31.356611  9765 raft_consensus.cc:493] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.357203  9765 raft_consensus.cc:515] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.358390  9730 tablet_bootstrap.cc:492] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:31.359702  9730 ts_tablet_manager.cc:1403] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.006s
I20260709 13:03:31.361004  9607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:31.363413  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:31.364547  9730 raft_consensus.cc:359] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
W20260709 13:03:31.364840  9646 leader_election.cc:343] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.365391  9765 leader_election.cc:290] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:31.367139  9730 raft_consensus.cc:385] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.367863  9730 raft_consensus.cc:740] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.369891  9730 consensus_queue.cc:260] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:31.342947  9729 raft_consensus.cc:359] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.371917  9804 raft_consensus.cc:515] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.372537  9729 raft_consensus.cc:385] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.372848  9729 raft_consensus.cc:740] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.373493  9729 consensus_queue.cc:260] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
W20260709 13:03:31.374101  9647 leader_election.cc:343] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.374511  9804 leader_election.cc:290] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:31.375658  9729 ts_tablet_manager.cc:1434] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:03:31.377261  9729 tablet_bootstrap.cc:492] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:31.377784  9728 tablet_bootstrap.cc:492] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:31.378252  9728 ts_tablet_manager.cc:1403] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.005s
I20260709 13:03:31.380095  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0d047c0df4036a4702dbc607a318e" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
W20260709 13:03:31.381772  9424 leader_election.cc:343] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.381853  9728 raft_consensus.cc:359] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.374552  9647 leader_election.cc:304] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:31.370489  9727 tablet_bootstrap.cc:654] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.383262  9765 raft_consensus.cc:2749] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:31.385223  9730 ts_tablet_manager.cc:1434] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:03:31.386529  9730 tablet_bootstrap.cc:492] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:31.389991  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0d047c0df4036a4702dbc607a318e" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:31.390679  9680 raft_consensus.cc:3060] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.392331  9765 raft_consensus.cc:493] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.392885  9765 raft_consensus.cc:515] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:31.393347  9804 raft_consensus.cc:493] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.394057  9804 raft_consensus.cc:515] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.394903  9765 leader_election.cc:290] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:31.397097  9804 leader_election.cc:290] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:31.397254  9607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134aecc79f7c4b398afcbf65000e3267" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
W20260709 13:03:31.398922  9424 leader_election.cc:343] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.399610  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169b723604b749b1b0d240d60266f922" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:31.401149  9804 raft_consensus.cc:493] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.401777  9804 raft_consensus.cc:515] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.403502  9607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169b723604b749b1b0d240d60266f922" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:31.404384  9804 leader_election.cc:290] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:31.405184  9970 raft_consensus.cc:493] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.405687  9970 raft_consensus.cc:515] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:31.407334  9729 tablet_bootstrap.cc:654] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.408118  9680 raft_consensus.cc:2468] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:31.382630  9728 raft_consensus.cc:385] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.410951  9728 raft_consensus.cc:740] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.411365  9804 raft_consensus.cc:493] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.412240  9607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d264be487e49f2b6cc37fefe738369" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:31.412065  9804 raft_consensus.cc:515] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.412452  9728 consensus_queue.cc:260] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.414300  9804 leader_election.cc:290] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:31.415723  9970 leader_election.cc:290] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
W20260709 13:03:31.415905  9499 leader_election.cc:343] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.417708  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aceba3614aec44bd97d0a2111129bae4" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:31.418279  9605 raft_consensus.cc:2468] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:31.419171  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03595cf8245743e5984b4c937130e90a" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:31.419402  9424 leader_election.cc:304] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:31.420356  9804 raft_consensus.cc:2804] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:31.420791  9804 raft_consensus.cc:493] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.421186  9804 raft_consensus.cc:3060] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.426608  9607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03595cf8245743e5984b4c937130e90a" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:31.428917  9804 raft_consensus.cc:515] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.431422  9804 leader_election.cc:290] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:31.433023  9728 ts_tablet_manager.cc:1434] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.004s
I20260709 13:03:31.435943  9728 tablet_bootstrap.cc:492] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:31.437361  9607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aceba3614aec44bd97d0a2111129bae4" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:31.436744  9730 tablet_bootstrap.cc:654] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.438042  9607 raft_consensus.cc:3060] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.439395  9765 raft_consensus.cc:493] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.439893  9765 raft_consensus.cc:515] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.442905  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0dfcbdce939448eaaae078332420bfa" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
W20260709 13:03:31.444442  9646 leader_election.cc:343] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.445771  9765 leader_election.cc:290] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:31.448084  9727 tablet_bootstrap.cc:492] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:31.448452  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134aecc79f7c4b398afcbf65000e3267" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:31.448691  9727 ts_tablet_manager.cc:1403] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.095s	user 0.026s	sys 0.044s
I20260709 13:03:31.449127  9680 raft_consensus.cc:2468] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
W20260709 13:03:31.439893  9424 leader_election.cc:343] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.450030  9728 tablet_bootstrap.cc:654] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.451879  9727 raft_consensus.cc:359] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.452652  9727 raft_consensus.cc:385] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.452991  9727 raft_consensus.cc:740] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.453882  9727 consensus_queue.cc:260] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
W20260709 13:03:31.454907  9424 leader_election.cc:343] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.455417  9424 leader_election.cc:304] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:31.456593  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aceba3614aec44bd97d0a2111129bae4" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:31.457206  9680 raft_consensus.cc:2468] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:31.460484  9727 ts_tablet_manager.cc:1434] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:03:31.461573  9727 tablet_bootstrap.cc:492] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:31.461755  9730 tablet_bootstrap.cc:492] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:31.462445  9730 ts_tablet_manager.cc:1403] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.005s
I20260709 13:03:31.466097  9730 raft_consensus.cc:359] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.468173  9727 tablet_bootstrap.cc:654] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.458743  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aceba3614aec44bd97d0a2111129bae4" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:31.469561  9680 raft_consensus.cc:3060] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.467051  9730 raft_consensus.cc:385] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.473524  9730 raft_consensus.cc:740] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.475755  9728 tablet_bootstrap.cc:492] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:31.476578  9728 ts_tablet_manager.cc:1403] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.013s
I20260709 13:03:31.475155  9422 leader_election.cc:304] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:31.477587  9804 raft_consensus.cc:2804] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:31.478016  9804 raft_consensus.cc:697] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:31.478724  9804 consensus_queue.cc:237] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.479480  9728 raft_consensus.cc:359] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.480121  9728 raft_consensus.cc:385] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.480379  9728 raft_consensus.cc:740] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.481248  9730 consensus_queue.cc:260] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.482349  9728 consensus_queue.cc:260] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.485038  9728 ts_tablet_manager.cc:1434] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:03:31.485947  9728 tablet_bootstrap.cc:492] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:31.491605 10011 raft_consensus.cc:2749] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:31.494525  9730 ts_tablet_manager.cc:1434] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:03:31.495589  9730 tablet_bootstrap.cc:492] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:31.497278  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0dfcbdce939448eaaae078332420bfa" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:31.503783  9357 catalog_manager.cc:5697] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.504987  9730 tablet_bootstrap.cc:654] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.515641  9728 tablet_bootstrap.cc:654] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.520373  9727 tablet_bootstrap.cc:492] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:31.520956  9727 ts_tablet_manager.cc:1403] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.005s
I20260709 13:03:31.523670  9727 raft_consensus.cc:359] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.524428  9727 raft_consensus.cc:385] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.524753  9727 raft_consensus.cc:740] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.525617  9727 consensus_queue.cc:260] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.527846  9727 ts_tablet_manager.cc:1434] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:31.528786  9727 tablet_bootstrap.cc:492] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:31.534251  9765 raft_consensus.cc:493] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.535002  9765 raft_consensus.cc:515] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:31.538044  9727 tablet_bootstrap.cc:654] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.537868  9765 leader_election.cc:290] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:31.552618  9728 tablet_bootstrap.cc:492] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:31.553184  9728 ts_tablet_manager.cc:1403] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.067s	user 0.007s	sys 0.007s
I20260709 13:03:31.557288  9730 tablet_bootstrap.cc:492] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:31.557945  9730 ts_tablet_manager.cc:1403] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.004s
I20260709 13:03:31.558494  9804 raft_consensus.cc:493] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.558997  9804 raft_consensus.cc:515] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.560892  9804 leader_election.cc:290] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:31.560827  9728 raft_consensus.cc:359] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.561827  9728 raft_consensus.cc:385] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.562114  9728 raft_consensus.cc:740] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.563696  9730 raft_consensus.cc:359] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.564429  9730 raft_consensus.cc:385] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.564699  9730 raft_consensus.cc:740] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.565327  9730 consensus_queue.cc:260] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.579483  9422 leader_election.cc:304] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:31.581087  9804 raft_consensus.cc:2804] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:31.581182  9727 tablet_bootstrap.cc:492] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:31.581518  9804 raft_consensus.cc:493] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.581907  9727 ts_tablet_manager.cc:1403] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.053s	user 0.027s	sys 0.009s
I20260709 13:03:31.581878  9804 raft_consensus.cc:3060] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.585104  9727 raft_consensus.cc:359] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.585852  9727 raft_consensus.cc:385] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.586162  9727 raft_consensus.cc:740] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.586920  9727 consensus_queue.cc:260] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.589260  9727 ts_tablet_manager.cc:1434] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:03:31.583113  9728 consensus_queue.cc:260] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.589993  9730 ts_tablet_manager.cc:1434] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:03:31.593708  9804 raft_consensus.cc:515] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.590358  9727 tablet_bootstrap.cc:492] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:31.602787  9970 raft_consensus.cc:493] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.597225  9728 ts_tablet_manager.cc:1434] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:03:31.591040  9730 tablet_bootstrap.cc:492] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5: Bootstrap starting.
I20260709 13:03:31.603403  9970 raft_consensus.cc:515] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.606844  9970 leader_election.cc:290] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:31.608641  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8d25c4566f4b24986e9c10ae6afa5e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:31.609951  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8d25c4566f4b24986e9c10ae6afa5e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:31.610731  9457 raft_consensus.cc:2393] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7610e18c23c543f1a31b6d851bac1bb2 in current term 1: Already voted for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in this term.
I20260709 13:03:31.612473  9728 tablet_bootstrap.cc:492] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:31.618897  9728 tablet_bootstrap.cc:654] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.624897  9498 leader_election.cc:304] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:31.622556  9727 tablet_bootstrap.cc:654] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.625046  9730 tablet_bootstrap.cc:654] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.634236 10003 consensus_queue.cc:1048] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:31.637245  9739 raft_consensus.cc:3060] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.669524  9737 raft_consensus.cc:493] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.670228  9737 raft_consensus.cc:515] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.674015  9737 leader_election.cc:290] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:31.681185 10069 raft_consensus.cc:493] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.684664 10069 raft_consensus.cc:515] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.689910  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03595cf8245743e5984b4c937130e90a" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:31.690748  9459 raft_consensus.cc:2468] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:31.692080  9498 leader_election.cc:304] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
W20260709 13:03:31.694650  9404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:31.687337  9728 tablet_bootstrap.cc:492] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:31.697896  9728 ts_tablet_manager.cc:1403] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.005s
I20260709 13:03:31.700673  9728 raft_consensus.cc:359] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.701341  9728 raft_consensus.cc:385] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.701617  9728 raft_consensus.cc:740] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.702392 10003 raft_consensus.cc:493] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.702224  9728 consensus_queue.cc:260] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.696476 10069 leader_election.cc:290] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:31.702881 10003 raft_consensus.cc:515] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.703507 10069 raft_consensus.cc:2804] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:31.703884 10069 raft_consensus.cc:493] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.704219 10069 raft_consensus.cc:3060] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.705190 10003 leader_election.cc:290] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:31.708415  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dc81bdfb864e568aba35ed5d9f24dd" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:31.709506  9678 raft_consensus.cc:2393] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8bf0e3504c4f46cf8c639da3e15caf68 in current term 1: Already voted for candidate 04edfe53c70f45e09190743b636a705f in this term.
I20260709 13:03:31.715368  9765 raft_consensus.cc:493] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.715953  9765 raft_consensus.cc:515] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:31.717865  9765 leader_election.cc:290] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:31.721004  9728 ts_tablet_manager.cc:1434] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:03:31.722162  9728 tablet_bootstrap.cc:492] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:31.729421 10069 raft_consensus.cc:515] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.734174  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03595cf8245743e5984b4c937130e90a" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:31.600107  9804 leader_election.cc:290] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:31.738893  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dc81bdfb864e568aba35ed5d9f24dd" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:31.741855 10070 consensus_queue.cc:1048] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:03:31.743553 10002 consensus_queue.cc:1048] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:03:31.744959  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03595cf8245743e5984b4c937130e90a" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:31.779695  9459 raft_consensus.cc:3060] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.785413  9532 raft_consensus.cc:3060] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.789201  9459 raft_consensus.cc:2468] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:31.749688 10069 leader_election.cc:290] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:31.770345  9728 tablet_bootstrap.cc:654] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.771066  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2155d805d55a413c9f51874ce70d88b8" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:31.776351  9804 raft_consensus.cc:493] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.790328  9498 leader_election.cc:304] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:31.798002  9804 raft_consensus.cc:515] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.798833 10069 raft_consensus.cc:2804] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:31.799593 10069 raft_consensus.cc:697] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:31.800629 10069 consensus_queue.cc:237] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.811921  9728 tablet_bootstrap.cc:492] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:31.812475  9728 ts_tablet_manager.cc:1403] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.003s
I20260709 13:03:31.815277  9728 raft_consensus.cc:359] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.815984  9728 raft_consensus.cc:385] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.816263  9728 raft_consensus.cc:740] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.820389  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d264be487e49f2b6cc37fefe738369" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:31.821298  9682 raft_consensus.cc:2468] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:31.822034  9728 consensus_queue.cc:260] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:31.833418 10077 raft_consensus.cc:493] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.834041  9728 ts_tablet_manager.cc:1434] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:03:31.849553  9739 raft_consensus.cc:2749] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:31.850423  9728 tablet_bootstrap.cc:492] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:31.844699 10077 raft_consensus.cc:515] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:31.872285  9727 tablet_bootstrap.cc:492] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:31.872793  9727 ts_tablet_manager.cc:1403] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.283s	user 0.014s	sys 0.000s
I20260709 13:03:31.872303  9729 tablet_bootstrap.cc:492] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:31.873772 10077 leader_election.cc:290] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:31.856631  9804 leader_election.cc:290] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:31.842463  9572 leader_election.cc:304] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:31.856297  9354 catalog_manager.cc:5697] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.857673  9730 tablet_bootstrap.cc:492] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5: No bootstrap required, opened a new log
I20260709 13:03:31.875818  9730 ts_tablet_manager.cc:1403] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5: Time spent bootstrapping tablet: real 0.285s	user 0.024s	sys 0.021s
I20260709 13:03:31.876296 10004 raft_consensus.cc:3060] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.878597 10002 consensus_queue.cc:1048] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:31.881026  9603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134aecc79f7c4b398afcbf65000e3267" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:31.883673  9604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2155d805d55a413c9f51874ce70d88b8" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:31.884581  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03595cf8245743e5984b4c937130e90a" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
W20260709 13:03:31.866837  9424 leader_election.cc:343] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.866705  9958 consensus_queue.cc:1048] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:31.884838 10004 raft_consensus.cc:2749] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:31.873814  9729 ts_tablet_manager.cc:1403] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.497s	user 0.128s	sys 0.167s
I20260709 13:03:31.889635  9728 tablet_bootstrap.cc:654] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.886947  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0d047c0df4036a4702dbc607a318e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:31.892535  9729 raft_consensus.cc:359] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.892675  9730 raft_consensus.cc:359] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.893486  9730 raft_consensus.cc:385] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.893769  9730 raft_consensus.cc:740] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.868909  9607 raft_consensus.cc:2468] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
W20260709 13:03:31.898104  9424 leader_election.cc:343] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.899222  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:31.483052  9680 raft_consensus.cc:2468] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
W20260709 13:03:31.869639  9647 leader_election.cc:343] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:31.900906  9424 leader_election.cc:343] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:31.901232  9647 leader_election.cc:343] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.893332  9729 raft_consensus.cc:385] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.901856  9647 leader_election.cc:304] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:31.902164  9729 raft_consensus.cc:740] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.903245  9755 raft_consensus.cc:2749] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:31.903864  9729 consensus_queue.cc:260] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
W20260709 13:03:31.904874  9647 leader_election.cc:343] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.906147  9727 raft_consensus.cc:359] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:31.906486  9647 leader_election.cc:304] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:31.906869  9727 raft_consensus.cc:385] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.907197  9727 raft_consensus.cc:740] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.907384  9755 raft_consensus.cc:2749] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:31.907660  9729 ts_tablet_manager.cc:1434] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:03:31.907902  9727 consensus_queue.cc:260] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:31.908613  9729 tablet_bootstrap.cc:492] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:31.909924  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d264be487e49f2b6cc37fefe738369" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:31.910538  9531 raft_consensus.cc:2468] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 0.
I20260709 13:03:31.911629  9497 leader_election.cc:304] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:31.901432  9424 leader_election.cc:304] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:31.913151  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247add59d191431987b50b009849ee54" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:31.913792 10069 raft_consensus.cc:2804] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:31.914188 10069 raft_consensus.cc:493] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.914518 10069 raft_consensus.cc:3060] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.915439  9958 raft_consensus.cc:2749] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:31.916754  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6708a2f76d0f4292b01c5bb066f7bcac" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:31.917383  9424 leader_election.cc:304] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:31.917696  9804 raft_consensus.cc:493] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:31.857983  9499 leader_election.cc:343] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.918942  9804 raft_consensus.cc:515] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
W20260709 13:03:31.919425  9499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45605, user_credentials={real_user=slave}} blocked reactor thread for 61519.6us
I20260709 13:03:31.920825  9804 leader_election.cc:290] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
W20260709 13:03:31.922478  9424 leader_election.cc:343] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.923398  9958 raft_consensus.cc:2804] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:31.924242  9958 raft_consensus.cc:697] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:31.925185  9958 consensus_queue.cc:237] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.894495  9730 consensus_queue.cc:260] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:31.938350  9679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134aecc79f7c4b398afcbf65000e3267" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:31.939000  9679 raft_consensus.cc:3060] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.941653  9730 ts_tablet_manager.cc:1434] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5: Time spent starting tablet: real 0.066s	user 0.004s	sys 0.002s
W20260709 13:03:31.942031  9424 leader_election.cc:343] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.945274 10069 raft_consensus.cc:515] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
W20260709 13:03:31.947127  9499 leader_election.cc:343] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.948177  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:31.948815  9682 raft_consensus.cc:2468] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:31.949766  9607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d264be487e49f2b6cc37fefe738369" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:31.949988 10003 consensus_queue.cc:1048] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:31.950716  9727 ts_tablet_manager.cc:1434] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
I20260709 13:03:31.949827  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190b9b4fa544118981626f9985e1276" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:31.953207  9729 tablet_bootstrap.cc:654] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.953719  9727 tablet_bootstrap.cc:492] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:31.954417  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247add59d191431987b50b009849ee54" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:31.961966  9679 raft_consensus.cc:2468] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:31.963495  9530 raft_consensus.cc:3060] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.980077  9728 tablet_bootstrap.cc:492] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:31.983592  9728 ts_tablet_manager.cc:1403] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.133s	user 0.014s	sys 0.005s
I20260709 13:03:32.003153  9676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6708a2f76d0f4292b01c5bb066f7bcac" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:32.003921  9676 raft_consensus.cc:2468] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:32.012585  9737 consensus_queue.cc:1048] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:32.018587  9424 leader_election.cc:343] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.026448  9727 tablet_bootstrap.cc:654] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.045342 10011 consensus_queue.cc:1048] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:03:32.043079  9728 raft_consensus.cc:359] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:32.057266  9728 raft_consensus.cc:385] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.037176  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d264be487e49f2b6cc37fefe738369" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:32.058310  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0d047c0df4036a4702dbc607a318e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:32.058435  9728 raft_consensus.cc:740] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.058733 10011 consensus_queue.cc:1048] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:32.054927 10069 leader_election.cc:290] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:32.059880  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190b9b4fa544118981626f9985e1276" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
W20260709 13:03:32.061666  9499 leader_election.cc:343] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.059095  9680 raft_consensus.cc:2393] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7610e18c23c543f1a31b6d851bac1bb2 in current term 1: Already voted for candidate 04edfe53c70f45e09190743b636a705f in this term.
I20260709 13:03:32.061014  9728 consensus_queue.cc:260] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
W20260709 13:03:32.047426  9647 leader_election.cc:343] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.078946  9728 ts_tablet_manager.cc:1434] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.095s	user 0.009s	sys 0.000s
I20260709 13:03:32.075527  9682 raft_consensus.cc:2468] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
W20260709 13:03:32.125972  9647 leader_election.cc:343] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:32.153415 10084 log.cc:927] Time spent T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f: Append to log took a long time: real 0.084s	user 0.003s	sys 0.000s
W20260709 13:03:32.158862  9422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:41541, user_credentials={real_user=slave}} blocked reactor thread for 114967us
I20260709 13:03:32.165505  9727 tablet_bootstrap.cc:492] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:32.166239  9727 ts_tablet_manager.cc:1403] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.213s	user 0.019s	sys 0.005s
I20260709 13:03:32.161374  9422 leader_election.cc:304] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:32.170209  9422 leader_election.cc:304] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:32.171767  9422 leader_election.cc:304] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2
W20260709 13:03:32.178144 10087 log.cc:927] Time spent T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:03:32.174793 10011 raft_consensus.cc:2804] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:32.184393 10011 raft_consensus.cc:697] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:32.185277 10011 consensus_queue.cc:237] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:32.173849  9958 raft_consensus.cc:2804] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:32.187500  9958 raft_consensus.cc:493] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.187850  9958 raft_consensus.cc:3060] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.192390  9804 raft_consensus.cc:493] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.192955  9804 raft_consensus.cc:515] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:32.193802  9729 tablet_bootstrap.cc:492] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:32.194324  9729 ts_tablet_manager.cc:1403] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.286s	user 0.020s	sys 0.009s
I20260709 13:03:32.194890  9804 leader_election.cc:290] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:32.197052  9728 tablet_bootstrap.cc:492] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:32.200762  9737 raft_consensus.cc:2804] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:32.201263  9737 raft_consensus.cc:493] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.201165  9729 raft_consensus.cc:359] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:32.201721  9737 raft_consensus.cc:3060] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.201999  9729 raft_consensus.cc:385] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.202330  9729 raft_consensus.cc:740] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.205848  9729 consensus_queue.cc:260] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:32.213565  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2167c25a8fe74cf9b28526359b63c3b4" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
W20260709 13:03:32.215971  9424 leader_election.cc:343] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.237478  9729 ts_tablet_manager.cc:1434] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
W20260709 13:03:32.205572  9571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:41541, user_credentials={real_user=slave}} blocked reactor thread for 56635.7us
I20260709 13:03:32.240857 10002 raft_consensus.cc:493] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.241492 10002 raft_consensus.cc:515] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
W20260709 13:03:32.244803  9499 consensus_peers.cc:597] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.246701  9647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:34349, user_credentials={real_user=slave}} blocked reactor thread for 119757us
I20260709 13:03:32.247396  9647 leader_election.cc:304] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:32.239216  9729 tablet_bootstrap.cc:492] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
W20260709 13:03:32.251770  9647 leader_election.cc:343] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.252250  9647 leader_election.cc:304] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:32.254720  9737 raft_consensus.cc:515] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
W20260709 13:03:32.264972 10089 log.cc:927] Time spent T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:03:32.265594 10091 raft_consensus.cc:493] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.266160 10091 raft_consensus.cc:515] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:32.268102  9765 raft_consensus.cc:2749] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:32.277045  9728 tablet_bootstrap.cc:654] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.250119  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2167c25a8fe74cf9b28526359b63c3b4" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:32.283504  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134aecc79f7c4b398afcbf65000e3267" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:32.251467  9755 raft_consensus.cc:2804] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:32.285218  9755 raft_consensus.cc:493] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.285585  9755 raft_consensus.cc:3060] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.296646  9737 leader_election.cc:290] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
W20260709 13:03:32.256397  9573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:34349, user_credentials={real_user=slave}} blocked reactor thread for 108225us
I20260709 13:03:32.315016  9958 raft_consensus.cc:515] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:32.317312  9958 leader_election.cc:290] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:32.270303 10002 leader_election.cc:290] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:32.325402  9727 raft_consensus.cc:359] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:32.326192  9727 raft_consensus.cc:385] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.326445  9727 raft_consensus.cc:740] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.327137  9727 consensus_queue.cc:260] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:32.274353  9677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134aecc79f7c4b398afcbf65000e3267" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:32.330931  9677 raft_consensus.cc:2393] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8bf0e3504c4f46cf8c639da3e15caf68 in current term 1: Already voted for candidate 04edfe53c70f45e09190743b636a705f in this term.
I20260709 13:03:32.332088  9571 leader_election.cc:304] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:32.344630  9727 ts_tablet_manager.cc:1434] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.178s	user 0.008s	sys 0.000s
I20260709 13:03:32.346014  9727 tablet_bootstrap.cc:492] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:32.378690  9729 tablet_bootstrap.cc:654] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.379221  9739 raft_consensus.cc:493] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.400959  9739 raft_consensus.cc:515] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:32.402786  9727 tablet_bootstrap.cc:654] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.403847 10091 leader_election.cc:290] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
W20260709 13:03:32.407418  9571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:41541, user_credentials={real_user=slave}} blocked reactor thread for 75461.6us
I20260709 13:03:32.389043 10002 raft_consensus.cc:3060] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.374351  9755 raft_consensus.cc:515] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:32.411367 10004 raft_consensus.cc:493] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.411824 10004 raft_consensus.cc:515] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:32.412935  9755 leader_election.cc:290] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:32.418007  9680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d264be487e49f2b6cc37fefe738369" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:32.418787  9680 raft_consensus.cc:2393] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8bf0e3504c4f46cf8c639da3e15caf68 in current term 1: Already voted for candidate eaba2f78a9274147a783ffa321939ed5 in this term.
I20260709 13:03:32.426227  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4f7949313a47fc9f7a799ef17d9999" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:32.428683 10075 consensus_queue.cc:1048] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:32.429921 10002 raft_consensus.cc:2749] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:32.435210 10004 leader_election.cc:290] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:32.440212  9739 leader_election.cc:290] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
W20260709 13:03:32.436283  9499 leader_election.cc:343] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.450260  9728 tablet_bootstrap.cc:492] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:32.450879  9728 ts_tablet_manager.cc:1403] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.254s	user 0.019s	sys 0.013s
W20260709 13:03:32.451467  9424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45605, user_credentials={real_user=slave}} blocked reactor thread for 187401us
I20260709 13:03:32.454278  9728 raft_consensus.cc:359] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:32.455030  9728 raft_consensus.cc:385] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.456192  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6708a2f76d0f4292b01c5bb066f7bcac" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:32.456558  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:32.456851  9727 tablet_bootstrap.cc:492] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:32.458611  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0dfcbdce939448eaaae078332420bfa" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:32.470105  9727 ts_tablet_manager.cc:1403] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.002s
I20260709 13:03:32.469357  9728 raft_consensus.cc:740] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.461153  9739 raft_consensus.cc:493] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.470885  9739 raft_consensus.cc:515] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:32.472007  9533 raft_consensus.cc:3060] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.473063  9727 raft_consensus.cc:359] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:32.473771  9727 raft_consensus.cc:385] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.474017  9727 raft_consensus.cc:740] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.470955  9728 consensus_queue.cc:260] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:32.476792  9728 ts_tablet_manager.cc:1434] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.001s
I20260709 13:03:32.474668  9727 consensus_queue.cc:260] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:32.477768  9728 tablet_bootstrap.cc:492] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:32.479305  9727 ts_tablet_manager.cc:1434] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:32.481848  9739 leader_election.cc:290] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
W20260709 13:03:32.484218  9573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:34349, user_credentials={real_user=slave}} blocked reactor thread for 73392.5us
I20260709 13:03:32.490461  9533 raft_consensus.cc:2468] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:32.485596  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6708a2f76d0f4292b01c5bb066f7bcac" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:32.491469  9457 raft_consensus.cc:2393] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7610e18c23c543f1a31b6d851bac1bb2 in current term 1: Already voted for candidate 04edfe53c70f45e09190743b636a705f in this term.
I20260709 13:03:32.486003  9729 tablet_bootstrap.cc:492] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:32.492614  9729 ts_tablet_manager.cc:1403] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.254s	user 0.014s	sys 0.005s
I20260709 13:03:32.467885  9354 catalog_manager.cc:5697] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:32.493186  9647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:34349, user_credentials={real_user=slave}} blocked reactor thread for 241550us
I20260709 13:03:32.494702  9728 tablet_bootstrap.cc:654] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.495273  9422 leader_election.cc:304] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:32.496171  9804 raft_consensus.cc:2804] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:32.496523  9804 raft_consensus.cc:493] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.496827  9804 raft_consensus.cc:3060] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.497517  9755 raft_consensus.cc:493] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.498148 10100 raft_consensus.cc:493] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.497997  9755 raft_consensus.cc:515] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:32.498780 10100 raft_consensus.cc:515] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:32.499190  9497 leader_election.cc:304] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:32.501199 10100 leader_election.cc:290] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:32.502355  9755 leader_election.cc:290] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:32.503458  9607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d264be487e49f2b6cc37fefe738369" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:32.505548  9607 raft_consensus.cc:3060] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.503082  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d264be487e49f2b6cc37fefe738369" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:32.514029  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6708a2f76d0f4292b01c5bb066f7bcac" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:32.514662  9682 raft_consensus.cc:3060] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.514113  9534 raft_consensus.cc:2393] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eaba2f78a9274147a783ffa321939ed5 in current term 1: Already voted for candidate 7610e18c23c543f1a31b6d851bac1bb2 in this term.
I20260709 13:03:32.516170  9729 raft_consensus.cc:359] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:32.516871  9729 raft_consensus.cc:385] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.515077 10075 raft_consensus.cc:2749] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:32.517120  9456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e29bfdaf3d4298afcb82e5edf9d136" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:32.517863  9456 raft_consensus.cc:2468] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 0.
I20260709 13:03:32.519305  9646 leader_election.cc:304] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:32.524940  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d264be487e49f2b6cc37fefe738369" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:32.525270 10100 raft_consensus.cc:2804] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:32.525849  9532 raft_consensus.cc:2393] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8bf0e3504c4f46cf8c639da3e15caf68 in current term 1: Already voted for candidate 7610e18c23c543f1a31b6d851bac1bb2 in this term.
I20260709 13:03:32.525797 10100 raft_consensus.cc:493] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.526392 10100 raft_consensus.cc:3060] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.528065  9727 tablet_bootstrap.cc:492] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:32.535888  9607 raft_consensus.cc:2468] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
I20260709 13:03:32.529055  9682 raft_consensus.cc:2468] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
W20260709 13:03:32.538951  9424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:34349, user_credentials={real_user=slave}} blocked reactor thread for 45935us
W20260709 13:03:32.539875  9424 leader_election.cc:343] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.540310  9424 leader_election.cc:304] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:32.540994 10103 raft_consensus.cc:2749] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:32.543805  9677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:32.544466  9677 raft_consensus.cc:3060] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:32.544766  9424 leader_election.cc:343] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.517148  9729 raft_consensus.cc:740] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.550376  9729 consensus_queue.cc:260] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:32.538516  9804 raft_consensus.cc:515] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:32.553479  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdb62158e6b4a6989246318d3d25d7c" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:32.547650  9573 leader_election.cc:304] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5
W20260709 13:03:32.556464  9646 leader_election.cc:343] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.556499  9679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0dfcbdce939448eaaae078332420bfa" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:32.557302  9679 raft_consensus.cc:2468] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:32.558575  9354 catalog_manager.cc:5697] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:32.575032  9424 leader_election.cc:343] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.581157  9424 leader_election.cc:304] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:32.592047  9804 leader_election.cc:290] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:32.596443  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190b9b4fa544118981626f9985e1276" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:32.596648 10097 raft_consensus.cc:2749] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:32.594985 10011 consensus_queue.cc:1048] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:32.597628  9674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d264be487e49f2b6cc37fefe738369" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:32.598467  9674 raft_consensus.cc:2393] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7610e18c23c543f1a31b6d851bac1bb2 in current term 1: Already voted for candidate eaba2f78a9274147a783ffa321939ed5 in this term.
I20260709 13:03:32.599124 10101 raft_consensus.cc:2804] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:32.601788 10101 raft_consensus.cc:697] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:32.602713 10101 consensus_queue.cc:237] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:32.603617  9679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6708a2f76d0f4292b01c5bb066f7bcac" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:32.604447  9679 raft_consensus.cc:2393] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7610e18c23c543f1a31b6d851bac1bb2 in current term 1: Already voted for candidate 04edfe53c70f45e09190743b636a705f in this term.
W20260709 13:03:32.601459  9424 leader_election.cc:343] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.601186  9729 ts_tablet_manager.cc:1434] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.000s
I20260709 13:03:32.606753  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e29bfdaf3d4298afcb82e5edf9d136" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:32.567793  9677 raft_consensus.cc:2468] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:32.613399  9422 leader_election.cc:304] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:32.615586  9737 consensus_queue.cc:1048] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:32.619815  9647 leader_election.cc:304] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2
W20260709 13:03:32.591260  9573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:34349, user_credentials={real_user=slave}} blocked reactor thread for 43700.3us
I20260709 13:03:32.622737  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4f7949313a47fc9f7a799ef17d9999" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:32.630203  9682 raft_consensus.cc:2468] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:32.615249 10091 raft_consensus.cc:2804] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:32.635206  9729 tablet_bootstrap.cc:492] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:32.650739  9727 tablet_bootstrap.cc:654] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.639782  9765 raft_consensus.cc:2804] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:32.634696 10091 raft_consensus.cc:493] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.652238  9604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdb62158e6b4a6989246318d3d25d7c" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:32.659865 10091 raft_consensus.cc:3060] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.663369  9765 raft_consensus.cc:697] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:32.664638  9497 leader_election.cc:304] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2; no voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:32.665542  9739 raft_consensus.cc:2749] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:32.664672  9765 consensus_queue.cc:237] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:32.671614  9728 tablet_bootstrap.cc:492] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:32.672240  9728 ts_tablet_manager.cc:1403] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.195s	user 0.035s	sys 0.030s
I20260709 13:03:32.620654 10103 consensus_queue.cc:1048] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:03:32.676525 10100 raft_consensus.cc:515] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:32.678784 10100 leader_election.cc:290] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:32.680207  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e29bfdaf3d4298afcb82e5edf9d136" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:32.680881  9458 raft_consensus.cc:3060] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.682727  9958 consensus_queue.cc:1048] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:32.686671  9647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45605, user_credentials={real_user=slave}} blocked reactor thread for 66997.5us
I20260709 13:03:32.691772  9422 leader_election.cc:304] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
W20260709 13:03:32.697603  9647 leader_election.cc:343] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.699386  9497 leader_election.cc:304] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:32.699712  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190b9b4fa544118981626f9985e1276" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
W20260709 13:03:32.701033  9647 leader_election.cc:343] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.705345  9647 leader_election.cc:304] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:32.710503  9728 raft_consensus.cc:359] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:32.711475  9728 raft_consensus.cc:385] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.711793  9728 raft_consensus.cc:740] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.712451  9728 consensus_queue.cc:260] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:32.714995  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e29bfdaf3d4298afcb82e5edf9d136" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
W20260709 13:03:32.722718  9647 leader_election.cc:343] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.720252 10080 raft_consensus.cc:2749] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:32.726477  9728 ts_tablet_manager.cc:1434] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:03:32.704900 10103 raft_consensus.cc:2804] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:32.727823  9728 tablet_bootstrap.cc:492] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:32.721029  9681 raft_consensus.cc:3060] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.711318 10100 raft_consensus.cc:2749] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:32.727319  9497 leader_election.cc:304] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:32.742581 10103 raft_consensus.cc:697] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:32.760987 10077 raft_consensus.cc:2804] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:32.763324 10103 consensus_queue.cc:237] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:32.763679 10091 raft_consensus.cc:515] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:32.763191 10077 raft_consensus.cc:493] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.765467 10077 raft_consensus.cc:3060] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.762288  9729 tablet_bootstrap.cc:654] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.746043  9458 raft_consensus.cc:2468] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
W20260709 13:03:32.797098  9404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:32.805722  9605 raft_consensus.cc:3060] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.806641  9646 leader_election.cc:304] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:32.823691  9728 tablet_bootstrap.cc:654] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.829136 10094 raft_consensus.cc:2804] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:32.829957 10094 raft_consensus.cc:697] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:32.836171 10091 leader_election.cc:290] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:32.838469  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0dfcbdce939448eaaae078332420bfa" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:32.843318  9682 raft_consensus.cc:3060] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.831099 10094 consensus_queue.cc:237] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:32.873034 10091 consensus_queue.cc:1048] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:32.878180  9681 raft_consensus.cc:2468] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:32.879933 10091 raft_consensus.cc:493] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.890969  9739 raft_consensus.cc:493] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.891707  9739 raft_consensus.cc:515] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:32.895012  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2167c25a8fe74cf9b28526359b63c3b4" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:32.895654  9458 raft_consensus.cc:2468] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:32.896601  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0dfcbdce939448eaaae078332420bfa" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:32.897270  9498 leader_election.cc:304] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:32.898705 10069 raft_consensus.cc:2804] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:32.899307 10069 raft_consensus.cc:493] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.899763 10069 raft_consensus.cc:3060] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.904377  9422 leader_election.cc:304] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:32.905459  9727 tablet_bootstrap.cc:492] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:32.905980  9727 ts_tablet_manager.cc:1403] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.378s	user 0.008s	sys 0.024s
I20260709 13:03:32.906056 10070 raft_consensus.cc:2804] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:32.906877 10070 raft_consensus.cc:697] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:32.907833 10070 consensus_queue.cc:237] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:32.908308  9739 leader_election.cc:290] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:32.908989  9727 raft_consensus.cc:359] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:32.909791  9727 raft_consensus.cc:385] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.910107  9727 raft_consensus.cc:740] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
W20260709 13:03:32.910344  9424 leader_election.cc:343] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.926432 10077 raft_consensus.cc:515] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:32.931293 10077 leader_election.cc:290] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:32.931537  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2167c25a8fe74cf9b28526359b63c3b4" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:32.910907  9727 consensus_queue.cc:260] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:32.880613 10091 raft_consensus.cc:515] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:32.950325  9727 ts_tablet_manager.cc:1434] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.002s
I20260709 13:03:32.951471  9727 tablet_bootstrap.cc:492] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:32.951435  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9be08bd7474b02b3fda228625577e4" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
W20260709 13:03:32.953496  9424 leader_election.cc:343] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.950331 10091 leader_election.cc:290] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:32.976514  9673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4f7949313a47fc9f7a799ef17d9999" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:32.977203  9673 raft_consensus.cc:3060] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.981137  9728 tablet_bootstrap.cc:492] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f: No bootstrap required, opened a new log
I20260709 13:03:32.981657  9728 ts_tablet_manager.cc:1403] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.254s	user 0.018s	sys 0.002s
I20260709 13:03:32.984406  9728 raft_consensus.cc:359] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:32.985037  9728 raft_consensus.cc:385] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.985304  9728 raft_consensus.cc:740] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.985924  9728 consensus_queue.cc:260] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:32.972681  9729 tablet_bootstrap.cc:492] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:32.987069  9729 ts_tablet_manager.cc:1403] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.355s	user 0.024s	sys 0.048s
I20260709 13:03:32.975971 10069 raft_consensus.cc:515] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:32.991052 10069 leader_election.cc:290] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:32.991186  9728 ts_tablet_manager.cc:1434] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:03:32.992784  9607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2167c25a8fe74cf9b28526359b63c3b4" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
W20260709 13:03:32.994045  9499 leader_election.cc:343] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.004006  9727 tablet_bootstrap.cc:654] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.011948  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2167c25a8fe74cf9b28526359b63c3b4" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:33.012629  9458 raft_consensus.cc:3060] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.994663  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4f7949313a47fc9f7a799ef17d9999" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:32.995316  9602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9be08bd7474b02b3fda228625577e4" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
W20260709 13:03:33.025957  9499 leader_election.cc:343] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.026201  9673 raft_consensus.cc:2468] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
W20260709 13:03:33.036600  9499 leader_election.cc:343] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.041863  9458 raft_consensus.cc:2468] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:33.048794  9498 leader_election.cc:304] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:33.054913 10130 raft_consensus.cc:2804] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:32.998642  9682 raft_consensus.cc:2468] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
W20260709 13:03:33.057962  9424 leader_election.cc:343] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.995187  9729 raft_consensus.cc:359] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:33.060410  9729 raft_consensus.cc:385] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.060930  9729 raft_consensus.cc:740] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.060320  9422 leader_election.cc:304] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:33.062052 10070 raft_consensus.cc:2804] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.061748  9729 consensus_queue.cc:260] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:33.063320 10070 raft_consensus.cc:697] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:32.998337  9354 catalog_manager.cc:5697] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.064917  9729 ts_tablet_manager.cc:1434] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.078s	user 0.004s	sys 0.002s
I20260709 13:03:33.065634  9497 leader_election.cc:304] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:33.062505  9424 leader_election.cc:304] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:33.070132 10103 raft_consensus.cc:2749] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:33.059132 10130 raft_consensus.cc:697] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:33.064275 10070 consensus_queue.cc:237] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:33.066020  9729 tablet_bootstrap.cc:492] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:33.076471 10130 consensus_queue.cc:237] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:33.067673  9354 catalog_manager.cc:5697] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.069432 10069 raft_consensus.cc:2804] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.088423 10069 raft_consensus.cc:697] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:33.089381 10069 consensus_queue.cc:237] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:33.091352  9727 tablet_bootstrap.cc:492] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:33.091925  9727 ts_tablet_manager.cc:1403] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.141s	user 0.006s	sys 0.005s
I20260709 13:03:33.094725  9727 raft_consensus.cc:359] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:33.095489  9727 raft_consensus.cc:385] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.095788  9727 raft_consensus.cc:740] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.097553  9727 consensus_queue.cc:260] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:33.099779  9727 ts_tablet_manager.cc:1434] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:33.103255  9727 tablet_bootstrap.cc:492] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:33.105870  9352 catalog_manager.cc:5697] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.110134  9727 tablet_bootstrap.cc:654] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.112208  9729 tablet_bootstrap.cc:654] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.140142 10103 consensus_queue.cc:1048] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:33.143257 10130 raft_consensus.cc:493] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.143854 10130 raft_consensus.cc:515] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:33.146255 10130 leader_election.cc:290] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:33.145790  9356 catalog_manager.cc:5697] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.148375  9356 catalog_manager.cc:5697] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.153103  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2155d805d55a413c9f51874ce70d88b8" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:33.153800  9458 raft_consensus.cc:2468] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:33.155086  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2155d805d55a413c9f51874ce70d88b8" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:33.155862  9605 raft_consensus.cc:2468] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:33.157306  9499 leader_election.cc:304] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:33.158174  9739 raft_consensus.cc:2804] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.158506  9739 raft_consensus.cc:493] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.158802  9739 raft_consensus.cc:3060] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.166460  9739 raft_consensus.cc:515] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:33.173539  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2155d805d55a413c9f51874ce70d88b8" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:33.174147  9458 raft_consensus.cc:3060] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.181358  9458 raft_consensus.cc:2468] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:33.183653 10130 raft_consensus.cc:493] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.187047 10130 raft_consensus.cc:515] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:33.189569 10130 leader_election.cc:290] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:33.190523  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169b723604b749b1b0d240d60266f922" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:33.190798  9498 leader_election.cc:304] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:33.191653 10130 raft_consensus.cc:2804] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.192118 10130 raft_consensus.cc:697] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
W20260709 13:03:33.192217  9499 leader_election.cc:343] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.192946 10130 consensus_queue.cc:237] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:33.192752  9352 catalog_manager.cc:5697] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.194482  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169b723604b749b1b0d240d60266f922" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:33.196514  9739 leader_election.cc:290] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:33.208029  9602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2155d805d55a413c9f51874ce70d88b8" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:33.195211  9682 raft_consensus.cc:2468] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:33.208776  9602 raft_consensus.cc:3060] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.209664  9497 leader_election.cc:304] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:33.210546  9739 raft_consensus.cc:2804] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.210867  9739 raft_consensus.cc:493] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.211154  9739 raft_consensus.cc:3060] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.216977  9602 raft_consensus.cc:2468] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:33.217453  9739 raft_consensus.cc:515] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
W20260709 13:03:33.218408  9424 consensus_peers.cc:597] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:33.227113  9729 tablet_bootstrap.cc:492] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:33.227739  9729 ts_tablet_manager.cc:1403] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.162s	user 0.005s	sys 0.018s
I20260709 13:03:33.229549  9355 catalog_manager.cc:5697] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.233083  9355 catalog_manager.cc:5697] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.239290  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169b723604b749b1b0d240d60266f922" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:33.241520  9739 leader_election.cc:290] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
W20260709 13:03:33.242244  9499 leader_election.cc:343] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.244236  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169b723604b749b1b0d240d60266f922" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:33.244776  9682 raft_consensus.cc:3060] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.255057 10070 consensus_queue.cc:1048] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:33.259110  9765 consensus_queue.cc:1048] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:33.268101 10103 consensus_queue.cc:1048] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:33.272195  9682 raft_consensus.cc:2468] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:33.273691  9729 raft_consensus.cc:359] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:33.274497  9729 raft_consensus.cc:385] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.274753  9729 raft_consensus.cc:740] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.277169  9497 leader_election.cc:304] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:33.278606 10130 raft_consensus.cc:2804] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.279361 10130 raft_consensus.cc:697] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:33.280480 10130 consensus_queue.cc:237] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:33.279706 10091 raft_consensus.cc:493] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.282822  9765 consensus_queue.cc:1048] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:33.283419 10091 raft_consensus.cc:515] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:33.281786  9729 consensus_queue.cc:260] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:33.293814  9602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdb62158e6b4a6989246318d3d25d7c" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:33.294760  9729 ts_tablet_manager.cc:1434] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.000s
I20260709 13:03:33.295828  9354 catalog_manager.cc:5697] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:33.298030  9424 leader_election.cc:343] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.303313 10091 leader_election.cc:290] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:33.305469  9676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdb62158e6b4a6989246318d3d25d7c" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:33.306205  9676 raft_consensus.cc:2468] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 0.
I20260709 13:03:33.308099  9422 leader_election.cc:304] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:33.298032  9727 tablet_bootstrap.cc:492] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:33.309180 10091 raft_consensus.cc:2804] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.309357  9727 ts_tablet_manager.cc:1403] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.206s	user 0.019s	sys 0.016s
I20260709 13:03:33.309648 10091 raft_consensus.cc:493] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.310175 10091 raft_consensus.cc:3060] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.295893  9729 tablet_bootstrap.cc:492] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:33.329104  9727 raft_consensus.cc:359] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:33.330770  9727 raft_consensus.cc:385] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.331027  9727 raft_consensus.cc:740] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.331696  9727 consensus_queue.cc:260] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:33.336114  9727 ts_tablet_manager.cc:1434] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:03:33.337430  9729 tablet_bootstrap.cc:654] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.343421  9727 tablet_bootstrap.cc:492] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:33.351089  9727 tablet_bootstrap.cc:654] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.358558  9352 catalog_manager.cc:5697] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.369210 10091 raft_consensus.cc:515] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:33.372462  9727 tablet_bootstrap.cc:492] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:33.373044  9727 ts_tablet_manager.cc:1403] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 13:03:33.380607  9727 raft_consensus.cc:359] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:33.381326  9727 raft_consensus.cc:385] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.381601  9727 raft_consensus.cc:740] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.382711  9602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdb62158e6b4a6989246318d3d25d7c" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
W20260709 13:03:33.384145  9424 leader_election.cc:343] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.384268  9727 consensus_queue.cc:260] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:33.386165 10091 leader_election.cc:290] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:33.386700  9727 ts_tablet_manager.cc:1434] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:03:33.387727  9727 tablet_bootstrap.cc:492] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:33.393088 10097 raft_consensus.cc:493] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.393702 10097 raft_consensus.cc:515] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:33.395982 10097 leader_election.cc:290] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:33.398313  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:33.400811  9727 tablet_bootstrap.cc:654] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.402164  9673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:33.411958  9571 leader_election.cc:304] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:33.413057 10097 raft_consensus.cc:2749] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:33.420674  9727 tablet_bootstrap.cc:492] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:33.421252  9727 ts_tablet_manager.cc:1403] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 13:03:33.422308  9765 consensus_queue.cc:1048] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:33.427619  9727 raft_consensus.cc:359] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:33.428364  9727 raft_consensus.cc:385] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.428658  9727 raft_consensus.cc:740] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.432627  9727 consensus_queue.cc:260] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
W20260709 13:03:33.434023  9424 consensus_peers.cc:597] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:33.438293  9727 ts_tablet_manager.cc:1434] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:03:33.442167  9676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdb62158e6b4a6989246318d3d25d7c" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:33.442868  9676 raft_consensus.cc:3060] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.443393  9727 tablet_bootstrap.cc:492] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2: Bootstrap starting.
I20260709 13:03:33.449954  9727 tablet_bootstrap.cc:654] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.442883 10069 raft_consensus.cc:493] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.451126 10069 raft_consensus.cc:515] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:33.457921  9602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247add59d191431987b50b009849ee54" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
W20260709 13:03:33.459985  9499 leader_election.cc:343] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.460259  9676 raft_consensus.cc:2468] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 1.
I20260709 13:03:33.464197  9533 raft_consensus.cc:3060] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.464272 10070 consensus_queue.cc:1048] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:33.466948  9422 leader_election.cc:304] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:33.468149 10070 raft_consensus.cc:2804] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.468223 10069 leader_election.cc:290] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:33.468806 10070 raft_consensus.cc:697] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:33.469769 10070 consensus_queue.cc:237] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:33.500895  9729 tablet_bootstrap.cc:492] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:33.507603  9729 ts_tablet_manager.cc:1403] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.212s	user 0.042s	sys 0.035s
I20260709 13:03:33.508129  9673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247add59d191431987b50b009849ee54" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:33.510694  9673 raft_consensus.cc:2468] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:33.513072  9729 raft_consensus.cc:359] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:33.514176  9765 consensus_queue.cc:1048] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:33.526764  9499 consensus_peers.cc:597] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:33.530889  9729 raft_consensus.cc:385] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.531296  9729 raft_consensus.cc:740] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.532078  9729 consensus_queue.cc:260] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:33.534420  9729 ts_tablet_manager.cc:1434] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.000s
I20260709 13:03:33.535861  9729 tablet_bootstrap.cc:492] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:33.514276  9354 catalog_manager.cc:5697] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 0 to 1, leader changed from <none> to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.517680 10069 raft_consensus.cc:493] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.536549 10069 raft_consensus.cc:515] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:33.537688  9727 tablet_bootstrap.cc:492] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2: No bootstrap required, opened a new log
I20260709 13:03:33.538249  9727 ts_tablet_manager.cc:1403] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent bootstrapping tablet: real 0.099s	user 0.029s	sys 0.039s
I20260709 13:03:33.538834 10069 leader_election.cc:290] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:33.520057  9497 leader_election.cc:304] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:33.541181  9727 raft_consensus.cc:359] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:33.541745  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e29bfdaf3d4298afcb82e5edf9d136" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:33.541992  9727 raft_consensus.cc:385] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.542136  9739 raft_consensus.cc:2804] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.542353  9727 raft_consensus.cc:740] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.542582  9739 raft_consensus.cc:493] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.542960  9739 raft_consensus.cc:3060] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.543794  9729 tablet_bootstrap.cc:654] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.543567  9727 consensus_queue.cc:260] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:33.548385  9727 ts_tablet_manager.cc:1434] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:03:33.576841  9739 raft_consensus.cc:515] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:33.581133  9739 leader_election.cc:290] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:33.589380  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247add59d191431987b50b009849ee54" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:33.586400 10069 consensus_queue.cc:1048] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:03:33.590020  9729 tablet_bootstrap.cc:492] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:33.589412 10106 raft_consensus.cc:493] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.591578  9729 ts_tablet_manager.cc:1403] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.036s
I20260709 13:03:33.591811 10106 raft_consensus.cc:515] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
W20260709 13:03:33.593319  9499 leader_election.cc:343] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.594023 10106 leader_election.cc:290] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:33.595685  9729 raft_consensus.cc:359] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:33.596511  9729 raft_consensus.cc:385] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.596786  9729 raft_consensus.cc:740] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.597539  9729 consensus_queue.cc:260] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:33.599599  9729 ts_tablet_manager.cc:1434] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:33.601354  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2167c25a8fe74cf9b28526359b63c3b4" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:33.602972 10069 raft_consensus.cc:493] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.603582  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2167c25a8fe74cf9b28526359b63c3b4" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:33.604108  9534 raft_consensus.cc:3060] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.603577 10069 raft_consensus.cc:515] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:33.606580 10069 leader_election.cc:290] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:33.609455  9676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e29bfdaf3d4298afcb82e5edf9d136" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:33.610998  9673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247add59d191431987b50b009849ee54" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:33.611595  9673 raft_consensus.cc:3060] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.613099  9572 leader_election.cc:304] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:33.614414  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9be08bd7474b02b3fda228625577e4" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:33.614635  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9be08bd7474b02b3fda228625577e4" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:33.615059 10107 raft_consensus.cc:2749] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:33.615343  9457 raft_consensus.cc:2468] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 0.
I20260709 13:03:33.615983  9729 tablet_bootstrap.cc:492] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
W20260709 13:03:33.616119  9499 leader_election.cc:343] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.616753  9498 leader_election.cc:304] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:33.618206 10069 raft_consensus.cc:2804] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.618625 10069 raft_consensus.cc:493] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.618996 10069 raft_consensus.cc:3060] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.619680  9673 raft_consensus.cc:2468] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:33.622989  9497 leader_election.cc:304] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:33.624446  9739 raft_consensus.cc:2749] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.627194  9729 tablet_bootstrap.cc:654] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.628240  9497 leader_election.cc:304] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:33.638315 10130 raft_consensus.cc:2804] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.638803 10130 raft_consensus.cc:697] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:33.639616 10130 consensus_queue.cc:237] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:33.650588  9739 raft_consensus.cc:493] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.651057  9739 raft_consensus.cc:515] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:33.652993  9739 leader_election.cc:290] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:33.652503 10091 consensus_queue.cc:1048] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:33.652653 10069 raft_consensus.cc:515] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:33.660000 10069 leader_election.cc:290] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:33.671794  9673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0dfcbdce939448eaaae078332420bfa" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:33.672601  9673 raft_consensus.cc:2468] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:33.682603  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0dfcbdce939448eaaae078332420bfa" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:33.685298  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9be08bd7474b02b3fda228625577e4" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:33.686115  9458 raft_consensus.cc:3060] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.692014  9605 raft_consensus.cc:3060] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.704013  9497 leader_election.cc:304] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:33.705412 10069 raft_consensus.cc:2804] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.705804 10069 raft_consensus.cc:493] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:33.706175 10069 raft_consensus.cc:3060] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.710044  9602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9be08bd7474b02b3fda228625577e4" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:33.718614 10069 raft_consensus.cc:515] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
W20260709 13:03:33.723194  9499 leader_election.cc:343] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.724751  9354 catalog_manager.cc:5697] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.727841  9607 raft_consensus.cc:3060] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.731544  9739 consensus_queue.cc:1048] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:33.734136  9739 consensus_queue.cc:1048] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:33.739055  9673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0dfcbdce939448eaaae078332420bfa" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
W20260709 13:03:33.739921  9499 consensus_peers.cc:597] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:33.739781  9673 raft_consensus.cc:3060] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.732048 10070 consensus_queue.cc:1048] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:03:33.766281  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0dfcbdce939448eaaae078332420bfa" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:33.766018  9739 consensus_queue.cc:1048] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:33.768491  9673 raft_consensus.cc:2468] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 2.
I20260709 13:03:33.769313  9682 raft_consensus.cc:1240] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Rejecting Update request from peer 04edfe53c70f45e09190743b636a705f for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:03:33.769991 10069 leader_election.cc:290] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:33.759516  9458 raft_consensus.cc:2468] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:33.791703  9498 leader_election.cc:304] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:33.794072 10130 raft_consensus.cc:2804] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.797192 10130 raft_consensus.cc:697] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:33.798494 10130 consensus_queue.cc:237] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:33.810482  9739 consensus_queue.cc:1048] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:33.839375  9497 leader_election.cc:304] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:33.840806  9739 raft_consensus.cc:2804] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.841306  9739 raft_consensus.cc:697] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:33.842103  9739 consensus_queue.cc:237] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:33.852401  9729 tablet_bootstrap.cc:492] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:33.852955  9729 ts_tablet_manager.cc:1403] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.238s	user 0.032s	sys 0.084s
I20260709 13:03:33.823618 10091 consensus_queue.cc:1059] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:03:33.836707 10069 consensus_queue.cc:1048] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:03:33.871557 10070 raft_consensus.cc:3055] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.871639  9729 raft_consensus.cc:359] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:33.872027 10070 raft_consensus.cc:740] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:33.872412  9729 raft_consensus.cc:385] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.872743  9729 raft_consensus.cc:740] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.872941 10070 consensus_queue.cc:260] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:33.874337 10070 raft_consensus.cc:3060] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.873350  9729 consensus_queue.cc:260] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:33.977237 10106 raft_consensus.cc:493] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.985438 10106 raft_consensus.cc:515] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
W20260709 13:03:34.010119  9499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45605, user_credentials={real_user=slave}} blocked reactor thread for 49646.3us
I20260709 13:03:34.023068  9355 catalog_manager.cc:5697] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.028159  9729 ts_tablet_manager.cc:1434] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.175s	user 0.008s	sys 0.004s
I20260709 13:03:34.030359  9729 tablet_bootstrap.cc:492] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:34.037647 10106 leader_election.cc:290] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:34.057452 10106 raft_consensus.cc:493] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.059903  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169b723604b749b1b0d240d60266f922" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:34.060187 10106 raft_consensus.cc:515] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:34.061208  9682 raft_consensus.cc:2393] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8bf0e3504c4f46cf8c639da3e15caf68 in current term 1: Already voted for candidate 7610e18c23c543f1a31b6d851bac1bb2 in this term.
I20260709 13:03:34.066959 10106 leader_election.cc:290] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:34.074898  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4f7949313a47fc9f7a799ef17d9999" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:34.077857  9608 raft_consensus.cc:3060] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:34.109721  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4f7949313a47fc9f7a799ef17d9999" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:34.115288  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169b723604b749b1b0d240d60266f922" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:34.118463  9729 tablet_bootstrap.cc:654] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:34.118675  9737 consensus_queue.cc:1048] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:34.125675  9573 leader_election.cc:304] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5
W20260709 13:03:34.126538  9424 consensus_peers.cc:597] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.130424  9573 leader_election.cc:304] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:34.132889 10169 raft_consensus.cc:3060] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:34.140205  9356 catalog_manager.cc:5697] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:34.196617  9729 tablet_bootstrap.cc:492] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:34.197360  9729 ts_tablet_manager.cc:1403] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.168s	user 0.014s	sys 0.004s
I20260709 13:03:34.227149 10169 raft_consensus.cc:2749] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:34.230084  9499 consensus_peers.cc:597] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.260711 10174 consensus_queue.cc:1048] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:34.277943 10174 consensus_queue.cc:1048] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.278194  9675 raft_consensus.cc:1275] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Refusing update from remote peer 7610e18c23c543f1a31b6d851bac1bb2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:03:34.280872  9499 consensus_peers.cc:597] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.287577 10069 consensus_queue.cc:1048] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:34.289317  9729 raft_consensus.cc:359] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:34.289659 10097 raft_consensus.cc:2749] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:34.293411  9729 raft_consensus.cc:385] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:34.306589  9729 raft_consensus.cc:740] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:34.338738  9459 raft_consensus.cc:1275] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Refusing update from remote peer 7610e18c23c543f1a31b6d851bac1bb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.341730 10080 consensus_queue.cc:1048] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:34.348930  9729 consensus_queue.cc:260] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:34.357108  9729 ts_tablet_manager.cc:1434] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.159s	user 0.010s	sys 0.000s
I20260709 13:03:34.361425  9729 tablet_bootstrap.cc:492] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:34.368664  9729 tablet_bootstrap.cc:654] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:34.372800 10097 raft_consensus.cc:493] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.373373 10097 raft_consensus.cc:515] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:34.377363 10097 leader_election.cc:290] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:34.378043  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190b9b4fa544118981626f9985e1276" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:34.378543  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190b9b4fa544118981626f9985e1276" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:34.392454  9572 leader_election.cc:304] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:34.393828 10097 raft_consensus.cc:2749] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:34.408603  9729 tablet_bootstrap.cc:492] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:34.409140  9729 ts_tablet_manager.cc:1403] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.048s	user 0.026s	sys 0.017s
I20260709 13:03:34.411883  9729 raft_consensus.cc:359] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:34.412609  9729 raft_consensus.cc:385] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:34.412865  9729 raft_consensus.cc:740] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:34.413592  9729 consensus_queue.cc:260] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:34.415191  9729 ts_tablet_manager.cc:1434] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:34.416301  9729 tablet_bootstrap.cc:492] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:34.421679  9729 tablet_bootstrap.cc:654] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:34.433619  9729 tablet_bootstrap.cc:492] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:34.435565  9729 ts_tablet_manager.cc:1403] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.007s
I20260709 13:03:34.438409  9729 raft_consensus.cc:359] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:34.439116  9729 raft_consensus.cc:385] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:34.439395  9729 raft_consensus.cc:740] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:34.440419  9729 consensus_queue.cc:260] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:34.443353  9729 ts_tablet_manager.cc:1434] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:34.444372  9729 tablet_bootstrap.cc:492] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68: Bootstrap starting.
I20260709 13:03:34.450860  9729 tablet_bootstrap.cc:654] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:34.456266  9729 tablet_bootstrap.cc:492] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68: No bootstrap required, opened a new log
I20260709 13:03:34.456813  9729 ts_tablet_manager.cc:1403] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:03:34.459924  9729 raft_consensus.cc:359] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:34.460608  9729 raft_consensus.cc:385] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:34.460866  9729 raft_consensus.cc:740] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Initialized, Role: FOLLOWER
I20260709 13:03:34.461520  9729 consensus_queue.cc:260] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:34.463550  9729 ts_tablet_manager.cc:1434] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:34.495765  9607 raft_consensus.cc:3060] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:34.512398 10169 raft_consensus.cc:493] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.512921 10169 raft_consensus.cc:515] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:34.514731  9602 raft_consensus.cc:3060] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:34.521274  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdb62158e6b4a6989246318d3d25d7c" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:34.521543 10169 leader_election.cc:290] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:34.523121  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdb62158e6b4a6989246318d3d25d7c" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:34.525132 10097 raft_consensus.cc:493] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.525688 10097 raft_consensus.cc:515] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:34.525997  9572 leader_election.cc:304] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:34.528008 10097 leader_election.cc:290] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:34.528081 10107 raft_consensus.cc:2749] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:34.528704  9533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247add59d191431987b50b009849ee54" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:34.529489  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247add59d191431987b50b009849ee54" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:34.531201  9571 leader_election.cc:304] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:34.533280 10107 raft_consensus.cc:2749] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:34.725335  9602 raft_consensus.cc:3060] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:34.771492  9602 raft_consensus.cc:3060] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:34.862282   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:03:34.875509  9498 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:03:34.889206  9498 consensus_peers.cc:597] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.912726   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:34.913534   431 tablet_replica.cc:333] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.914582   431 raft_consensus.cc:2243] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.915213   431 raft_consensus.cc:2272] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.917464   431 tablet_replica.cc:333] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.918104   431 raft_consensus.cc:2243] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.918529   431 raft_consensus.cc:2272] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.920603   431 tablet_replica.cc:333] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.921254   431 raft_consensus.cc:2243] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.922076   431 raft_consensus.cc:2272] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.924038   431 tablet_replica.cc:333] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.924695   431 raft_consensus.cc:2243] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.925621   431 raft_consensus.cc:2272] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.928097   431 tablet_replica.cc:333] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.928633   431 raft_consensus.cc:2243] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.929039   431 raft_consensus.cc:2272] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.931964   431 tablet_replica.cc:333] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.932825   431 raft_consensus.cc:2243] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.933347   431 raft_consensus.cc:2272] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.936183   431 tablet_replica.cc:333] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
W20260709 13:03:34.936846  9646 consensus_peers.cc:597] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.936905   431 raft_consensus.cc:2243] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.938081   431 raft_consensus.cc:2272] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.940757   431 tablet_replica.cc:333] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.941402   431 raft_consensus.cc:2243] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.942196   431 raft_consensus.cc:2272] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.944209   431 tablet_replica.cc:333] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.945029   431 raft_consensus.cc:2243] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.945528   431 raft_consensus.cc:2272] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.948057   431 tablet_replica.cc:333] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.948712   431 raft_consensus.cc:2243] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.949445   431 raft_consensus.cc:2272] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.951179   431 tablet_replica.cc:333] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.951905   431 raft_consensus.cc:2243] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.952939   431 raft_consensus.cc:2272] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.955588   431 tablet_replica.cc:333] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.956096   431 raft_consensus.cc:2243] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.956813   431 raft_consensus.cc:2272] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.958950   431 tablet_replica.cc:333] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.959753   431 raft_consensus.cc:2243] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.960261   431 raft_consensus.cc:2272] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.962456   431 tablet_replica.cc:333] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.962991   431 raft_consensus.cc:2243] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.963936   431 raft_consensus.cc:2272] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.965960   431 tablet_replica.cc:333] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.966500   431 raft_consensus.cc:2243] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.967015   431 raft_consensus.cc:2272] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.969883   431 tablet_replica.cc:333] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.970494   431 raft_consensus.cc:2243] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.971598   431 raft_consensus.cc:2272] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.974025   431 tablet_replica.cc:333] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.974606   431 raft_consensus.cc:2243] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.975474   431 raft_consensus.cc:2272] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.977420   431 tablet_replica.cc:333] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.977955   431 raft_consensus.cc:2243] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.978368   431 raft_consensus.cc:2272] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.980425   431 tablet_replica.cc:333] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.980952   431 raft_consensus.cc:2243] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.981397   431 raft_consensus.cc:2272] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.983527   431 tablet_replica.cc:333] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.984079   431 raft_consensus.cc:2243] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.984902   431 raft_consensus.cc:2272] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.987980   431 tablet_replica.cc:333] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.988770   431 raft_consensus.cc:2243] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.989264   431 raft_consensus.cc:2272] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.992038   431 tablet_replica.cc:333] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.992616   431 raft_consensus.cc:2243] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:03:34.993546  9498 consensus_peers.cc:597] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.993681   431 raft_consensus.cc:2272] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:34.994150  9498 consensus_peers.cc:597] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.995875   431 tablet_replica.cc:333] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:34.996500   431 raft_consensus.cc:2243] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.996912   431 raft_consensus.cc:2272] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.999837   431 tablet_replica.cc:333] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.000433   431 raft_consensus.cc:2243] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.001459   431 raft_consensus.cc:2272] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.003728   431 tablet_replica.cc:333] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.004220   431 raft_consensus.cc:2243] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.004609   431 raft_consensus.cc:2272] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.006516   431 tablet_replica.cc:333] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.007079   431 raft_consensus.cc:2243] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.007529   431 raft_consensus.cc:2272] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.009650   431 tablet_replica.cc:333] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.010149   431 raft_consensus.cc:2243] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.010576   431 raft_consensus.cc:2272] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.013172   431 tablet_replica.cc:333] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.014045   431 raft_consensus.cc:2243] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.015070   431 raft_consensus.cc:2272] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:35.015892  9498 consensus_peers.cc:597] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.018057   431 tablet_replica.cc:333] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.019029   431 raft_consensus.cc:2243] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.019677   431 raft_consensus.cc:2272] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.022020   431 tablet_replica.cc:333] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.022529   431 raft_consensus.cc:2243] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.022913   431 raft_consensus.cc:2272] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.024969   431 tablet_replica.cc:333] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.025455   431 raft_consensus.cc:2243] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.025938   431 raft_consensus.cc:2272] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.028204   431 tablet_replica.cc:333] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.028789   431 raft_consensus.cc:2243] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.029247   431 raft_consensus.cc:2272] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.031399   431 tablet_replica.cc:333] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.032111   431 raft_consensus.cc:2243] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.032625   431 raft_consensus.cc:2272] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.035693   431 tablet_replica.cc:333] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.036736   431 raft_consensus.cc:2243] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:35.037158  9498 consensus_peers.cc:597] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.037298   431 raft_consensus.cc:2272] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.039561   431 tablet_replica.cc:333] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.040223   431 raft_consensus.cc:2243] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.040671   431 raft_consensus.cc:2272] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.042946   431 tablet_replica.cc:333] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.043543   431 raft_consensus.cc:2243] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.044015   431 raft_consensus.cc:2272] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.046952   431 tablet_replica.cc:333] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.047711   431 raft_consensus.cc:2243] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.048695   431 raft_consensus.cc:2272] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.050947   431 tablet_replica.cc:333] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.051503   431 raft_consensus.cc:2243] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.051926   431 raft_consensus.cc:2272] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.054528   431 tablet_replica.cc:333] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.055213   431 raft_consensus.cc:2243] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.056033   431 raft_consensus.cc:2272] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.058101   431 tablet_replica.cc:333] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.058619   431 raft_consensus.cc:2243] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.059033   431 raft_consensus.cc:2272] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.061306   431 tablet_replica.cc:333] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.061813   431 raft_consensus.cc:2243] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.062314   431 raft_consensus.cc:2272] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.064662   431 tablet_replica.cc:333] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.065301   431 raft_consensus.cc:2243] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.065790   431 raft_consensus.cc:2272] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.068511   431 tablet_replica.cc:333] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.069118   431 raft_consensus.cc:2243] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.070089   431 raft_consensus.cc:2272] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.072830   431 tablet_replica.cc:333] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.073434   431 raft_consensus.cc:2243] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.074473   431 raft_consensus.cc:2272] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.077378   431 tablet_replica.cc:333] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f: stopping tablet replica
I20260709 13:03:35.077935   431 raft_consensus.cc:2243] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.078888   431 raft_consensus.cc:2272] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:35.084249  9572 consensus_peers.cc:597] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.088205  9572 consensus_peers.cc:597] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.111471  9572 consensus_peers.cc:597] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.113759  9498 consensus_peers.cc:597] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.124151  9572 consensus_peers.cc:597] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.132247  9572 consensus_peers.cc:597] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.154349  9425 connection.cc:466] server connection from 127.0.0.1:42620 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 187) could send its response
W20260709 13:03:35.155411  9572 consensus_peers.cc:597] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: recv got EOF from 127.0.107.193:39371 (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.171473   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:35.236357  9572 consensus_peers.cc:597] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.246348   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:35.254658  9498 consensus_peers.cc:597] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.257795 10198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:35.258078  9572 consensus_peers.cc:597] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.258152 10199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:35.264555  9498 consensus_peers.cc:597] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.266692 10201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:35.268529  9572 consensus_peers.cc:597] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.269708   431 server_base.cc:1061] running on GCE node
I20260709 13:03:35.273876   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:35.274142   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:35.274355   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602215274342 us; error 0 us; skew 500 ppm
I20260709 13:03:35.274989   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:03:35.277768  9646 consensus_peers.cc:597] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.278707   431 webserver.cc:533] Webserver started at http://127.0.107.193:38677/ using document root <none> and password file <none>
I20260709 13:03:35.279330   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:35.279496   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:03:35.283104   431 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:03:35.293176 10207 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:35.295085   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:03:35.295506   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-0-root
uuid: "04edfe53c70f45e09190743b636a705f"
format_stamp: "Formatted at 2026-07-09 13:03:24 on dist-test-slave-zhw8"
I20260709 13:03:35.296037   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601945298557-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:03:35.307880  9498 consensus_peers.cc:597] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.310856  9646 consensus_peers.cc:597] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.341655   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:35.343377   431 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260709 13:03:35.343267  9498 consensus_peers.cc:597] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.347605   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:35.352537 10215 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:03:35.355216  9646 consensus_peers.cc:597] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.363123  9572 consensus_peers.cc:597] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.379133  9646 consensus_peers.cc:597] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.441347  9572 consensus_peers.cc:597] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.626479   431 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:03:35.626895   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.275s	user 0.009s	sys 0.000s
I20260709 13:03:35.627270   431 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:03:35.635272 10215 tablet_bootstrap.cc:492] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:35.662456 10215 tablet_bootstrap.cc:492] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.663491 10215 tablet_bootstrap.cc:492] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:35.664096 10215 ts_tablet_manager.cc:1403] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.008s
I20260709 13:03:35.666415 10215 raft_consensus.cc:359] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:35.667057 10215 raft_consensus.cc:740] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.667739 10215 consensus_queue.cc:260] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:35.670236 10215 ts_tablet_manager.cc:1434] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:35.670960 10215 tablet_bootstrap.cc:492] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:35.689512 10215 tablet_bootstrap.cc:492] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.690254 10215 tablet_bootstrap.cc:492] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:35.690752 10215 ts_tablet_manager.cc:1403] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:03:35.692603 10215 raft_consensus.cc:359] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:35.693101 10215 raft_consensus.cc:740] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.693651 10215 consensus_queue.cc:260] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:35.695055 10215 ts_tablet_manager.cc:1434] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:03:35.695684 10215 tablet_bootstrap.cc:492] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:35.713187 10215 tablet_bootstrap.cc:492] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.714128 10215 tablet_bootstrap.cc:492] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:35.714704 10215 ts_tablet_manager.cc:1403] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 13:03:35.717335 10215 raft_consensus.cc:359] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:35.717972 10215 raft_consensus.cc:740] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.718557 10215 consensus_queue.cc:260] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:35.720300 10215 ts_tablet_manager.cc:1434] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:03:35.721092 10215 tablet_bootstrap.cc:492] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:35.734484 10215 tablet_bootstrap.cc:492] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.735503 10215 tablet_bootstrap.cc:492] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:35.736068 10215 ts_tablet_manager.cc:1403] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:03:35.737754 10215 raft_consensus.cc:359] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:35.738214 10215 raft_consensus.cc:740] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.738806 10215 consensus_queue.cc:260] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:35.740492 10215 ts_tablet_manager.cc:1434] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:35.741149 10215 tablet_bootstrap.cc:492] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:35.752588 10215 tablet_bootstrap.cc:492] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.753473 10215 tablet_bootstrap.cc:492] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:35.756299 10215 ts_tablet_manager.cc:1403] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:03:35.758636 10215 raft_consensus.cc:359] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:35.759310 10215 raft_consensus.cc:740] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.759894 10215 consensus_queue.cc:260] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:35.761814 10215 ts_tablet_manager.cc:1434] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:35.762516 10215 tablet_bootstrap.cc:492] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:35.784484 10215 tablet_bootstrap.cc:492] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.785512 10215 tablet_bootstrap.cc:492] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:35.786214 10215 ts_tablet_manager.cc:1403] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 13:03:35.788717 10215 raft_consensus.cc:359] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:35.789458 10215 raft_consensus.cc:740] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.790311 10215 consensus_queue.cc:260] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:35.792506 10215 ts_tablet_manager.cc:1434] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:35.793279 10215 tablet_bootstrap.cc:492] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:35.844630 10215 tablet_bootstrap.cc:492] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.845642 10215 tablet_bootstrap.cc:492] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:35.846256 10215 ts_tablet_manager.cc:1403] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.035s
I20260709 13:03:35.848467 10215 raft_consensus.cc:359] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:35.848978 10215 raft_consensus.cc:740] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.849514 10215 consensus_queue.cc:260] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:35.850962 10215 ts_tablet_manager.cc:1434] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:03:35.851632 10215 tablet_bootstrap.cc:492] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:35.854419   431 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:03:35.854727   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.227s	user 0.220s	sys 0.002s
I20260709 13:03:35.862746 10215 tablet_bootstrap.cc:492] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.864078 10215 tablet_bootstrap.cc:492] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:35.864851 10215 ts_tablet_manager.cc:1403] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:03:35.868180 10215 raft_consensus.cc:359] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:35.868872 10215 raft_consensus.cc:740] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.869647 10215 consensus_queue.cc:260] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:35.871845 10215 ts_tablet_manager.cc:1434] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:35.872623 10215 tablet_bootstrap.cc:492] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:35.873479 10227 raft_consensus.cc:493] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:35.874048 10227 raft_consensus.cc:515] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:35.876212 10227 leader_election.cc:290] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:35.882349  9602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
W20260709 13:03:35.886889  9646 leader_election.cc:336] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:35.887349  9646 leader_election.cc:304] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:35.888087 10227 raft_consensus.cc:2749] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:35.888199 10215 tablet_bootstrap.cc:492] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.889206 10215 tablet_bootstrap.cc:492] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:35.889843 10215 ts_tablet_manager.cc:1403] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.010s
I20260709 13:03:35.892331 10215 raft_consensus.cc:359] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:35.892979 10215 raft_consensus.cc:740] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.893618 10215 consensus_queue.cc:260] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:35.895692 10215 ts_tablet_manager.cc:1434] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:03:35.896394 10215 tablet_bootstrap.cc:492] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:35.911031 10229 raft_consensus.cc:493] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:35.911656 10229 raft_consensus.cc:515] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:35.914182 10229 leader_election.cc:290] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:35.914844  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a58824acb343fa8f9e1349207a54b1" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:35.917205 10215 tablet_bootstrap.cc:492] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.918175 10215 tablet_bootstrap.cc:492] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:35.918821 10215 ts_tablet_manager.cc:1403] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.009s
W20260709 13:03:35.921387  9498 leader_election.cc:336] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:35.921432 10215 raft_consensus.cc:359] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:35.922004  9498 leader_election.cc:304] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:35.922263 10215 raft_consensus.cc:740] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.922734 10216 raft_consensus.cc:2749] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:35.922971 10215 consensus_queue.cc:260] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:35.925071 10215 ts_tablet_manager.cc:1434] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.006s
I20260709 13:03:35.925810 10215 tablet_bootstrap.cc:492] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:35.926674 10227 raft_consensus.cc:493] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:35.927407 10227 raft_consensus.cc:515] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:35.933523  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a58824acb343fa8f9e1349207a54b1" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:35.934113  9532 raft_consensus.cc:2468] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
W20260709 13:03:35.935261  9646 leader_election.cc:336] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:35.935567 10227 leader_election.cc:290] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:35.936353  9647 leader_election.cc:304] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:35.937595 10227 raft_consensus.cc:2804] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:35.938045 10227 raft_consensus.cc:493] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:35.938570 10227 raft_consensus.cc:3060] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.942214 10215 tablet_bootstrap.cc:492] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.943379 10215 tablet_bootstrap.cc:492] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:35.944015 10215 ts_tablet_manager.cc:1403] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:03:35.946079 10215 raft_consensus.cc:359] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:35.946610 10215 raft_consensus.cc:740] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.947278 10215 consensus_queue.cc:260] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:35.948729 10215 ts_tablet_manager.cc:1434] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:35.949352 10215 tablet_bootstrap.cc:492] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:35.949271 10227 raft_consensus.cc:515] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
W20260709 13:03:35.959599  9646 leader_election.cc:336] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:35.960180 10226 raft_consensus.cc:493] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:35.960708 10217 raft_consensus.cc:493] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:35.960757 10226 raft_consensus.cc:515] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:35.961390 10217 raft_consensus.cc:515] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:35.963492 10217 leader_election.cc:290] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:35.964130 10215 tablet_bootstrap.cc:492] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.964998  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dc81bdfb864e568aba35ed5d9f24dd" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:35.965289 10215 tablet_bootstrap.cc:492] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:35.966207 10215 ts_tablet_manager.cc:1403] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:03:35.969360 10215 raft_consensus.cc:359] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:35.969964 10226 leader_election.cc:290] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:35.970232 10215 raft_consensus.cc:740] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.970566 10227 leader_election.cc:290] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:35.971477 10215 consensus_queue.cc:260] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
W20260709 13:03:35.972447  9572 leader_election.cc:336] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:35.973141  9572 leader_election.cc:304] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:35.974375  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a58824acb343fa8f9e1349207a54b1" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:35.974921  9532 raft_consensus.cc:3060] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.975251 10097 raft_consensus.cc:2749] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:35.976296  9607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190b9b4fa544118981626f9985e1276" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:35.978973 10215 ts_tablet_manager.cc:1434] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
W20260709 13:03:35.979681  9646 leader_election.cc:336] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:35.980151  9646 leader_election.cc:304] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:35.980818 10227 raft_consensus.cc:2749] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:35.979796 10215 tablet_bootstrap.cc:492] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:35.982682  9532 raft_consensus.cc:2468] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 2.
I20260709 13:03:35.983673  9647 leader_election.cc:304] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:35.984467 10227 raft_consensus.cc:2804] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:35.984386 10097 raft_consensus.cc:493] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:35.985076 10227 raft_consensus.cc:697] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:35.985132 10097 raft_consensus.cc:515] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:35.986150 10227 consensus_queue.cc:237] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:35.987444 10097 leader_election.cc:290] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:35.989037  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:35.989713  9678 raft_consensus.cc:2468] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:35.991012  9571 leader_election.cc:304] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:35.996099 10097 raft_consensus.cc:2804] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:35.996704 10097 raft_consensus.cc:493] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:35.997325 10097 raft_consensus.cc:3060] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.001274  9354 catalog_manager.cc:5697] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.005858 10227 raft_consensus.cc:493] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.006511 10227 raft_consensus.cc:515] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.016064 10107 raft_consensus.cc:493] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.016359 10097 raft_consensus.cc:515] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.016923 10107 raft_consensus.cc:515] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.019759  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:36.020506  9678 raft_consensus.cc:3060] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.022044 10107 leader_election.cc:290] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.022806  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871790aff5ff4037ad0c30f4e0276aa3" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
W20260709 13:03:36.023042  9646 leader_election.cc:336] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.023907 10227 leader_election.cc:290] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
W20260709 13:03:36.055068  9572 leader_election.cc:336] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.061478  9678 raft_consensus.cc:2468] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 2.
I20260709 13:03:36.061576  9603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134aecc79f7c4b398afcbf65000e3267" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:36.062574 10227 raft_consensus.cc:493] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.065512 10227 raft_consensus.cc:515] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.067032  9647 leader_election.cc:304] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:36.070305 10218 raft_consensus.cc:2749] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:36.071848  9572 leader_election.cc:336] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.064759  9571 leader_election.cc:304] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.073130 10107 raft_consensus.cc:493] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.075225  9572 leader_election.cc:304] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:36.075472 10107 raft_consensus.cc:515] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
W20260709 13:03:36.076259  9646 leader_election.cc:336] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.077924 10107 leader_election.cc:290] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.078083 10217 raft_consensus.cc:2749] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:36.079759 10217 raft_consensus.cc:2804] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.080669  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aceba3614aec44bd97d0a2111129bae4" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:36.073594 10227 leader_election.cc:290] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.064827 10097 leader_election.cc:290] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.081938 10215 tablet_bootstrap.cc:492] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:36.082897 10215 tablet_bootstrap.cc:492] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:36.083539 10215 ts_tablet_manager.cc:1403] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.104s	user 0.043s	sys 0.038s
I20260709 13:03:36.073839  9603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dc81bdfb864e568aba35ed5d9f24dd" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:36.085942  9603 raft_consensus.cc:2468] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
I20260709 13:03:36.086082 10215 raft_consensus.cc:359] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.086820 10215 raft_consensus.cc:740] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:36.087647 10215 consensus_queue.cc:260] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.090245 10215 ts_tablet_manager.cc:1434] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 13:03:36.090327  9572 leader_election.cc:336] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.091207 10215 tablet_bootstrap.cc:492] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:36.092996  9647 leader_election.cc:304] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:36.094367 10227 raft_consensus.cc:2804] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.095142 10227 raft_consensus.cc:493] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.095539 10227 raft_consensus.cc:3060] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.096387 10217 raft_consensus.cc:697] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:36.106307 10217 consensus_queue.cc:237] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.109462 10227 raft_consensus.cc:515] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.113353 10227 leader_election.cc:290] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.114171  9603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dc81bdfb864e568aba35ed5d9f24dd" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:36.114837  9603 raft_consensus.cc:3060] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:36.118072  9646 leader_election.cc:336] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.123132 10215 tablet_bootstrap.cc:492] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:36.123956  9603 raft_consensus.cc:2468] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 2.
I20260709 13:03:36.124261 10215 tablet_bootstrap.cc:492] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:36.125124 10215 ts_tablet_manager.cc:1403] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.004s
I20260709 13:03:36.126438  9647 leader_election.cc:304] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:36.127398 10227 raft_consensus.cc:2804] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.127861 10227 raft_consensus.cc:697] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:36.128508 10215 raft_consensus.cc:359] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.128666 10227 consensus_queue.cc:237] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.129477 10215 raft_consensus.cc:740] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:36.128512  9355 catalog_manager.cc:5697] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.130216 10215 consensus_queue.cc:260] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.132444 10215 ts_tablet_manager.cc:1434] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:36.133188 10215 tablet_bootstrap.cc:492] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:36.136008 10226 raft_consensus.cc:493] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.136626 10226 raft_consensus.cc:515] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.138826 10226 leader_election.cc:290] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:36.139927 10229 raft_consensus.cc:493] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.140453 10229 raft_consensus.cc:515] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.142556 10229 leader_election.cc:290] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.145977  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c671c6618ad41ff8d9f7d3d121ed086" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:36.145694  9603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df55ee6044645c183a597fd3f8b2aaf" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
W20260709 13:03:36.153609  9646 leader_election.cc:336] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.154217  9646 leader_election.cc:304] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:36.155400 10227 raft_consensus.cc:2749] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:36.159372  9354 catalog_manager.cc:5697] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.168962 10229 raft_consensus.cc:493] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.169554 10229 raft_consensus.cc:515] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.163064 10215 tablet_bootstrap.cc:492] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:36.171942 10215 tablet_bootstrap.cc:492] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:36.172442  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6708a2f76d0f4292b01c5bb066f7bcac" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:36.172830 10215 ts_tablet_manager.cc:1403] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.040s	user 0.023s	sys 0.005s
I20260709 13:03:36.174068 10080 raft_consensus.cc:493] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.174757 10080 raft_consensus.cc:515] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.175827 10215 raft_consensus.cc:359] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:36.176507 10215 raft_consensus.cc:740] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:36.177268 10215 consensus_queue.cc:260] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:36.177572 10080 leader_election.cc:290] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.179467 10215 ts_tablet_manager.cc:1434] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:36.180233 10215 tablet_bootstrap.cc:492] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:36.181667 10226 raft_consensus.cc:493] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.182173 10226 raft_consensus.cc:515] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.183652  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d50b9a85aa742458e037bd19f757196" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
W20260709 13:03:36.189236  9646 leader_election.cc:336] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.191926  9603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871790aff5ff4037ad0c30f4e0276aa3" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:36.193269 10226 leader_election.cc:290] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.194068  9603 raft_consensus.cc:2468] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
I20260709 13:03:36.195772  9647 leader_election.cc:304] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:36.197153 10226 raft_consensus.cc:2804] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.197649 10226 raft_consensus.cc:493] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.198093 10226 raft_consensus.cc:3060] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.204612 10107 raft_consensus.cc:493] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.206508 10080 raft_consensus.cc:493] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.206624 10229 leader_election.cc:290] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.207227 10080 raft_consensus.cc:515] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.210518 10226 raft_consensus.cc:515] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.211305 10080 leader_election.cc:290] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.213620  9603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871790aff5ff4037ad0c30f4e0276aa3" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:36.214257  9603 raft_consensus.cc:3060] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.214967 10226 leader_election.cc:290] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.216492 10217 raft_consensus.cc:493] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.217224 10217 raft_consensus.cc:515] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
W20260709 13:03:36.218676  9646 leader_election.cc:336] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.220326  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcede6679b495786781fa878243f44" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:36.206943 10107 raft_consensus.cc:515] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.220547 10217 leader_election.cc:290] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.222851 10107 leader_election.cc:290] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.223899  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134aecc79f7c4b398afcbf65000e3267" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:36.224716  9682 raft_consensus.cc:2468] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:36.226367  9571 leader_election.cc:304] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.227859  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23edaf5688c4b51a8f524e1fb7c928f" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:36.228469  9603 raft_consensus.cc:2468] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 2.
I20260709 13:03:36.228677 10107 raft_consensus.cc:2804] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.231657 10107 raft_consensus.cc:493] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.232117 10107 raft_consensus.cc:3060] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.232360  9647 leader_election.cc:304] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:36.233163 10226 raft_consensus.cc:2804] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.233651 10226 raft_consensus.cc:697] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:36.205093 10215 tablet_bootstrap.cc:492] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:36.235000 10215 tablet_bootstrap.cc:492] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:36.235761 10215 ts_tablet_manager.cc:1403] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.007s
I20260709 13:03:36.234509 10226 consensus_queue.cc:237] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.242908 10227 raft_consensus.cc:493] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.243507 10227 raft_consensus.cc:515] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.247669 10107 raft_consensus.cc:515] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.250524  9603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aceba3614aec44bd97d0a2111129bae4" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
W20260709 13:03:36.252354  9646 leader_election.cc:336] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.252019  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134aecc79f7c4b398afcbf65000e3267" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:36.251180 10218 raft_consensus.cc:493] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.252866  9603 raft_consensus.cc:2468] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
I20260709 13:03:36.247735 10227 leader_election.cc:290] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.252909 10107 leader_election.cc:290] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.253610 10218 raft_consensus.cc:515] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.249488 10215 raft_consensus.cc:359] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:36.253364  9682 raft_consensus.cc:3060] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.255138 10215 raft_consensus.cc:740] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:36.256494 10218 leader_election.cc:290] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:36.256140 10215 consensus_queue.cc:260] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:36.254277  9647 leader_election.cc:304] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:36.258890  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0d047c0df4036a4702dbc607a318e" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:36.259110 10218 raft_consensus.cc:2804] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.259585 10218 raft_consensus.cc:493] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.260459 10218 raft_consensus.cc:3060] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.261499 10215 ts_tablet_manager.cc:1434] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:03:36.262588 10215 tablet_bootstrap.cc:492] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
W20260709 13:03:36.266459  9646 leader_election.cc:336] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.266916  9646 leader_election.cc:304] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:36.268028 10226 raft_consensus.cc:2749] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:36.268581 10268 raft_consensus.cc:493] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.269093 10268 raft_consensus.cc:515] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:36.271123 10227 raft_consensus.cc:493] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.271714 10227 raft_consensus.cc:515] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.272627  9354 catalog_manager.cc:5697] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.273691 10227 leader_election.cc:290] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:36.274255 10227 raft_consensus.cc:493] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.274679 10227 raft_consensus.cc:515] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.276402  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6708a2f76d0f4292b01c5bb066f7bcac" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:36.276762 10094 raft_consensus.cc:493] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.277527  9534 raft_consensus.cc:2468] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
I20260709 13:03:36.277784 10094 raft_consensus.cc:515] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.278707  9647 leader_election.cc:304] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.279500 10226 raft_consensus.cc:2804] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.279861 10226 raft_consensus.cc:493] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.280244 10226 raft_consensus.cc:3060] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.281205  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aa3eb6cc3047579924350ba3f75d90" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:36.271167 10268 leader_election.cc:290] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:36.283373  9682 raft_consensus.cc:2468] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 2.
I20260709 13:03:36.284171 10080 raft_consensus.cc:493] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.279883 10094 leader_election.cc:290] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.284564  9571 leader_election.cc:304] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.284691 10080 raft_consensus.cc:515] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:36.285341 10094 raft_consensus.cc:493] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.285599 10268 raft_consensus.cc:2804] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.286033 10094 raft_consensus.cc:515] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.287623  9603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0797397ca74a699473bb7b07f063c8" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:36.286794 10268 raft_consensus.cc:697] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:36.286937 10080 leader_election.cc:290] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:36.292830 10268 consensus_queue.cc:237] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.294258  9603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aa3eb6cc3047579924350ba3f75d90" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:36.294934  9603 raft_consensus.cc:2468] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:36.296169  9499 leader_election.cc:304] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:36.295869 10227 leader_election.cc:290] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:36.297663 10080 raft_consensus.cc:2804] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.301086 10080 raft_consensus.cc:493] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.303054  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d50b9a85aa742458e037bd19f757196" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:36.302109  9603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23edaf5688c4b51a8f524e1fb7c928f" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:36.302592 10080 raft_consensus.cc:3060] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.303795  9532 raft_consensus.cc:2468] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
I20260709 13:03:36.303927  9603 raft_consensus.cc:2468] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
I20260709 13:03:36.305370  9647 leader_election.cc:304] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.311440 10295 raft_consensus.cc:493] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.315502 10295 raft_consensus.cc:515] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.316946 10226 raft_consensus.cc:515] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.317108 10080 raft_consensus.cc:515] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:36.318656 10227 raft_consensus.cc:493] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.319483 10215 tablet_bootstrap.cc:492] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:36.320453 10215 tablet_bootstrap.cc:492] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:36.321173 10215 ts_tablet_manager.cc:1403] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.059s	user 0.028s	sys 0.008s
I20260709 13:03:36.319509 10227 raft_consensus.cc:515] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.328750 10227 leader_election.cc:290] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.329736 10295 leader_election.cc:290] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:36.330140 10227 raft_consensus.cc:2804] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.327850  9647 leader_election.cc:304] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.333858 10295 raft_consensus.cc:2804] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.330600 10094 leader_election.cc:290] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.334266 10295 raft_consensus.cc:493] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.333500 10215 raft_consensus.cc:359] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.334678 10295 raft_consensus.cc:3060] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:36.334812  9646 leader_election.cc:336] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.335155  9603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdb62158e6b4a6989246318d3d25d7c" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
W20260709 13:03:36.335632  9646 leader_election.cc:336] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.335831  9603 raft_consensus.cc:2468] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
I20260709 13:03:36.336052  9646 leader_election.cc:304] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:36.337080 10215 raft_consensus.cc:740] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:36.337141  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcede6679b495786781fa878243f44" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
W20260709 13:03:36.337459  9646 leader_election.cc:336] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.337926  9532 raft_consensus.cc:2468] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
W20260709 13:03:36.338673  9646 leader_election.cc:336] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.339061  9647 leader_election.cc:304] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.330524 10227 raft_consensus.cc:493] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.341243 10080 leader_election.cc:290] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:36.342185 10215 consensus_queue.cc:260] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.344272 10226 leader_election.cc:290] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:36.344584 10297 raft_consensus.cc:2749] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:36.344871 10226 raft_consensus.cc:2804] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.345283 10226 raft_consensus.cc:493] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.345640 10226 raft_consensus.cc:3060] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:36.347435  9646 leader_election.cc:336] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
W20260709 13:03:36.347945  9646 leader_election.cc:336] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.342724  9603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aa3eb6cc3047579924350ba3f75d90" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:36.349113  9603 raft_consensus.cc:3060] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:36.350060  9646 leader_election.cc:336] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.351193 10215 ts_tablet_manager.cc:1434] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:03:36.347036  9354 catalog_manager.cc:5697] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.352197 10215 tablet_bootstrap.cc:492] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:36.355084 10226 raft_consensus.cc:515] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.340252 10227 raft_consensus.cc:3060] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.366398 10226 leader_election.cc:290] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.368842  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6708a2f76d0f4292b01c5bb066f7bcac" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:36.369458  9532 raft_consensus.cc:3060] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.369336  9605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdb62158e6b4a6989246318d3d25d7c" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:36.370098  9605 raft_consensus.cc:3060] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.368358 10218 raft_consensus.cc:515] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.372829 10218 leader_election.cc:290] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.374905  9647 leader_election.cc:304] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:36.376921  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aceba3614aec44bd97d0a2111129bae4" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:36.377017 10097 raft_consensus.cc:493] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.377498  9608 raft_consensus.cc:3060] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.377703  9532 raft_consensus.cc:2468] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 2.
I20260709 13:03:36.377545 10097 raft_consensus.cc:515] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.379908 10097 leader_election.cc:290] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.381587  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190b9b4fa544118981626f9985e1276" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:36.382296  9682 raft_consensus.cc:2468] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:36.383816  9571 leader_election.cc:304] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.384812 10097 raft_consensus.cc:2804] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.373950  9603 raft_consensus.cc:2468] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 2.
I20260709 13:03:36.388033  9608 raft_consensus.cc:2468] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 2.
I20260709 13:03:36.389619 10226 raft_consensus.cc:2804] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.390213 10226 raft_consensus.cc:493] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.390719 10226 raft_consensus.cc:3060] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.385766 10097 raft_consensus.cc:493] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.394739 10097 raft_consensus.cc:3060] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.397116  9499 leader_election.cc:304] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:36.398065 10080 raft_consensus.cc:2804] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.398584 10080 raft_consensus.cc:697] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:36.399807 10218 raft_consensus.cc:493] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.400362 10218 raft_consensus.cc:515] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.402408 10218 leader_election.cc:290] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:36.395216 10229 raft_consensus.cc:493] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.403074 10268 raft_consensus.cc:493] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.403676 10229 raft_consensus.cc:515] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.403744 10268 raft_consensus.cc:515] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.404666 10295 raft_consensus.cc:515] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.405838 10229 leader_election.cc:290] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.406620 10295 leader_election.cc:290] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.406991  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0797397ca74a699473bb7b07f063c8" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:36.407064 10097 raft_consensus.cc:515] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.407780  9682 raft_consensus.cc:2468] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:36.409082  9571 leader_election.cc:304] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.410043  9647 leader_election.cc:304] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:36.412207 10107 raft_consensus.cc:2804] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.412703 10107 raft_consensus.cc:493] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.413652 10107 raft_consensus.cc:3060] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.414359 10268 leader_election.cc:290] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.417479 10227 raft_consensus.cc:515] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.399822 10080 consensus_queue.cc:237] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:36.419626 10097 leader_election.cc:290] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.420503  9647 leader_election.cc:304] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.436028  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05c2b77c014117ae5c53f3f8198342" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:36.443784 10299 raft_consensus.cc:2804] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.425519 10218 raft_consensus.cc:2804] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.444181 10227 leader_election.cc:290] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:36.444545  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2c2487f2f644ce9cba2ec3f72b7993" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:36.446422  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d50b9a85aa742458e037bd19f757196" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:36.446545  9605 raft_consensus.cc:2468] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 2.
I20260709 13:03:36.446975  9532 raft_consensus.cc:3060] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.448508  9682 raft_consensus.cc:2468] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:36.449864  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23edaf5688c4b51a8f524e1fb7c928f" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:36.450431  9608 raft_consensus.cc:3060] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.449229 10218 raft_consensus.cc:697] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:36.457693 10218 consensus_queue.cc:237] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.451525 10297 raft_consensus.cc:493] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.459616 10297 raft_consensus.cc:515] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.463111  9532 raft_consensus.cc:2468] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 2.
I20260709 13:03:36.448792 10299 raft_consensus.cc:697] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:36.472275 10297 leader_election.cc:290] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:36.474889  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190b9b4fa544118981626f9985e1276" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:36.475538  9682 raft_consensus.cc:3060] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.480110 10215 tablet_bootstrap.cc:492] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:36.481154 10215 tablet_bootstrap.cc:492] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:36.481838 10215 ts_tablet_manager.cc:1403] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.130s	user 0.024s	sys 0.012s
I20260709 13:03:36.482554 10299 consensus_queue.cc:237] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.484702 10215 raft_consensus.cc:359] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.485473 10215 raft_consensus.cc:740] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:36.486248  9608 raft_consensus.cc:2468] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 2.
W20260709 13:03:36.486179  9646 leader_election.cc:336] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.492046 10075 raft_consensus.cc:493] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.492631 10075 raft_consensus.cc:515] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.489742 10215 consensus_queue.cc:260] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.497859 10107 raft_consensus.cc:515] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
W20260709 13:03:36.498750  9646 leader_election.cc:336] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
W20260709 13:03:36.500121  9646 leader_election.cc:336] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.503963 10075 leader_election.cc:290] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
W20260709 13:03:36.500717  9646 leader_election.cc:336] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
W20260709 13:03:36.507136  9646 leader_election.cc:336] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
W20260709 13:03:36.507843  9646 consensus_peers.cc:597] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.508232  9646 leader_election.cc:336] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
W20260709 13:03:36.509703  9647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45605, user_credentials={real_user=slave}} blocked reactor thread for 64422.5us
I20260709 13:03:36.516419 10215 ts_tablet_manager.cc:1434] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 13:03:36.518307 10215 tablet_bootstrap.cc:492] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:36.525177 10107 leader_election.cc:290] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.516280  9354 catalog_manager.cc:5697] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.555195  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05c2b77c014117ae5c53f3f8198342" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:36.518093  9682 raft_consensus.cc:2468] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 2.
I20260709 13:03:36.596268 10229 raft_consensus.cc:493] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.597477  9647 leader_election.cc:304] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:36.598564  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c671c6618ad41ff8d9f7d3d121ed086" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:36.601369  9681 raft_consensus.cc:2468] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:36.601549 10299 raft_consensus.cc:2749] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:36.601699  9647 leader_election.cc:304] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:36.599171 10216 raft_consensus.cc:493] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.602571 10218 raft_consensus.cc:2804] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.602734 10216 raft_consensus.cc:515] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.603307 10218 raft_consensus.cc:697] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:36.600307 10229 raft_consensus.cc:515] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.604254 10218 consensus_queue.cc:237] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.605172 10216 leader_election.cc:290] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.605276 10229 leader_election.cc:290] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.596508 10226 raft_consensus.cc:515] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.608210 10268 raft_consensus.cc:493] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.608918 10268 raft_consensus.cc:515] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.610913 10268 leader_election.cc:290] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:36.620709  9571 leader_election.cc:304] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.620594  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0797397ca74a699473bb7b07f063c8" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:36.623677  9681 raft_consensus.cc:1275] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Refusing update from remote peer 8bf0e3504c4f46cf8c639da3e15caf68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.623823  9682 raft_consensus.cc:3060] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.625140 10107 raft_consensus.cc:2804] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.625609 10107 raft_consensus.cc:697] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:36.611883  9497 leader_election.cc:304] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.626365 10107 consensus_queue.cc:237] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.628089 10217 consensus_queue.cc:1048] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:36.628285  9355 catalog_manager.cc:5697] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.619578  9647 leader_election.cc:304] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:36.633599 10227 raft_consensus.cc:2804] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.634694 10227 raft_consensus.cc:697] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:36.636540  9647 leader_election.cc:304] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:36.640389 10299 raft_consensus.cc:2804] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.640992 10299 raft_consensus.cc:697] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:36.642572 10299 consensus_queue.cc:237] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
W20260709 13:03:36.650527  9497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:41541, user_credentials={real_user=slave}} blocked reactor thread for 132707us
I20260709 13:03:36.654085  9355 catalog_manager.cc:5697] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.660449  9534 raft_consensus.cc:1275] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Refusing update from remote peer eaba2f78a9274147a783ffa321939ed5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.664044 10299 consensus_queue.cc:1048] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:36.664258  9646 leader_election.cc:336] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.598970  9532 raft_consensus.cc:2468] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
I20260709 13:03:36.670935 10080 raft_consensus.cc:2804] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.673871 10080 raft_consensus.cc:493] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.674559 10080 raft_consensus.cc:3060] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.680442 10226 leader_election.cc:290] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:36.640604 10227 consensus_queue.cc:237] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.682729  9534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcede6679b495786781fa878243f44" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:36.682729  9647 leader_election.cc:304] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:36.687887  9534 raft_consensus.cc:3060] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.693863 10306 raft_consensus.cc:2804] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.694636 10306 raft_consensus.cc:493] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.694689  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0d047c0df4036a4702dbc607a318e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:36.686285  9603 raft_consensus.cc:1275] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Refusing update from remote peer eaba2f78a9274147a783ffa321939ed5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.695072 10306 raft_consensus.cc:3060] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.695461  9678 raft_consensus.cc:2468] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:36.696197  9673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2c2487f2f644ce9cba2ec3f72b7993" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:36.696921  9673 raft_consensus.cc:2468] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:36.702912  9534 raft_consensus.cc:2468] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 2.
I20260709 13:03:36.703954  9607 raft_consensus.cc:1275] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Refusing update from remote peer eaba2f78a9274147a783ffa321939ed5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.702942  9530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df55ee6044645c183a597fd3f8b2aaf" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:36.705013  9530 raft_consensus.cc:2468] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:36.705094  9682 raft_consensus.cc:2468] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 2.
I20260709 13:03:36.705216  9497 leader_election.cc:304] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.708516 10216 raft_consensus.cc:2804] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.708984 10216 raft_consensus.cc:493] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.709484 10216 raft_consensus.cc:3060] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.712455  9571 leader_election.cc:304] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.713598 10097 raft_consensus.cc:2804] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.713918 10215 tablet_bootstrap.cc:492] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:36.714213 10097 raft_consensus.cc:697] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:36.715319 10097 consensus_queue.cc:237] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:36.718677 10215 tablet_bootstrap.cc:492] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:36.720942  9647 leader_election.cc:304] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:36.722287 10299 raft_consensus.cc:2804] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.725895 10298 consensus_queue.cc:1048] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.726779 10215 ts_tablet_manager.cc:1403] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.210s	user 0.017s	sys 0.007s
I20260709 13:03:36.726841 10299 raft_consensus.cc:697] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:36.727968 10298 consensus_queue.cc:1048] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.727979 10299 consensus_queue.cc:237] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.747888  9573 leader_election.cc:304] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:36.750761 10107 raft_consensus.cc:2804] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.751334 10107 raft_consensus.cc:493] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.751829 10107 raft_consensus.cc:3060] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.756412 10215 raft_consensus.cc:359] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:36.757156 10215 raft_consensus.cc:740] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:36.759389 10215 consensus_queue.cc:260] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
W20260709 13:03:36.773511  9497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:41541, user_credentials={real_user=slave}} blocked reactor thread for 67239us
I20260709 13:03:36.777551  9497 leader_election.cc:304] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.778475 10326 raft_consensus.cc:2804] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.778882 10326 raft_consensus.cc:493] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.779215 10326 raft_consensus.cc:3060] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.784341 10215 ts_tablet_manager.cc:1434] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:03:36.785075 10215 tablet_bootstrap.cc:492] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:36.783743  9497 leader_election.cc:304] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 
W20260709 13:03:36.793113  9646 consensus_peers.cc:597] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:36.798106 10216 raft_consensus.cc:515] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.808049 10107 raft_consensus.cc:515] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.819008 10326 raft_consensus.cc:515] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.822886  9677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0d047c0df4036a4702dbc607a318e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:36.823781  9677 raft_consensus.cc:3060] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:36.829583  9646 consensus_peers.cc:597] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:36.834473  9355 catalog_manager.cc:5697] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.837795 10308 raft_consensus.cc:2804] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.838227 10308 raft_consensus.cc:493] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:36.838630 10308 raft_consensus.cc:3060] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.836380  9355 catalog_manager.cc:5697] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.822049 10326 leader_election.cc:290] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.867023 10107 leader_election.cc:290] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:36.867728  9355 catalog_manager.cc:5697] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.869603  9355 catalog_manager.cc:5697] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.877007  9528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df55ee6044645c183a597fd3f8b2aaf" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:36.877786  9528 raft_consensus.cc:3060] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.878037 10216 leader_election.cc:290] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.882043  9677 raft_consensus.cc:2468] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 2.
I20260709 13:03:36.882259 10308 raft_consensus.cc:515] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.886659 10308 leader_election.cc:290] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.888185 10306 raft_consensus.cc:515] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.897416  9528 raft_consensus.cc:2468] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 2.
I20260709 13:03:36.898025  9354 catalog_manager.cc:5697] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.900450  9573 leader_election.cc:304] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:36.903221  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05c2b77c014117ae5c53f3f8198342" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
W20260709 13:03:36.902575  9497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:41541, user_credentials={real_user=slave}} blocked reactor thread for 53037.4us
I20260709 13:03:36.892187 10080 raft_consensus.cc:515] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.906823 10080 leader_election.cc:290] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:36.891050 10306 leader_election.cc:290] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:36.914440  9531 raft_consensus.cc:2393] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate eaba2f78a9274147a783ffa321939ed5 in current term 2: Already voted for candidate 7610e18c23c543f1a31b6d851bac1bb2 in this term.
I20260709 13:03:36.914790  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2c2487f2f644ce9cba2ec3f72b7993" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:36.915658  9678 raft_consensus.cc:3060] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.916682  9677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c671c6618ad41ff8d9f7d3d121ed086" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:36.917315  9677 raft_consensus.cc:3060] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:36.917694  9646 leader_election.cc:336] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:36.921947  9647 leader_election.cc:304] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:36.934240  9681 raft_consensus.cc:1275] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Refusing update from remote peer 8bf0e3504c4f46cf8c639da3e15caf68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.928881 10299 raft_consensus.cc:2749] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:36.941952  9497 leader_election.cc:304] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.944015 10097 consensus_queue.cc:1048] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:36.947383 10303 raft_consensus.cc:2804] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.949363 10303 raft_consensus.cc:697] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:36.943387  9677 raft_consensus.cc:2468] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 2.
I20260709 13:03:36.950253 10080 raft_consensus.cc:2804] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.950227 10303 consensus_queue.cc:237] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.954705  9603 raft_consensus.cc:1275] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Refusing update from remote peer 7610e18c23c543f1a31b6d851bac1bb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.967077 10080 raft_consensus.cc:697] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:36.968660 10080 consensus_queue.cc:237] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.951112  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05c2b77c014117ae5c53f3f8198342" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:36.968875 10308 consensus_queue.cc:1048] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:36.969873  9682 raft_consensus.cc:2393] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7610e18c23c543f1a31b6d851bac1bb2 in current term 2: Already voted for candidate eaba2f78a9274147a783ffa321939ed5 in this term.
I20260709 13:03:36.953152  9354 catalog_manager.cc:5697] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.970793  9497 leader_election.cc:304] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.974076 10308 raft_consensus.cc:2804] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.974581 10308 raft_consensus.cc:697] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:36.977739 10215 tablet_bootstrap.cc:492] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:36.979851 10215 tablet_bootstrap.cc:492] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:36.979892  9607 raft_consensus.cc:1275] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Refusing update from remote peer eaba2f78a9274147a783ffa321939ed5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.976963 10308 consensus_queue.cc:237] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:36.980571 10215 ts_tablet_manager.cc:1403] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.196s	user 0.023s	sys 0.011s
I20260709 13:03:36.947090  9678 raft_consensus.cc:2468] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 2.
I20260709 13:03:36.982936 10306 consensus_queue.cc:1048] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.983253 10215 raft_consensus.cc:359] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:36.983922 10215 raft_consensus.cc:740] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:36.984606 10215 consensus_queue.cc:260] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:36.986078  9497 leader_election.cc:304] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:36.987988 10215 ts_tablet_manager.cc:1434] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:36.989248 10215 tablet_bootstrap.cc:492] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:36.993599 10323 raft_consensus.cc:2804] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:37.000324 10323 raft_consensus.cc:697] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:37.001358 10323 consensus_queue.cc:237] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:37.011571   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:39371
I20260709 13:03:37.019600 10338 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:39371 every 8 connection(s)
I20260709 13:03:37.020355  9682 raft_consensus.cc:1275] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Refusing update from remote peer 8bf0e3504c4f46cf8c639da3e15caf68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:37.023351 10097 consensus_queue.cc:1048] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:37.043588 10215 tablet_bootstrap.cc:492] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:37.044806 10215 tablet_bootstrap.cc:492] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:37.045440 10215 ts_tablet_manager.cc:1403] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.019s
I20260709 13:03:37.048498 10215 raft_consensus.cc:359] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:37.049574 10215 raft_consensus.cc:740] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.050397 10215 consensus_queue.cc:260] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:37.052570 10215 ts_tablet_manager.cc:1434] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:37.053423 10215 tablet_bootstrap.cc:492] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:37.064904  9354 catalog_manager.cc:5697] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:37.074515 10220 raft_consensus.cc:493] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.075188 10220 raft_consensus.cc:515] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:37.086095  9352 catalog_manager.cc:5697] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:37.074576  9530 raft_consensus.cc:1275] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Refusing update from remote peer eaba2f78a9274147a783ffa321939ed5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:37.118584 10218 consensus_queue.cc:1048] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:03:37.135885 10220 leader_election.cc:290] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:37.150476 10275 raft_consensus.cc:3060] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:37.150930 10215 tablet_bootstrap.cc:492] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:37.152148 10215 tablet_bootstrap.cc:492] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:37.152953 10215 ts_tablet_manager.cc:1403] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.100s	user 0.042s	sys 0.032s
I20260709 13:03:37.156044  9531 raft_consensus.cc:1275] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Refusing update from remote peer eaba2f78a9274147a783ffa321939ed5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:37.156183 10220 raft_consensus.cc:493] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.156770 10220 raft_consensus.cc:515] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:37.159880  9608 raft_consensus.cc:1275] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Refusing update from remote peer eaba2f78a9274147a783ffa321939ed5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:37.159106 10220 leader_election.cc:290] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
W20260709 13:03:37.163435  9646 consensus_peers.cc:597] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:37.164113 10295 consensus_queue.cc:1048] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:03:37.167652 10226 consensus_queue.cc:1048] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:37.165398 10220 raft_consensus.cc:493] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.169834 10220 raft_consensus.cc:515] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
W20260709 13:03:37.171729  9646 consensus_peers.cc:597] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:37.176973 10215 raft_consensus.cc:359] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:37.177755 10215 raft_consensus.cc:740] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.177366 10275 raft_consensus.cc:1275] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Refusing update from remote peer eaba2f78a9274147a783ffa321939ed5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:37.179869 10215 consensus_queue.cc:260] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:37.187125  9355 catalog_manager.cc:5697] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:37.195082  9355 catalog_manager.cc:5697] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 1 to 2, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:37.198002 10276 raft_consensus.cc:3060] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:37.223846 10215 ts_tablet_manager.cc:1434] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.071s	user 0.010s	sys 0.014s
I20260709 13:03:37.230438  9682 raft_consensus.cc:1275] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Refusing update from remote peer 8bf0e3504c4f46cf8c639da3e15caf68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:37.220726 10299 consensus_queue.cc:1048] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:03:37.239689 10268 consensus_queue.cc:1048] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:03:37.245718 10220 leader_election.cc:290] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:37.240775 10269 raft_consensus.cc:3060] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:37.253086  9607 raft_consensus.cc:1275] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Refusing update from remote peer eaba2f78a9274147a783ffa321939ed5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:03:37.274238  9646 consensus_peers.cc:597] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:37.274995  9646 consensus_peers.cc:597] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:37.277901  9531 raft_consensus.cc:1275] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Refusing update from remote peer eaba2f78a9274147a783ffa321939ed5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:37.257341 10215 tablet_bootstrap.cc:492] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:37.285386 10226 consensus_queue.cc:1048] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:37.295897 10298 consensus_queue.cc:1048] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:37.334475  9573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:34349, user_credentials={real_user=slave}} blocked reactor thread for 117070us
I20260709 13:03:37.341233 10276 raft_consensus.cc:1275] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Refusing update from remote peer eaba2f78a9274147a783ffa321939ed5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:37.328606 10220 raft_consensus.cc:493] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.359513 10359 raft_consensus.cc:493] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.366984 10273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df55ee6044645c183a597fd3f8b2aaf" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:37.367185 10275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6708a2f76d0f4292b01c5bb066f7bcac" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:37.367730 10267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d50b9a85aa742458e037bd19f757196" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:37.368440 10267 raft_consensus.cc:2468] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 2.
I20260709 13:03:37.369632 10359 raft_consensus.cc:515] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:37.370797 10262 raft_consensus.cc:3060] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:37.371907 10359 leader_election.cc:290] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:37.379782  9682 raft_consensus.cc:1275] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Refusing update from remote peer 7610e18c23c543f1a31b6d851bac1bb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:37.350989 10220 raft_consensus.cc:515] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:37.392964 10298 consensus_queue.cc:1048] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:37.380585 10359 raft_consensus.cc:493] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.405401 10215 tablet_bootstrap.cc:492] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:37.388176 10308 consensus_queue.cc:1048] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:03:37.419003 10215 tablet_bootstrap.cc:492] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:37.420137 10215 ts_tablet_manager.cc:1403] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.165s	user 0.032s	sys 0.008s
I20260709 13:03:37.421027 10220 leader_election.cc:290] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:37.422410 10276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aceba3614aec44bd97d0a2111129bae4" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:37.435773 10273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05c2b77c014117ae5c53f3f8198342" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:37.437073 10273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c671c6618ad41ff8d9f7d3d121ed086" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:37.437741 10273 raft_consensus.cc:2468] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:37.438596 10273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aa3eb6cc3047579924350ba3f75d90" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:37.411147 10359 raft_consensus.cc:515] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:37.441331  9677 raft_consensus.cc:1275] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Refusing update from remote peer 7610e18c23c543f1a31b6d851bac1bb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:37.439201 10273 raft_consensus.cc:3060] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:37.445324 10308 consensus_queue.cc:1048] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:37.450294 10273 raft_consensus.cc:2468] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 2.
I20260709 13:03:37.397284 10267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcede6679b495786781fa878243f44" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:37.466315 10257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2c2487f2f644ce9cba2ec3f72b7993" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:37.467583 10257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0d047c0df4036a4702dbc607a318e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:37.455560 10359 leader_election.cc:290] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:37.470424 10257 raft_consensus.cc:2468] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:37.479447 10257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0d047c0df4036a4702dbc607a318e" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:37.480123 10257 raft_consensus.cc:3060] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:37.489677 10276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23edaf5688c4b51a8f524e1fb7c928f" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:37.490898 10276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aa3eb6cc3047579924350ba3f75d90" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:37.491725 10276 raft_consensus.cc:2393] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8bf0e3504c4f46cf8c639da3e15caf68 in current term 2: Already voted for candidate 7610e18c23c543f1a31b6d851bac1bb2 in this term.
W20260709 13:03:37.491613  9498 leader_election.cc:343] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.500213  9498 leader_election.cc:304] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:37.501621 10323 raft_consensus.cc:2749] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:37.502097  9498 leader_election.cc:343] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.502574  9498 leader_election.cc:304] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:37.503326 10323 raft_consensus.cc:2749] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:37.503942  9498 leader_election.cc:304] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:37.505656  9530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a58824acb343fa8f9e1349207a54b1" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:37.506726  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d335e60a664ce6a7db36b70d7a0403" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:37.507153  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0b0663f9ce4c9db6d2da7a4405309b" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:37.507210 10215 raft_consensus.cc:359] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:37.508626 10215 raft_consensus.cc:740] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.513561 10273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134aecc79f7c4b398afcbf65000e3267" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:37.509867 10323 raft_consensus.cc:2764] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:03:37.514385 10276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134aecc79f7c4b398afcbf65000e3267" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:37.515537 10276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df55ee6044645c183a597fd3f8b2aaf" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:37.515858 10275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aa3eb6cc3047579924350ba3f75d90" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:37.516520 10275 raft_consensus.cc:2376] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 2. Re-sending same reply.
I20260709 13:03:37.517714 10275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0797397ca74a699473bb7b07f063c8" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:37.518392 10275 raft_consensus.cc:2468] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:37.520179 10215 consensus_queue.cc:260] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
W20260709 13:03:37.521773  9498 leader_election.cc:343] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.526310 10215 ts_tablet_manager.cc:1434] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.106s	user 0.006s	sys 0.001s
I20260709 13:03:37.526435 10267 raft_consensus.cc:2468] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 1.
I20260709 13:03:37.527262 10215 tablet_bootstrap.cc:492] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:37.529953 10267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2c2487f2f644ce9cba2ec3f72b7993" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:37.516592 10276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df55ee6044645c183a597fd3f8b2aaf" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:37.539773  9682 raft_consensus.cc:1275] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Refusing update from remote peer 7610e18c23c543f1a31b6d851bac1bb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:37.515563 10273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0797397ca74a699473bb7b07f063c8" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:37.519817 10258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05c2b77c014117ae5c53f3f8198342" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:37.554100 10258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c671c6618ad41ff8d9f7d3d121ed086" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:37.554941 10258 raft_consensus.cc:3060] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:37.565022 10326 consensus_queue.cc:1048] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:37.568552 10266 raft_consensus.cc:1275] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Refusing update from remote peer 7610e18c23c543f1a31b6d851bac1bb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:37.544543 10257 raft_consensus.cc:2468] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 2.
I20260709 13:03:37.542768 10267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190b9b4fa544118981626f9985e1276" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:37.554267  9531 raft_consensus.cc:1275] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Refusing update from remote peer 8bf0e3504c4f46cf8c639da3e15caf68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:37.575178 10267 raft_consensus.cc:2468] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:37.560752 10275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190b9b4fa544118981626f9985e1276" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:37.577050 10275 raft_consensus.cc:3060] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:37.585568 10303 consensus_queue.cc:1048] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:37.546732 10273 raft_consensus.cc:3060] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:37.600203  9498 leader_election.cc:343] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.604825  9572 leader_election.cc:304] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:37.609365  9498 leader_election.cc:304] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: eaba2f78a9274147a783ffa321939ed5
W20260709 13:03:37.611286  9498 leader_election.cc:343] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:37.612087  9498 leader_election.cc:343] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.612425  9498 leader_election.cc:304] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:37.621711 10080 consensus_queue.cc:1048] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:37.626046 10266 raft_consensus.cc:1275] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Refusing update from remote peer 7610e18c23c543f1a31b6d851bac1bb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:37.619613 10308 raft_consensus.cc:2764] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:03:37.627401 10360 raft_consensus.cc:2749] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:37.621326 10216 raft_consensus.cc:2749] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:03:37.629125  9572 leader_election.cc:343] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.629614  9572 leader_election.cc:304] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:37.639642 10357 raft_consensus.cc:493] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaba2f78a9274147a783ffa321939ed5)
I20260709 13:03:37.640323 10357 raft_consensus.cc:515] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:37.642872 10275 raft_consensus.cc:2468] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 2.
I20260709 13:03:37.652168 10268 raft_consensus.cc:2749] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:37.652345  9572 leader_election.cc:304] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:37.653843 10268 raft_consensus.cc:2749] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:37.654286  9572 leader_election.cc:343] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:37.655969  9572 leader_election.cc:343] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:37.657294  9572 leader_election.cc:343] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.658469 10276 raft_consensus.cc:1275] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Refusing update from remote peer 8bf0e3504c4f46cf8c639da3e15caf68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:37.659876 10260 raft_consensus.cc:3060] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:37.678716  9498 consensus_peers.cc:597] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:37.679293  9498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39371, user_credentials={real_user=slave}} blocked reactor thread for 55574.2us
I20260709 13:03:37.681275 10258 raft_consensus.cc:2468] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 2.
I20260709 13:03:37.683455 10216 consensus_queue.cc:1048] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:37.678718  9572 leader_election.cc:343] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.695152  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0797397ca74a699473bb7b07f063c8" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:37.695887  9673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b589ee51a3b4411a255ac63c57232f9" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:37.696579  9682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dc81bdfb864e568aba35ed5d9f24dd" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:37.699193  9607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b589ee51a3b4411a255ac63c57232f9" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:37.699569  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0797397ca74a699473bb7b07f063c8" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
W20260709 13:03:37.704213  9572 consensus_peers.cc:597] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:37.705461  9572 consensus_peers.cc:597] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:37.706993  9572 consensus_peers.cc:597] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:37.717729  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dc81bdfb864e568aba35ed5d9f24dd" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:37.700454  9676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a58824acb343fa8f9e1349207a54b1" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
W20260709 13:03:37.738060 10376 log.cc:927] Time spent T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:03:37.741139  9604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d335e60a664ce6a7db36b70d7a0403" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:37.722923 10357 leader_election.cc:290] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:37.733912  9603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0b0663f9ce4c9db6d2da7a4405309b" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:37.764144 10208 leader_election.cc:304] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:37.764689 10303 consensus_queue.cc:1048] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:37.765599 10208 leader_election.cc:304] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:37.746729 10267 raft_consensus.cc:1275] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Refusing update from remote peer 7610e18c23c543f1a31b6d851bac1bb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:37.767498  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871790aff5ff4037ad0c30f4e0276aa3" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:37.767832 10210 leader_election.cc:304] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:37.768981 10375 raft_consensus.cc:2749] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:37.769201 10210 leader_election.cc:304] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:37.769685 10375 raft_consensus.cc:2749] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:37.770315 10375 raft_consensus.cc:2749] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:37.791637  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871790aff5ff4037ad0c30f4e0276aa3" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:37.800288 10273 raft_consensus.cc:2468] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 2.
I20260709 13:03:37.802379 10257 raft_consensus.cc:1275] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Refusing update from remote peer 8bf0e3504c4f46cf8c639da3e15caf68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:37.803373 10367 raft_consensus.cc:2749] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:37.805130 10208 leader_election.cc:304] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:37.806457 10357 raft_consensus.cc:2749] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:37.808151 10208 leader_election.cc:304] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:37.808568 10269 raft_consensus.cc:3060] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:37.821182 10357 raft_consensus.cc:2749] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:37.826310 10208 leader_election.cc:304] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04edfe53c70f45e09190743b636a705f; no voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:37.827459 10367 raft_consensus.cc:2749] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:37.828858  9646 consensus_peers.cc:597] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:37.831552 10360 consensus_queue.cc:1048] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:37.833942 10216 consensus_queue.cc:1048] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:37.883436  9646 consensus_peers.cc:597] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:37.968364 10215 tablet_bootstrap.cc:492] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:37.969655 10215 tablet_bootstrap.cc:492] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:37.970528 10215 ts_tablet_manager.cc:1403] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.443s	user 0.028s	sys 0.033s
I20260709 13:03:38.005144 10346 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41919
I20260709 13:03:38.005658 10346 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:38.006579 10346 heartbeater.cc:507] Master 127.0.107.254:41919 requested a full tablet report, sending...
I20260709 13:03:38.022497 10215 raft_consensus.cc:359] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
W20260709 13:03:38.031601  9646 consensus_peers.cc:597] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:38.025336 10215 raft_consensus.cc:740] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.047549 10215 consensus_queue.cc:260] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:38.049923 10215 ts_tablet_manager.cc:1434] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.000s
I20260709 13:03:38.050782 10215 tablet_bootstrap.cc:492] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.067155  9356 ts_manager.cc:194] Re-registered known tserver with Master: 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:38.071090 10215 tablet_bootstrap.cc:492] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.072518 10215 tablet_bootstrap.cc:492] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.074499 10215 ts_tablet_manager.cc:1403] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.000s
I20260709 13:03:38.076829 10215 raft_consensus.cc:359] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:38.077468 10215 raft_consensus.cc:740] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.078078 10215 consensus_queue.cc:260] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:38.079977 10215 ts_tablet_manager.cc:1434] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:03:38.080509 10215 tablet_bootstrap.cc:492] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
W20260709 13:03:38.083532  9498 consensus_peers.cc:597] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:38.092469 10215 tablet_bootstrap.cc:492] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.093397 10215 tablet_bootstrap.cc:492] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.093983 10215 ts_tablet_manager.cc:1403] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 13:03:38.096585 10215 raft_consensus.cc:359] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.097267 10215 raft_consensus.cc:740] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.097937 10215 consensus_queue.cc:260] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.099684 10215 ts_tablet_manager.cc:1434] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:03:38.100428 10215 tablet_bootstrap.cc:492] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.109978  9356 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49240
I20260709 13:03:38.114528 10215 tablet_bootstrap.cc:492] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.114979 10346 heartbeater.cc:499] Master 127.0.107.254:41919 was elected leader, sending a full tablet report...
I20260709 13:03:38.115927 10215 tablet_bootstrap.cc:492] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.120724 10215 ts_tablet_manager.cc:1403] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.007s
I20260709 13:03:38.123749 10215 raft_consensus.cc:359] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.124423 10215 raft_consensus.cc:740] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.125214 10215 consensus_queue.cc:260] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.127992 10215 ts_tablet_manager.cc:1434] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:38.129222 10215 tablet_bootstrap.cc:492] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.144397 10215 tablet_bootstrap.cc:492] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.145141 10215 tablet_bootstrap.cc:492] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.145663 10215 ts_tablet_manager.cc:1403] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:03:38.148121 10215 raft_consensus.cc:359] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:38.148717 10215 raft_consensus.cc:740] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.149338 10215 consensus_queue.cc:260] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:38.151448 10215 ts_tablet_manager.cc:1434] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:03:38.152215 10215 tablet_bootstrap.cc:492] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.166879 10215 tablet_bootstrap.cc:492] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.167840 10215 tablet_bootstrap.cc:492] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.168483 10215 ts_tablet_manager.cc:1403] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:03:38.170871 10215 raft_consensus.cc:359] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.171497 10215 raft_consensus.cc:740] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.172192 10215 consensus_queue.cc:260] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.174376 10215 ts_tablet_manager.cc:1434] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:38.175139 10215 tablet_bootstrap.cc:492] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.194571 10215 tablet_bootstrap.cc:492] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.195475 10215 tablet_bootstrap.cc:492] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.196062 10215 ts_tablet_manager.cc:1403] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:03:38.198596 10215 raft_consensus.cc:359] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.199100 10215 raft_consensus.cc:740] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.199795 10215 consensus_queue.cc:260] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.204304 10215 ts_tablet_manager.cc:1434] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:03:38.205067 10215 tablet_bootstrap.cc:492] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.227540 10215 tablet_bootstrap.cc:492] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.228677 10215 tablet_bootstrap.cc:492] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.229411 10215 ts_tablet_manager.cc:1403] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.003s
I20260709 13:03:38.231488 10215 raft_consensus.cc:359] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:38.232010 10215 raft_consensus.cc:740] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.232630 10215 consensus_queue.cc:260] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:38.234495 10215 ts_tablet_manager.cc:1434] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:03:38.235827 10215 tablet_bootstrap.cc:492] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.251806 10215 tablet_bootstrap.cc:492] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.252751 10215 tablet_bootstrap.cc:492] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.253371 10215 ts_tablet_manager.cc:1403] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:03:38.255584 10215 raft_consensus.cc:359] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:38.256148 10215 raft_consensus.cc:740] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.256691 10215 consensus_queue.cc:260] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:38.258378 10215 ts_tablet_manager.cc:1434] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:38.259570 10215 tablet_bootstrap.cc:492] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.273898 10215 tablet_bootstrap.cc:492] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.274739 10215 tablet_bootstrap.cc:492] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.275417 10215 ts_tablet_manager.cc:1403] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.004s
I20260709 13:03:38.277784 10215 raft_consensus.cc:359] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.278432 10215 raft_consensus.cc:740] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.279093 10215 consensus_queue.cc:260] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.280550 10215 ts_tablet_manager.cc:1434] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:38.281657 10215 tablet_bootstrap.cc:492] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.297224 10215 tablet_bootstrap.cc:492] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.298169 10215 tablet_bootstrap.cc:492] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.298975 10215 ts_tablet_manager.cc:1403] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 13:03:38.301258 10215 raft_consensus.cc:359] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.302608 10215 raft_consensus.cc:740] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.303399 10215 consensus_queue.cc:260] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.305536 10215 ts_tablet_manager.cc:1434] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:03:38.306300 10215 tablet_bootstrap.cc:492] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.314670 10269 raft_consensus.cc:3060] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.340427 10215 tablet_bootstrap.cc:492] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.341336 10215 tablet_bootstrap.cc:492] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.342010 10215 ts_tablet_manager.cc:1403] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.036s	user 0.024s	sys 0.008s
I20260709 13:03:38.344429 10215 raft_consensus.cc:359] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:38.345316 10215 raft_consensus.cc:740] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.346074 10215 consensus_queue.cc:260] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:38.348193 10215 ts_tablet_manager.cc:1434] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:03:38.348994 10215 tablet_bootstrap.cc:492] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.366623 10215 tablet_bootstrap.cc:492] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.367614 10215 tablet_bootstrap.cc:492] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.368252 10215 ts_tablet_manager.cc:1403] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.009s
I20260709 13:03:38.370771 10215 raft_consensus.cc:359] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:38.371397 10215 raft_consensus.cc:740] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.371981 10215 consensus_queue.cc:260] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:38.374020 10215 ts_tablet_manager.cc:1434] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260709 13:03:38.375502 10215 tablet_bootstrap.cc:492] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.390010 10215 tablet_bootstrap.cc:492] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.390902 10215 tablet_bootstrap.cc:492] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.391537 10215 ts_tablet_manager.cc:1403] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.001s
I20260709 13:03:38.393236 10215 raft_consensus.cc:359] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.393707 10215 raft_consensus.cc:740] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.394254 10215 consensus_queue.cc:260] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.395918 10215 ts_tablet_manager.cc:1434] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:38.397527 10215 tablet_bootstrap.cc:492] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.411316 10215 tablet_bootstrap.cc:492] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.412225 10215 tablet_bootstrap.cc:492] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.412875 10215 ts_tablet_manager.cc:1403] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:03:38.414915 10215 raft_consensus.cc:359] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:38.415652 10215 raft_consensus.cc:740] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.416216 10215 consensus_queue.cc:260] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:38.418053 10215 ts_tablet_manager.cc:1434] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:38.419462 10215 tablet_bootstrap.cc:492] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.437175 10215 tablet_bootstrap.cc:492] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.438110 10215 tablet_bootstrap.cc:492] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.438889 10215 ts_tablet_manager.cc:1403] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 13:03:38.440871 10215 raft_consensus.cc:359] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:38.441502 10215 raft_consensus.cc:740] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.442306 10215 consensus_queue.cc:260] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:38.444137 10215 ts_tablet_manager.cc:1434] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:03:38.445118 10215 tablet_bootstrap.cc:492] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
W20260709 13:03:38.449066  9498 consensus_peers.cc:597] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:38.460220 10215 tablet_bootstrap.cc:492] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.461048 10215 tablet_bootstrap.cc:492] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.461575 10215 ts_tablet_manager.cc:1403] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.003s
I20260709 13:03:38.463428 10215 raft_consensus.cc:359] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:38.464375 10215 raft_consensus.cc:740] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.464936 10215 consensus_queue.cc:260] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:38.466754 10215 ts_tablet_manager.cc:1434] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:38.467710 10215 tablet_bootstrap.cc:492] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.483347 10215 tablet_bootstrap.cc:492] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.484361 10215 tablet_bootstrap.cc:492] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.485030 10215 ts_tablet_manager.cc:1403] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:03:38.487607 10215 raft_consensus.cc:359] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.488273 10215 raft_consensus.cc:740] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.488893 10215 consensus_queue.cc:260] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.490620 10215 ts_tablet_manager.cc:1434] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:38.491622 10215 tablet_bootstrap.cc:492] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.508771 10215 tablet_bootstrap.cc:492] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.509503 10215 tablet_bootstrap.cc:492] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.510042 10215 ts_tablet_manager.cc:1403] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:03:38.512308 10215 raft_consensus.cc:359] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.512926 10215 raft_consensus.cc:740] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.513568 10215 consensus_queue.cc:260] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:38.515676 10215 ts_tablet_manager.cc:1434] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:03:38.517027 10215 tablet_bootstrap.cc:492] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.523459 10260 raft_consensus.cc:3060] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.540027 10215 tablet_bootstrap.cc:492] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.541116 10215 tablet_bootstrap.cc:492] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.541949 10215 ts_tablet_manager.cc:1403] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.008s
I20260709 13:03:38.544771 10215 raft_consensus.cc:359] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:38.545490 10215 raft_consensus.cc:740] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.546489 10215 consensus_queue.cc:260] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:38.547993 10215 ts_tablet_manager.cc:1434] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:03:38.548805 10257 raft_consensus.cc:3060] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.549147 10215 tablet_bootstrap.cc:492] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.594360 10260 raft_consensus.cc:3060] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.606232 10215 tablet_bootstrap.cc:492] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.607218 10215 tablet_bootstrap.cc:492] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.607928 10215 ts_tablet_manager.cc:1403] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.016s
I20260709 13:03:38.610598 10215 raft_consensus.cc:359] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:38.611326 10215 raft_consensus.cc:740] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.611979 10215 consensus_queue.cc:260] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:38.613806 10215 ts_tablet_manager.cc:1434] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:38.614562 10215 tablet_bootstrap.cc:492] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f: Bootstrap starting.
I20260709 13:03:38.629309 10215 tablet_bootstrap.cc:492] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.630234 10215 tablet_bootstrap.cc:492] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f: Bootstrap complete.
I20260709 13:03:38.630815 10215 ts_tablet_manager.cc:1403] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:03:38.633163 10215 raft_consensus.cc:359] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:38.633852 10215 raft_consensus.cc:740] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.634480 10215 consensus_queue.cc:260] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:38.636358 10215 ts_tablet_manager.cc:1434] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 13:03:38.759260 10257 raft_consensus.cc:3060] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.808245 10257 raft_consensus.cc:3060] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.901577 10298 raft_consensus.cc:493] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.902181 10298 raft_consensus.cc:515] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:38.904327 10298 leader_election.cc:290] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:38.905103 10257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05c2b77c014117ae5c53f3f8198342" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f" is_pre_election: true
I20260709 13:03:38.905380  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05c2b77c014117ae5c53f3f8198342" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2" is_pre_election: true
I20260709 13:03:38.905752 10260 raft_consensus.cc:3060] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.905848 10257 raft_consensus.cc:2468] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
I20260709 13:03:38.906172  9531 raft_consensus.cc:2468] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 2.
I20260709 13:03:38.907274  9646 leader_election.cc:304] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:38.908970 10298 raft_consensus.cc:2804] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:38.909372 10298 raft_consensus.cc:493] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.909776 10298 raft_consensus.cc:3060] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:38.916178 10298 raft_consensus.cc:515] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:38.919636 10260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05c2b77c014117ae5c53f3f8198342" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04edfe53c70f45e09190743b636a705f"
I20260709 13:03:38.920092 10298 leader_election.cc:290] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 election: Requested vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:38.920399 10260 raft_consensus.cc:3060] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:38.921960  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05c2b77c014117ae5c53f3f8198342" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:38.922611  9531 raft_consensus.cc:3060] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:38.930452  9531 raft_consensus.cc:2468] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 3.
I20260709 13:03:38.931524 10260 raft_consensus.cc:2468] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 3.
I20260709 13:03:38.933703  9646 leader_election.cc:304] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:38.934652 10227 raft_consensus.cc:2804] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:38.935194 10227 raft_consensus.cc:697] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 3 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:38.936344 10227 consensus_queue.cc:237] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:38.951431  9356 catalog_manager.cc:5697] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 1 to 3, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.330410  9530 raft_consensus.cc:1275] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Refusing update from remote peer eaba2f78a9274147a783ffa321939ed5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:39.331516 10227 consensus_queue.cc:1048] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:39.341635 10260 raft_consensus.cc:1275] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Refusing update from remote peer eaba2f78a9274147a783ffa321939ed5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:39.344166 10392 consensus_queue.cc:1048] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:41.307516  9645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.009s	sys 0.008s
W20260709 13:03:41.311414  9645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.010s	sys 0.008s
W20260709 13:03:42.203017 10319 debug-util.cc:398] Leaking SignalData structure 0x7b0800369b20 after lost signal to thread 434
W20260709 13:03:42.204183 10319 debug-util.cc:398] Leaking SignalData structure 0x7b0800237780 after lost signal to thread 9391
W20260709 13:03:42.205577 10319 debug-util.cc:398] Leaking SignalData structure 0x7b08001c6b60 after lost signal to thread 9558
W20260709 13:03:42.206764 10319 debug-util.cc:398] Leaking SignalData structure 0x7b0800203a40 after lost signal to thread 9632
W20260709 13:03:42.207823 10319 debug-util.cc:398] Leaking SignalData structure 0x7b080030cbe0 after lost signal to thread 9706
W20260709 13:03:42.208961 10319 debug-util.cc:398] Leaking SignalData structure 0x7b080030c240 after lost signal to thread 10338
I20260709 13:03:47.775537   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:47.834038  9530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "247add59d191431987b50b009849ee54"
dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
mode: GRACEFUL
new_leader_uuid: "eaba2f78a9274147a783ffa321939ed5"
 from {username='slave'} at 127.0.0.1:40244
I20260709 13:03:47.835047  9530 raft_consensus.cc:606] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Received request to transfer leadership to TS eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:47.838500  9530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a0333b232194ff09fbd6593bc528531"
dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
mode: GRACEFUL
new_leader_uuid: "eaba2f78a9274147a783ffa321939ed5"
 from {username='slave'} at 127.0.0.1:40244
I20260709 13:03:47.839048  9530 raft_consensus.cc:606] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Received request to transfer leadership to TS eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:47.840981 10459 raft_consensus.cc:993] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2: : Instructing follower eaba2f78a9274147a783ffa321939ed5 to start an election
I20260709 13:03:47.841509 10459 raft_consensus.cc:1081] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Signalling peer eaba2f78a9274147a783ffa321939ed5 to start an election
I20260709 13:03:47.843932  9675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "247add59d191431987b50b009849ee54"
dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
 from {username='slave'} at 127.0.0.1:49728
I20260709 13:03:47.844563  9675 raft_consensus.cc:493] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:47.844974  9675 raft_consensus.cc:3060] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:47.854206  9675 raft_consensus.cc:515] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:47.854898  9602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6432b6ee54144ac1963d46714288e802"
dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
mode: GRACEFUL
new_leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
 from {username='slave'} at 127.0.0.1:45114
I20260709 13:03:47.855669  9602 raft_consensus.cc:606] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Received request to transfer leadership to TS 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:47.857040  9675 leader_election.cc:290] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:47.858083  9530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247add59d191431987b50b009849ee54" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:47.858745  9531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74c0e4e3fe184fd4af9e5a84ddc58828"
dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
mode: GRACEFUL
new_leader_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:40244
I20260709 13:03:47.858930  9530 raft_consensus.cc:3055] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:47.858896  9602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247add59d191431987b50b009849ee54" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:47.859362  9531 raft_consensus.cc:606] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Received request to transfer leadership to TS 04edfe53c70f45e09190743b636a705f
I20260709 13:03:47.859454  9530 raft_consensus.cc:740] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:47.859673  9602 raft_consensus.cc:3060] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:47.860502  9530 consensus_queue.cc:260] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:47.861615  9530 raft_consensus.cc:3060] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:47.863370  9531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c671c6618ad41ff8d9f7d3d121ed086"
dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
mode: GRACEFUL
new_leader_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:40244
I20260709 13:03:47.863899  9531 raft_consensus.cc:606] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Received request to transfer leadership to TS 04edfe53c70f45e09190743b636a705f
I20260709 13:03:47.867342  9602 raft_consensus.cc:2468] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 2.
I20260709 13:03:47.871485  9530 raft_consensus.cc:2468] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 2.
I20260709 13:03:47.872105  9647 leader_election.cc:304] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:47.873566 10464 raft_consensus.cc:2804] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:47.875916 10464 raft_consensus.cc:697] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:47.877002 10464 consensus_queue.cc:237] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:47.888293  9675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aceba3614aec44bd97d0a2111129bae4"
dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
mode: GRACEFUL
new_leader_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:39466
I20260709 13:03:47.888912  9675 raft_consensus.cc:606] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Received request to transfer leadership to TS 04edfe53c70f45e09190743b636a705f
I20260709 13:03:47.891698  9530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cba0d047c0df4036a4702dbc607a318e"
dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
mode: GRACEFUL
new_leader_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:40244
I20260709 13:03:47.892338  9530 raft_consensus.cc:606] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Received request to transfer leadership to TS 04edfe53c70f45e09190743b636a705f
I20260709 13:03:47.893900   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:03:47.895833   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:47.899905  9355 catalog_manager.cc:5697] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 1 to 2, leader changed from 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194) to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:47.958786 10459 raft_consensus.cc:993] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2: : Instructing follower 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:47.959544 10449 raft_consensus.cc:1081] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Signalling peer 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:47.961392 10267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c671c6618ad41ff8d9f7d3d121ed086"
dest_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:42618
I20260709 13:03:47.961941 10267 raft_consensus.cc:493] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:47.962287 10267 raft_consensus.cc:3060] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:47.971884 10267 raft_consensus.cc:515] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:47.973902 10267 leader_election.cc:290] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:47.974905  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c671c6618ad41ff8d9f7d3d121ed086" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:47.974931  9530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c671c6618ad41ff8d9f7d3d121ed086" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:47.975734  9675 raft_consensus.cc:3060] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:47.975826  9530 raft_consensus.cc:3055] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:47.976282  9530 raft_consensus.cc:740] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:47.977087  9530 consensus_queue.cc:260] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:47.978376  9530 raft_consensus.cc:3060] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:47.981101  9675 raft_consensus.cc:2468] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 3.
I20260709 13:03:47.982704 10208 leader_election.cc:304] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:47.985550  9530 raft_consensus.cc:2468] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 3.
I20260709 13:03:47.988538 10480 raft_consensus.cc:2804] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:47.991001 10480 raft_consensus.cc:697] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 3 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:47.992094 10480 consensus_queue.cc:237] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:48.007501  9355 catalog_manager.cc:5697] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 2 to 3, leader changed from 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194) to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 3 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:48.052459 10449 raft_consensus.cc:993] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2: : Instructing follower 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:48.052944 10449 raft_consensus.cc:1081] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Signalling peer 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:48.054589 10267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74c0e4e3fe184fd4af9e5a84ddc58828"
dest_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:42618
I20260709 13:03:48.055193 10267 raft_consensus.cc:493] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:48.055966 10267 raft_consensus.cc:3060] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.061398 10267 raft_consensus.cc:515] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:48.063040 10267 leader_election.cc:290] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:48.063728  9530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0e4e3fe184fd4af9e5a84ddc58828" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:48.064132  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0e4e3fe184fd4af9e5a84ddc58828" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:48.064328  9530 raft_consensus.cc:3055] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:48.064671  9675 raft_consensus.cc:3060] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.064667  9530 raft_consensus.cc:740] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:48.065661  9530 consensus_queue.cc:260] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:48.066872  9530 raft_consensus.cc:3060] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.071125  9675 raft_consensus.cc:2468] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 2.
I20260709 13:03:48.073125 10208 leader_election.cc:304] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:48.073913 10480 raft_consensus.cc:2804] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:48.074442 10480 raft_consensus.cc:697] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [term 2 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:48.074498  9530 raft_consensus.cc:2468] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 2.
I20260709 13:03:48.075476 10480 consensus_queue.cc:237] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:48.084978  9355 catalog_manager.cc:5697] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 1 to 2, leader changed from 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194) to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:48.085928 10464 raft_consensus.cc:993] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5: : Instructing follower 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:48.086972 10464 raft_consensus.cc:1081] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Signalling peer 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:48.088624 10267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aceba3614aec44bd97d0a2111129bae4"
dest_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:43002
I20260709 13:03:48.089175 10267 raft_consensus.cc:493] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:48.089499 10267 raft_consensus.cc:3060] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.095033 10267 raft_consensus.cc:515] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:48.096870 10267 leader_election.cc:290] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:48.097627  9602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aceba3614aec44bd97d0a2111129bae4" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:48.098272  9602 raft_consensus.cc:3060] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.098111  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aceba3614aec44bd97d0a2111129bae4" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:48.103670  9675 raft_consensus.cc:3055] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:48.104009  9675 raft_consensus.cc:740] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:48.104223  9602 raft_consensus.cc:2468] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 3.
I20260709 13:03:48.104799  9675 consensus_queue.cc:260] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:48.105436 10210 leader_election.cc:304] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:48.106207  9675 raft_consensus.cc:3060] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.106360 10480 raft_consensus.cc:2804] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:48.108050 10480 raft_consensus.cc:697] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 3 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:48.109068 10480 consensus_queue.cc:237] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:48.118600  9675 raft_consensus.cc:2468] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 3.
I20260709 13:03:48.121969  9355 catalog_manager.cc:5697] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 2 to 3, leader changed from eaba2f78a9274147a783ffa321939ed5 (127.0.107.196) to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 3 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:48.141238 10469 raft_consensus.cc:993] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68: : Instructing follower 7610e18c23c543f1a31b6d851bac1bb2 to start an election
I20260709 13:03:48.141798 10466 raft_consensus.cc:1081] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Signalling peer 7610e18c23c543f1a31b6d851bac1bb2 to start an election
I20260709 13:03:48.143131  9530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6432b6ee54144ac1963d46714288e802"
dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
 from {username='slave'} at 127.0.0.1:51908
I20260709 13:03:48.143677  9530 raft_consensus.cc:493] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:48.143999  9530 raft_consensus.cc:3060] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.148939  9530 raft_consensus.cc:515] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:48.151733  9530 leader_election.cc:290] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:48.152849  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6432b6ee54144ac1963d46714288e802" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:48.153465  9675 raft_consensus.cc:3060] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.154017  9602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6432b6ee54144ac1963d46714288e802" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:48.154589  9602 raft_consensus.cc:3055] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:48.154908  9602 raft_consensus.cc:740] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:48.155690  9602 consensus_queue.cc:260] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:48.156980  9602 raft_consensus.cc:3060] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.161161  9675 raft_consensus.cc:2468] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 2.
I20260709 13:03:48.162348  9497 leader_election.cc:304] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:48.163131 10459 raft_consensus.cc:2804] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:48.163400  9602 raft_consensus.cc:2468] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 2.
I20260709 13:03:48.164783 10459 raft_consensus.cc:697] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:48.165663 10459 consensus_queue.cc:237] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:48.175886  9355 catalog_manager.cc:5697] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 1 to 2, leader changed from 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195) to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:48.235528 10449 raft_consensus.cc:993] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2: : Instructing follower 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:48.236024 10449 raft_consensus.cc:1081] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Signalling peer 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:48.237314 10267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cba0d047c0df4036a4702dbc607a318e"
dest_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:42618
I20260709 13:03:48.237799 10267 raft_consensus.cc:493] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:48.238142 10267 raft_consensus.cc:3060] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.244915 10267 raft_consensus.cc:515] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:48.246788 10267 leader_election.cc:290] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:48.248062  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0d047c0df4036a4702dbc607a318e" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:48.248427  9530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0d047c0df4036a4702dbc607a318e" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:48.248721  9675 raft_consensus.cc:3060] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.249120  9530 raft_consensus.cc:3055] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:48.250052 10449 raft_consensus.cc:993] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2: : Instructing follower eaba2f78a9274147a783ffa321939ed5 to start an election
I20260709 13:03:48.250402  9530 raft_consensus.cc:740] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:48.250705 10449 raft_consensus.cc:1081] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Signalling peer eaba2f78a9274147a783ffa321939ed5 to start an election
I20260709 13:03:48.251472  9530 consensus_queue.cc:260] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:48.252713  9530 raft_consensus.cc:3060] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.253024  9678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a0333b232194ff09fbd6593bc528531"
dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
 from {username='slave'} at 127.0.0.1:49728
I20260709 13:03:48.253635  9678 raft_consensus.cc:493] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:48.253962  9678 raft_consensus.cc:3060] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.257285  9675 raft_consensus.cc:2468] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 3.
I20260709 13:03:48.258533 10208 leader_election.cc:304] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:48.259634 10480 raft_consensus.cc:2804] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:48.260095 10480 raft_consensus.cc:697] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 3 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:48.261169  9530 raft_consensus.cc:2468] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 3.
I20260709 13:03:48.261030 10480 consensus_queue.cc:237] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:48.263687  9678 raft_consensus.cc:515] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:48.266907  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0333b232194ff09fbd6593bc528531" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:48.267473  9531 raft_consensus.cc:3055] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:48.267753  9531 raft_consensus.cc:740] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:48.268674  9678 leader_election.cc:290] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:48.268543  9531 consensus_queue.cc:260] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:48.269989  9531 raft_consensus.cc:3060] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.270366  9602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0333b232194ff09fbd6593bc528531" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:48.270978  9602 raft_consensus.cc:3060] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.277217  9531 raft_consensus.cc:2468] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 2.
I20260709 13:03:48.278294  9647 leader_election.cc:304] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:48.279397 10462 raft_consensus.cc:2804] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:48.279829 10462 raft_consensus.cc:697] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:48.280659 10462 consensus_queue.cc:237] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:48.280117  9355 catalog_manager.cc:5697] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 2 to 3, leader changed from 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194) to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 3 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:48.283378  9602 raft_consensus.cc:2468] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 2.
I20260709 13:03:48.294021  9356 catalog_manager.cc:5697] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 1 to 2, leader changed from 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194) to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:48.316385  9531 raft_consensus.cc:1275] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Refusing update from remote peer eaba2f78a9274147a783ffa321939ed5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:48.317412 10462 consensus_queue.cc:1048] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:48.328540  9602 raft_consensus.cc:1275] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Refusing update from remote peer eaba2f78a9274147a783ffa321939ed5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:48.330025 10462 consensus_queue.cc:1048] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:48.425395  9531 raft_consensus.cc:1275] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:48.426707 10480 consensus_queue.cc:1048] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:48.433934  9675 raft_consensus.cc:1275] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:48.435423 10480 consensus_queue.cc:1048] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:48.485037  9678 raft_consensus.cc:1275] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:48.489920 10481 consensus_queue.cc:1048] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:48.500244  9531 raft_consensus.cc:1275] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:48.501715 10480 consensus_queue.cc:1048] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:48.634711  9675 raft_consensus.cc:1275] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:48.636396 10497 consensus_queue.cc:1048] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:48.637588  9602 raft_consensus.cc:1275] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:48.638903 10497 consensus_queue.cc:1048] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:48.646013  9678 raft_consensus.cc:1275] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Refusing update from remote peer 7610e18c23c543f1a31b6d851bac1bb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:48.647603 10459 consensus_queue.cc:1048] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:48.662515  9532 raft_consensus.cc:1275] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:48.664527 10497 consensus_queue.cc:1048] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:48.673203  9608 raft_consensus.cc:1275] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Refusing update from remote peer 7610e18c23c543f1a31b6d851bac1bb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:48.683624 10459 consensus_queue.cc:1048] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:48.687763  9678 raft_consensus.cc:1275] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:48.694113 10497 consensus_queue.cc:1048] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:48.691538  9602 raft_consensus.cc:1275] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Refusing update from remote peer eaba2f78a9274147a783ffa321939ed5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:48.717505  9531 raft_consensus.cc:1275] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Refusing update from remote peer eaba2f78a9274147a783ffa321939ed5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:48.760469 10462 consensus_queue.cc:1048] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:48.761160 10464 consensus_queue.cc:1048] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:48.897284   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:48.936230   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:48.973886  9602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17a105ce4cd245e3ada74a6fa7b69ffd"
dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
mode: GRACEFUL
new_leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
 from {username='slave'} at 127.0.0.1:45114
I20260709 13:03:48.974421  9602 raft_consensus.cc:606] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Received request to transfer leadership to TS 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:48.977007  9602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3188c3b2ea944412b8f9b38b34380bf0"
dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
mode: GRACEFUL
new_leader_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:45114
I20260709 13:03:48.977492  9602 raft_consensus.cc:606] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Received request to transfer leadership to TS 04edfe53c70f45e09190743b636a705f
I20260709 13:03:48.980371  9531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39889cbf037947ddabe6cf7bc7a8334a"
dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
mode: GRACEFUL
new_leader_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:40244
I20260709 13:03:48.980917  9531 raft_consensus.cc:606] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Received request to transfer leadership to TS 04edfe53c70f45e09190743b636a705f
I20260709 13:03:48.983747  9681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39a58824acb343fa8f9e1349207a54b1"
dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
mode: GRACEFUL
new_leader_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:39466
I20260709 13:03:48.984246  9681 raft_consensus.cc:606] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Received request to transfer leadership to TS 04edfe53c70f45e09190743b636a705f
I20260709 13:03:48.988994  9531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f7f960fa21840e4b44bfd4dd63d950f"
dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
mode: GRACEFUL
new_leader_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:40244
I20260709 13:03:48.990525 10485 raft_consensus.cc:993] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2: : Instructing follower 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:48.989539  9531 raft_consensus.cc:606] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Received request to transfer leadership to TS 04edfe53c70f45e09190743b636a705f
I20260709 13:03:48.991065 10449 raft_consensus.cc:1081] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Signalling peer 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:48.992687 10267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39889cbf037947ddabe6cf7bc7a8334a"
dest_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:42618
I20260709 13:03:48.993162 10267 raft_consensus.cc:493] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:48.993901 10267 raft_consensus.cc:3060] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.993897  9608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb"
dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
mode: GRACEFUL
new_leader_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:45114
I20260709 13:03:48.994653  9608 raft_consensus.cc:606] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Received request to transfer leadership to TS 04edfe53c70f45e09190743b636a705f
I20260709 13:03:48.996548   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:48.998164   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:49.005826 10267 raft_consensus.cc:515] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:49.007839 10267 leader_election.cc:290] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:49.008836  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39889cbf037947ddabe6cf7bc7a8334a" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:49.009404  9681 raft_consensus.cc:3060] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.015453  9681 raft_consensus.cc:2468] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 2.
I20260709 13:03:49.015913  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39889cbf037947ddabe6cf7bc7a8334a" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:49.016578  9531 raft_consensus.cc:3055] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:49.016829  9531 raft_consensus.cc:740] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:49.016682 10208 leader_election.cc:304] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:49.017674 10481 raft_consensus.cc:2804] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:49.018319 10481 raft_consensus.cc:697] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [term 2 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:49.019302 10481 consensus_queue.cc:237] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:49.017660  9531 consensus_queue.cc:260] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:49.024690  9531 raft_consensus.cc:3060] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.031543  9531 raft_consensus.cc:2468] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 2.
I20260709 13:03:49.045904  9355 catalog_manager.cc:5697] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 1 to 2, leader changed from 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194) to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:49.107383 10449 raft_consensus.cc:993] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2: : Instructing follower 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:49.107786 10459 raft_consensus.cc:1081] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Signalling peer 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:49.109274 10267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f7f960fa21840e4b44bfd4dd63d950f"
dest_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:42618
I20260709 13:03:49.109812 10267 raft_consensus.cc:493] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:49.110122 10267 raft_consensus.cc:3060] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.115909 10267 raft_consensus.cc:515] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:49.117595 10267 leader_election.cc:290] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:49.118247  9530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7f960fa21840e4b44bfd4dd63d950f" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:49.118899  9530 raft_consensus.cc:3055] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:49.119236  9530 raft_consensus.cc:740] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:49.118598  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7f960fa21840e4b44bfd4dd63d950f" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:49.120110  9608 raft_consensus.cc:3060] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.119966  9530 consensus_queue.cc:260] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:49.121093  9530 raft_consensus.cc:3060] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.125507  9608 raft_consensus.cc:2468] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 2.
I20260709 13:03:49.126178  9530 raft_consensus.cc:2468] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 2.
I20260709 13:03:49.126748 10210 leader_election.cc:304] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:49.127622 10481 raft_consensus.cc:2804] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:49.128108 10481 raft_consensus.cc:697] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 2 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:49.128958 10481 consensus_queue.cc:237] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:49.138759  9355 catalog_manager.cc:5697] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 1 to 2, leader changed from 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194) to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:49.281003 10474 raft_consensus.cc:993] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5: : Instructing follower 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:49.281607 10462 raft_consensus.cc:1081] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Signalling peer 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:49.283311 10273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39a58824acb343fa8f9e1349207a54b1"
dest_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:43002
I20260709 13:03:49.283810 10273 raft_consensus.cc:493] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:49.284075 10273 raft_consensus.cc:3060] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:49.290143 10273 raft_consensus.cc:515] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:49.292096 10273 leader_election.cc:290] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:49.292696  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a58824acb343fa8f9e1349207a54b1" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:49.293331  9675 raft_consensus.cc:3055] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:49.293365  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a58824acb343fa8f9e1349207a54b1" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:49.293721  9675 raft_consensus.cc:740] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:49.294051  9531 raft_consensus.cc:3060] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:49.294545  9675 consensus_queue.cc:260] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:49.295797  9675 raft_consensus.cc:3060] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:49.302368  9675 raft_consensus.cc:2468] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 3.
I20260709 13:03:49.302558  9531 raft_consensus.cc:2468] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 3.
I20260709 13:03:49.303844 10208 leader_election.cc:304] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:49.305429 10481 raft_consensus.cc:2804] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:49.307056 10481 raft_consensus.cc:697] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 3 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:49.308466 10481 consensus_queue.cc:237] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:49.320611 10517 raft_consensus.cc:993] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68: : Instructing follower 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:49.322220 10507 raft_consensus.cc:1081] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Signalling peer 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:49.325755 10273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3188c3b2ea944412b8f9b38b34380bf0"
dest_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:42616
I20260709 13:03:49.326347 10273 raft_consensus.cc:493] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:49.326712 10273 raft_consensus.cc:3060] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.320376  9355 catalog_manager.cc:5697] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 2 to 3, leader changed from eaba2f78a9274147a783ffa321939ed5 (127.0.107.196) to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 3 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:49.334975 10273 raft_consensus.cc:515] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:49.337956 10273 leader_election.cc:290] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:49.339215  9532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3188c3b2ea944412b8f9b38b34380bf0" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:49.339359  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3188c3b2ea944412b8f9b38b34380bf0" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:49.339777  9532 raft_consensus.cc:3060] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.339998  9608 raft_consensus.cc:3055] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:49.340404  9608 raft_consensus.cc:740] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:49.341123  9608 consensus_queue.cc:260] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:49.342269  9608 raft_consensus.cc:3060] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.345306  9532 raft_consensus.cc:2468] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 2.
I20260709 13:03:49.346434 10210 leader_election.cc:304] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:49.348538 10481 raft_consensus.cc:2804] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:49.349198 10481 raft_consensus.cc:697] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 2 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:49.350184  9608 raft_consensus.cc:2468] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 2.
I20260709 13:03:49.350106 10481 consensus_queue.cc:237] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:49.360034  9355 catalog_manager.cc:5697] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 1 to 2, leader changed from 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195) to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:49.366652 10466 raft_consensus.cc:993] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68: : Instructing follower 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:49.367190 10466 raft_consensus.cc:1081] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Signalling peer 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:49.369832 10273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb"
dest_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:42616
I20260709 13:03:49.371224 10273 raft_consensus.cc:493] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:49.371616 10273 raft_consensus.cc:3060] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:49.377688 10273 raft_consensus.cc:515] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:49.380451  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:49.380625  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:49.381139  9608 raft_consensus.cc:3055] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:49.381276  9681 raft_consensus.cc:3060] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:49.381572  9608 raft_consensus.cc:740] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:49.382464  9608 consensus_queue.cc:260] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:49.383718  9608 raft_consensus.cc:3060] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:49.387375 10273 leader_election.cc:290] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:49.388567  9681 raft_consensus.cc:2468] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 3.
I20260709 13:03:49.389550 10208 leader_election.cc:304] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:49.390112  9608 raft_consensus.cc:2468] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 3.
I20260709 13:03:49.390196 10481 raft_consensus.cc:2804] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:49.390857 10481 raft_consensus.cc:697] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 3 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:49.391896 10481 consensus_queue.cc:237] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:49.401671  9355 catalog_manager.cc:5697] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 2 to 3, leader changed from 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195) to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 3 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:49.484689 10466 raft_consensus.cc:993] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68: : Instructing follower 7610e18c23c543f1a31b6d851bac1bb2 to start an election
I20260709 13:03:49.485316 10517 raft_consensus.cc:1081] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Signalling peer 7610e18c23c543f1a31b6d851bac1bb2 to start an election
I20260709 13:03:49.486645  9532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17a105ce4cd245e3ada74a6fa7b69ffd"
dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
 from {username='slave'} at 127.0.0.1:51908
I20260709 13:03:49.487041  9532 raft_consensus.cc:493] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:49.487323  9532 raft_consensus.cc:3060] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.492609  9532 raft_consensus.cc:515] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:49.494019  9532 leader_election.cc:290] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:49.494870  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a105ce4cd245e3ada74a6fa7b69ffd" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:49.495477  9608 raft_consensus.cc:3055] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:49.495589  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a105ce4cd245e3ada74a6fa7b69ffd" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:49.495751  9608 raft_consensus.cc:740] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:49.496294  9681 raft_consensus.cc:3060] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.496687  9608 consensus_queue.cc:260] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:49.497591  9608 raft_consensus.cc:3060] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.501466  9681 raft_consensus.cc:2468] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 2.
I20260709 13:03:49.502496  9497 leader_election.cc:304] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:49.502849  9608 raft_consensus.cc:2468] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 2.
I20260709 13:03:49.503188 10459 raft_consensus.cc:2804] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:49.503665 10459 raft_consensus.cc:697] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:49.504413 10459 consensus_queue.cc:237] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:49.521790  9355 catalog_manager.cc:5697] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 1 to 2, leader changed from 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195) to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:49.535565  9681 raft_consensus.cc:1275] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.537827 10481 consensus_queue.cc:1048] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.563823  9532 raft_consensus.cc:1275] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.565224 10480 consensus_queue.cc:1048] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.616408  9608 raft_consensus.cc:1275] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.617646 10497 consensus_queue.cc:1048] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.634567  9531 raft_consensus.cc:1275] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.638728 10481 consensus_queue.cc:1048] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.730844  9532 raft_consensus.cc:1275] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.732142 10481 consensus_queue.cc:1048] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.745491  9608 raft_consensus.cc:1275] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.747539 10497 consensus_queue.cc:1048] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.850179  9675 raft_consensus.cc:1275] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:49.851539 10497 consensus_queue.cc:1048] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:49.869827  9532 raft_consensus.cc:1275] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:49.877274 10497 consensus_queue.cc:1048] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:49.888710  9675 raft_consensus.cc:1275] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:49.891963 10497 consensus_queue.cc:1048] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:49.908295  9602 raft_consensus.cc:1275] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:49.910420 10481 consensus_queue.cc:1048] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:49.986413  9681 raft_consensus.cc:1275] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Refusing update from remote peer 7610e18c23c543f1a31b6d851bac1bb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.987666 10459 consensus_queue.cc:1048] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.997345  9602 raft_consensus.cc:1275] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Refusing update from remote peer 7610e18c23c543f1a31b6d851bac1bb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.999030   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:50.002866 10459 consensus_queue.cc:1048] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:50.053027   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:50.091481  9531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2155d805d55a413c9f51874ce70d88b8"
dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
mode: GRACEFUL
new_leader_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:40244
I20260709 13:03:50.092001  9531 raft_consensus.cc:606] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Received request to transfer leadership to TS 04edfe53c70f45e09190743b636a705f
I20260709 13:03:50.094403  9675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6708a2f76d0f4292b01c5bb066f7bcac"
dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
mode: GRACEFUL
new_leader_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:39466
I20260709 13:03:50.094882  9675 raft_consensus.cc:606] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Received request to transfer leadership to TS 04edfe53c70f45e09190743b636a705f
I20260709 13:03:50.097359  9675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92d264be487e49f2b6cc37fefe738369"
dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
mode: GRACEFUL
new_leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
 from {username='slave'} at 127.0.0.1:39466
I20260709 13:03:50.097889  9675 raft_consensus.cc:606] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Received request to transfer leadership to TS 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:50.100304  9602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b190b9b4fa544118981626f9985e1276"
dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
mode: GRACEFUL
new_leader_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:45114
I20260709 13:03:50.100891  9602 raft_consensus.cc:606] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Received request to transfer leadership to TS 04edfe53c70f45e09190743b636a705f
I20260709 13:03:50.103559  9675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d23edaf5688c4b51a8f524e1fb7c928f"
dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
mode: GRACEFUL
new_leader_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:39466
I20260709 13:03:50.104126  9675 raft_consensus.cc:606] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Received request to transfer leadership to TS 04edfe53c70f45e09190743b636a705f
I20260709 13:03:50.105257   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:50.106580   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:50.231961 10539 raft_consensus.cc:993] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2: : Instructing follower 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:50.232550 10459 raft_consensus.cc:1081] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Signalling peer 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:50.234000 10273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2155d805d55a413c9f51874ce70d88b8"
dest_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:42618
I20260709 13:03:50.234424 10273 raft_consensus.cc:493] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:50.234724 10273 raft_consensus.cc:3060] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:50.240402 10273 raft_consensus.cc:515] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:50.242138 10273 leader_election.cc:290] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:50.243125  9602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2155d805d55a413c9f51874ce70d88b8" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:50.243292  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2155d805d55a413c9f51874ce70d88b8" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:50.243831  9602 raft_consensus.cc:3060] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:50.243860  9531 raft_consensus.cc:3055] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:50.244293  9531 raft_consensus.cc:740] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:50.244884  9531 consensus_queue.cc:260] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:50.245878  9531 raft_consensus.cc:3060] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:50.249754  9602 raft_consensus.cc:2468] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 2.
I20260709 13:03:50.251490 10210 leader_election.cc:304] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:50.252367 10480 raft_consensus.cc:2804] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:50.252863 10480 raft_consensus.cc:697] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 2 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:50.253787 10480 consensus_queue.cc:237] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:50.261309  9531 raft_consensus.cc:2468] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 2.
I20260709 13:03:50.268205  9354 catalog_manager.cc:5697] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 1 to 2, leader changed from 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194) to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:50.389655 10535 raft_consensus.cc:993] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5: : Instructing follower 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:50.390349 10536 raft_consensus.cc:1081] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Signalling peer 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:50.392133 10273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6708a2f76d0f4292b01c5bb066f7bcac"
dest_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:43002
I20260709 13:03:50.392575 10273 raft_consensus.cc:493] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:50.392890 10273 raft_consensus.cc:3060] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.399281 10273 raft_consensus.cc:515] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:50.401190 10273 leader_election.cc:290] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:50.404896 10535 raft_consensus.cc:993] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5: : Instructing follower 7610e18c23c543f1a31b6d851bac1bb2 to start an election
I20260709 13:03:50.405174  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6708a2f76d0f4292b01c5bb066f7bcac" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:50.405606 10535 raft_consensus.cc:1081] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Signalling peer 7610e18c23c543f1a31b6d851bac1bb2 to start an election
I20260709 13:03:50.405805  9675 raft_consensus.cc:3055] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:50.406211  9675 raft_consensus.cc:740] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:50.405833  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6708a2f76d0f4292b01c5bb066f7bcac" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:50.406945  9531 raft_consensus.cc:3060] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.408823  9675 consensus_queue.cc:260] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:50.410223  9675 raft_consensus.cc:3060] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.410408  9532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92d264be487e49f2b6cc37fefe738369"
dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
 from {username='slave'} at 127.0.0.1:51914
I20260709 13:03:50.410940  9532 raft_consensus.cc:493] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:50.411362  9532 raft_consensus.cc:3060] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:50.415652  9531 raft_consensus.cc:2468] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 3.
I20260709 13:03:50.416944 10210 leader_election.cc:304] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:50.417896 10480 raft_consensus.cc:2804] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:50.418519 10480 raft_consensus.cc:697] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 3 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:50.417619  9532 raft_consensus.cc:515] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:50.419672 10480 consensus_queue.cc:237] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:50.421273  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d264be487e49f2b6cc37fefe738369" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:50.421850  9608 raft_consensus.cc:3060] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:50.422371  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d264be487e49f2b6cc37fefe738369" candidate_uuid: "7610e18c23c543f1a31b6d851bac1bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:50.423381  9681 raft_consensus.cc:3055] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:50.423844  9681 raft_consensus.cc:740] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:50.424853  9681 consensus_queue.cc:260] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:50.426623  9681 raft_consensus.cc:3060] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:50.427314  9675 raft_consensus.cc:2468] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 3.
I20260709 13:03:50.432956  9608 raft_consensus.cc:2468] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 2.
I20260709 13:03:50.433765  9532 leader_election.cc:290] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:50.434055  9499 leader_election.cc:304] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:50.434845 10459 raft_consensus.cc:2804] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:50.435235 10459 raft_consensus.cc:697] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Becoming Leader. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:50.435985 10459 consensus_queue.cc:237] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:50.439097  9681 raft_consensus.cc:2468] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7610e18c23c543f1a31b6d851bac1bb2 in term 2.
I20260709 13:03:50.440120  9354 catalog_manager.cc:5697] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 2 to 3, leader changed from eaba2f78a9274147a783ffa321939ed5 (127.0.107.196) to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 3 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:50.447220  9355 catalog_manager.cc:5697] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 reported cstate change: term changed from 1 to 2, leader changed from eaba2f78a9274147a783ffa321939ed5 (127.0.107.196) to 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7610e18c23c543f1a31b6d851bac1bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:50.455848 10517 raft_consensus.cc:993] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68: : Instructing follower 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:50.456272 10545 raft_consensus.cc:1081] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Signalling peer 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:50.457630 10273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b190b9b4fa544118981626f9985e1276"
dest_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:42616
I20260709 13:03:50.458012 10273 raft_consensus.cc:493] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:50.458238 10273 raft_consensus.cc:3060] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.463348 10273 raft_consensus.cc:515] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:50.465158 10273 leader_election.cc:290] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:50.466113  9602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190b9b4fa544118981626f9985e1276" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:50.466702  9602 raft_consensus.cc:3055] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:50.467056  9602 raft_consensus.cc:740] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:50.467895  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190b9b4fa544118981626f9985e1276" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:50.467770  9602 consensus_queue.cc:260] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:50.469522  9602 raft_consensus.cc:3060] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.471505  9681 raft_consensus.cc:3060] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.475593  9602 raft_consensus.cc:2468] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 3.
I20260709 13:03:50.476593 10210 leader_election.cc:304] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:50.477456 10480 raft_consensus.cc:2804] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:50.477886 10480 raft_consensus.cc:697] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 3 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:50.477190  9681 raft_consensus.cc:2468] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 3.
I20260709 13:03:50.479661 10480 consensus_queue.cc:237] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:50.489261  9355 catalog_manager.cc:5697] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 2 to 3, leader changed from 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195) to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 3 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:50.548427 10536 raft_consensus.cc:993] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5: : Instructing follower 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:50.548936 10536 raft_consensus.cc:1081] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Signalling peer 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:50.550542 10276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d23edaf5688c4b51a8f524e1fb7c928f"
dest_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:43002
I20260709 13:03:50.551021 10276 raft_consensus.cc:493] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:50.551330 10276 raft_consensus.cc:3060] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.558104 10276 raft_consensus.cc:515] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:50.561686 10276 leader_election.cc:290] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:50.562716  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23edaf5688c4b51a8f524e1fb7c928f" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:50.563441  9681 raft_consensus.cc:3055] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:50.563597  9602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23edaf5688c4b51a8f524e1fb7c928f" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:50.563756  9681 raft_consensus.cc:740] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:50.564741  9681 consensus_queue.cc:260] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:50.566000  9602 raft_consensus.cc:3060] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.570510  9681 raft_consensus.cc:3060] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.573268  9602 raft_consensus.cc:2468] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 3.
I20260709 13:03:50.574391 10210 leader_election.cc:304] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:50.575192 10480 raft_consensus.cc:2804] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:50.575671 10480 raft_consensus.cc:697] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 3 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:50.576764  9681 raft_consensus.cc:2468] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 3.
I20260709 13:03:50.576479 10480 consensus_queue.cc:237] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:50.585572  9355 catalog_manager.cc:5697] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 2 to 3, leader changed from eaba2f78a9274147a783ffa321939ed5 (127.0.107.196) to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 3 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:50.725276  9532 raft_consensus.cc:1275] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:50.726573 10480 consensus_queue.cc:1048] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:50.736048  9606 raft_consensus.cc:1275] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:50.737919 10480 consensus_queue.cc:1048] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:50.818169  9532 raft_consensus.cc:1275] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:50.819403 10480 consensus_queue.cc:1048] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:50.833109  9681 raft_consensus.cc:1275] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:50.845894 10549 consensus_queue.cc:1048] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:50.887749  9681 raft_consensus.cc:1275] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:50.888901 10549 consensus_queue.cc:1048] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:50.896582  9602 raft_consensus.cc:1275] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Refusing update from remote peer 7610e18c23c543f1a31b6d851bac1bb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:50.897810 10550 consensus_queue.cc:1048] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:50.900147  9602 raft_consensus.cc:1275] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:50.901510 10497 consensus_queue.cc:1048] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:50.929877  9681 raft_consensus.cc:1275] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Refusing update from remote peer 7610e18c23c543f1a31b6d851bac1bb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:50.935211 10550 consensus_queue.cc:1048] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:51.068673  9606 raft_consensus.cc:1275] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:51.070046 10549 consensus_queue.cc:1048] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:51.091598  9681 raft_consensus.cc:1275] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:51.093429 10549 consensus_queue.cc:1048] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:51.107525   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:51.146972   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:51.186633  9531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c12ad87eca574eefa5cbe3f34e13eb8e"
dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
mode: GRACEFUL
new_leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
 from {username='slave'} at 127.0.0.1:40244
I20260709 13:03:51.187379  9531 raft_consensus.cc:606] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Received request to transfer leadership to TS 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:51.188867   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:03:51.190534   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:51.531350 10459 raft_consensus.cc:993] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2: : Instructing follower 8bf0e3504c4f46cf8c639da3e15caf68 to start an election
I20260709 13:03:51.531889 10539 raft_consensus.cc:1081] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Signalling peer 8bf0e3504c4f46cf8c639da3e15caf68 to start an election
I20260709 13:03:51.533450  9608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c12ad87eca574eefa5cbe3f34e13eb8e"
dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
 from {username='slave'} at 127.0.0.1:52032
I20260709 13:03:51.534114  9608 raft_consensus.cc:493] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:51.534449  9608 raft_consensus.cc:3060] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:51.539098  9608 raft_consensus.cc:515] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:51.541875  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12ad87eca574eefa5cbe3f34e13eb8e" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:51.541646  9608 leader_election.cc:290] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:51.542543  9531 raft_consensus.cc:3055] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:51.542701  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12ad87eca574eefa5cbe3f34e13eb8e" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:51.542920  9531 raft_consensus.cc:740] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7610e18c23c543f1a31b6d851bac1bb2, State: Running, Role: LEADER
I20260709 13:03:51.543359  9675 raft_consensus.cc:3060] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:51.543751  9531 consensus_queue.cc:260] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:51.544926  9531 raft_consensus.cc:3060] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:51.551419  9531 raft_consensus.cc:2468] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 2.
I20260709 13:03:51.551553  9675 raft_consensus.cc:2468] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 2.
I20260709 13:03:51.552667  9573 leader_election.cc:304] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 
I20260709 13:03:51.553972 10545 raft_consensus.cc:2804] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:51.556627 10545 raft_consensus.cc:697] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:51.557437 10545 consensus_queue.cc:237] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:51.566148  9354 catalog_manager.cc:5697] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 1 to 2, leader changed from 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194) to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.982223  9675 raft_consensus.cc:1275] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Refusing update from remote peer 8bf0e3504c4f46cf8c639da3e15caf68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:51.983561 10567 consensus_queue.cc:1048] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:51.999022  9532 raft_consensus.cc:1275] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Refusing update from remote peer 8bf0e3504c4f46cf8c639da3e15caf68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:52.000530 10545 consensus_queue.cc:1048] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:52.191574   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:52.243052   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:52.279138  9608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fc5524c279b403bb8db8d843b728706"
dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
mode: GRACEFUL
new_leader_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:45114
I20260709 13:03:52.279743  9608 raft_consensus.cc:606] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Received request to transfer leadership to TS 04edfe53c70f45e09190743b636a705f
I20260709 13:03:52.280822   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:03:52.281978   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:52.367971 10545 raft_consensus.cc:993] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68: : Instructing follower 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:52.368703 10563 raft_consensus.cc:1081] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Signalling peer 04edfe53c70f45e09190743b636a705f to start an election
I20260709 13:03:52.370086 10276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fc5524c279b403bb8db8d843b728706"
dest_uuid: "04edfe53c70f45e09190743b636a705f"
 from {username='slave'} at 127.0.0.1:42616
I20260709 13:03:52.370564 10276 raft_consensus.cc:493] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:52.370944 10276 raft_consensus.cc:3060] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.376886 10276 raft_consensus.cc:515] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:52.378973 10276 leader_election.cc:290] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:52.379604  9531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5524c279b403bb8db8d843b728706" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7610e18c23c543f1a31b6d851bac1bb2"
I20260709 13:03:52.379980  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5524c279b403bb8db8d843b728706" candidate_uuid: "04edfe53c70f45e09190743b636a705f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:52.380147  9531 raft_consensus.cc:3060] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.381126  9608 raft_consensus.cc:3055] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:52.381405  9608 raft_consensus.cc:740] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:52.382133  9608 consensus_queue.cc:260] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:52.383081  9608 raft_consensus.cc:3060] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.386663  9531 raft_consensus.cc:2468] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 2.
I20260709 13:03:52.387966 10210 leader_election.cc:304] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2; no voters: 
I20260709 13:03:52.388041  9608 raft_consensus.cc:2468] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04edfe53c70f45e09190743b636a705f in term 2.
I20260709 13:03:52.388818 10497 raft_consensus.cc:2804] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:52.389307 10497 raft_consensus.cc:697] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 2 LEADER]: Becoming Leader. State: Replica: 04edfe53c70f45e09190743b636a705f, State: Running, Role: LEADER
I20260709 13:03:52.390163 10497 consensus_queue.cc:237] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:52.405568  9354 catalog_manager.cc:5697] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f reported cstate change: term changed from 1 to 2, leader changed from 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195) to 04edfe53c70f45e09190743b636a705f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "04edfe53c70f45e09190743b636a705f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.887279  9532 raft_consensus.cc:1275] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:52.888365 10480 consensus_queue.cc:1048] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:52.898324  9606 raft_consensus.cc:1275] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Refusing update from remote peer 04edfe53c70f45e09190743b636a705f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:52.899752 10480 consensus_queue.cc:1048] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:53.283010   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:53.328470   431 tablet_server.cc:179] TabletServer@127.0.107.193:39371 shutting down...
W20260709 13:03:53.343351  9572 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 104 similar messages]
W20260709 13:03:53.355439  9572 consensus_peers.cc:597] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.367167   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:53.368084   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.368894   431 raft_consensus.cc:2243] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.369771   431 raft_consensus.cc:2272] T 2167c25a8fe74cf9b28526359b63c3b4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.372984   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:03:53.373333  9572 consensus_peers.cc:597] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.373930   431 raft_consensus.cc:2243] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.374473   431 raft_consensus.cc:2272] T 03595cf8245743e5984b4c937130e90a P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.377050   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.377769   431 raft_consensus.cc:2243] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.378500   431 raft_consensus.cc:2272] T 2155d805d55a413c9f51874ce70d88b8 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.381047   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.381841   431 raft_consensus.cc:2243] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.382277   431 raft_consensus.cc:2272] T 8df55ee6044645c183a597fd3f8b2aaf P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.384516   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.385105   431 raft_consensus.cc:2243] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.385524   431 raft_consensus.cc:2272] T bcdb62158e6b4a6989246318d3d25d7c P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.387511   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.388087   431 raft_consensus.cc:2243] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.388614   431 raft_consensus.cc:2272] T ac05c2b77c014117ae5c53f3f8198342 P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.391366   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.391952   431 raft_consensus.cc:2243] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.392340   431 raft_consensus.cc:2272] T 1c3d23cd333345c2a5010982e21b397e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.394254   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.394868   431 raft_consensus.cc:2243] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.395323   431 raft_consensus.cc:2272] T 5e8d25c4566f4b24986e9c10ae6afa5e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.397431   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.397964   431 raft_consensus.cc:2243] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.398787   431 raft_consensus.cc:2272] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.400792   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.401356   431 raft_consensus.cc:2243] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.402195   431 raft_consensus.cc:2272] T bf988aa1c4094545b8b3a1568680bdfb P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.404279   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.405687   431 raft_consensus.cc:2243] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.406535   431 raft_consensus.cc:2272] T b190b9b4fa544118981626f9985e1276 P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.409299   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.409988   431 raft_consensus.cc:2243] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.410597   431 raft_consensus.cc:2272] T ae9be08bd7474b02b3fda228625577e4 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.413844   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.414611   431 raft_consensus.cc:2243] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.415578   431 raft_consensus.cc:2272] T 39889cbf037947ddabe6cf7bc7a8334a P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.418481   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.419327   431 raft_consensus.cc:2243] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:03:53.419612  9572 consensus_peers.cc:597] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.420382   431 raft_consensus.cc:2272] T 7c671c6618ad41ff8d9f7d3d121ed086 P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.423123   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.423851   431 raft_consensus.cc:2243] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.424296   431 raft_consensus.cc:2272] T 423b11e873bd4a57ad207fc15fcb995e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.426658   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.427464   431 raft_consensus.cc:2243] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.427980   431 raft_consensus.cc:2272] T b0dfcbdce939448eaaae078332420bfa P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.430557   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.431437   431 raft_consensus.cc:2243] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.432418   431 raft_consensus.cc:2272] T cba0d047c0df4036a4702dbc607a318e P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.435554   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.436388   431 raft_consensus.cc:2243] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:53.436314  9646 consensus_peers.cc:597] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.437211   431 raft_consensus.cc:2272] T 4d50b9a85aa742458e037bd19f757196 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.440183   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.441080   431 raft_consensus.cc:2243] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:03:53.441978  9572 consensus_peers.cc:597] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.442097   431 raft_consensus.cc:2272] T 3188c3b2ea944412b8f9b38b34380bf0 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.444635   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.445286   431 raft_consensus.cc:2243] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.445806   431 raft_consensus.cc:2272] T bd6508e7cfe8459d9903c00481fda73d P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.448187   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.448776   431 raft_consensus.cc:2243] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.449178   431 raft_consensus.cc:2272] T 09481da07933449cae77deb1569c9f9e P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.451654   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.452433   431 raft_consensus.cc:2243] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.453361   431 raft_consensus.cc:2272] T 9f7f960fa21840e4b44bfd4dd63d950f P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.456058   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:03:53.456445  9572 consensus_peers.cc:597] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.456935   431 raft_consensus.cc:2243] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.457497   431 raft_consensus.cc:2272] T b099c00fd6634f1396a726b711f9e555 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:53.459777  9646 consensus_peers.cc:597] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.460541   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.461398   431 raft_consensus.cc:2243] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.462369   431 raft_consensus.cc:2272] T 3fc5524c279b403bb8db8d843b728706 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.465345   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.466142   431 raft_consensus.cc:2243] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.466657   431 raft_consensus.cc:2272] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.469487   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.470316   431 raft_consensus.cc:2243] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.470928   431 raft_consensus.cc:2272] T 134aecc79f7c4b398afcbf65000e3267 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:53.471154  9498 consensus_peers.cc:597] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:53.472618  9498 consensus_peers.cc:597] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.473428   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.474015   431 raft_consensus.cc:2243] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.474423   431 raft_consensus.cc:2272] T 89dc81bdfb864e568aba35ed5d9f24dd P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.476481   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.476969   431 raft_consensus.cc:2243] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.477288   431 raft_consensus.cc:2272] T 1fe09b15d9f346838b395c7fd2da18ad P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.479295   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.479799   431 raft_consensus.cc:2243] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.480449   431 raft_consensus.cc:2272] T 6708a2f76d0f4292b01c5bb066f7bcac P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.482193   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.482671   431 raft_consensus.cc:2243] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.482998   431 raft_consensus.cc:2272] T 6b589ee51a3b4411a255ac63c57232f9 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.485709   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.486250   431 raft_consensus.cc:2243] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.486649   431 raft_consensus.cc:2272] T 8511189d31f8408a9103bf9cadddd6c7 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.488636   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.489171   431 raft_consensus.cc:2243] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.489571   431 raft_consensus.cc:2272] T 59aa3eb6cc3047579924350ba3f75d90 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.491878   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.492564   431 raft_consensus.cc:2243] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.493343   431 raft_consensus.cc:2272] T 39a58824acb343fa8f9e1349207a54b1 P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.495568   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.496181   431 raft_consensus.cc:2243] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.496975   431 raft_consensus.cc:2272] T aceba3614aec44bd97d0a2111129bae4 P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:53.498996  9498 consensus_peers.cc:597] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.499437   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.500056   431 raft_consensus.cc:2243] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.500422   431 raft_consensus.cc:2272] T 18d335e60a664ce6a7db36b70d7a0403 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.502987   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.503650   431 raft_consensus.cc:2243] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.504127   431 raft_consensus.cc:2272] T ee70c523613a48fc8f5cca7456742e7b P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:53.504614  9646 consensus_peers.cc:597] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.506187   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.506770   431 raft_consensus.cc:2243] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.507177   431 raft_consensus.cc:2272] T 7e0b0663f9ce4c9db6d2da7a4405309b P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.509533   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.510206   431 raft_consensus.cc:2243] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.510619   431 raft_consensus.cc:2272] T 0bbe6355bc344a7d883c246c2cc8adc1 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:53.513026  9572 consensus_peers.cc:597] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.513669   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.514416   431 raft_consensus.cc:2243] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.514916   431 raft_consensus.cc:2272] T 79e29bfdaf3d4298afcb82e5edf9d136 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:53.515010  9498 consensus_peers.cc:597] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.517774   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.518522   431 raft_consensus.cc:2243] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.518965   431 raft_consensus.cc:2272] T 270eabeaaff64040920c19c1ab4a2903 P 04edfe53c70f45e09190743b636a705f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.520857   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.521579   431 raft_consensus.cc:2243] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.522514   431 raft_consensus.cc:2272] T d23edaf5688c4b51a8f524e1fb7c928f P 04edfe53c70f45e09190743b636a705f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.525246   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.525960   431 raft_consensus.cc:2243] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.526710   431 raft_consensus.cc:2272] T ad0797397ca74a699473bb7b07f063c8 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.528949   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:03:53.531347  9646 consensus_peers.cc:597] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:53.533612  9572 consensus_peers.cc:597] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.535938   431 raft_consensus.cc:2243] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.536628   431 raft_consensus.cc:2272] T 0adcede6679b495786781fa878243f44 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.539719   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.540385   431 raft_consensus.cc:2243] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.541309   431 raft_consensus.cc:2272] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.543685   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:53.544111   431 raft_consensus.cc:2243] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.544543   431 raft_consensus.cc:2272] T 871790aff5ff4037ad0c30f4e0276aa3 P 04edfe53c70f45e09190743b636a705f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:53.548055  9646 consensus_peers.cc:597] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:53.574271  9646 consensus_peers.cc:597] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:53.581362  9498 consensus_peers.cc:597] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:53.623703  9572 consensus_peers.cc:597] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:53.631701  9646 consensus_peers.cc:597] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.645140   431 tablet_server.cc:196] TabletServer@127.0.107.193:39371 shutdown complete.
W20260709 13:03:53.650419  9646 consensus_peers.cc:597] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:53.657732  9646 consensus_peers.cc:597] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:53.665895  9572 consensus_peers.cc:597] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:53.693593  9572 consensus_peers.cc:597] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:53.699198  9646 consensus_peers.cc:597] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:53.705799  9572 consensus_peers.cc:597] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.727074   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:53.731379  9573 consensus_peers.cc:597] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:53.735867  9573 consensus_peers.cc:597] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:53.744608  9647 consensus_peers.cc:597] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:53.760728  9647 consensus_peers.cc:597] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.772365   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:53.773696   431 tablet_replica.cc:333] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.774761   431 raft_consensus.cc:2243] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.775554   431 raft_consensus.cc:2272] T 79e29bfdaf3d4298afcb82e5edf9d136 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:53.777475  9573 consensus_peers.cc:597] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.778591   431 tablet_replica.cc:333] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
W20260709 13:03:53.779112  9647 consensus_peers.cc:597] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.779577   431 raft_consensus.cc:2243] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.780042   431 raft_consensus.cc:2272] T 2155d805d55a413c9f51874ce70d88b8 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.781930   431 tablet_replica.cc:333] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.782459   431 raft_consensus.cc:2243] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.783356   431 raft_consensus.cc:2272] T 2167c25a8fe74cf9b28526359b63c3b4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.786001   431 tablet_replica.cc:333] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.786589   431 raft_consensus.cc:2243] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.787057   431 raft_consensus.cc:2272] T 6708a2f76d0f4292b01c5bb066f7bcac P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:53.788133  9572 consensus_peers.cc:597] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.789306   431 tablet_replica.cc:333] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.789945   431 raft_consensus.cc:2243] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.790386   431 raft_consensus.cc:2272] T 39a58824acb343fa8f9e1349207a54b1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.792338   431 tablet_replica.cc:333] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.793098   431 raft_consensus.cc:2243] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.793731   431 raft_consensus.cc:2272] T 5e8d25c4566f4b24986e9c10ae6afa5e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.796267   431 tablet_replica.cc:333] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.797039   431 raft_consensus.cc:2243] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.797626   431 raft_consensus.cc:2272] T 4d50b9a85aa742458e037bd19f757196 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.799594   431 tablet_replica.cc:333] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.800144   431 raft_consensus.cc:2243] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.800529   431 raft_consensus.cc:2272] T 5a0333b232194ff09fbd6593bc528531 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.802521   431 tablet_replica.cc:333] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.803051   431 raft_consensus.cc:2243] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.803812   431 raft_consensus.cc:2272] T 59aa3eb6cc3047579924350ba3f75d90 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.805620   431 tablet_replica.cc:333] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.806305   431 raft_consensus.cc:2243] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.806749   431 raft_consensus.cc:2272] T ac05c2b77c014117ae5c53f3f8198342 P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.808502   431 tablet_replica.cc:333] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.809031   431 raft_consensus.cc:2243] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.809746   431 raft_consensus.cc:2272] T b0dfcbdce939448eaaae078332420bfa P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.811573   431 tablet_replica.cc:333] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.812152   431 raft_consensus.cc:2243] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.812950   431 raft_consensus.cc:2272] T 169b723604b749b1b0d240d60266f922 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.814930   431 tablet_replica.cc:333] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.815716   431 raft_consensus.cc:2243] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.816128   431 raft_consensus.cc:2272] T cba0d047c0df4036a4702dbc607a318e P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.818292   431 tablet_replica.cc:333] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.819563   431 raft_consensus.cc:2243] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.820317   431 raft_consensus.cc:2272] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.822206   431 tablet_replica.cc:333] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.822721   431 raft_consensus.cc:2243] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.823426   431 raft_consensus.cc:2272] T 92d264be487e49f2b6cc37fefe738369 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.825547   431 tablet_replica.cc:333] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.826094   431 raft_consensus.cc:2243] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.826510   431 raft_consensus.cc:2272] T 18d335e60a664ce6a7db36b70d7a0403 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.828284   431 tablet_replica.cc:333] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.828817   431 raft_consensus.cc:2243] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.829440   431 raft_consensus.cc:2272] T 03595cf8245743e5984b4c937130e90a P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.831473   431 tablet_replica.cc:333] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.831991   431 raft_consensus.cc:2243] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.832414   431 raft_consensus.cc:2272] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.834275   431 tablet_replica.cc:333] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.834801   431 raft_consensus.cc:2243] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.835196   431 raft_consensus.cc:2272] T c12ad87eca574eefa5cbe3f34e13eb8e P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.836941   431 tablet_replica.cc:333] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.837489   431 raft_consensus.cc:2243] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.837896   431 raft_consensus.cc:2272] T 9f7f960fa21840e4b44bfd4dd63d950f P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.840190   431 tablet_replica.cc:333] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.840883   431 raft_consensus.cc:2243] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.841741   431 raft_consensus.cc:2272] T 09481da07933449cae77deb1569c9f9e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.843811   431 tablet_replica.cc:333] T 1fe09b15d9f346838b395c7fd2da18ad P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.844511   431 raft_consensus.cc:2243] T 1fe09b15d9f346838b395c7fd2da18ad P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.845111   431 raft_consensus.cc:2272] T 1fe09b15d9f346838b395c7fd2da18ad P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.846946   431 tablet_replica.cc:333] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.847481   431 raft_consensus.cc:2243] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.848176   431 raft_consensus.cc:2272] T 1c3d23cd333345c2a5010982e21b397e P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.850368   431 tablet_replica.cc:333] T 7449453f99c946a6a8ad01c0b5faadf9 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.851042   431 raft_consensus.cc:2243] T 7449453f99c946a6a8ad01c0b5faadf9 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.851503   431 raft_consensus.cc:2272] T 7449453f99c946a6a8ad01c0b5faadf9 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:53.852931  9573 consensus_peers.cc:597] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.853767   431 tablet_replica.cc:333] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.854311   431 raft_consensus.cc:2243] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.854883   431 raft_consensus.cc:2272] T ae9be08bd7474b02b3fda228625577e4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.857116   431 tablet_replica.cc:333] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.857661   431 raft_consensus.cc:2243] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.858014   431 raft_consensus.cc:2272] T 247add59d191431987b50b009849ee54 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.859865   431 tablet_replica.cc:333] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.860440   431 raft_consensus.cc:2243] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.860785   431 raft_consensus.cc:2272] T 7c671c6618ad41ff8d9f7d3d121ed086 P 7610e18c23c543f1a31b6d851bac1bb2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.862543   431 tablet_replica.cc:333] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.863054   431 raft_consensus.cc:2243] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.863413   431 raft_consensus.cc:2272] T 39889cbf037947ddabe6cf7bc7a8334a P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.865602   431 tablet_replica.cc:333] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.866348   431 raft_consensus.cc:2243] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.867324   431 raft_consensus.cc:2272] T 6432b6ee54144ac1963d46714288e802 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:53.868188  9647 consensus_peers.cc:597] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:53.868538  9573 consensus_peers.cc:597] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.869621   431 tablet_replica.cc:333] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.870438   431 raft_consensus.cc:2243] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.870971   431 raft_consensus.cc:2272] T 8df55ee6044645c183a597fd3f8b2aaf P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.873687   431 tablet_replica.cc:333] T 270eabeaaff64040920c19c1ab4a2903 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.874430   431 raft_consensus.cc:2243] T 270eabeaaff64040920c19c1ab4a2903 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.874913   431 raft_consensus.cc:2272] T 270eabeaaff64040920c19c1ab4a2903 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.877616   431 tablet_replica.cc:333] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.878324   431 raft_consensus.cc:2243] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.879347   431 raft_consensus.cc:2272] T 17a105ce4cd245e3ada74a6fa7b69ffd P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.881937   431 tablet_replica.cc:333] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.882707   431 raft_consensus.cc:2243] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.883297   431 raft_consensus.cc:2272] T 7e0b0663f9ce4c9db6d2da7a4405309b P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:53.883749  9647 consensus_peers.cc:597] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.885613   431 tablet_replica.cc:333] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.886250   431 raft_consensus.cc:2243] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.887012   431 raft_consensus.cc:2272] T 5d4f7949313a47fc9f7a799ef17d9999 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.889088   431 tablet_replica.cc:333] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.889669   431 raft_consensus.cc:2243] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.890187   431 raft_consensus.cc:2272] T 0bbe6355bc344a7d883c246c2cc8adc1 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.892647   431 tablet_replica.cc:333] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.893373   431 raft_consensus.cc:2243] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.893883   431 raft_consensus.cc:2272] T 3fc5524c279b403bb8db8d843b728706 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.896670   431 tablet_replica.cc:333] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.897286   431 raft_consensus.cc:2243] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.897770   431 raft_consensus.cc:2272] T 74c0e4e3fe184fd4af9e5a84ddc58828 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.900002   431 tablet_replica.cc:333] T 4315cb1968e34e2e8539985ae04e2bd4 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.900564   431 raft_consensus.cc:2243] T 4315cb1968e34e2e8539985ae04e2bd4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.900982   431 raft_consensus.cc:2272] T 4315cb1968e34e2e8539985ae04e2bd4 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.902966   431 tablet_replica.cc:333] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.903615   431 raft_consensus.cc:2243] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.904103   431 raft_consensus.cc:2272] T 3188c3b2ea944412b8f9b38b34380bf0 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:53.906306  9647 consensus_peers.cc:597] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.906494   431 tablet_replica.cc:333] T bd6508e7cfe8459d9903c00481fda73d P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.907618   431 raft_consensus.cc:2243] T bd6508e7cfe8459d9903c00481fda73d P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.908205   431 raft_consensus.cc:2272] T bd6508e7cfe8459d9903c00481fda73d P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.910701   431 tablet_replica.cc:333] T 5e8d47fa67d245fb837b1492c15e9766 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.911482   431 raft_consensus.cc:2243] T 5e8d47fa67d245fb837b1492c15e9766 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.912037   431 raft_consensus.cc:2272] T 5e8d47fa67d245fb837b1492c15e9766 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.914422   431 tablet_replica.cc:333] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.915208   431 raft_consensus.cc:2243] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:03:53.915318  9573 consensus_peers.cc:597] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.916339   431 raft_consensus.cc:2272] T d2bdb17a9faf45208000a631d0455183 P 7610e18c23c543f1a31b6d851bac1bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.918866   431 tablet_replica.cc:333] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.919530   431 raft_consensus.cc:2243] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.920262   431 raft_consensus.cc:2272] T 2e2c2487f2f644ce9cba2ec3f72b7993 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.922793   431 tablet_replica.cc:333] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2: stopping tablet replica
I20260709 13:03:53.923408   431 raft_consensus.cc:2243] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.923892   431 raft_consensus.cc:2272] T 0adcede6679b495786781fa878243f44 P 7610e18c23c543f1a31b6d851bac1bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:54.005663  9647 consensus_peers.cc:597] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.018644  9647 consensus_peers.cc:597] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.087826  9573 consensus_peers.cc:597] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.103267  9573 consensus_peers.cc:597] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.153784  9647 consensus_peers.cc:597] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.184939  9647 consensus_peers.cc:597] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.239660  9573 consensus_peers.cc:597] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.287510  9497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:54.304594  9499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:54.317222  9499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.359794 10594 raft_consensus.cc:493] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.360661 10594 raft_consensus.cc:515] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:54.362828 10594 leader_election.cc:290] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
W20260709 13:03:54.365820  9573 leader_election.cc:336] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:54.366977  9572 leader_election.cc:336] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.367415  9572 leader_election.cc:304] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:54.368006 10594 raft_consensus.cc:2749] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:54.407119 10600 raft_consensus.cc:493] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.407899 10600 raft_consensus.cc:515] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:54.409904 10600 leader_election.cc:290] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
W20260709 13:03:54.412563  9647 leader_election.cc:336] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:54.452135 10545 raft_consensus.cc:493] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.452765 10545 raft_consensus.cc:515] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:54.454629 10545 leader_election.cc:290] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:54.455354  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
W20260709 13:03:54.459971  9572 leader_election.cc:336] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.460502  9572 leader_election.cc:304] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:54.461077 10545 raft_consensus.cc:2749] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:54.493623 10600 raft_consensus.cc:493] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.494324 10600 raft_consensus.cc:515] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:54.496390 10600 leader_election.cc:290] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
W20260709 13:03:54.498771  9647 leader_election.cc:336] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:54.532389 10600 raft_consensus.cc:493] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.533154 10600 raft_consensus.cc:515] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:54.535423 10600 leader_election.cc:290] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
W20260709 13:03:54.537571  9647 leader_election.cc:336] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:54.559288 10600 raft_consensus.cc:493] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.560207 10600 raft_consensus.cc:515] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:54.562803  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aceba3614aec44bd97d0a2111129bae4" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:54.562402 10600 leader_election.cc:290] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:54.592510 10596 raft_consensus.cc:493] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.593185 10596 raft_consensus.cc:515] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:54.595001 10596 leader_election.cc:290] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:54.595708  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:54.596246  9606 raft_consensus.cc:2468] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 3.
I20260709 13:03:54.597349  9647 leader_election.cc:304] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:54.598093 10596 raft_consensus.cc:2804] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:54.598487 10596 raft_consensus.cc:493] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.598798 10596 raft_consensus.cc:3060] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.606917 10596 raft_consensus.cc:515] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:54.608651 10596 leader_election.cc:290] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:54.609452  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf988aa1c4094545b8b3a1568680bdfb" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:54.610073  9606 raft_consensus.cc:3060] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.611752 10596 raft_consensus.cc:493] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.612397 10596 raft_consensus.cc:515] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:54.614470 10596 leader_election.cc:290] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:54.615478  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190b9b4fa544118981626f9985e1276" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:54.617192  9606 raft_consensus.cc:2468] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 4.
I20260709 13:03:54.618129  9647 leader_election.cc:304] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:54.618929 10596 raft_consensus.cc:2804] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:54.619520 10596 raft_consensus.cc:697] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 4 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:54.621085 10596 consensus_queue.cc:237] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:54.622268 10600 raft_consensus.cc:493] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.622969 10600 raft_consensus.cc:515] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:54.626767 10600 leader_election.cc:290] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
W20260709 13:03:54.629535  9647 leader_election.cc:336] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:54.631839  9354 catalog_manager.cc:5697] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 3 to 4, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:54.677929  9497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.702527 10600 raft_consensus.cc:493] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.703179 10600 raft_consensus.cc:515] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:54.705149 10600 leader_election.cc:290] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
W20260709 13:03:54.707873  9647 leader_election.cc:336] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:54.741914 10600 raft_consensus.cc:493] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.742650 10600 raft_consensus.cc:515] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:54.744537 10600 leader_election.cc:290] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
W20260709 13:03:54.747342  9647 leader_election.cc:336] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:54.756611 10595 raft_consensus.cc:493] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.757236 10595 raft_consensus.cc:515] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:54.757596 10545 raft_consensus.cc:493] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:54.758181 10545 raft_consensus.cc:515] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:54.759473 10595 leader_election.cc:290] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:54.760114 10545 leader_election.cc:290] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:54.761495  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5d1e1a6ffc47f994ee7cd91df4db54" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
W20260709 13:03:54.765336  9499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:54.766592  9572 leader_election.cc:336] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
W20260709 13:03:54.767287  9573 leader_election.cc:336] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:54.767691  9573 leader_election.cc:304] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:54.768349 10545 raft_consensus.cc:2749] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:54.768563  9573 leader_election.cc:336] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:54.768901  9646 leader_election.cc:336] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.769029  9573 leader_election.cc:304] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:54.769384  9646 leader_election.cc:304] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:54.769711 10545 raft_consensus.cc:2749] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:54.770195 10596 raft_consensus.cc:2749] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:54.770308  9646 leader_election.cc:336] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.770941  9646 leader_election.cc:304] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:54.771514 10596 raft_consensus.cc:2749] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:54.771605  9646 leader_election.cc:336] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.772053  9646 leader_election.cc:304] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:54.772644 10596 raft_consensus.cc:2749] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:54.772789  9646 leader_election.cc:336] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.773286  9646 leader_election.cc:304] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:54.773857 10596 raft_consensus.cc:2749] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:54.773929  9646 leader_election.cc:336] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
W20260709 13:03:54.774761  9646 leader_election.cc:336] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
W20260709 13:03:54.775362  9646 leader_election.cc:336] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.775631  9646 leader_election.cc:304] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:54.776221 10596 raft_consensus.cc:2749] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:54.776419  9646 leader_election.cc:336] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.776835  9646 leader_election.cc:304] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:54.777478 10596 raft_consensus.cc:2749] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:54.777652  9646 leader_election.cc:336] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.778093  9646 leader_election.cc:304] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:54.778635 10596 raft_consensus.cc:2749] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:54.778820  9646 leader_election.cc:336] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.779305  9646 leader_election.cc:304] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:54.779860 10596 raft_consensus.cc:2749] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:54.782363  9646 consensus_peers.cc:597] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.806381  9647 connection.cc:573] client connection to 127.0.107.194:34349 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:03:54.814920 10545 raft_consensus.cc:493] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:54.815593 10545 raft_consensus.cc:515] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:54.817185 10545 leader_election.cc:290] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
W20260709 13:03:54.823160  9572 leader_election.cc:336] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.824324   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:03:54.824389  9573 leader_election.cc:336] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:54.826040  9573 leader_election.cc:304] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:54.827836 10545 raft_consensus.cc:2749] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:54.834843 10545 raft_consensus.cc:493] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.835492 10545 raft_consensus.cc:515] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:54.837419 10545 leader_election.cc:290] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:54.838304  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23edaf5688c4b51a8f524e1fb7c928f" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:54.838428 10596 raft_consensus.cc:493] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:54.839154 10596 raft_consensus.cc:515] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:54.841610 10596 leader_election.cc:290] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
W20260709 13:03:54.842325  9572 leader_election.cc:336] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.842825  9572 leader_election.cc:304] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:54.843498 10545 raft_consensus.cc:2749] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:54.846123 10545 raft_consensus.cc:493] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
W20260709 13:03:54.846834  9647 leader_election.cc:336] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:54.846810 10545 raft_consensus.cc:515] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:54.850970 10545 leader_election.cc:290] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
W20260709 13:03:54.852936  9646 leader_election.cc:336] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.853479  9646 leader_election.cc:304] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:54.854233 10596 raft_consensus.cc:2749] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:54.855219  9572 leader_election.cc:336] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
W20260709 13:03:54.855895  9573 leader_election.cc:336] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:54.856379  9573 leader_election.cc:304] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:54.857152 10545 raft_consensus.cc:2749] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:54.865064 10545 raft_consensus.cc:493] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.865794 10545 raft_consensus.cc:515] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:54.868916  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190b9b4fa544118981626f9985e1276" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:54.869596  9675 raft_consensus.cc:2468] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 3.
I20260709 13:03:54.871819  9571 leader_election.cc:304] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:54.873095 10595 raft_consensus.cc:2804] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:54.873533 10595 raft_consensus.cc:493] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.873934 10595 raft_consensus.cc:3060] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.874033 10545 leader_election.cc:290] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
W20260709 13:03:54.879400  9572 leader_election.cc:336] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.884577 10595 raft_consensus.cc:515] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:54.876142 10545 raft_consensus.cc:493] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.887943  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190b9b4fa544118981626f9985e1276" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:54.888496  9675 raft_consensus.cc:3060] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.888224 10545 raft_consensus.cc:515] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
W20260709 13:03:54.895875  9572 leader_election.cc:336] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.896948  9675 raft_consensus.cc:2468] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 4.
I20260709 13:03:54.898295  9571 leader_election.cc:304] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:54.899385 10594 raft_consensus.cc:2804] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:54.900198 10594 raft_consensus.cc:697] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:54.901661 10594 consensus_queue.cc:237] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:54.903002 10545 leader_election.cc:290] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:54.908862 10596 raft_consensus.cc:493] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:54.909718 10596 raft_consensus.cc:515] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
W20260709 13:03:54.910547  9573 leader_election.cc:336] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:54.911209  9573 leader_election.cc:304] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:54.912211 10596 leader_election.cc:290] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:54.914502  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5d1e1a6ffc47f994ee7cd91df4db54" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:54.915194  9606 raft_consensus.cc:2468] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 1.
I20260709 13:03:54.916114 10610 raft_consensus.cc:2749] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:54.912292 10595 leader_election.cc:290] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:54.917321  9647 leader_election.cc:304] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:54.918308 10596 raft_consensus.cc:2804] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:54.918726 10596 raft_consensus.cc:493] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
W20260709 13:03:54.918908  9572 leader_election.cc:336] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.919193 10596 raft_consensus.cc:3060] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:54.923533 10535 raft_consensus.cc:493] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.924113 10535 raft_consensus.cc:515] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:54.926393 10535 leader_election.cc:290] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
W20260709 13:03:54.923492  9647 leader_election.cc:336] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
W20260709 13:03:54.934116  9646 leader_election.cc:336] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.938408 10535 raft_consensus.cc:493] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:54.939366 10535 raft_consensus.cc:515] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:54.942044 10535 leader_election.cc:290] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:54.942499 10595 raft_consensus.cc:493] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.943310 10595 raft_consensus.cc:515] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:54.945828  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23edaf5688c4b51a8f524e1fb7c928f" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:54.946412 10595 leader_election.cc:290] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:54.946594  9606 raft_consensus.cc:2468] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 3.
I20260709 13:03:54.947194  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aceba3614aec44bd97d0a2111129bae4" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:54.947789  9675 raft_consensus.cc:2468] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 3.
I20260709 13:03:54.949124  9571 leader_election.cc:304] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:54.950169 10610 raft_consensus.cc:2804] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:54.950096 10596 raft_consensus.cc:515] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:54.950642 10610 raft_consensus.cc:493] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.951093 10610 raft_consensus.cc:3060] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.953253 10596 leader_election.cc:290] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:54.954223  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a105ce4cd245e3ada74a6fa7b69ffd" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:54.958163  9354 catalog_manager.cc:5697] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 3 to 4, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:54.959816  9647 leader_election.cc:336] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:54.960347 10535 raft_consensus.cc:493] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:54.960919 10535 raft_consensus.cc:515] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:54.961063  9647 leader_election.cc:304] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:54.967756 10594 raft_consensus.cc:493] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:54.968416 10594 raft_consensus.cc:515] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:54.969585 10609 raft_consensus.cc:493] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:54.963014 10535 leader_election.cc:290] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:54.970274 10609 raft_consensus.cc:515] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:54.972069  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5d1e1a6ffc47f994ee7cd91df4db54" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
W20260709 13:03:54.972446  9572 leader_election.cc:336] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:54.972738  9606 raft_consensus.cc:3060] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:54.976027  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169b723604b749b1b0d240d60266f922" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:54.978428  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d264be487e49f2b6cc37fefe738369" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:54.981045 10609 leader_election.cc:290] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:54.984726 10594 leader_election.cc:290] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:54.962776 10596 raft_consensus.cc:2804] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:54.986624 10596 raft_consensus.cc:493] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 04edfe53c70f45e09190743b636a705f)
I20260709 13:03:54.986981 10596 raft_consensus.cc:3060] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.988792  9606 raft_consensus.cc:2468] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 2.
I20260709 13:03:54.990835 10610 raft_consensus.cc:515] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:54.996286  9647 leader_election.cc:304] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:54.996483 10535 raft_consensus.cc:493] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:54.997272 10600 raft_consensus.cc:2749] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:54.997202 10535 raft_consensus.cc:515] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:54.999742 10596 raft_consensus.cc:515] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:55.001543  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aceba3614aec44bd97d0a2111129bae4" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:55.002161  9675 raft_consensus.cc:3060] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.005577 10596 leader_election.cc:290] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 election: Requested vote from peers 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
W20260709 13:03:55.006889  9573 leader_election.cc:336] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:55.009171  9647 leader_election.cc:304] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:55.009425  9573 leader_election.cc:304] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:55.008406  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bdb17a9faf45208000a631d0455183" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:55.007720 10535 leader_election.cc:290] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
W20260709 13:03:55.007830  9646 leader_election.cc:336] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:55.010174 10596 raft_consensus.cc:2804] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:03:55.011004  9573 leader_election.cc:336] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
W20260709 13:03:55.011317  9647 leader_election.cc:336] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:55.014424  9573 leader_election.cc:304] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 7610e18c23c543f1a31b6d851bac1bb2, eaba2f78a9274147a783ffa321939ed5
I20260709 13:03:55.010910 10612 raft_consensus.cc:2749] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:55.015376 10594 raft_consensus.cc:2749] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:55.014950  9675 raft_consensus.cc:2468] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 4.
I20260709 13:03:55.011528 10596 raft_consensus.cc:697] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:55.011824 10610 leader_election.cc:290] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 election: Requested vote from peers eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541), 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371)
I20260709 13:03:55.017098 10596 consensus_queue.cc:237] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:55.017966 10535 raft_consensus.cc:493] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:55.018883 10535 raft_consensus.cc:515] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
W20260709 13:03:55.017231  9572 leader_election.cc:336] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:55.021049 10535 leader_election.cc:290] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:55.022809 10610 raft_consensus.cc:493] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:55.023713 10610 raft_consensus.cc:515] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:55.023958 10594 raft_consensus.cc:493] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:55.024698 10594 raft_consensus.cc:515] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:55.025305  9608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4f7949313a47fc9f7a799ef17d9999" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" is_pre_election: true
I20260709 13:03:55.026023 10610 leader_election.cc:290] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:55.026894 10594 leader_election.cc:290] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:55.027072  9571 leader_election.cc:304] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
I20260709 13:03:55.027951 10610 raft_consensus.cc:2804] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:55.028491 10610 raft_consensus.cc:697] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:55.029979  9606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23edaf5688c4b51a8f524e1fb7c928f" candidate_uuid: "eaba2f78a9274147a783ffa321939ed5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8bf0e3504c4f46cf8c639da3e15caf68"
I20260709 13:03:55.030738  9606 raft_consensus.cc:3060] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.029453 10610 consensus_queue.cc:237] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
I20260709 13:03:55.032316   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:03:55.023262  9647 leader_election.cc:336] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:55.047602  9606 raft_consensus.cc:2468] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaba2f78a9274147a783ffa321939ed5 in term 4.
I20260709 13:03:55.054261  9647 leader_election.cc:304] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:55.055975 10535 raft_consensus.cc:2749] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:55.056196  9647 leader_election.cc:304] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f
W20260709 13:03:55.055898  9573 leader_election.cc:336] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
W20260709 13:03:55.058171  9573 leader_election.cc:336] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
W20260709 13:03:55.061285  9647 leader_election.cc:336] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:55.061909  9647 leader_election.cc:304] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:55.061272 10613 raft_consensus.cc:2804] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:55.072374 10613 raft_consensus.cc:697] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 4 LEADER]: Becoming Leader. State: Replica: eaba2f78a9274147a783ffa321939ed5, State: Running, Role: LEADER
I20260709 13:03:55.073254 10596 raft_consensus.cc:2749] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:55.073134 10613 consensus_queue.cc:237] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } }
W20260709 13:03:55.074771  9647 leader_election.cc:336] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
W20260709 13:03:55.061957  9572 leader_election.cc:336] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:55.077538  9572 leader_election.cc:304] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:55.079173 10610 raft_consensus.cc:2749] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:55.081938 10613 raft_consensus.cc:493] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:55.082629 10613 raft_consensus.cc:515] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:55.083338  9355 catalog_manager.cc:5697] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 reported cstate change: term changed from 3 to 4, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:55.084270  9572 leader_election.cc:336] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:55.084754  9572 leader_election.cc:304] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:55.087448 10610 raft_consensus.cc:2749] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:55.084970 10613 leader_election.cc:290] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:55.087580  9354 catalog_manager.cc:5697] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 1 to 2, leader changed from 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194) to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:55.092360  9647 leader_election.cc:336] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:55.093297  9647 leader_election.cc:304] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
W20260709 13:03:55.097949  9647 leader_election.cc:336] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:55.096217 10613 raft_consensus.cc:2749] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:55.101187 10535 raft_consensus.cc:493] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
W20260709 13:03:55.100899  9647 consensus_peers.cc:597] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.101758 10535 raft_consensus.cc:515] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
W20260709 13:03:55.103475  9646 leader_election.cc:336] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:55.103734 10535 leader_election.cc:290] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:55.104048  9646 leader_election.cc:304] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:55.105335 10535 raft_consensus.cc:2749] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:55.112059 10612 raft_consensus.cc:493] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:55.112735 10612 raft_consensus.cc:515] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:55.116488 10612 leader_election.cc:290] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
W20260709 13:03:55.119165  9647 leader_election.cc:336] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
W20260709 13:03:55.121562  9573 leader_election.cc:336] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:55.126703 10535 raft_consensus.cc:493] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:55.127518 10612 raft_consensus.cc:493] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:55.127394 10535 raft_consensus.cc:515] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:55.128109 10612 raft_consensus.cc:515] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:55.129423 10535 leader_election.cc:290] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605)
I20260709 13:03:55.130995 10612 leader_election.cc:290] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:55.131194  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4f7949313a47fc9f7a799ef17d9999" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:55.131808  9675 raft_consensus.cc:2468] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
I20260709 13:03:55.130800  9355 catalog_manager.cc:5697] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 reported cstate change: term changed from 3 to 4, leader changed from 04edfe53c70f45e09190743b636a705f (127.0.107.193) to eaba2f78a9274147a783ffa321939ed5 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "eaba2f78a9274147a783ffa321939ed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.132937  9571 leader_election.cc:304] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:55.133756 10612 raft_consensus.cc:2804] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:55.134135 10612 raft_consensus.cc:493] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:55.136833 10612 raft_consensus.cc:3060] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:55.137508  9572 leader_election.cc:336] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
I20260709 13:03:55.138094  9572 leader_election.cc:304] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:55.139045 10594 raft_consensus.cc:2749] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:55.135967  9647 leader_election.cc:336] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:55.136351 10610 raft_consensus.cc:493] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:55.143618 10610 raft_consensus.cc:515] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:55.145351   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:55.145751 10610 leader_election.cc:290] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:55.147665  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6432b6ee54144ac1963d46714288e802" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:55.148710   431 tablet_replica.cc:333] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.150039   431 raft_consensus.cc:2243] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.150812   431 raft_consensus.cc:2272] T ae9be08bd7474b02b3fda228625577e4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:55.155004  9647 leader_election.cc:336] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:55.155632  9647 leader_election.cc:304] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:55.156512 10535 raft_consensus.cc:2749] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:55.155920   431 tablet_replica.cc:333] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
W20260709 13:03:55.156962  9647 consensus_peers.cc:597] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.157181 10612 raft_consensus.cc:515] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:55.157662  9675 raft_consensus.cc:2468] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 2.
W20260709 13:03:55.159335  9573 leader_election.cc:336] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
W20260709 13:03:55.158147  9646 consensus_peers.cc:597] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:55.159927  9647 leader_election.cc:336] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:55.160246  9573 leader_election.cc:336] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:55.160420  9647 leader_election.cc:304] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2, 8bf0e3504c4f46cf8c639da3e15caf68
I20260709 13:03:55.161062 10610 raft_consensus.cc:493] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:55.161198  9571 leader_election.cc:304] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:55.161681 10610 raft_consensus.cc:515] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:55.162273 10609 raft_consensus.cc:2804] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:55.162626   431 raft_consensus.cc:2243] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.162791 10609 raft_consensus.cc:493] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:55.163208 10609 raft_consensus.cc:3060] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:55.163365   431 raft_consensus.cc:2272] T 247add59d191431987b50b009849ee54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.165285  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a105ce4cd245e3ada74a6fa7b69ffd" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:55.166066  9675 raft_consensus.cc:2468] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 2.
I20260709 13:03:55.166812   431 tablet_replica.cc:333] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.167410 10535 raft_consensus.cc:2749] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:55.167764   431 raft_consensus.cc:2243] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.168838   431 raft_consensus.cc:2272] T bcdb62158e6b4a6989246318d3d25d7c P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.168952  9571 leader_election.cc:304] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:55.169847 10594 raft_consensus.cc:2804] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:55.170297 10594 raft_consensus.cc:493] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:55.170699 10594 raft_consensus.cc:3060] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:55.172027   431 tablet_replica.cc:333] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
W20260709 13:03:55.172796  9647 consensus_peers.cc:597] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.173077   431 raft_consensus.cc:2243] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.174240   431 pending_rounds.cc:70] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68: Trying to abort 1 pending ops.
I20260709 13:03:55.174474   431 pending_rounds.cc:77] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305634754195247104 op_type: NO_OP noop_request { }
I20260709 13:03:55.174877   431 raft_consensus.cc:2889] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:55.175253   431 raft_consensus.cc:2272] T b190b9b4fa544118981626f9985e1276 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:55.176360  9647 consensus_peers.cc:597] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.178228 10610 leader_election.cc:290] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:55.178711  9675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4f7949313a47fc9f7a799ef17d9999" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:55.179423  9675 raft_consensus.cc:3060] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.178988   431 tablet_replica.cc:333] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.180660   431 raft_consensus.cc:2243] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.178023 10609 raft_consensus.cc:515] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:55.181919 10594 raft_consensus.cc:515] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:55.182576   431 raft_consensus.cc:2272] T 2167c25a8fe74cf9b28526359b63c3b4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:55.183518  9573 leader_election.cc:336] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:55.184510 10594 leader_election.cc:290] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:55.185600 10609 leader_election.cc:290] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:55.185670  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6432b6ee54144ac1963d46714288e802" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:55.187893  9678 raft_consensus.cc:3060] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:55.188066  9675 raft_consensus.cc:2468] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 2.
I20260709 13:03:55.186228   431 tablet_replica.cc:333] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.190371  9571 leader_election.cc:304] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:55.190496 10612 leader_election.cc:290] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:55.190394   431 raft_consensus.cc:2243] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.186657  9681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a105ce4cd245e3ada74a6fa7b69ffd" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:55.191666  9681 raft_consensus.cc:3060] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:55.193991  9647 consensus_peers.cc:597] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.197490  9681 raft_consensus.cc:2468] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 3.
I20260709 13:03:55.198350  9678 raft_consensus.cc:2468] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 3.
I20260709 13:03:55.198519 10609 raft_consensus.cc:2804] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:55.198843   431 raft_consensus.cc:2272] T bf988aa1c4094545b8b3a1568680bdfb P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:55.198904  9573 leader_election.cc:336] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:55.199105 10609 raft_consensus.cc:697] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:55.198565  9571 leader_election.cc:304] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:55.199381 10594 raft_consensus.cc:493] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:55.201212 10609 consensus_queue.cc:237] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:55.202617   431 tablet_replica.cc:333] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.202375 10594 raft_consensus.cc:515] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:55.203600   431 raft_consensus.cc:2243] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.204290   431 raft_consensus.cc:2272] T 2155d805d55a413c9f51874ce70d88b8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:55.199951  9573 leader_election.cc:336] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:55.205031 10612 raft_consensus.cc:2804] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:03:55.205106  9573 leader_election.cc:336] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:55.204572 10594 leader_election.cc:290] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
I20260709 13:03:55.205145 10613 raft_consensus.cc:493] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:55.208078 10612 raft_consensus.cc:697] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:55.208618 10613 raft_consensus.cc:515] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } } peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } }
I20260709 13:03:55.209138 10612 consensus_queue.cc:237] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:55.211567 10613 leader_election.cc:290] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
I20260709 13:03:55.207432   431 tablet_replica.cc:333] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.207254  9571 leader_election.cc:304] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:55.214834 10610 raft_consensus.cc:2804] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:55.215430 10610 raft_consensus.cc:697] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:55.216488 10610 consensus_queue.cc:237] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:55.217545  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bdb17a9faf45208000a631d0455183" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5" is_pre_election: true
I20260709 13:03:55.218173  9678 raft_consensus.cc:2468] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 1.
W20260709 13:03:55.219180  9646 leader_election.cc:336] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
W20260709 13:03:55.219995  9647 leader_election.cc:336] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:55.220484  9647 leader_election.cc:304] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaba2f78a9274147a783ffa321939ed5; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:55.220973  9571 leader_election.cc:304] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
I20260709 13:03:55.221786 10594 raft_consensus.cc:2804] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:55.221827 10535 raft_consensus.cc:2749] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:55.222272 10594 raft_consensus.cc:493] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:55.222703 10594 raft_consensus.cc:3060] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.230003 10594 raft_consensus.cc:515] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
W20260709 13:03:55.230585  9573 leader_election.cc:336] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:55.215454   431 raft_consensus.cc:2243] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.233815   431 pending_rounds.cc:70] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68: Trying to abort 1 pending ops.
I20260709 13:03:55.234109   431 pending_rounds.cc:77] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305634754708885504 op_type: NO_OP noop_request { }
I20260709 13:03:55.234472   431 raft_consensus.cc:2889] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:55.234782   431 raft_consensus.cc:2272] T aceba3614aec44bd97d0a2111129bae4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.239919  9678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bdb17a9faf45208000a631d0455183" candidate_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaba2f78a9274147a783ffa321939ed5"
I20260709 13:03:55.240787  9678 raft_consensus.cc:3060] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.248238  9678 raft_consensus.cc:2468] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf0e3504c4f46cf8c639da3e15caf68 in term 2.
I20260709 13:03:55.249310  9571 leader_election.cc:304] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68, eaba2f78a9274147a783ffa321939ed5; no voters: 
W20260709 13:03:55.249856  9573 leader_election.cc:336] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:55.250214 10609 raft_consensus.cc:2804] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:55.252584   431 tablet_replica.cc:333] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.251049 10609 raft_consensus.cc:697] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Becoming Leader. State: Replica: 8bf0e3504c4f46cf8c639da3e15caf68, State: Running, Role: LEADER
I20260709 13:03:55.253597   431 raft_consensus.cc:2243] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.253917 10610 raft_consensus.cc:493] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7610e18c23c543f1a31b6d851bac1bb2)
I20260709 13:03:55.253778 10609 consensus_queue.cc:237] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } } peers { permanent_uuid: "eaba2f78a9274147a783ffa321939ed5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41541 } }
I20260709 13:03:55.254722   431 raft_consensus.cc:2272] T 134aecc79f7c4b398afcbf65000e3267 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.254599 10610 raft_consensus.cc:515] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04edfe53c70f45e09190743b636a705f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39371 } } peers { permanent_uuid: "7610e18c23c543f1a31b6d851bac1bb2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34349 } } peers { permanent_uuid: "8bf0e3504c4f46cf8c639da3e15caf68" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45605 } }
I20260709 13:03:55.255561 10594 leader_election.cc:290] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 election: Requested vote from peers 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349), eaba2f78a9274147a783ffa321939ed5 (127.0.107.196:41541)
W20260709 13:03:55.274926  9647 consensus_peers.cc:597] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.277185   431 tablet_replica.cc:333] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.278160   431 raft_consensus.cc:2243] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.278834   431 raft_consensus.cc:2272] T 89dc81bdfb864e568aba35ed5d9f24dd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.273820 10610 leader_election.cc:290] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371), 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349)
W20260709 13:03:55.280328  9572 leader_election.cc:336] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111)
W20260709 13:03:55.280622  9647 consensus_peers.cc:597] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.282106   431 tablet_replica.cc:333] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
W20260709 13:03:55.282065  9647 consensus_peers.cc:597] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:55.287087  9573 leader_election.cc:336] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111)
I20260709 13:03:55.287671  9573 leader_election.cc:304] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf0e3504c4f46cf8c639da3e15caf68; no voters: 04edfe53c70f45e09190743b636a705f, 7610e18c23c543f1a31b6d851bac1bb2
I20260709 13:03:55.288043   431 raft_consensus.cc:2243] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.288434 10594 raft_consensus.cc:2749] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:55.289763   431 raft_consensus.cc:2272] T 5e8d25c4566f4b24986e9c10ae6afa5e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.292907   431 tablet_replica.cc:333] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.293655   431 raft_consensus.cc:2243] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.294251   431 raft_consensus.cc:2272] T 5a0333b232194ff09fbd6593bc528531 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.297534   431 tablet_replica.cc:333] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.298389   431 raft_consensus.cc:2243] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.298950   431 raft_consensus.cc:2272] T 92d264be487e49f2b6cc37fefe738369 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.301656   431 tablet_replica.cc:333] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.302410   431 raft_consensus.cc:2243] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.303485   431 raft_consensus.cc:2272] T 18d335e60a664ce6a7db36b70d7a0403 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.305994   431 tablet_replica.cc:333] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.306708   431 raft_consensus.cc:2243] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.307334   431 raft_consensus.cc:2272] T 59aa3eb6cc3047579924350ba3f75d90 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.309867   431 tablet_replica.cc:333] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.310623   431 raft_consensus.cc:2243] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.311659   431 raft_consensus.cc:2272] T 8511189d31f8408a9103bf9cadddd6c7 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.314275   431 tablet_replica.cc:333] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.315071   431 raft_consensus.cc:2243] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.315577   431 raft_consensus.cc:2272] T 03595cf8245743e5984b4c937130e90a P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.318451   431 tablet_replica.cc:333] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.319330   431 raft_consensus.cc:2243] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.319911   431 raft_consensus.cc:2272] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.322642   431 tablet_replica.cc:333] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.323411   431 raft_consensus.cc:2243] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.324489   431 raft_consensus.cc:2272] T c12ad87eca574eefa5cbe3f34e13eb8e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.327179   431 tablet_replica.cc:333] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.327976   431 raft_consensus.cc:2243] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.328672   431 raft_consensus.cc:2272] T d23edaf5688c4b51a8f524e1fb7c928f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.331928   431 tablet_replica.cc:333] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.332726   431 raft_consensus.cc:2243] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.333775   431 raft_consensus.cc:2272] T ad0797397ca74a699473bb7b07f063c8 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.336763   431 tablet_replica.cc:333] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
W20260709 13:03:55.336939  9647 consensus_peers.cc:597] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.337540   431 raft_consensus.cc:2243] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.338266   431 raft_consensus.cc:2272] T 1c3d23cd333345c2a5010982e21b397e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.340866   431 tablet_replica.cc:333] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.341610   431 raft_consensus.cc:2243] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.342180   431 raft_consensus.cc:2272] T 871790aff5ff4037ad0c30f4e0276aa3 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.344447   431 tablet_replica.cc:333] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.345283   431 raft_consensus.cc:2243] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.346305   431 raft_consensus.cc:2272] T 7449453f99c946a6a8ad01c0b5faadf9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.348915   431 tablet_replica.cc:333] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.349439   431 raft_consensus.cc:2243] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.349851   431 raft_consensus.cc:2272] T 9f7f960fa21840e4b44bfd4dd63d950f P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.352524   431 tablet_replica.cc:333] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.353360   431 raft_consensus.cc:2243] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.354242   431 pending_rounds.cc:70] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68: Trying to abort 1 pending ops.
I20260709 13:03:55.354511   431 pending_rounds.cc:77] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305634755458351104 op_type: NO_OP noop_request { }
I20260709 13:03:55.354887   431 raft_consensus.cc:2889] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:55.355387   431 raft_consensus.cc:2272] T 6432b6ee54144ac1963d46714288e802 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.357663   431 tablet_replica.cc:333] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.358295   431 raft_consensus.cc:2243] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.359119   431 raft_consensus.cc:2272] T 6b589ee51a3b4411a255ac63c57232f9 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.361119   431 tablet_replica.cc:333] T b099c00fd6634f1396a726b711f9e555 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.361644   431 raft_consensus.cc:2243] T b099c00fd6634f1396a726b711f9e555 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.362036   431 raft_consensus.cc:2272] T b099c00fd6634f1396a726b711f9e555 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.363870   431 tablet_replica.cc:333] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.364389   431 raft_consensus.cc:2243] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.364822   431 raft_consensus.cc:2272] T 3fc5524c279b403bb8db8d843b728706 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.366676   431 tablet_replica.cc:333] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.367165   431 raft_consensus.cc:2243] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.367993   431 raft_consensus.cc:2272] T b92fcf3ae6ad4cb7b6c86496a6f70cde P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.369735   431 tablet_replica.cc:333] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.370227   431 raft_consensus.cc:2243] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.370960   431 raft_consensus.cc:2272] T ee70c523613a48fc8f5cca7456742e7b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.372793   431 tablet_replica.cc:333] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.373322   431 raft_consensus.cc:2243] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.374085   431 raft_consensus.cc:2272] T 7e0b0663f9ce4c9db6d2da7a4405309b P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.375953   431 tablet_replica.cc:333] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.376917   431 raft_consensus.cc:2243] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.377681   431 pending_rounds.cc:70] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68: Trying to abort 1 pending ops.
I20260709 13:03:55.377861   431 pending_rounds.cc:77] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305634755509891072 op_type: NO_OP noop_request { }
I20260709 13:03:55.378229   431 raft_consensus.cc:2889] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:55.378561   431 raft_consensus.cc:2272] T 17a105ce4cd245e3ada74a6fa7b69ffd P 8bf0e3504c4f46cf8c639da3e15caf68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.381465   431 tablet_replica.cc:333] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.382296   431 raft_consensus.cc:2243] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.383080   431 pending_rounds.cc:70] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68: Trying to abort 1 pending ops.
I20260709 13:03:55.383304   431 pending_rounds.cc:77] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634755395158016 op_type: NO_OP noop_request { }
I20260709 13:03:55.383627   431 raft_consensus.cc:2889] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:55.383962   431 raft_consensus.cc:2272] T 5d4f7949313a47fc9f7a799ef17d9999 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.386463   431 tablet_replica.cc:333] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.387010   431 raft_consensus.cc:2243] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.387797   431 raft_consensus.cc:2272] T 0bbe6355bc344a7d883c246c2cc8adc1 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.389770   431 tablet_replica.cc:333] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.390290   431 raft_consensus.cc:2243] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.390698   431 raft_consensus.cc:2272] T 4315cb1968e34e2e8539985ae04e2bd4 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.392635   431 tablet_replica.cc:333] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.393144   431 raft_consensus.cc:2243] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.393590   431 raft_consensus.cc:2272] T 3188c3b2ea944412b8f9b38b34380bf0 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.395622   431 tablet_replica.cc:333] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.396229   431 raft_consensus.cc:2243] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.397034   431 raft_consensus.cc:2272] T bd6508e7cfe8459d9903c00481fda73d P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.398923   431 tablet_replica.cc:333] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.399495   431 raft_consensus.cc:2243] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.399935   431 raft_consensus.cc:2272] T 169b723604b749b1b0d240d60266f922 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.401820   431 tablet_replica.cc:333] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.402303   431 raft_consensus.cc:2243] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.402695   431 raft_consensus.cc:2272] T dc5d1e1a6ffc47f994ee7cd91df4db54 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.404505   431 tablet_replica.cc:333] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.405016   431 raft_consensus.cc:2243] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.405452   431 raft_consensus.cc:2272] T 423b11e873bd4a57ad207fc15fcb995e P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.407387   431 tablet_replica.cc:333] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.407852   431 raft_consensus.cc:2243] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.408608   431 raft_consensus.cc:2272] T 8df55ee6044645c183a597fd3f8b2aaf P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.410619   431 tablet_replica.cc:333] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.411129   431 raft_consensus.cc:2243] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.411962   431 raft_consensus.cc:2272] T 5e8d47fa67d245fb837b1492c15e9766 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.413981   431 tablet_replica.cc:333] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68: stopping tablet replica
I20260709 13:03:55.414423   431 raft_consensus.cc:2243] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.415007   431 pending_rounds.cc:70] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68: Trying to abort 1 pending ops.
I20260709 13:03:55.415181   431 pending_rounds.cc:77] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634755689893888 op_type: NO_OP noop_request { }
I20260709 13:03:55.415504   431 raft_consensus.cc:2889] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:55.415791   431 raft_consensus.cc:2272] T d2bdb17a9faf45208000a631d0455183 P 8bf0e3504c4f46cf8c639da3e15caf68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.491135   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:03:55.554979  9646 consensus_peers.cc:597] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 -> Peer 04edfe53c70f45e09190743b636a705f (127.0.107.193:39371): Couldn't send request to peer 04edfe53c70f45e09190743b636a705f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:55.561003  9647 consensus_peers.cc:597] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.565482   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
W20260709 13:03:55.589548  9647 consensus_peers.cc:597] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 -> Peer 7610e18c23c543f1a31b6d851bac1bb2 (127.0.107.194:34349): Couldn't send request to peer 7610e18c23c543f1a31b6d851bac1bb2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:34349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.618162   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:03:55.618222  9647 consensus_peers.cc:597] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.619194   431 tablet_replica.cc:333] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.620028   431 raft_consensus.cc:2243] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.620587   431 raft_consensus.cc:2272] T b190b9b4fa544118981626f9985e1276 P eaba2f78a9274147a783ffa321939ed5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.622737   431 tablet_replica.cc:333] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.623405   431 raft_consensus.cc:2243] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.624150   431 raft_consensus.cc:2272] T 79e29bfdaf3d4298afcb82e5edf9d136 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.626219   431 tablet_replica.cc:333] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.626981   431 raft_consensus.cc:2243] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.628139   431 pending_rounds.cc:70] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5: Trying to abort 1 pending ops.
I20260709 13:03:55.628404   431 pending_rounds.cc:77] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305634753017188352 op_type: NO_OP noop_request { }
I20260709 13:03:55.628789   431 raft_consensus.cc:2889] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:55.629199   431 raft_consensus.cc:2272] T bf988aa1c4094545b8b3a1568680bdfb P eaba2f78a9274147a783ffa321939ed5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.631930   431 tablet_replica.cc:333] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.632833   431 raft_consensus.cc:2243] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.633464   431 raft_consensus.cc:2272] T 5d4f7949313a47fc9f7a799ef17d9999 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.635733   431 tablet_replica.cc:333] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.636385   431 raft_consensus.cc:2243] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.636947   431 raft_consensus.cc:2272] T aceba3614aec44bd97d0a2111129bae4 P eaba2f78a9274147a783ffa321939ed5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.639577   431 tablet_replica.cc:333] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.640499   431 raft_consensus.cc:2243] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.641182   431 raft_consensus.cc:2272] T 92d264be487e49f2b6cc37fefe738369 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.643671   431 tablet_replica.cc:333] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.644304   431 raft_consensus.cc:2243] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.644802   431 raft_consensus.cc:2272] T 39a58824acb343fa8f9e1349207a54b1 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.646924   431 tablet_replica.cc:333] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.647603   431 raft_consensus.cc:2243] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.648093   431 raft_consensus.cc:2272] T 134aecc79f7c4b398afcbf65000e3267 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.650985   431 tablet_replica.cc:333] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.651938   431 raft_consensus.cc:2243] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.653054   431 raft_consensus.cc:2272] T 89dc81bdfb864e568aba35ed5d9f24dd P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.655359   431 tablet_replica.cc:333] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.655881   431 raft_consensus.cc:2243] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.656647   431 raft_consensus.cc:2272] T 5a0333b232194ff09fbd6593bc528531 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.658627   431 tablet_replica.cc:333] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.659174   431 raft_consensus.cc:2243] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.660036   431 raft_consensus.cc:2272] T 4d50b9a85aa742458e037bd19f757196 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.662031   431 tablet_replica.cc:333] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.662551   431 raft_consensus.cc:2243] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.663369   431 raft_consensus.cc:2272] T bcdb62158e6b4a6989246318d3d25d7c P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.665562   431 tablet_replica.cc:333] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.666136   431 raft_consensus.cc:2243] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.666931   431 raft_consensus.cc:2272] T ac05c2b77c014117ae5c53f3f8198342 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.668988   431 tablet_replica.cc:333] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.669579   431 raft_consensus.cc:2243] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.670024   431 raft_consensus.cc:2272] T 8511189d31f8408a9103bf9cadddd6c7 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.672134   431 tablet_replica.cc:333] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.672716   431 raft_consensus.cc:2243] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.673547   431 raft_consensus.cc:2272] T f1e8eed746fe4a8fbbdbcc76f7ab8260 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.676221   431 tablet_replica.cc:333] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.677021   431 raft_consensus.cc:2243] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.677600   431 raft_consensus.cc:2272] T c12ad87eca574eefa5cbe3f34e13eb8e P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:55.679031  9647 consensus_peers.cc:597] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 -> Peer 8bf0e3504c4f46cf8c639da3e15caf68 (127.0.107.195:45605): Couldn't send request to peer 8bf0e3504c4f46cf8c639da3e15caf68. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.680359   431 tablet_replica.cc:333] T 7449453f99c946a6a8ad01c0b5faadf9 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.680981   431 raft_consensus.cc:2243] T 7449453f99c946a6a8ad01c0b5faadf9 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.681375   431 raft_consensus.cc:2272] T 7449453f99c946a6a8ad01c0b5faadf9 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.683393   431 tablet_replica.cc:333] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.684051   431 raft_consensus.cc:2243] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.684767   431 raft_consensus.cc:2272] T 270eabeaaff64040920c19c1ab4a2903 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.686681   431 tablet_replica.cc:333] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.687288   431 raft_consensus.cc:2243] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.688005   431 pending_rounds.cc:70] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5: Trying to abort 1 pending ops.
I20260709 13:03:55.688184   431 pending_rounds.cc:77] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305634754867318784 op_type: NO_OP noop_request { }
I20260709 13:03:55.688423   431 raft_consensus.cc:2889] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:55.688653   431 raft_consensus.cc:2272] T d23edaf5688c4b51a8f524e1fb7c928f P eaba2f78a9274147a783ffa321939ed5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.690999   431 tablet_replica.cc:333] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.691632   431 raft_consensus.cc:2243] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.692057   431 raft_consensus.cc:2272] T ad0797397ca74a699473bb7b07f063c8 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.694042   431 tablet_replica.cc:333] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.694552   431 raft_consensus.cc:2243] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.694936   431 raft_consensus.cc:2272] T 09481da07933449cae77deb1569c9f9e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.696949   431 tablet_replica.cc:333] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.697472   431 raft_consensus.cc:2243] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.698248   431 raft_consensus.cc:2272] T 247add59d191431987b50b009849ee54 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.700314   431 tablet_replica.cc:333] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.700819   431 raft_consensus.cc:2243] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.701267   431 raft_consensus.cc:2272] T 7c671c6618ad41ff8d9f7d3d121ed086 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.703203   431 tablet_replica.cc:333] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.703806   431 raft_consensus.cc:2243] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.704272   431 raft_consensus.cc:2272] T 39889cbf037947ddabe6cf7bc7a8334a P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.706317   431 tablet_replica.cc:333] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.706910   431 raft_consensus.cc:2243] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.707407   431 raft_consensus.cc:2272] T 6432b6ee54144ac1963d46714288e802 P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.709468   431 tablet_replica.cc:333] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.710034   431 raft_consensus.cc:2243] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.710940   431 raft_consensus.cc:2272] T 4315cb1968e34e2e8539985ae04e2bd4 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.712958   431 tablet_replica.cc:333] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.713541   431 raft_consensus.cc:2243] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.713985   431 raft_consensus.cc:2272] T 74c0e4e3fe184fd4af9e5a84ddc58828 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.715960   431 tablet_replica.cc:333] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.716536   431 raft_consensus.cc:2243] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.716988   431 raft_consensus.cc:2272] T ee70c523613a48fc8f5cca7456742e7b P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.719008   431 tablet_replica.cc:333] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.719630   431 raft_consensus.cc:2243] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.720080   431 raft_consensus.cc:2272] T 17a105ce4cd245e3ada74a6fa7b69ffd P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.722133   431 tablet_replica.cc:333] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.722694   431 raft_consensus.cc:2243] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.723591   431 raft_consensus.cc:2272] T 871790aff5ff4037ad0c30f4e0276aa3 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.725636   431 tablet_replica.cc:333] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.726198   431 raft_consensus.cc:2243] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.726643   431 raft_consensus.cc:2272] T 2e2c2487f2f644ce9cba2ec3f72b7993 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.728722   431 tablet_replica.cc:333] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.729315   431 raft_consensus.cc:2243] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.730151   431 raft_consensus.cc:2272] T 0adcede6679b495786781fa878243f44 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.732162   431 tablet_replica.cc:333] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.732744   431 raft_consensus.cc:2243] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.733206   431 raft_consensus.cc:2272] T b92fcf3ae6ad4cb7b6c86496a6f70cde P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.735070   431 tablet_replica.cc:333] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.735653   431 raft_consensus.cc:2243] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.736519   431 raft_consensus.cc:2272] T b099c00fd6634f1396a726b711f9e555 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.738597   431 tablet_replica.cc:333] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.739202   431 raft_consensus.cc:2243] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.739704   431 raft_consensus.cc:2272] T 5e8d47fa67d245fb837b1492c15e9766 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.741638   431 tablet_replica.cc:333] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.742202   431 raft_consensus.cc:2243] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.742650   431 raft_consensus.cc:2272] T d2bdb17a9faf45208000a631d0455183 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.744558   431 tablet_replica.cc:333] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.745100   431 raft_consensus.cc:2243] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.745577   431 raft_consensus.cc:2272] T b0dfcbdce939448eaaae078332420bfa P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.747531   431 tablet_replica.cc:333] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.748066   431 raft_consensus.cc:2243] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.748497   431 raft_consensus.cc:2272] T 169b723604b749b1b0d240d60266f922 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.750483   431 tablet_replica.cc:333] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.751113   431 raft_consensus.cc:2243] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.751631   431 raft_consensus.cc:2272] T cba0d047c0df4036a4702dbc607a318e P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.753526   431 tablet_replica.cc:333] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.754060   431 raft_consensus.cc:2243] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.754777   431 pending_rounds.cc:70] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5: Trying to abort 1 pending ops.
I20260709 13:03:55.755066   431 pending_rounds.cc:77] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634754645831680 op_type: NO_OP noop_request { }
I20260709 13:03:55.755429   431 raft_consensus.cc:2889] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:55.755705   431 raft_consensus.cc:2272] T dc5d1e1a6ffc47f994ee7cd91df4db54 P eaba2f78a9274147a783ffa321939ed5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.757834   431 tablet_replica.cc:333] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.758291   431 raft_consensus.cc:2243] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.758970   431 raft_consensus.cc:2272] T 423b11e873bd4a57ad207fc15fcb995e P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.761258   431 tablet_replica.cc:333] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.761719   431 raft_consensus.cc:2243] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.762449   431 raft_consensus.cc:2272] T 1fe09b15d9f346838b395c7fd2da18ad P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.764395   431 tablet_replica.cc:333] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.764832   431 raft_consensus.cc:2243] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.765229   431 raft_consensus.cc:2272] T 6708a2f76d0f4292b01c5bb066f7bcac P eaba2f78a9274147a783ffa321939ed5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.767304   431 tablet_replica.cc:333] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5: stopping tablet replica
I20260709 13:03:55.767742   431 raft_consensus.cc:2243] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.768102   431 raft_consensus.cc:2272] T 6b589ee51a3b4411a255ac63c57232f9 P eaba2f78a9274147a783ffa321939ed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.835372   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:03:55.900841   431 master.cc:562] Master@127.0.107.254:41919 shutting down...
I20260709 13:03:55.929311   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.929937   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.930352   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 594d46eb8a6d478899418a7e9af1d891: stopping tablet replica
I20260709 13:03:55.954670   431 master.cc:584] Master@127.0.107.254:41919 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32244 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:03:56.046803   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:42039
I20260709 13:03:56.048213   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:56.055312 10622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:56.055886 10623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:56.056195 10625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:56.057798   431 server_base.cc:1061] running on GCE node
I20260709 13:03:56.058950   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:56.059149   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:56.059392   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602236059371 us; error 0 us; skew 500 ppm
I20260709 13:03:56.059944   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:56.062346   431 webserver.cc:533] Webserver started at http://127.0.107.254:35237/ using document root <none> and password file <none>
I20260709 13:03:56.062879   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:56.063072   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:56.063383   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:56.064591   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/master-0-root/instance:
uuid: "4f7aa3f9f80a44bca1dfd146933195ea"
format_stamp: "Formatted at 2026-07-09 13:03:56 on dist-test-slave-zhw8"
I20260709 13:03:56.069207   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:56.072988 10630 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:56.073923   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:03:56.074182   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/master-0-root
uuid: "4f7aa3f9f80a44bca1dfd146933195ea"
format_stamp: "Formatted at 2026-07-09 13:03:56 on dist-test-slave-zhw8"
I20260709 13:03:56.074433   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:56.101649   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:56.102843   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:56.144179   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:42039
I20260709 13:03:56.144296 10681 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:42039 every 8 connection(s)
I20260709 13:03:56.148223 10682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.158778 10682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea: Bootstrap starting.
I20260709 13:03:56.163641 10682 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.167914 10682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea: No bootstrap required, opened a new log
I20260709 13:03:56.169993 10682 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f7aa3f9f80a44bca1dfd146933195ea" member_type: VOTER }
I20260709 13:03:56.170357 10682 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.170532 10682 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f7aa3f9f80a44bca1dfd146933195ea, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.171018 10682 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f7aa3f9f80a44bca1dfd146933195ea" member_type: VOTER }
I20260709 13:03:56.171440 10682 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:56.171624 10682 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:56.171835 10682 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.176333 10682 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f7aa3f9f80a44bca1dfd146933195ea" member_type: VOTER }
I20260709 13:03:56.176810 10682 leader_election.cc:304] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f7aa3f9f80a44bca1dfd146933195ea; no voters: 
I20260709 13:03:56.177996 10682 leader_election.cc:290] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:56.178439 10685 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.179858 10685 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [term 1 LEADER]: Becoming Leader. State: Replica: 4f7aa3f9f80a44bca1dfd146933195ea, State: Running, Role: LEADER
I20260709 13:03:56.180533 10685 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f7aa3f9f80a44bca1dfd146933195ea" member_type: VOTER }
I20260709 13:03:56.181000 10682 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:56.185518 10687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f7aa3f9f80a44bca1dfd146933195ea. Latest consensus state: current_term: 1 leader_uuid: "4f7aa3f9f80a44bca1dfd146933195ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f7aa3f9f80a44bca1dfd146933195ea" member_type: VOTER } }
I20260709 13:03:56.185633 10686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f7aa3f9f80a44bca1dfd146933195ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f7aa3f9f80a44bca1dfd146933195ea" member_type: VOTER } }
I20260709 13:03:56.186779 10686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:56.186436 10687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:56.188915 10692 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:56.194262 10692 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:56.198452   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:56.203539 10692 catalog_manager.cc:1383] Generated new cluster ID: 2c51a43bf0884224b154e6d6e5196dae
I20260709 13:03:56.203848 10692 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:56.216806 10692 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:56.218312 10692 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:56.233616 10692 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea: Generated new TSK 0
I20260709 13:03:56.234243 10692 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:56.265111   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:56.271528 10703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:56.272862 10704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:56.274695   431 server_base.cc:1061] running on GCE node
W20260709 13:03:56.274623 10706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:56.275978   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:56.276245   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:56.276420   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602236276402 us; error 0 us; skew 500 ppm
I20260709 13:03:56.276922   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:56.279717   431 webserver.cc:533] Webserver started at http://127.0.107.193:41969/ using document root <none> and password file <none>
I20260709 13:03:56.280216   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:56.280385   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:56.280611   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:56.281769   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-0-root/instance:
uuid: "6603ab202ddd40348d5c442a116570d2"
format_stamp: "Formatted at 2026-07-09 13:03:56 on dist-test-slave-zhw8"
I20260709 13:03:56.286944   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:03:56.290709 10711 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:56.291636   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:03:56.291916   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-0-root
uuid: "6603ab202ddd40348d5c442a116570d2"
format_stamp: "Formatted at 2026-07-09 13:03:56 on dist-test-slave-zhw8"
I20260709 13:03:56.292229   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:56.305852   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:56.307112   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:56.308652   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:56.310976   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:56.311199   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:56.311501   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:56.311692   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:56.356419   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:33037
I20260709 13:03:56.356590 10773 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:33037 every 8 connection(s)
I20260709 13:03:56.361631   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:56.369908 10778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:56.370010 10779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:56.374037 10781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:56.374679   431 server_base.cc:1061] running on GCE node
I20260709 13:03:56.375712   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:56.375948   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:56.376161   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602236376138 us; error 0 us; skew 500 ppm
I20260709 13:03:56.376818   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:56.380129 10774 heartbeater.cc:344] Connected to a master server at 127.0.107.254:42039
I20260709 13:03:56.380528 10774 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:56.380278   431 webserver.cc:533] Webserver started at http://127.0.107.194:33899/ using document root <none> and password file <none>
I20260709 13:03:56.381263   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:56.381322 10774 heartbeater.cc:507] Master 127.0.107.254:42039 requested a full tablet report, sending...
I20260709 13:03:56.381510   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:56.381958   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:56.383483   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-1-root/instance:
uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
format_stamp: "Formatted at 2026-07-09 13:03:56 on dist-test-slave-zhw8"
I20260709 13:03:56.383862 10647 ts_manager.cc:194] Registered new tserver with Master: 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037)
I20260709 13:03:56.385830 10647 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42020
I20260709 13:03:56.388466   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:03:56.392450 10786 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:56.393318   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:03:56.393642   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-1-root
uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
format_stamp: "Formatted at 2026-07-09 13:03:56 on dist-test-slave-zhw8"
I20260709 13:03:56.393929   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:56.422598   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:56.423892   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:56.425292   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:56.427567   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:56.427762   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:56.428061   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:56.428200   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:56.472695   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:41591
I20260709 13:03:56.472793 10848 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:41591 every 8 connection(s)
I20260709 13:03:56.477514   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:56.485602 10852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:56.488492 10853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:56.489585 10855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:56.490790   431 server_base.cc:1061] running on GCE node
I20260709 13:03:56.492008   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:56.492281   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:56.492530   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602236492505 us; error 0 us; skew 500 ppm
I20260709 13:03:56.492931 10849 heartbeater.cc:344] Connected to a master server at 127.0.107.254:42039
I20260709 13:03:56.493315   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:56.493453 10849 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:56.494599 10849 heartbeater.cc:507] Master 127.0.107.254:42039 requested a full tablet report, sending...
I20260709 13:03:56.496968 10647 ts_manager.cc:194] Registered new tserver with Master: f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:56.498318 10647 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42026
I20260709 13:03:56.499332   431 webserver.cc:533] Webserver started at http://127.0.107.195:46671/ using document root <none> and password file <none>
I20260709 13:03:56.500152   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:56.500437   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:56.500795   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:56.502063   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-2-root/instance:
uuid: "6ff3a67a6b814758872d067d3a852116"
format_stamp: "Formatted at 2026-07-09 13:03:56 on dist-test-slave-zhw8"
I20260709 13:03:56.507000   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.001s
I20260709 13:03:56.510450 10860 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:56.511441   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:56.511781   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-2-root
uuid: "6ff3a67a6b814758872d067d3a852116"
format_stamp: "Formatted at 2026-07-09 13:03:56 on dist-test-slave-zhw8"
I20260709 13:03:56.512077   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:56.570838   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:56.572299   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:56.573657   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:56.576102   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:56.576356   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:56.576702   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:56.576864   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:56.619364   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:46551
I20260709 13:03:56.619560 10922 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:46551 every 8 connection(s)
I20260709 13:03:56.633236 10923 heartbeater.cc:344] Connected to a master server at 127.0.107.254:42039
I20260709 13:03:56.633745 10923 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:56.634552 10923 heartbeater.cc:507] Master 127.0.107.254:42039 requested a full tablet report, sending...
I20260709 13:03:56.636689 10647 ts_manager.cc:194] Registered new tserver with Master: 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:03:56.637367   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014890658s
I20260709 13:03:56.638200 10647 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42036
I20260709 13:03:56.665803 10647 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42050:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:56.668808 10647 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:56.770566 10888 tablet_service.cc:1511] Processing CreateTablet for tablet d5f3e403122e4cdfa4c423d00d4c1577 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:56.772264 10888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f3e403122e4cdfa4c423d00d4c1577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.772761 10737 tablet_service.cc:1511] Processing CreateTablet for tablet c5db8e3237574f9a8836e5e9a88ba2c4 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:56.773452 10884 tablet_service.cc:1511] Processing CreateTablet for tablet 640b1bca020c48d2b5c418402f198ff1 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:56.774189 10737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5db8e3237574f9a8836e5e9a88ba2c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.774765 10884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 640b1bca020c48d2b5c418402f198ff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.776374 10736 tablet_service.cc:1511] Processing CreateTablet for tablet e0f5e456fbfd4fce8e37636881dce2b5 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:56.777743 10736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f5e456fbfd4fce8e37636881dce2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.777513 10886 tablet_service.cc:1511] Processing CreateTablet for tablet c5db8e3237574f9a8836e5e9a88ba2c4 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:56.778851 10886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5db8e3237574f9a8836e5e9a88ba2c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.780272 10885 tablet_service.cc:1511] Processing CreateTablet for tablet e0f5e456fbfd4fce8e37636881dce2b5 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:56.781632 10885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f5e456fbfd4fce8e37636881dce2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.781415 10734 tablet_service.cc:1511] Processing CreateTablet for tablet 01b2d44c8aa74629b6f07f2a05b1255f (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:56.782727 10734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b2d44c8aa74629b6f07f2a05b1255f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.783488 10883 tablet_service.cc:1511] Processing CreateTablet for tablet 01b2d44c8aa74629b6f07f2a05b1255f (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:56.784404 10882 tablet_service.cc:1511] Processing CreateTablet for tablet 2a94d0fa583e4778b899a7c62324e39e (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:56.780272 10735 tablet_service.cc:1511] Processing CreateTablet for tablet 640b1bca020c48d2b5c418402f198ff1 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:56.786805 10735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 640b1bca020c48d2b5c418402f198ff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.786901 10738 tablet_service.cc:1511] Processing CreateTablet for tablet def0dda674d640a7bf9832c41e6411e8 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:56.772287 10739 tablet_service.cc:1511] Processing CreateTablet for tablet d5f3e403122e4cdfa4c423d00d4c1577 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:56.788456 10738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def0dda674d640a7bf9832c41e6411e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.789480 10739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f3e403122e4cdfa4c423d00d4c1577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.792186 10887 tablet_service.cc:1511] Processing CreateTablet for tablet def0dda674d640a7bf9832c41e6411e8 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:56.776374 10814 tablet_service.cc:1511] Processing CreateTablet for tablet d5f3e403122e4cdfa4c423d00d4c1577 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:56.795696 10814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f3e403122e4cdfa4c423d00d4c1577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.790665 10733 tablet_service.cc:1511] Processing CreateTablet for tablet 2a94d0fa583e4778b899a7c62324e39e (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:56.797935 10733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a94d0fa583e4778b899a7c62324e39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.784870 10883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b2d44c8aa74629b6f07f2a05b1255f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.800527 10882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a94d0fa583e4778b899a7c62324e39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.804939 10732 tablet_service.cc:1511] Processing CreateTablet for tablet 7b8b72efed2f46e4b7c41a823d941b54 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:56.806392 10732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b8b72efed2f46e4b7c41a823d941b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.808144 10887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def0dda674d640a7bf9832c41e6411e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.816113 10813 tablet_service.cc:1511] Processing CreateTablet for tablet def0dda674d640a7bf9832c41e6411e8 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:56.816802 10881 tablet_service.cc:1511] Processing CreateTablet for tablet 7b8b72efed2f46e4b7c41a823d941b54 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:56.817646 10813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def0dda674d640a7bf9832c41e6411e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.818110 10881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b8b72efed2f46e4b7c41a823d941b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.819787 10880 tablet_service.cc:1511] Processing CreateTablet for tablet d89a7a13b88149bd87ba85a0f44c174d (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:56.820436 10731 tablet_service.cc:1511] Processing CreateTablet for tablet d89a7a13b88149bd87ba85a0f44c174d (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:56.821244 10880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d89a7a13b88149bd87ba85a0f44c174d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.821720 10731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d89a7a13b88149bd87ba85a0f44c174d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.872774 10730 tablet_service.cc:1511] Processing CreateTablet for tablet dea67ea321734b05a2c1f920d4fd1eab (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:56.874298 10730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea67ea321734b05a2c1f920d4fd1eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.882118 10812 tablet_service.cc:1511] Processing CreateTablet for tablet c5db8e3237574f9a8836e5e9a88ba2c4 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:56.884507 10811 tablet_service.cc:1511] Processing CreateTablet for tablet e0f5e456fbfd4fce8e37636881dce2b5 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:56.884867 10805 tablet_service.cc:1511] Processing CreateTablet for tablet dea67ea321734b05a2c1f920d4fd1eab (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:56.886953 10809 tablet_service.cc:1511] Processing CreateTablet for tablet 01b2d44c8aa74629b6f07f2a05b1255f (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:56.888965 10808 tablet_service.cc:1511] Processing CreateTablet for tablet 2a94d0fa583e4778b899a7c62324e39e (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:56.894269 10806 tablet_service.cc:1511] Processing CreateTablet for tablet d89a7a13b88149bd87ba85a0f44c174d (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:56.896188 10810 tablet_service.cc:1511] Processing CreateTablet for tablet 640b1bca020c48d2b5c418402f198ff1 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:56.891009 10807 tablet_service.cc:1511] Processing CreateTablet for tablet 7b8b72efed2f46e4b7c41a823d941b54 (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:56.902204 10812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5db8e3237574f9a8836e5e9a88ba2c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.902864 10805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea67ea321734b05a2c1f920d4fd1eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.904877 10811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f5e456fbfd4fce8e37636881dce2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.907776 10806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d89a7a13b88149bd87ba85a0f44c174d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.911872 10810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 640b1bca020c48d2b5c418402f198ff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.920251 10808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a94d0fa583e4778b899a7c62324e39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.920714 10887 tablet_service.cc:1511] Processing CreateTablet for tablet dea67ea321734b05a2c1f920d4fd1eab (DEFAULT_TABLE table=test-workload [id=39376141d6ae4afcacce253072f6d7fd]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:56.922008 10887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea67ea321734b05a2c1f920d4fd1eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.923563 10807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b8b72efed2f46e4b7c41a823d941b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.927557 10809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b2d44c8aa74629b6f07f2a05b1255f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:56.950915 10938 tablet_bootstrap.cc:492] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116: Bootstrap starting.
I20260709 13:03:56.982905 10940 tablet_bootstrap.cc:492] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a: Bootstrap starting.
I20260709 13:03:56.992427 10938 tablet_bootstrap.cc:654] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.010987 10939 tablet_bootstrap.cc:492] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
I20260709 13:03:57.013065 10940 tablet_bootstrap.cc:654] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.026750 10938 tablet_bootstrap.cc:492] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116: No bootstrap required, opened a new log
I20260709 13:03:57.027348 10938 ts_tablet_manager.cc:1403] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.000s
I20260709 13:03:57.028966 10940 tablet_bootstrap.cc:492] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a: No bootstrap required, opened a new log
I20260709 13:03:57.029479 10940 ts_tablet_manager.cc:1403] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent bootstrapping tablet: real 0.047s	user 0.006s	sys 0.015s
I20260709 13:03:57.030375 10938 raft_consensus.cc:359] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.031009 10939 tablet_bootstrap.cc:654] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.031318 10938 raft_consensus.cc:385] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.031641 10938 raft_consensus.cc:740] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.032495 10938 consensus_queue.cc:260] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.032859 10940 raft_consensus.cc:359] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.033708 10940 raft_consensus.cc:385] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.034006 10940 raft_consensus.cc:740] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.034865 10940 consensus_queue.cc:260] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.035408 10923 heartbeater.cc:499] Master 127.0.107.254:42039 was elected leader, sending a full tablet report...
I20260709 13:03:57.036079 10938 ts_tablet_manager.cc:1434] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:03:57.037070 10938 tablet_bootstrap.cc:492] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116: Bootstrap starting.
I20260709 13:03:57.038779 10939 tablet_bootstrap.cc:492] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2: No bootstrap required, opened a new log
I20260709 13:03:57.039343 10939 ts_tablet_manager.cc:1403] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.005s
I20260709 13:03:57.042503 10939 raft_consensus.cc:359] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.043278 10939 raft_consensus.cc:385] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.043583 10939 raft_consensus.cc:740] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.043793 10938 tablet_bootstrap.cc:654] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.044471 10939 consensus_queue.cc:260] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.047173 10849 heartbeater.cc:499] Master 127.0.107.254:42039 was elected leader, sending a full tablet report...
I20260709 13:03:57.047851 10940 ts_tablet_manager.cc:1434] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.011s
I20260709 13:03:57.049134 10940 tablet_bootstrap.cc:492] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a: Bootstrap starting.
I20260709 13:03:57.056344 10940 tablet_bootstrap.cc:654] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.059849 10939 ts_tablet_manager.cc:1434] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.003s
I20260709 13:03:57.060612 10774 heartbeater.cc:499] Master 127.0.107.254:42039 was elected leader, sending a full tablet report...
I20260709 13:03:57.061264 10939 tablet_bootstrap.cc:492] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
I20260709 13:03:57.060623 10943 raft_consensus.cc:493] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.063135 10943 raft_consensus.cc:515] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.071170 10938 tablet_bootstrap.cc:492] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116: No bootstrap required, opened a new log
I20260709 13:03:57.071805 10938 ts_tablet_manager.cc:1403] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.017s
I20260709 13:03:57.073901 10940 tablet_bootstrap.cc:492] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a: No bootstrap required, opened a new log
I20260709 13:03:57.074407 10940 ts_tablet_manager.cc:1403] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.010s
I20260709 13:03:57.074954 10943 leader_election.cc:290] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:57.071190 10939 tablet_bootstrap.cc:654] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.074734 10938 raft_consensus.cc:359] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.077167 10938 raft_consensus.cc:385] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.077488 10938 raft_consensus.cc:740] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.078274 10938 consensus_queue.cc:260] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.080503 10938 ts_tablet_manager.cc:1434] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:03:57.080391 10940 raft_consensus.cc:359] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.081194 10940 raft_consensus.cc:385] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.081527 10938 tablet_bootstrap.cc:492] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116: Bootstrap starting.
I20260709 13:03:57.081489 10940 raft_consensus.cc:740] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.083285 10940 consensus_queue.cc:260] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.086880 10940 ts_tablet_manager.cc:1434] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:03:57.087930 10940 tablet_bootstrap.cc:492] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a: Bootstrap starting.
I20260709 13:03:57.089397 10938 tablet_bootstrap.cc:654] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.103142 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5db8e3237574f9a8836e5e9a88ba2c4" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2" is_pre_election: true
I20260709 13:03:57.104040 10749 raft_consensus.cc:2468] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 0.
I20260709 13:03:57.106783 10861 leader_election.cc:304] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, 6ff3a67a6b814758872d067d3a852116; no voters: 
I20260709 13:03:57.107887 10943 raft_consensus.cc:2804] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.108321 10943 raft_consensus.cc:493] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.108690 10943 raft_consensus.cc:3060] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.109683 10938 tablet_bootstrap.cc:492] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116: No bootstrap required, opened a new log
I20260709 13:03:57.110262 10938 ts_tablet_manager.cc:1403] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.005s
W20260709 13:03:57.110947 10775 tablet.cc:2406] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:57.113090 10938 raft_consensus.cc:359] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.113844 10938 raft_consensus.cc:385] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.114168 10940 tablet_bootstrap.cc:654] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.114149 10938 raft_consensus.cc:740] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.115340 10938 consensus_queue.cc:260] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.116775 10824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5db8e3237574f9a8836e5e9a88ba2c4" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" is_pre_election: true
I20260709 13:03:57.107026 10939 tablet_bootstrap.cc:492] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2: No bootstrap required, opened a new log
I20260709 13:03:57.118332 10939 ts_tablet_manager.cc:1403] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.007s
W20260709 13:03:57.120348 10861 leader_election.cc:343] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.121601 10939 raft_consensus.cc:359] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.122392 10939 raft_consensus.cc:385] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.122732 10939 raft_consensus.cc:740] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.123723 10939 consensus_queue.cc:260] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.126004 10939 ts_tablet_manager.cc:1434] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:03:57.126405 10943 raft_consensus.cc:515] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.126981 10946 raft_consensus.cc:493] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.127812 10946 raft_consensus.cc:515] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.130280 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5db8e3237574f9a8836e5e9a88ba2c4" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:03:57.130296 10939 tablet_bootstrap.cc:492] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
I20260709 13:03:57.131151 10749 raft_consensus.cc:3060] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.136171 10946 leader_election.cc:290] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:03:57.141448 10749 raft_consensus.cc:2468] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 1.
I20260709 13:03:57.142964 10861 leader_election.cc:304] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, 6ff3a67a6b814758872d067d3a852116; no voters: 
I20260709 13:03:57.143098 10939 tablet_bootstrap.cc:654] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.168136 10955 raft_consensus.cc:2804] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.168828 10955 raft_consensus.cc:697] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Becoming Leader. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:03:57.169889 10955 consensus_queue.cc:237] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.173816 10824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5db8e3237574f9a8836e5e9a88ba2c4" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
W20260709 13:03:57.176024 10861 leader_election.cc:343] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.177224 10943 leader_election.cc:290] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:57.189774 10940 tablet_bootstrap.cc:492] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a: No bootstrap required, opened a new log
I20260709 13:03:57.190374 10940 ts_tablet_manager.cc:1403] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent bootstrapping tablet: real 0.103s	user 0.025s	sys 0.018s
W20260709 13:03:57.193789 10695 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:57.193536 10940 raft_consensus.cc:359] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.194366 10940 raft_consensus.cc:385] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.194774 10940 raft_consensus.cc:740] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.197540 10939 tablet_bootstrap.cc:492] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2: No bootstrap required, opened a new log
I20260709 13:03:57.198076 10939 ts_tablet_manager.cc:1403] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.013s
I20260709 13:03:57.200996 10939 raft_consensus.cc:359] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.201728 10939 raft_consensus.cc:385] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.202039 10939 raft_consensus.cc:740] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.195881 10940 consensus_queue.cc:260] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.203157 10938 ts_tablet_manager.cc:1434] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116: Time spent starting tablet: real 0.093s	user 0.035s	sys 0.053s
I20260709 13:03:57.204212 10938 tablet_bootstrap.cc:492] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116: Bootstrap starting.
I20260709 13:03:57.204644 10824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b2d44c8aa74629b6f07f2a05b1255f" candidate_uuid: "6603ab202ddd40348d5c442a116570d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" is_pre_election: true
W20260709 13:03:57.206069 10712 leader_election.cc:343] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.207201 10940 ts_tablet_manager.cc:1434] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.006s
I20260709 13:03:57.208338 10940 tablet_bootstrap.cc:492] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a: Bootstrap starting.
I20260709 13:03:57.210676 10938 tablet_bootstrap.cc:654] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.211871 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b2d44c8aa74629b6f07f2a05b1255f" candidate_uuid: "6603ab202ddd40348d5c442a116570d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ff3a67a6b814758872d067d3a852116" is_pre_election: true
W20260709 13:03:57.213440 10712 leader_election.cc:343] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.213915 10712 leader_election.cc:304] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2; no voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a
I20260709 13:03:57.215106 10946 raft_consensus.cc:2749] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.216171 10939 consensus_queue.cc:260] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.219332 10939 ts_tablet_manager.cc:1434] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:03:57.219933 10946 raft_consensus.cc:493] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.220511 10938 tablet_bootstrap.cc:492] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116: No bootstrap required, opened a new log
I20260709 13:03:57.220459 10946 raft_consensus.cc:515] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.221074 10938 ts_tablet_manager.cc:1403] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.004s
I20260709 13:03:57.221686 10647 catalog_manager.cc:5697] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ff3a67a6b814758872d067d3a852116 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6ff3a67a6b814758872d067d3a852116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:57.222599 10946 leader_election.cc:290] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:03:57.224591 10938 raft_consensus.cc:359] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.224858 10824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8b72efed2f46e4b7c41a823d941b54" candidate_uuid: "6603ab202ddd40348d5c442a116570d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" is_pre_election: true
I20260709 13:03:57.225284 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8b72efed2f46e4b7c41a823d941b54" candidate_uuid: "6603ab202ddd40348d5c442a116570d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ff3a67a6b814758872d067d3a852116" is_pre_election: true
I20260709 13:03:57.225416 10945 raft_consensus.cc:493] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.226167 10938 raft_consensus.cc:385] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.225950 10945 raft_consensus.cc:515] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.226496 10938 raft_consensus.cc:740] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Initialized, Role: FOLLOWER
W20260709 13:03:57.227632 10712 leader_election.cc:343] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.227339 10938 consensus_queue.cc:260] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
W20260709 13:03:57.228350 10712 leader_election.cc:343] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.228786 10712 leader_election.cc:304] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2; no voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a
I20260709 13:03:57.229080 10939 tablet_bootstrap.cc:492] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
I20260709 13:03:57.229915 10938 ts_tablet_manager.cc:1434] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:57.230949 10938 tablet_bootstrap.cc:492] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116: Bootstrap starting.
I20260709 13:03:57.231911 10945 leader_election.cc:290] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:03:57.234828 10946 raft_consensus.cc:2749] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.238103 10940 tablet_bootstrap.cc:654] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.239024 10938 tablet_bootstrap.cc:654] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.245797 10939 tablet_bootstrap.cc:654] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.252018 10938 tablet_bootstrap.cc:492] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116: No bootstrap required, opened a new log
I20260709 13:03:57.252761 10938 ts_tablet_manager.cc:1403] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 13:03:57.256819 10938 raft_consensus.cc:359] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.258061 10938 raft_consensus.cc:385] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.258684 10938 raft_consensus.cc:740] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.260023 10938 consensus_queue.cc:260] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.263116 10938 ts_tablet_manager.cc:1434] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:03:57.264432 10938 tablet_bootstrap.cc:492] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116: Bootstrap starting.
I20260709 13:03:57.265196 10955 raft_consensus.cc:493] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.265751 10955 raft_consensus.cc:515] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.265224 10940 tablet_bootstrap.cc:492] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a: No bootstrap required, opened a new log
I20260709 13:03:57.266741 10940 ts_tablet_manager.cc:1403] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent bootstrapping tablet: real 0.059s	user 0.008s	sys 0.008s
I20260709 13:03:57.268023 10955 leader_election.cc:290] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:57.268247 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def0dda674d640a7bf9832c41e6411e8" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2" is_pre_election: true
I20260709 13:03:57.270058 10824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640b1bca020c48d2b5c418402f198ff1" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" is_pre_election: true
I20260709 13:03:57.271337 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640b1bca020c48d2b5c418402f198ff1" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2" is_pre_election: true
W20260709 13:03:57.271620 10861 leader_election.cc:343] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.271893 10938 tablet_bootstrap.cc:654] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.270025 10940 raft_consensus.cc:359] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
W20260709 13:03:57.272976 10861 leader_election.cc:343] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:57.273353 10787 leader_election.cc:343] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.273550 10861 leader_election.cc:304] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116; no voters: 6603ab202ddd40348d5c442a116570d2, f524ec9f4fca44a4bbf5a5c4b329079a
I20260709 13:03:57.274784 10955 raft_consensus.cc:2749] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.272969 10940 raft_consensus.cc:385] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.275985 10940 raft_consensus.cc:740] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.277596 10940 consensus_queue.cc:260] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.279439 10939 tablet_bootstrap.cc:492] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2: No bootstrap required, opened a new log
I20260709 13:03:57.280002 10939 ts_tablet_manager.cc:1403] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.000s
I20260709 13:03:57.280648 10940 ts_tablet_manager.cc:1434] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.006s
I20260709 13:03:57.282188 10940 tablet_bootstrap.cc:492] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a: Bootstrap starting.
I20260709 13:03:57.285645 10939 raft_consensus.cc:359] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.287496 10939 raft_consensus.cc:385] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.287786 10939 raft_consensus.cc:740] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.288647 10939 consensus_queue.cc:260] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.290479 10940 tablet_bootstrap.cc:654] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.290848 10939 ts_tablet_manager.cc:1434] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:03:57.291986 10939 tablet_bootstrap.cc:492] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
I20260709 13:03:57.293759 10938 tablet_bootstrap.cc:492] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116: No bootstrap required, opened a new log
I20260709 13:03:57.294883 10938 ts_tablet_manager.cc:1403] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.013s
I20260709 13:03:57.298676 10939 tablet_bootstrap.cc:654] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.299214 10938 raft_consensus.cc:359] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.300503 10938 raft_consensus.cc:385] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.300894 10938 raft_consensus.cc:740] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.301893 10938 consensus_queue.cc:260] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.303362 10940 tablet_bootstrap.cc:492] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a: No bootstrap required, opened a new log
I20260709 13:03:57.303900 10940 ts_tablet_manager.cc:1403] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 13:03:57.304417 10938 ts_tablet_manager.cc:1434] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:03:57.305545 10938 tablet_bootstrap.cc:492] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116: Bootstrap starting.
I20260709 13:03:57.306874 10940 raft_consensus.cc:359] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.307670 10940 raft_consensus.cc:385] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.307972 10940 raft_consensus.cc:740] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.308975 10940 consensus_queue.cc:260] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.311583 10940 ts_tablet_manager.cc:1434] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:57.312656 10940 tablet_bootstrap.cc:492] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a: Bootstrap starting.
I20260709 13:03:57.313032 10938 tablet_bootstrap.cc:654] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.321738 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def0dda674d640a7bf9832c41e6411e8" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ff3a67a6b814758872d067d3a852116" is_pre_election: true
I20260709 13:03:57.322638 10898 raft_consensus.cc:2468] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 0.
I20260709 13:03:57.324005 10787 leader_election.cc:304] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 6603ab202ddd40348d5c442a116570d2
I20260709 13:03:57.324282 10939 tablet_bootstrap.cc:492] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2: No bootstrap required, opened a new log
I20260709 13:03:57.324867 10939 ts_tablet_manager.cc:1403] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.012s
I20260709 13:03:57.325244 10938 tablet_bootstrap.cc:492] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116: No bootstrap required, opened a new log
I20260709 13:03:57.325264 10945 raft_consensus.cc:2804] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.325855 10945 raft_consensus.cc:493] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.326013 10938 ts_tablet_manager.cc:1403] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 13:03:57.326231 10945 raft_consensus.cc:3060] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.327912 10939 raft_consensus.cc:359] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.328701 10939 raft_consensus.cc:385] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.328999 10939 raft_consensus.cc:740] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.329566 10938 raft_consensus.cc:359] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.329735 10939 consensus_queue.cc:260] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.330415 10938 raft_consensus.cc:385] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.330883 10938 raft_consensus.cc:740] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.331305 10946 raft_consensus.cc:493] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.331810 10946 raft_consensus.cc:515] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.332187 10939 ts_tablet_manager.cc:1434] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:03:57.331875 10938 consensus_queue.cc:260] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.333320 10939 tablet_bootstrap.cc:492] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
I20260709 13:03:57.333958 10946 leader_election.cc:290] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:03:57.333794 10945 raft_consensus.cc:515] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.335799 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89a7a13b88149bd87ba85a0f44c174d" candidate_uuid: "6603ab202ddd40348d5c442a116570d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ff3a67a6b814758872d067d3a852116" is_pre_election: true
I20260709 13:03:57.321682 10940 tablet_bootstrap.cc:654] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.337073 10938 ts_tablet_manager.cc:1434] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:03:57.338487 10938 tablet_bootstrap.cc:492] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116: Bootstrap starting.
W20260709 13:03:57.339521 10712 leader_election.cc:343] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.340952 10939 tablet_bootstrap.cc:654] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.335908 10824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89a7a13b88149bd87ba85a0f44c174d" candidate_uuid: "6603ab202ddd40348d5c442a116570d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" is_pre_election: true
I20260709 13:03:57.341614 10945 leader_election.cc:290] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:03:57.343107 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def0dda674d640a7bf9832c41e6411e8" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:03:57.344506 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def0dda674d640a7bf9832c41e6411e8" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ff3a67a6b814758872d067d3a852116"
I20260709 13:03:57.345114 10898 raft_consensus.cc:3060] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.345851 10945 raft_consensus.cc:493] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.347007 10938 tablet_bootstrap.cc:654] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.346503 10945 raft_consensus.cc:515] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.349721 10945 leader_election.cc:290] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
W20260709 13:03:57.352988 10787 leader_election.cc:343] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.353982 10940 tablet_bootstrap.cc:492] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a: No bootstrap required, opened a new log
I20260709 13:03:57.354568 10940 ts_tablet_manager.cc:1403] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.000s
I20260709 13:03:57.356691 10938 tablet_bootstrap.cc:492] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116: No bootstrap required, opened a new log
I20260709 13:03:57.356591 10897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5db8e3237574f9a8836e5e9a88ba2c4" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ff3a67a6b814758872d067d3a852116" is_pre_election: true
I20260709 13:03:57.357229 10938 ts_tablet_manager.cc:1403] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.003s
I20260709 13:03:57.358119 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5db8e3237574f9a8836e5e9a88ba2c4" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2" is_pre_election: true
I20260709 13:03:57.359002 10749 raft_consensus.cc:2393] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f524ec9f4fca44a4bbf5a5c4b329079a in current term 1: Already voted for candidate 6ff3a67a6b814758872d067d3a852116 in this term.
I20260709 13:03:57.358353 10940 raft_consensus.cc:359] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.359601 10940 raft_consensus.cc:385] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.359917 10940 raft_consensus.cc:740] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.360036 10938 raft_consensus.cc:359] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.360895 10938 raft_consensus.cc:385] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.361416 10938 raft_consensus.cc:740] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.360814 10940 consensus_queue.cc:260] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.362193 10938 consensus_queue.cc:260] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.364245 10938 ts_tablet_manager.cc:1434] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:03:57.365017 10939 tablet_bootstrap.cc:492] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2: No bootstrap required, opened a new log
I20260709 13:03:57.365072 10940 ts_tablet_manager.cc:1434] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 13:03:57.365170 10938 tablet_bootstrap.cc:492] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116: Bootstrap starting.
I20260709 13:03:57.365949 10939 ts_tablet_manager.cc:1403] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.009s
I20260709 13:03:57.366513 10940 tablet_bootstrap.cc:492] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a: Bootstrap starting.
W20260709 13:03:57.368642 10712 leader_election.cc:343] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.369190 10712 leader_election.cc:304] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2; no voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a
I20260709 13:03:57.369035 10939 raft_consensus.cc:359] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.369935 10939 raft_consensus.cc:385] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.370301 10939 raft_consensus.cc:740] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.371210 10939 consensus_queue.cc:260] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.372586 10938 tablet_bootstrap.cc:654] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.372968 10940 tablet_bootstrap.cc:654] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.374293 10946 raft_consensus.cc:2749] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.383215 10938 tablet_bootstrap.cc:492] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116: No bootstrap required, opened a new log
I20260709 13:03:57.383911 10938 ts_tablet_manager.cc:1403] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:03:57.386960 10938 raft_consensus.cc:359] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.387872 10938 raft_consensus.cc:385] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.388285 10938 raft_consensus.cc:740] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.389329 10938 consensus_queue.cc:260] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.392302 10938 ts_tablet_manager.cc:1434] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:57.392921 10787 leader_election.cc:304] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 6603ab202ddd40348d5c442a116570d2, 6ff3a67a6b814758872d067d3a852116
I20260709 13:03:57.394100 10945 raft_consensus.cc:3060] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.402282 10898 raft_consensus.cc:2468] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 1.
I20260709 13:03:57.405151 10945 raft_consensus.cc:2749] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.416520 10938 tablet_bootstrap.cc:492] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116: Bootstrap starting.
I20260709 13:03:57.417412 10939 ts_tablet_manager.cc:1434] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.051s	user 0.013s	sys 0.030s
I20260709 13:03:57.418430 10940 tablet_bootstrap.cc:492] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a: No bootstrap required, opened a new log
I20260709 13:03:57.419543 10940 ts_tablet_manager.cc:1403] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.016s
I20260709 13:03:57.420746 10939 tablet_bootstrap.cc:492] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
I20260709 13:03:57.422966 10938 tablet_bootstrap.cc:654] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.422705 10940 raft_consensus.cc:359] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.423720 10940 raft_consensus.cc:385] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.424083 10940 raft_consensus.cc:740] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.418685 10787 leader_election.cc:304] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 6603ab202ddd40348d5c442a116570d2
I20260709 13:03:57.425375 10945 raft_consensus.cc:2804] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.425072 10940 consensus_queue.cc:260] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.427569 10955 raft_consensus.cc:493] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.428231 10955 raft_consensus.cc:515] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.430490 10955 leader_election.cc:290] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:57.434018 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b2d44c8aa74629b6f07f2a05b1255f" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2" is_pre_election: true
I20260709 13:03:57.434579 10939 tablet_bootstrap.cc:654] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.434757 10749 raft_consensus.cc:2468] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 0.
I20260709 13:03:57.436096 10955 raft_consensus.cc:493] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.436614 10940 ts_tablet_manager.cc:1434] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.011s
I20260709 13:03:57.436739 10938 tablet_bootstrap.cc:492] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116: No bootstrap required, opened a new log
I20260709 13:03:57.437405 10938 ts_tablet_manager.cc:1403] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:03:57.437732 10824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b2d44c8aa74629b6f07f2a05b1255f" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" is_pre_election: true
I20260709 13:03:57.438117 10940 tablet_bootstrap.cc:492] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a: Bootstrap starting.
I20260709 13:03:57.438387 10824 raft_consensus.cc:2468] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 0.
I20260709 13:03:57.440212 10938 raft_consensus.cc:359] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.440882 10938 raft_consensus.cc:385] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.441026 10861 leader_election.cc:304] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:03:57.441208 10938 raft_consensus.cc:740] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.436610 10955 raft_consensus.cc:515] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.442176 10938 consensus_queue.cc:260] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.443389 10945 raft_consensus.cc:697] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 LEADER]: Becoming Leader. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Running, Role: LEADER
I20260709 13:03:57.443967 10955 leader_election.cc:290] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:57.444339 10945 consensus_queue.cc:237] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.447314 10952 raft_consensus.cc:2804] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.447755 10952 raft_consensus.cc:493] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.448249 10952 raft_consensus.cc:3060] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.448972 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea67ea321734b05a2c1f920d4fd1eab" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2" is_pre_election: true
I20260709 13:03:57.449245 10940 tablet_bootstrap.cc:654] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.452519 10943 raft_consensus.cc:493] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.453033 10943 raft_consensus.cc:515] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.455210 10943 leader_election.cc:290] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:57.455915 10979 raft_consensus.cc:493] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.456440 10979 raft_consensus.cc:515] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.460376 10952 raft_consensus.cc:515] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.462406 10940 tablet_bootstrap.cc:492] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a: No bootstrap required, opened a new log
I20260709 13:03:57.463225 10940 ts_tablet_manager.cc:1403] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.006s
I20260709 13:03:57.464278 10938 ts_tablet_manager.cc:1434] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:03:57.462570 10952 leader_election.cc:290] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:57.464361 10644 catalog_manager.cc:5697] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a reported cstate change: term changed from 0 to 1, leader changed from <none> to f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.466734 10940 raft_consensus.cc:359] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.467715 10940 raft_consensus.cc:385] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.468055 10940 raft_consensus.cc:740] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.468231 10824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea67ea321734b05a2c1f920d4fd1eab" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" is_pre_election: true
I20260709 13:03:57.468953 10824 raft_consensus.cc:2468] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 0.
I20260709 13:03:57.471489 10824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8b72efed2f46e4b7c41a823d941b54" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" is_pre_election: true
I20260709 13:03:57.472934 10824 raft_consensus.cc:2468] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 0.
I20260709 13:03:57.474725 10955 raft_consensus.cc:493] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.474858 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b2d44c8aa74629b6f07f2a05b1255f" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:03:57.469244 10940 consensus_queue.cc:260] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.475683 10748 raft_consensus.cc:3060] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.475970 10823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b2d44c8aa74629b6f07f2a05b1255f" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
I20260709 13:03:57.475657 10955 raft_consensus.cc:515] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.476744 10823 raft_consensus.cc:3060] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.475744 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8b72efed2f46e4b7c41a823d941b54" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2" is_pre_election: true
I20260709 13:03:57.477747 10749 raft_consensus.cc:2468] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 0.
I20260709 13:03:57.479807 10955 leader_election.cc:290] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:57.480597 10861 leader_election.cc:304] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:03:57.481498 10861 leader_election.cc:304] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:03:57.482017 10955 raft_consensus.cc:2804] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:03:57.482458 10861 leader_election.cc:343] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.474318 10979 leader_election.cc:290] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:03:57.482492 10955 raft_consensus.cc:493] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.483069 10747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea67ea321734b05a2c1f920d4fd1eab" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2" is_pre_election: true
I20260709 13:03:57.483626 10955 raft_consensus.cc:3060] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:57.485025 10787 leader_election.cc:343] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.485450 10952 raft_consensus.cc:2804] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.486824 10952 raft_consensus.cc:493] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.488416 10952 raft_consensus.cc:3060] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.488512 10939 tablet_bootstrap.cc:492] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2: No bootstrap required, opened a new log
I20260709 13:03:57.487833 10748 raft_consensus.cc:2468] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 1.
I20260709 13:03:57.489208 10940 ts_tablet_manager.cc:1434] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:03:57.489236 10939 ts_tablet_manager.cc:1403] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.069s	user 0.019s	sys 0.028s
I20260709 13:03:57.491083 10861 leader_election.cc:304] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, 6ff3a67a6b814758872d067d3a852116; no voters: 
I20260709 13:03:57.485062 10823 raft_consensus.cc:2468] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 1.
I20260709 13:03:57.492017 10943 raft_consensus.cc:2804] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.493513 10940 tablet_bootstrap.cc:492] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a: Bootstrap starting.
I20260709 13:03:57.494549 10824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" is_pre_election: true
I20260709 13:03:57.495705 10824 raft_consensus.cc:2468] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 0.
I20260709 13:03:57.496546 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2" is_pre_election: true
I20260709 13:03:57.500649 10940 tablet_bootstrap.cc:654] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.504168 10939 raft_consensus.cc:359] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.504976 10939 raft_consensus.cc:385] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.505314 10939 raft_consensus.cc:740] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.503079 10952 raft_consensus.cc:515] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.504639 10955 raft_consensus.cc:515] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.506839 10939 consensus_queue.cc:260] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.507495 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea67ea321734b05a2c1f920d4fd1eab" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ff3a67a6b814758872d067d3a852116" is_pre_election: true
I20260709 13:03:57.508845 10898 raft_consensus.cc:2393] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f524ec9f4fca44a4bbf5a5c4b329079a in current term 1: Already voted for candidate 6ff3a67a6b814758872d067d3a852116 in this term.
I20260709 13:03:57.509857 10955 leader_election.cc:290] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:57.514039 10943 raft_consensus.cc:697] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Becoming Leader. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:03:57.508846 10952 leader_election.cc:290] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:57.515071 10943 consensus_queue.cc:237] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.507740 10861 leader_election.cc:304] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:03:57.516368 10939 ts_tablet_manager.cc:1434] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:03:57.516820 10952 raft_consensus.cc:2804] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.517480 10939 tablet_bootstrap.cc:492] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
W20260709 13:03:57.517257 10861 leader_election.cc:343] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.519579 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8b72efed2f46e4b7c41a823d941b54" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:03:57.520198 10748 raft_consensus.cc:3060] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.524701 10939 tablet_bootstrap.cc:654] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.528290 10940 tablet_bootstrap.cc:492] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a: No bootstrap required, opened a new log
I20260709 13:03:57.528776 10940 ts_tablet_manager.cc:1403] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 13:03:57.529211 10952 raft_consensus.cc:493] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.529928 10952 raft_consensus.cc:3060] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.528581 10748 raft_consensus.cc:2468] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 1.
I20260709 13:03:57.531821 10824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8b72efed2f46e4b7c41a823d941b54" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
I20260709 13:03:57.531778 10940 raft_consensus.cc:359] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.532655 10824 raft_consensus.cc:3060] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.532725 10940 raft_consensus.cc:385] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.533144 10940 raft_consensus.cc:740] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.533231 10787 leader_election.cc:304] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 6603ab202ddd40348d5c442a116570d2, 6ff3a67a6b814758872d067d3a852116
I20260709 13:03:57.534112 10939 tablet_bootstrap.cc:492] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2: No bootstrap required, opened a new log
I20260709 13:03:57.534036 10940 consensus_queue.cc:260] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.534603 10939 ts_tablet_manager.cc:1403] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 13:03:57.535045 10945 raft_consensus.cc:3060] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.535929 10823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea67ea321734b05a2c1f920d4fd1eab" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
I20260709 13:03:57.537609 10939 raft_consensus.cc:359] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.538326 10939 raft_consensus.cc:385] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.538729 10939 raft_consensus.cc:740] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.539564 10939 consensus_queue.cc:260] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.541498 10939 ts_tablet_manager.cc:1434] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:03:57.542892 10945 raft_consensus.cc:2749] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.544881 10940 ts_tablet_manager.cc:1434] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:03:57.545344 10939 tablet_bootstrap.cc:492] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
I20260709 13:03:57.545858 10940 tablet_bootstrap.cc:492] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a: Bootstrap starting.
I20260709 13:03:57.546936 10943 raft_consensus.cc:493] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.547441 10943 raft_consensus.cc:515] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.549599 10943 leader_election.cc:290] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:57.552034 10940 tablet_bootstrap.cc:654] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.555371 10939 tablet_bootstrap.cc:654] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.561359 10824 raft_consensus.cc:2468] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 1.
I20260709 13:03:57.561632 10943 raft_consensus.cc:493] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.566829 10943 raft_consensus.cc:515] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.562288 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea67ea321734b05a2c1f920d4fd1eab" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:03:57.569502 10748 raft_consensus.cc:3060] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.564754 10747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f5e456fbfd4fce8e37636881dce2b5" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2" is_pre_election: true
I20260709 13:03:57.569657 10943 leader_election.cc:290] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:57.570416 10945 raft_consensus.cc:493] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.565722 10822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f5e456fbfd4fce8e37636881dce2b5" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" is_pre_election: true
I20260709 13:03:57.571028 10945 raft_consensus.cc:515] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.562978 10823 raft_consensus.cc:2468] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 1.
I20260709 13:03:57.571347 10822 raft_consensus.cc:2468] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 0.
I20260709 13:03:57.573504 10945 leader_election.cc:290] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:03:57.575259 10747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89a7a13b88149bd87ba85a0f44c174d" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2" is_pre_election: true
I20260709 13:03:57.576071 10747 raft_consensus.cc:2468] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 0.
I20260709 13:03:57.577952 10787 leader_election.cc:304] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:03:57.578959 10945 raft_consensus.cc:2804] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.578676 10952 raft_consensus.cc:515] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.579452 10945 raft_consensus.cc:493] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.579856 10945 raft_consensus.cc:3060] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.581040 10952 leader_election.cc:290] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:57.565892 10861 leader_election.cc:304] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, 6ff3a67a6b814758872d067d3a852116; no voters: 
I20260709 13:03:57.585513 10939 tablet_bootstrap.cc:492] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2: No bootstrap required, opened a new log
I20260709 13:03:57.586067 10939 ts_tablet_manager.cc:1403] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.012s
I20260709 13:03:57.586786 10644 catalog_manager.cc:5697] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ff3a67a6b814758872d067d3a852116 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6ff3a67a6b814758872d067d3a852116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:57.587631 10945 raft_consensus.cc:515] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.588900 10939 raft_consensus.cc:359] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.589674 10945 leader_election.cc:290] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:03:57.590129 10943 raft_consensus.cc:2804] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.589645 10939 raft_consensus.cc:385] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.590636 10747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89a7a13b88149bd87ba85a0f44c174d" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:03:57.591384 10747 raft_consensus.cc:3060] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.591688 10940 tablet_bootstrap.cc:492] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a: No bootstrap required, opened a new log
I20260709 13:03:57.591810 10748 raft_consensus.cc:2468] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 1.
I20260709 13:03:57.592249 10940 ts_tablet_manager.cc:1403] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.015s
I20260709 13:03:57.590759 10943 raft_consensus.cc:697] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Becoming Leader. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:03:57.593914 10943 consensus_queue.cc:237] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.595063 10940 raft_consensus.cc:359] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.595852 10940 raft_consensus.cc:385] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.596104 10940 raft_consensus.cc:740] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.596776 10940 consensus_queue.cc:260] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.599028 10940 ts_tablet_manager.cc:1434] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:57.601944 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89a7a13b88149bd87ba85a0f44c174d" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ff3a67a6b814758872d067d3a852116" is_pre_election: true
I20260709 13:03:57.602399 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:03:57.601904 10823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3e403122e4cdfa4c423d00d4c1577" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" is_pre_election: true
I20260709 13:03:57.602829 10898 raft_consensus.cc:2468] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 0.
I20260709 13:03:57.602964 10861 leader_election.cc:304] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:03:57.602005 10824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
I20260709 13:03:57.603492 10823 raft_consensus.cc:2468] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 0.
I20260709 13:03:57.590762 10939 raft_consensus.cc:740] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.603982 10824 raft_consensus.cc:3060] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.604131 10952 raft_consensus.cc:2804] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.604683 10952 raft_consensus.cc:493] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.605006 10952 raft_consensus.cc:3060] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.605269 10747 raft_consensus.cc:2468] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 1.
I20260709 13:03:57.604791 10939 consensus_queue.cc:260] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.602415 10897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89a7a13b88149bd87ba85a0f44c174d" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ff3a67a6b814758872d067d3a852116"
I20260709 13:03:57.608381 10897 raft_consensus.cc:3060] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.610363 10952 raft_consensus.cc:515] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.612068 10787 leader_election.cc:304] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:03:57.612416 10952 leader_election.cc:290] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:57.613023 10945 raft_consensus.cc:2804] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.613515 10945 raft_consensus.cc:697] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 LEADER]: Becoming Leader. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Running, Role: LEADER
I20260709 13:03:57.613641 10861 leader_election.cc:304] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:03:57.614394 10945 consensus_queue.cc:237] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.615119 10984 raft_consensus.cc:2804] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.615625 10984 raft_consensus.cc:697] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Becoming Leader. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:03:57.616469 10984 consensus_queue.cc:237] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.617084 10939 ts_tablet_manager.cc:1434] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260709 13:03:57.619480 10749 raft_consensus.cc:3060] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.620676 10861 leader_election.cc:304] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:03:57.621470 10939 tablet_bootstrap.cc:492] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
I20260709 13:03:57.621604 10955 raft_consensus.cc:2804] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.622095 10955 raft_consensus.cc:493] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.622442 10955 raft_consensus.cc:3060] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:57.621745 10861 leader_election.cc:343] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.628273 10939 tablet_bootstrap.cc:654] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.637423 10747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f5e456fbfd4fce8e37636881dce2b5" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:03:57.643850 10823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f5e456fbfd4fce8e37636881dce2b5" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
I20260709 13:03:57.644794 10823 raft_consensus.cc:3060] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.649504 10975 raft_consensus.cc:493] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.650142 10975 raft_consensus.cc:515] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.654323 10824 raft_consensus.cc:2468] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 1.
I20260709 13:03:57.655651 10975 leader_election.cc:290] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:03:57.657799 10897 raft_consensus.cc:2468] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 1.
I20260709 13:03:57.657670 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3e403122e4cdfa4c423d00d4c1577" candidate_uuid: "6603ab202ddd40348d5c442a116570d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ff3a67a6b814758872d067d3a852116" is_pre_election: true
I20260709 13:03:57.658213 10749 raft_consensus.cc:2468] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 1.
I20260709 13:03:57.663163 10824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3e403122e4cdfa4c423d00d4c1577" candidate_uuid: "6603ab202ddd40348d5c442a116570d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" is_pre_election: true
I20260709 13:03:57.664525 10824 raft_consensus.cc:2468] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6603ab202ddd40348d5c442a116570d2 in term 0.
I20260709 13:03:57.655694 10955 raft_consensus.cc:515] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.665953 10898 raft_consensus.cc:2393] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6603ab202ddd40348d5c442a116570d2 in current term 1: Already voted for candidate 6ff3a67a6b814758872d067d3a852116 in this term.
I20260709 13:03:57.659793 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3e403122e4cdfa4c423d00d4c1577" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2" is_pre_election: true
I20260709 13:03:57.666049 10712 leader_election.cc:304] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
W20260709 13:03:57.659107 10861 leader_election.cc:343] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.666760 10748 raft_consensus.cc:2468] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 0.
I20260709 13:03:57.667408 10975 raft_consensus.cc:2804] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.659253 10943 consensus_queue.cc:1048] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:03:57.667917 10975 raft_consensus.cc:493] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.668494 10975 raft_consensus.cc:3060] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.669160 10952 consensus_queue.cc:1048] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.670797 10955 leader_election.cc:290] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:57.671080 10861 leader_election.cc:304] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:03:57.676520 10955 raft_consensus.cc:2804] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.677301 10955 raft_consensus.cc:697] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Becoming Leader. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:03:57.678224 10955 consensus_queue.cc:237] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.678858 10975 raft_consensus.cc:515] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.682111 10824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3e403122e4cdfa4c423d00d4c1577" candidate_uuid: "6603ab202ddd40348d5c442a116570d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
I20260709 13:03:57.685386 10645 catalog_manager.cc:5697] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a reported cstate change: term changed from 0 to 1, leader changed from <none> to f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.687701 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3e403122e4cdfa4c423d00d4c1577" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:03:57.695950 10749 raft_consensus.cc:2393] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff3a67a6b814758872d067d3a852116 in current term 1: Already voted for candidate 6603ab202ddd40348d5c442a116570d2 in this term.
I20260709 13:03:57.662581 10823 raft_consensus.cc:2468] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 1.
I20260709 13:03:57.688449 10821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3e403122e4cdfa4c423d00d4c1577" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
I20260709 13:03:57.698315 10861 leader_election.cc:304] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 6603ab202ddd40348d5c442a116570d2
I20260709 13:03:57.682802 10824 raft_consensus.cc:3060] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.700142 10861 leader_election.cc:304] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116; no voters: 6603ab202ddd40348d5c442a116570d2, f524ec9f4fca44a4bbf5a5c4b329079a
I20260709 13:03:57.701035 10984 raft_consensus.cc:2804] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.701581 10984 raft_consensus.cc:697] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Becoming Leader. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:03:57.703408 10943 raft_consensus.cc:2749] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.702508 10984 consensus_queue.cc:237] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.704730 10644 catalog_manager.cc:5697] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ff3a67a6b814758872d067d3a852116 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6ff3a67a6b814758872d067d3a852116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:57.707038 10644 catalog_manager.cc:5697] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ff3a67a6b814758872d067d3a852116 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6ff3a67a6b814758872d067d3a852116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:57.710862 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3e403122e4cdfa4c423d00d4c1577" candidate_uuid: "6603ab202ddd40348d5c442a116570d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ff3a67a6b814758872d067d3a852116"
I20260709 13:03:57.711855 10898 raft_consensus.cc:2393] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6603ab202ddd40348d5c442a116570d2 in current term 1: Already voted for candidate 6ff3a67a6b814758872d067d3a852116 in this term.
I20260709 13:03:57.713200 10939 tablet_bootstrap.cc:492] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2: No bootstrap required, opened a new log
I20260709 13:03:57.713908 10939 ts_tablet_manager.cc:1403] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.093s	user 0.029s	sys 0.030s
I20260709 13:03:57.717347 10939 raft_consensus.cc:359] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.718324 10939 raft_consensus.cc:385] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.718742 10939 raft_consensus.cc:740] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.723526 10975 leader_election.cc:290] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 election: Requested vote from peers f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:03:57.727527 10824 raft_consensus.cc:2468] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6603ab202ddd40348d5c442a116570d2 in term 1.
I20260709 13:03:57.729171 10712 leader_election.cc:304] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 6ff3a67a6b814758872d067d3a852116
I20260709 13:03:57.730515 10975 raft_consensus.cc:2804] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.731752 10975 raft_consensus.cc:697] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 1 LEADER]: Becoming Leader. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Running, Role: LEADER
I20260709 13:03:57.732630 10975 consensus_queue.cc:237] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.743772 10939 consensus_queue.cc:260] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.746656 10939 ts_tablet_manager.cc:1434] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:03:57.746150 10645 catalog_manager.cc:5697] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ff3a67a6b814758872d067d3a852116 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6ff3a67a6b814758872d067d3a852116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:57.751155 10645 catalog_manager.cc:5697] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ff3a67a6b814758872d067d3a852116 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6ff3a67a6b814758872d067d3a852116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:57.757840 10644 catalog_manager.cc:5697] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6603ab202ddd40348d5c442a116570d2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6603ab202ddd40348d5c442a116570d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.765561 10945 raft_consensus.cc:493] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.766187 10945 raft_consensus.cc:515] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.768401 10945 leader_election.cc:290] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:03:57.769141 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640b1bca020c48d2b5c418402f198ff1" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2" is_pre_election: true
I20260709 13:03:57.769550 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640b1bca020c48d2b5c418402f198ff1" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ff3a67a6b814758872d067d3a852116" is_pre_election: true
I20260709 13:03:57.769919 10748 raft_consensus.cc:2468] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 0.
I20260709 13:03:57.770267 10898 raft_consensus.cc:2468] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 0.
I20260709 13:03:57.771162 10787 leader_election.cc:304] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:03:57.771950 10945 raft_consensus.cc:2804] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.772332 10945 raft_consensus.cc:493] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.772694 10945 raft_consensus.cc:3060] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.778545 10945 raft_consensus.cc:515] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.780598 10945 leader_election.cc:290] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:03:57.781394 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640b1bca020c48d2b5c418402f198ff1" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:03:57.781682 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640b1bca020c48d2b5c418402f198ff1" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ff3a67a6b814758872d067d3a852116"
I20260709 13:03:57.781973 10748 raft_consensus.cc:3060] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.782343 10898 raft_consensus.cc:3060] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.787039 10748 raft_consensus.cc:2468] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 1.
I20260709 13:03:57.787359 10898 raft_consensus.cc:2468] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 1.
I20260709 13:03:57.788352 10787 leader_election.cc:304] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:03:57.789134 10945 raft_consensus.cc:2804] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.789531 10945 raft_consensus.cc:697] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 LEADER]: Becoming Leader. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Running, Role: LEADER
I20260709 13:03:57.790248 10945 consensus_queue.cc:237] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.798101 10644 catalog_manager.cc:5697] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a reported cstate change: term changed from 0 to 1, leader changed from <none> to f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.829782 10975 raft_consensus.cc:493] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.830341 10975 raft_consensus.cc:515] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:57.832098 10975 leader_election.cc:290] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:03:57.833003 10822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def0dda674d640a7bf9832c41e6411e8" candidate_uuid: "6603ab202ddd40348d5c442a116570d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" is_pre_election: true
I20260709 13:03:57.833189 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def0dda674d640a7bf9832c41e6411e8" candidate_uuid: "6603ab202ddd40348d5c442a116570d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ff3a67a6b814758872d067d3a852116" is_pre_election: true
I20260709 13:03:57.833877 10898 raft_consensus.cc:2393] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6603ab202ddd40348d5c442a116570d2 in current term 1: Already voted for candidate f524ec9f4fca44a4bbf5a5c4b329079a in this term.
I20260709 13:03:57.834757 10712 leader_election.cc:304] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2; no voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a
I20260709 13:03:57.835565 10975 raft_consensus.cc:3060] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.840638 10975 raft_consensus.cc:2749] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.856056   431 ts_manager.cc:295] Set tserver state for 6603ab202ddd40348d5c442a116570d2 to MAINTENANCE_MODE
I20260709 13:03:57.856942   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:03:57.883507   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:57.884262   431 tablet_replica.cc:333] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2: stopping tablet replica
I20260709 13:03:57.884893   431 raft_consensus.cc:2243] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:57.885288   431 raft_consensus.cc:2272] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:57.887940   431 tablet_replica.cc:333] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2: stopping tablet replica
I20260709 13:03:57.888482   431 raft_consensus.cc:2243] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:57.888918   431 raft_consensus.cc:2272] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:57.892745   431 tablet_replica.cc:333] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2: stopping tablet replica
I20260709 13:03:57.893364   431 raft_consensus.cc:2243] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:57.893759   431 raft_consensus.cc:2272] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:57.895702   431 tablet_replica.cc:333] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2: stopping tablet replica
I20260709 13:03:57.896322   431 raft_consensus.cc:2243] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:57.896705   431 raft_consensus.cc:2272] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:57.898658   431 tablet_replica.cc:333] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2: stopping tablet replica
I20260709 13:03:57.899204   431 raft_consensus.cc:2243] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:57.899664   431 raft_consensus.cc:2272] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:57.901248   431 tablet_replica.cc:333] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2: stopping tablet replica
I20260709 13:03:57.901823   431 raft_consensus.cc:2243] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:57.902217   431 raft_consensus.cc:2272] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:57.904379   431 tablet_replica.cc:333] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2: stopping tablet replica
I20260709 13:03:57.904902   431 raft_consensus.cc:2243] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:57.905460   431 pending_rounds.cc:70] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2: Trying to abort 1 pending ops.
I20260709 13:03:57.905611   431 pending_rounds.cc:77] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634765800947712 op_type: NO_OP noop_request { }
I20260709 13:03:57.905987   431 raft_consensus.cc:2889] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:57.906298   431 raft_consensus.cc:2272] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:57.908867   431 tablet_replica.cc:333] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2: stopping tablet replica
I20260709 13:03:57.909575   431 raft_consensus.cc:2243] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:57.909950   431 raft_consensus.cc:2272] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:57.911664   431 tablet_replica.cc:333] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2: stopping tablet replica
I20260709 13:03:57.912142   431 raft_consensus.cc:2243] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:57.912509   431 raft_consensus.cc:2272] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:57.914201   431 tablet_replica.cc:333] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2: stopping tablet replica
I20260709 13:03:57.914659   431 raft_consensus.cc:2243] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:57.915028   431 raft_consensus.cc:2272] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:57.941749   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:57.968173 10787 consensus_peers.cc:597] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:57.982374 10945 consensus_queue.cc:1048] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:58.006728 10861 consensus_peers.cc:597] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:58.019935 10984 consensus_queue.cc:1048] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:58.033589 10861 consensus_peers.cc:597] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:58.089166 10787 consensus_peers.cc:597] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:58.124007 10943 consensus_queue.cc:1048] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.136569 10952 consensus_queue.cc:1048] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:58.151607 10861 consensus_peers.cc:597] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:58.195060 10695 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:58.212008 10979 consensus_queue.cc:1048] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:58.241272 10861 consensus_peers.cc:597] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:58.249032 10955 consensus_queue.cc:1048] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:58.259788 10861 consensus_peers.cc:597] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:58.266989 10787 consensus_peers.cc:597] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:58.280105 10945 consensus_queue.cc:1048] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.330648 10955 consensus_queue.cc:1048] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:58.333348 10861 consensus_peers.cc:597] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:58.385428 10787 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111) [suppressed 264 similar messages]
W20260709 13:03:59.196327 10695 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:59.785310 10955 raft_consensus.cc:493] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.785909 10955 raft_consensus.cc:515] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:59.788681 10955 leader_election.cc:290] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:59.790063 10824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3e403122e4cdfa4c423d00d4c1577" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" is_pre_election: true
I20260709 13:03:59.790802 10824 raft_consensus.cc:2468] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 1.
I20260709 13:03:59.792124 10861 leader_election.cc:304] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
W20260709 13:03:59.793144 10861 leader_election.cc:336] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111)
I20260709 13:03:59.793191 10955 raft_consensus.cc:2804] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:59.793648 10955 raft_consensus.cc:493] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.794015 10955 raft_consensus.cc:3060] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:59.799396 10955 raft_consensus.cc:515] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:59.800930 10955 leader_election.cc:290] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 2 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:03:59.802538 10824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3e403122e4cdfa4c423d00d4c1577" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
I20260709 13:03:59.803476 10824 raft_consensus.cc:3060] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:59.804888 10861 leader_election.cc:336] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111)
I20260709 13:03:59.809742 10824 raft_consensus.cc:2468] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 2.
I20260709 13:03:59.810900 10861 leader_election.cc:304] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 6603ab202ddd40348d5c442a116570d2
I20260709 13:03:59.811652 10955 raft_consensus.cc:2804] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:59.812714 10955 raft_consensus.cc:697] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 2 LEADER]: Becoming Leader. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:03:59.813768 10955 consensus_queue.cc:237] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:03:59.821991 10643 catalog_manager.cc:5697] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 reported cstate change: term changed from 1 to 2, leader changed from 6603ab202ddd40348d5c442a116570d2 (127.0.107.193) to 6ff3a67a6b814758872d067d3a852116 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "6ff3a67a6b814758872d067d3a852116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:00.197245 10695 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:00.369433 10861 consensus_peers.cc:597] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:00.413794 10824 raft_consensus.cc:1275] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Refusing update from remote peer 6ff3a67a6b814758872d067d3a852116: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:00.414988 10955 consensus_queue.cc:1048] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:00.438546 10861 consensus_peers.cc:597] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:00.458390 10787 consensus_peers.cc:597] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:00.500157 10861 consensus_peers.cc:597] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:00.568207 10787 consensus_peers.cc:597] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:00.636894 10861 consensus_peers.cc:597] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:00.805333 10861 consensus_peers.cc:597] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.198323 10695 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:01.208492 10861 consensus_peers.cc:597] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.209108 10861 consensus_peers.cc:597] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.210461 10787 consensus_peers.cc:597] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.040745 10678 debug-util.cc:398] Leaking SignalData structure 0x7b0800252140 after lost signal to thread 434
W20260709 13:04:02.041838 10678 debug-util.cc:398] Leaking SignalData structure 0x7b0800330e80 after lost signal to thread 10681
W20260709 13:04:02.042956 10678 debug-util.cc:398] Leaking SignalData structure 0x7b0800223ba0 after lost signal to thread 10848
W20260709 13:04:02.043913 10678 debug-util.cc:398] Leaking SignalData structure 0x7b08001ecfa0 after lost signal to thread 10922
W20260709 13:04:02.044370 10678 debug-util.cc:398] Leaking SignalData structure 0x7b08003024a0 after lost signal to thread 10955
W20260709 13:04:02.199532 10695 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:02.983174   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:02.993253 10787 consensus_peers.cc:597] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:02.993795 11037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:02.997748 11038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:03.001935 11040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:03.001579   431 server_base.cc:1061] running on GCE node
I20260709 13:04:03.004110   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:03.004384   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:03.004581   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602243004558 us; error 0 us; skew 500 ppm
I20260709 13:04:03.005144   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:03.008404   431 webserver.cc:533] Webserver started at http://127.0.107.193:41969/ using document root <none> and password file <none>
I20260709 13:04:03.009016   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:03.009230   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:04:03.014554   431 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:04:03.020080 11045 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:03.021098   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:04:03.021503   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-0-root
uuid: "6603ab202ddd40348d5c442a116570d2"
format_stamp: "Formatted at 2026-07-09 13:03:56 on dist-test-slave-zhw8"
I20260709 13:04:03.021911   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601945298557-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:03.038839   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:03.040042   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:03.042057   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:03.047312 11052 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:04:03.109153   431 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:04:03.109579   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.064s	user 0.003s	sys 0.000s
I20260709 13:04:03.109965   431 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
W20260709 13:04:03.116339 10861 consensus_peers.cc:597] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:03.117905 11052 tablet_bootstrap.cc:492] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
I20260709 13:04:03.131493 11052 tablet_bootstrap.cc:492] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.132323 11052 tablet_bootstrap.cc:492] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2: Bootstrap complete.
I20260709 13:04:03.132965 11052 ts_tablet_manager.cc:1403] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:04:03.135210 11052 raft_consensus.cc:359] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.135883 11052 raft_consensus.cc:740] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.136588 11052 consensus_queue.cc:260] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.139353 11052 ts_tablet_manager.cc:1434] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:04:03.140167 11052 tablet_bootstrap.cc:492] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
I20260709 13:04:03.153286 11052 tablet_bootstrap.cc:492] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.154078 11052 tablet_bootstrap.cc:492] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2: Bootstrap complete.
I20260709 13:04:03.154750 11052 ts_tablet_manager.cc:1403] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 13:04:03.157114 11052 raft_consensus.cc:359] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.157809 11052 raft_consensus.cc:740] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.158584 11052 consensus_queue.cc:260] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.160522 11052 ts_tablet_manager.cc:1434] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:04:03.161271 11052 tablet_bootstrap.cc:492] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
I20260709 13:04:03.172518 11052 tablet_bootstrap.cc:492] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.173295 11052 tablet_bootstrap.cc:492] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2: Bootstrap complete.
I20260709 13:04:03.173933 11052 ts_tablet_manager.cc:1403] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:04:03.176426 11052 raft_consensus.cc:359] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.177335 11052 raft_consensus.cc:740] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.178349 11052 consensus_queue.cc:260] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.180572   431 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:04:03.180960 11052 ts_tablet_manager.cc:1434] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:03.181068   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.071s	user 0.072s	sys 0.000s
I20260709 13:04:03.182245 11052 tablet_bootstrap.cc:492] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
I20260709 13:04:03.194667 11052 tablet_bootstrap.cc:492] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.195437 11052 tablet_bootstrap.cc:492] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2: Bootstrap complete.
I20260709 13:04:03.196172 11052 ts_tablet_manager.cc:1403] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.002s
I20260709 13:04:03.198539 11052 raft_consensus.cc:359] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.199267 11052 raft_consensus.cc:740] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.200053 11052 consensus_queue.cc:260] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
W20260709 13:04:03.200764 10695 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:03.202546 11052 ts_tablet_manager.cc:1434] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:03.203586 11052 tablet_bootstrap.cc:492] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
I20260709 13:04:03.222565 11052 tablet_bootstrap.cc:492] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.223920 11052 tablet_bootstrap.cc:492] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2: Bootstrap complete.
I20260709 13:04:03.224987 11052 ts_tablet_manager.cc:1403] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 13:04:03.228567 11052 raft_consensus.cc:359] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.229453 11052 raft_consensus.cc:740] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.230440 11052 consensus_queue.cc:260] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.232828 11052 ts_tablet_manager.cc:1434] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:03.233704 11052 tablet_bootstrap.cc:492] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
W20260709 13:04:03.234862 10861 consensus_peers.cc:597] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:03.251516 11052 tablet_bootstrap.cc:492] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.252660 11052 tablet_bootstrap.cc:492] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2: Bootstrap complete.
I20260709 13:04:03.253355 11052 ts_tablet_manager.cc:1403] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:04:03.256429 11052 raft_consensus.cc:359] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.256958 11052 raft_consensus.cc:740] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.257766 11052 consensus_queue.cc:260] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.260679 11052 ts_tablet_manager.cc:1434] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:03.262085 11052 tablet_bootstrap.cc:492] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
W20260709 13:04:03.263329 10861 consensus_peers.cc:597] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:03.275538 11052 tablet_bootstrap.cc:492] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.276527 11052 tablet_bootstrap.cc:492] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2: Bootstrap complete.
I20260709 13:04:03.277256 11052 ts_tablet_manager.cc:1403] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:04:03.280453 11052 raft_consensus.cc:359] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.281244 11052 raft_consensus.cc:740] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.282115 11052 consensus_queue.cc:260] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.284530 11052 ts_tablet_manager.cc:1434] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 13:04:03.284972 10787 consensus_peers.cc:597] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:03.285568 11052 tablet_bootstrap.cc:492] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
I20260709 13:04:03.288342   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:33037
I20260709 13:04:03.288492 11117 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:33037 every 8 connection(s)
I20260709 13:04:03.304574   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:03.305775 11052 tablet_bootstrap.cc:492] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.306818 11052 tablet_bootstrap.cc:492] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2: Bootstrap complete.
I20260709 13:04:03.307699 11052 ts_tablet_manager.cc:1403] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 13:04:03.311091 11052 raft_consensus.cc:359] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.312218 11052 raft_consensus.cc:385] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.312649 11052 raft_consensus.cc:740] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.313618 11052 consensus_queue.cc:260] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.316361 11052 ts_tablet_manager.cc:1434] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:03.317354 11052 tablet_bootstrap.cc:492] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
I20260709 13:04:03.346956 10898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e"
dest_uuid: "6ff3a67a6b814758872d067d3a852116"
mode: GRACEFUL
new_leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
 from {username='slave'} at 127.0.0.1:41518
I20260709 13:04:03.347826 10898 raft_consensus.cc:606] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Received request to transfer leadership to TS f524ec9f4fca44a4bbf5a5c4b329079a
I20260709 13:04:03.351143 11052 tablet_bootstrap.cc:492] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.352294 11052 tablet_bootstrap.cc:492] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2: Bootstrap complete.
I20260709 13:04:03.352548 10898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b8b72efed2f46e4b7c41a823d941b54"
dest_uuid: "6ff3a67a6b814758872d067d3a852116"
mode: GRACEFUL
new_leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
 from {username='slave'} at 127.0.0.1:41518
I20260709 13:04:03.353171 10898 raft_consensus.cc:606] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Received request to transfer leadership to TS f524ec9f4fca44a4bbf5a5c4b329079a
I20260709 13:04:03.353228 11118 heartbeater.cc:344] Connected to a master server at 127.0.107.254:42039
I20260709 13:04:03.353853 11118 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:03.354882 11118 heartbeater.cc:507] Master 127.0.107.254:42039 requested a full tablet report, sending...
I20260709 13:04:03.355779 10898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dea67ea321734b05a2c1f920d4fd1eab"
dest_uuid: "6ff3a67a6b814758872d067d3a852116"
mode: GRACEFUL
new_leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
 from {username='slave'} at 127.0.0.1:41518
I20260709 13:04:03.356226 10898 raft_consensus.cc:606] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Received request to transfer leadership to TS f524ec9f4fca44a4bbf5a5c4b329079a
I20260709 13:04:03.357403   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:03.358000   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:03.358683   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:03.363207 10643 ts_manager.cc:194] Re-registered known tserver with Master: 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037)
I20260709 13:04:03.353209 11052 ts_tablet_manager.cc:1403] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.036s	user 0.023s	sys 0.011s
I20260709 13:04:03.374059 11052 raft_consensus.cc:359] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.383443 11052 raft_consensus.cc:740] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.384431 11052 consensus_queue.cc:260] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.387043 11052 ts_tablet_manager.cc:1434] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 13:04:03.388115 11052 tablet_bootstrap.cc:492] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2: Bootstrap starting.
I20260709 13:04:03.382915 10643 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34934
I20260709 13:04:03.395342 11118 heartbeater.cc:499] Master 127.0.107.254:42039 was elected leader, sending a full tablet report...
I20260709 13:04:03.428146 11052 tablet_bootstrap.cc:492] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:04:03.429759 11052 tablet_bootstrap.cc:492] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2: Bootstrap complete.
I20260709 13:04:03.430593 11052 ts_tablet_manager.cc:1403] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.004s
I20260709 13:04:03.433004 11052 raft_consensus.cc:359] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.433732 11052 raft_consensus.cc:740] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603ab202ddd40348d5c442a116570d2, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.434438 11052 consensus_queue.cc:260] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.436681 11052 ts_tablet_manager.cc:1434] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:03.529908 11053 raft_consensus.cc:993] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116: : Instructing follower f524ec9f4fca44a4bbf5a5c4b329079a to start an election
I20260709 13:04:03.530546 11036 raft_consensus.cc:1081] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Signalling peer f524ec9f4fca44a4bbf5a5c4b329079a to start an election
I20260709 13:04:03.532359 10822 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e"
dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
 from {username='slave'} at 127.0.0.1:33218
I20260709 13:04:03.533056 10822 raft_consensus.cc:493] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:03.533486 10822 raft_consensus.cc:3060] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.536487 11090 raft_consensus.cc:3060] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.539621 10822 raft_consensus.cc:515] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.541534 10822 leader_election.cc:290] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 2 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:04:03.542719 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ff3a67a6b814758872d067d3a852116"
I20260709 13:04:03.542747 11091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:04:03.543560 10898 raft_consensus.cc:3055] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:03.543646 11091 raft_consensus.cc:3060] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.543989 10898 raft_consensus.cc:740] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:04:03.544883 10898 consensus_queue.cc:260] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.546200 10898 raft_consensus.cc:3060] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.546868 11090 pending_rounds.cc:85] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2: Aborting all ops after (but not including) 0
I20260709 13:04:03.547266 11090 pending_rounds.cc:107] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:04:03.547676 11090 raft_consensus.cc:2889] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:03.551301 11091 raft_consensus.cc:2468] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 2.
I20260709 13:04:03.552700 10787 leader_election.cc:304] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:04:03.553591 10979 raft_consensus.cc:2804] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.553831 10898 raft_consensus.cc:2468] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 2.
I20260709 13:04:03.559041 10979 raft_consensus.cc:697] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Becoming Leader. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Running, Role: LEADER
I20260709 13:04:03.560093 10979 consensus_queue.cc:237] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.568853 10644 catalog_manager.cc:5697] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a reported cstate change: term changed from 1 to 2, leader changed from 6ff3a67a6b814758872d067d3a852116 (127.0.107.195) to f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.571693 11090 raft_consensus.cc:3060] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.595870 11053 raft_consensus.cc:993] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116: : Instructing follower f524ec9f4fca44a4bbf5a5c4b329079a to start an election
I20260709 13:04:03.596395 11036 raft_consensus.cc:1081] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Signalling peer f524ec9f4fca44a4bbf5a5c4b329079a to start an election
I20260709 13:04:03.597959 10822 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b8b72efed2f46e4b7c41a823d941b54"
dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
 from {username='slave'} at 127.0.0.1:33218
I20260709 13:04:03.598606 10822 raft_consensus.cc:493] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:03.598950 10822 raft_consensus.cc:3060] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.604564 10822 raft_consensus.cc:515] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.606561 10822 leader_election.cc:290] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 2 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:04:03.607837 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8b72efed2f46e4b7c41a823d941b54" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ff3a67a6b814758872d067d3a852116"
I20260709 13:04:03.607790 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8b72efed2f46e4b7c41a823d941b54" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:04:03.608671 10898 raft_consensus.cc:3055] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:03.608824 11090 raft_consensus.cc:3060] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.609127 10898 raft_consensus.cc:740] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:04:03.610036 10898 consensus_queue.cc:260] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.611413 10898 raft_consensus.cc:3060] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.616346 10898 raft_consensus.cc:2468] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 2.
I20260709 13:04:03.617236 11090 raft_consensus.cc:2468] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 2.
I20260709 13:04:03.617437 10787 leader_election.cc:304] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:04:03.618319 10979 raft_consensus.cc:2804] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.618794 10979 raft_consensus.cc:697] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Becoming Leader. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Running, Role: LEADER
I20260709 13:04:03.619617 10979 consensus_queue.cc:237] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.629072 10644 catalog_manager.cc:5697] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a reported cstate change: term changed from 1 to 2, leader changed from 6ff3a67a6b814758872d067d3a852116 (127.0.107.195) to f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.874022 11053 raft_consensus.cc:993] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116: : Instructing follower f524ec9f4fca44a4bbf5a5c4b329079a to start an election
I20260709 13:04:03.874504 11036 raft_consensus.cc:1081] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Signalling peer f524ec9f4fca44a4bbf5a5c4b329079a to start an election
I20260709 13:04:03.876027 10822 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dea67ea321734b05a2c1f920d4fd1eab"
dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
 from {username='slave'} at 127.0.0.1:33218
I20260709 13:04:03.876682 10822 raft_consensus.cc:493] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:03.877014 10822 raft_consensus.cc:3060] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.882965 10822 raft_consensus.cc:515] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.884910 10822 leader_election.cc:290] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 2 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:04:03.885402 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea67ea321734b05a2c1f920d4fd1eab" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:04:03.885787 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea67ea321734b05a2c1f920d4fd1eab" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ff3a67a6b814758872d067d3a852116"
I20260709 13:04:03.886119 11090 raft_consensus.cc:3060] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.886371 10898 raft_consensus.cc:3055] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:03.886747 10898 raft_consensus.cc:740] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:04:03.887470 10898 consensus_queue.cc:260] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.888299 10898 raft_consensus.cc:3060] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.893522 10898 raft_consensus.cc:2468] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 2.
I20260709 13:04:03.894604 10787 leader_election.cc:304] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:04:03.895012 11090 raft_consensus.cc:2468] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 2.
I20260709 13:04:03.895313 11136 raft_consensus.cc:2804] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.895927 11136 raft_consensus.cc:697] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Becoming Leader. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Running, Role: LEADER
I20260709 13:04:03.896728 11136 consensus_queue.cc:237] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:03.904335 10644 catalog_manager.cc:5697] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a reported cstate change: term changed from 1 to 2, leader changed from 6ff3a67a6b814758872d067d3a852116 (127.0.107.195) to f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.987826 11090 raft_consensus.cc:1275] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Refusing update from remote peer f524ec9f4fca44a4bbf5a5c4b329079a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.989277 11136 consensus_queue.cc:1048] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.998090 10898 raft_consensus.cc:1275] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Refusing update from remote peer f524ec9f4fca44a4bbf5a5c4b329079a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.000411 10979 consensus_queue.cc:1048] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:04.052978 11090 raft_consensus.cc:1275] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Refusing update from remote peer f524ec9f4fca44a4bbf5a5c4b329079a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.054556 11146 consensus_queue.cc:1048] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:04.073114 10898 raft_consensus.cc:1275] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Refusing update from remote peer f524ec9f4fca44a4bbf5a5c4b329079a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.074581 11146 consensus_queue.cc:1048] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:04.202790 10695 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:04.332669 10898 raft_consensus.cc:1275] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Refusing update from remote peer f524ec9f4fca44a4bbf5a5c4b329079a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.334276 11146 consensus_queue.cc:1048] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:04.347695 11090 raft_consensus.cc:1275] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Refusing update from remote peer f524ec9f4fca44a4bbf5a5c4b329079a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.349581 11136 consensus_queue.cc:1048] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:04.372439   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:04.395092 10822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e"
dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
mode: GRACEFUL
new_leader_uuid: "6ff3a67a6b814758872d067d3a852116"
 from {username='slave'} at 127.0.0.1:37150
I20260709 13:04:04.397594 10822 raft_consensus.cc:606] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Received request to transfer leadership to TS 6ff3a67a6b814758872d067d3a852116
I20260709 13:04:04.401729 10822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "def0dda674d640a7bf9832c41e6411e8"
dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
mode: GRACEFUL
new_leader_uuid: "6ff3a67a6b814758872d067d3a852116"
 from {username='slave'} at 127.0.0.1:37150
I20260709 13:04:04.402402 10822 raft_consensus.cc:606] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 LEADER]: Received request to transfer leadership to TS 6ff3a67a6b814758872d067d3a852116
I20260709 13:04:04.404089   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:04.404798   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:04.405859   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:04.521685 11146 raft_consensus.cc:993] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a: : Instructing follower 6ff3a67a6b814758872d067d3a852116 to start an election
I20260709 13:04:04.522280 11136 raft_consensus.cc:1081] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 LEADER]: Signalling peer 6ff3a67a6b814758872d067d3a852116 to start an election
I20260709 13:04:04.524189 10898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "def0dda674d640a7bf9832c41e6411e8"
dest_uuid: "6ff3a67a6b814758872d067d3a852116"
 from {username='slave'} at 127.0.0.1:55920
I20260709 13:04:04.524931 10898 raft_consensus.cc:493] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:04.525349 10898 raft_consensus.cc:3060] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.537858 10898 raft_consensus.cc:515] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:04.540267 10898 leader_election.cc:290] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 2 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:04:04.540984 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def0dda674d640a7bf9832c41e6411e8" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:04:04.541467 10822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def0dda674d640a7bf9832c41e6411e8" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
I20260709 13:04:04.541839 11090 raft_consensus.cc:3060] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.542106 10822 raft_consensus.cc:3055] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:04.542450 10822 raft_consensus.cc:740] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Running, Role: LEADER
I20260709 13:04:04.543525 10822 consensus_queue.cc:260] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:04.546262 10822 raft_consensus.cc:3060] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.553926 11090 raft_consensus.cc:2468] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 2.
I20260709 13:04:04.555446 10861 leader_election.cc:304] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, 6ff3a67a6b814758872d067d3a852116; no voters: 
I20260709 13:04:04.556454 11036 raft_consensus.cc:2804] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:04.556985 11036 raft_consensus.cc:697] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [term 2 LEADER]: Becoming Leader. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:04:04.558189 11036 consensus_queue.cc:237] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:04.561691 10822 raft_consensus.cc:2468] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 2.
I20260709 13:04:04.567317 10979 raft_consensus.cc:993] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a: : Instructing follower 6ff3a67a6b814758872d067d3a852116 to start an election
I20260709 13:04:04.567797 10979 raft_consensus.cc:1081] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Signalling peer 6ff3a67a6b814758872d067d3a852116 to start an election
I20260709 13:04:04.571077 10898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e"
dest_uuid: "6ff3a67a6b814758872d067d3a852116"
 from {username='slave'} at 127.0.0.1:55920
I20260709 13:04:04.571759 10898 raft_consensus.cc:493] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:04.572139 10898 raft_consensus.cc:3060] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:04.573207 10644 catalog_manager.cc:5697] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 reported cstate change: term changed from 1 to 2, leader changed from f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194) to 6ff3a67a6b814758872d067d3a852116 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "6ff3a67a6b814758872d067d3a852116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:04.582787 10898 raft_consensus.cc:515] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:04.585114 10898 leader_election.cc:290] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 3 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:04:04.585978 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:04:04.586834 11090 raft_consensus.cc:3060] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:04.586942 10822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
I20260709 13:04:04.587785 10822 raft_consensus.cc:3055] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:04.588166 10822 raft_consensus.cc:740] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Running, Role: LEADER
I20260709 13:04:04.589322 10822 consensus_queue.cc:260] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:04.591444 10822 raft_consensus.cc:3060] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:04.596760 11090 raft_consensus.cc:2468] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 3.
I20260709 13:04:04.598266 10861 leader_election.cc:304] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, 6ff3a67a6b814758872d067d3a852116; no voters: 
I20260709 13:04:04.599257 11036 raft_consensus.cc:2804] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:04.599786 11036 raft_consensus.cc:697] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 3 LEADER]: Becoming Leader. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:04:04.600917 11036 consensus_queue.cc:237] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:04.608434 10822 raft_consensus.cc:2468] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 3.
I20260709 13:04:04.610350 10644 catalog_manager.cc:5697] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 reported cstate change: term changed from 2 to 3, leader changed from f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194) to 6ff3a67a6b814758872d067d3a852116 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "6ff3a67a6b814758872d067d3a852116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:04.957765 11090 raft_consensus.cc:1275] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Refusing update from remote peer 6ff3a67a6b814758872d067d3a852116: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.959312 11036 consensus_queue.cc:1048] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:04.990408 10822 raft_consensus.cc:1275] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Refusing update from remote peer 6ff3a67a6b814758872d067d3a852116: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.994395 11036 consensus_queue.cc:1048] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:05.124543 11090 raft_consensus.cc:1275] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 3 FOLLOWER]: Refusing update from remote peer 6ff3a67a6b814758872d067d3a852116: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:05.125883 11036 consensus_queue.cc:1048] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:05.137946 10822 raft_consensus.cc:1275] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 3 FOLLOWER]: Refusing update from remote peer 6ff3a67a6b814758872d067d3a852116: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:05.140825 11169 consensus_queue.cc:1048] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:04:05.204442 10695 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:05.414322   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:05.421805 10898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e"
dest_uuid: "6ff3a67a6b814758872d067d3a852116"
mode: GRACEFUL
new_leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
 from {username='slave'} at 127.0.0.1:41518
I20260709 13:04:05.422403 10898 raft_consensus.cc:606] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 3 LEADER]: Received request to transfer leadership to TS f524ec9f4fca44a4bbf5a5c4b329079a
I20260709 13:04:05.425266 10822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "640b1bca020c48d2b5c418402f198ff1"
dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
mode: GRACEFUL
new_leader_uuid: "6ff3a67a6b814758872d067d3a852116"
 from {username='slave'} at 127.0.0.1:37150
I20260709 13:04:05.425849 10822 raft_consensus.cc:606] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 LEADER]: Received request to transfer leadership to TS 6ff3a67a6b814758872d067d3a852116
I20260709 13:04:05.428326 10898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0f5e456fbfd4fce8e37636881dce2b5"
dest_uuid: "6ff3a67a6b814758872d067d3a852116"
mode: GRACEFUL
new_leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
 from {username='slave'} at 127.0.0.1:41518
I20260709 13:04:05.428799 10898 raft_consensus.cc:606] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Received request to transfer leadership to TS f524ec9f4fca44a4bbf5a5c4b329079a
I20260709 13:04:05.430131   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:05.430632   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:05.431190   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:05.532282 11169 raft_consensus.cc:993] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116: : Instructing follower f524ec9f4fca44a4bbf5a5c4b329079a to start an election
I20260709 13:04:05.532784 11149 raft_consensus.cc:1081] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 3 LEADER]: Signalling peer f524ec9f4fca44a4bbf5a5c4b329079a to start an election
I20260709 13:04:05.534408 10822 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e"
dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
 from {username='slave'} at 127.0.0.1:33218
I20260709 13:04:05.534969 10822 raft_consensus.cc:493] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:05.535356 10822 raft_consensus.cc:3060] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:05.541631 10822 raft_consensus.cc:515] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:05.543322 10822 leader_election.cc:290] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 4 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:04:05.544294 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6ff3a67a6b814758872d067d3a852116"
I20260709 13:04:05.544293 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:04:05.545054 10898 raft_consensus.cc:3055] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:05.545073 11090 raft_consensus.cc:3060] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:05.545375 10898 raft_consensus.cc:740] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:04:05.546132 10898 consensus_queue.cc:260] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:05.547080 10898 raft_consensus.cc:3060] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:05.550689 11090 raft_consensus.cc:2468] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 4.
I20260709 13:04:05.552121 10787 leader_election.cc:304] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:04:05.552568 10898 raft_consensus.cc:2468] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 4.
I20260709 13:04:05.552883 11136 raft_consensus.cc:2804] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:05.554630 11136 raft_consensus.cc:697] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 4 LEADER]: Becoming Leader. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Running, Role: LEADER
I20260709 13:04:05.555434 11136 consensus_queue.cc:237] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:05.563094 10645 catalog_manager.cc:5697] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a reported cstate change: term changed from 3 to 4, leader changed from 6ff3a67a6b814758872d067d3a852116 (127.0.107.195) to f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194). New cstate: current_term: 4 leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.788412 11171 raft_consensus.cc:993] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a: : Instructing follower 6ff3a67a6b814758872d067d3a852116 to start an election
I20260709 13:04:05.788977 11136 raft_consensus.cc:1081] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 LEADER]: Signalling peer 6ff3a67a6b814758872d067d3a852116 to start an election
I20260709 13:04:05.790352 10898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "640b1bca020c48d2b5c418402f198ff1"
dest_uuid: "6ff3a67a6b814758872d067d3a852116"
 from {username='slave'} at 127.0.0.1:55920
I20260709 13:04:05.790891 10898 raft_consensus.cc:493] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:05.791215 10898 raft_consensus.cc:3060] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:05.796186 10898 raft_consensus.cc:515] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:05.797533 10898 leader_election.cc:290] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 2 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:04:05.798643 10822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640b1bca020c48d2b5c418402f198ff1" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
I20260709 13:04:05.798524 11089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640b1bca020c48d2b5c418402f198ff1" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:04:05.799376 10822 raft_consensus.cc:3055] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:05.799510 11089 raft_consensus.cc:3060] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:05.799664 10822 raft_consensus.cc:740] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Running, Role: LEADER
I20260709 13:04:05.800555 10822 consensus_queue.cc:260] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:05.801481 10822 raft_consensus.cc:3060] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:05.805840 11089 raft_consensus.cc:2468] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 2.
I20260709 13:04:05.806489 10822 raft_consensus.cc:2468] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 2.
I20260709 13:04:05.807054 10861 leader_election.cc:304] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, 6ff3a67a6b814758872d067d3a852116; no voters: 
I20260709 13:04:05.807880 11149 raft_consensus.cc:2804] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:05.808349 11149 raft_consensus.cc:697] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 2 LEADER]: Becoming Leader. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:04:05.809233 11149 consensus_queue.cc:237] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:05.816673 10645 catalog_manager.cc:5697] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 reported cstate change: term changed from 1 to 2, leader changed from f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194) to 6ff3a67a6b814758872d067d3a852116 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "6ff3a67a6b814758872d067d3a852116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.917996 11169 raft_consensus.cc:993] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116: : Instructing follower f524ec9f4fca44a4bbf5a5c4b329079a to start an election
I20260709 13:04:05.918484 11149 raft_consensus.cc:1081] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Signalling peer f524ec9f4fca44a4bbf5a5c4b329079a to start an election
I20260709 13:04:05.919948 10822 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0f5e456fbfd4fce8e37636881dce2b5"
dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
 from {username='slave'} at 127.0.0.1:33218
I20260709 13:04:05.920452 10822 raft_consensus.cc:493] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:05.920753 10822 raft_consensus.cc:3060] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:05.925663 10822 raft_consensus.cc:515] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:05.927373 10822 leader_election.cc:290] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 2 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:04:05.928293 11089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f5e456fbfd4fce8e37636881dce2b5" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:04:05.928467 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f5e456fbfd4fce8e37636881dce2b5" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ff3a67a6b814758872d067d3a852116"
I20260709 13:04:05.929072 11089 raft_consensus.cc:3060] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:05.929105 10898 raft_consensus.cc:3055] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:05.929594 10898 raft_consensus.cc:740] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:04:05.930655 10898 consensus_queue.cc:260] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:05.932112 10898 raft_consensus.cc:3060] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:05.937121 11089 raft_consensus.cc:2468] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 2.
I20260709 13:04:05.938565 10787 leader_election.cc:304] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:04:05.939252 11136 raft_consensus.cc:2804] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:05.939467 10898 raft_consensus.cc:2468] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 2.
I20260709 13:04:05.939740 11136 raft_consensus.cc:697] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Becoming Leader. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Running, Role: LEADER
I20260709 13:04:05.940915 11136 consensus_queue.cc:237] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:05.944175 10898 raft_consensus.cc:1275] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 4 FOLLOWER]: Refusing update from remote peer f524ec9f4fca44a4bbf5a5c4b329079a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:05.946120 11171 consensus_queue.cc:1048] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:05.949488 10645 catalog_manager.cc:5697] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a reported cstate change: term changed from 1 to 2, leader changed from 6ff3a67a6b814758872d067d3a852116 (127.0.107.195) to f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.955716 11089 raft_consensus.cc:1275] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 4 FOLLOWER]: Refusing update from remote peer f524ec9f4fca44a4bbf5a5c4b329079a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:05.957038 11136 consensus_queue.cc:1048] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:04:06.205550 10695 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:06.269569 10822 raft_consensus.cc:1275] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Refusing update from remote peer 6ff3a67a6b814758872d067d3a852116: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:06.270830 11149 consensus_queue.cc:1048] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:06.279796 11089 raft_consensus.cc:1275] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Refusing update from remote peer 6ff3a67a6b814758872d067d3a852116: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:06.281402 11183 consensus_queue.cc:1048] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:06.412835 11089 raft_consensus.cc:1275] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Refusing update from remote peer f524ec9f4fca44a4bbf5a5c4b329079a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:06.414176 11136 consensus_queue.cc:1048] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:06.425745 10898 raft_consensus.cc:1275] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Refusing update from remote peer f524ec9f4fca44a4bbf5a5c4b329079a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:06.427291 11172 consensus_queue.cc:1048] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:06.437297   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:06.446072 10898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01b2d44c8aa74629b6f07f2a05b1255f"
dest_uuid: "6ff3a67a6b814758872d067d3a852116"
mode: GRACEFUL
new_leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
 from {username='slave'} at 127.0.0.1:41518
I20260709 13:04:06.446628 10898 raft_consensus.cc:606] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Received request to transfer leadership to TS f524ec9f4fca44a4bbf5a5c4b329079a
I20260709 13:04:06.449047 10822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d89a7a13b88149bd87ba85a0f44c174d"
dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
mode: GRACEFUL
new_leader_uuid: "6ff3a67a6b814758872d067d3a852116"
 from {username='slave'} at 127.0.0.1:37150
I20260709 13:04:06.449507 10822 raft_consensus.cc:606] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 LEADER]: Received request to transfer leadership to TS 6ff3a67a6b814758872d067d3a852116
I20260709 13:04:06.452220 10822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dea67ea321734b05a2c1f920d4fd1eab"
dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
mode: GRACEFUL
new_leader_uuid: "6ff3a67a6b814758872d067d3a852116"
 from {username='slave'} at 127.0.0.1:37150
I20260709 13:04:06.452656 10822 raft_consensus.cc:606] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Received request to transfer leadership to TS 6ff3a67a6b814758872d067d3a852116
I20260709 13:04:06.453660   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:06.454145   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:06.454720   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:06.515439 11171 raft_consensus.cc:993] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a: : Instructing follower 6ff3a67a6b814758872d067d3a852116 to start an election
I20260709 13:04:06.516003 11172 raft_consensus.cc:1081] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 LEADER]: Signalling peer 6ff3a67a6b814758872d067d3a852116 to start an election
I20260709 13:04:06.517427 10898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d89a7a13b88149bd87ba85a0f44c174d"
dest_uuid: "6ff3a67a6b814758872d067d3a852116"
 from {username='slave'} at 127.0.0.1:55920
I20260709 13:04:06.517907 10898 raft_consensus.cc:493] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:06.518139 10898 raft_consensus.cc:3060] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:06.522799 10898 raft_consensus.cc:515] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:06.524459 10898 leader_election.cc:290] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 2 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:04:06.525234 11089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89a7a13b88149bd87ba85a0f44c174d" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:04:06.525375 10822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89a7a13b88149bd87ba85a0f44c174d" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
I20260709 13:04:06.525960 11089 raft_consensus.cc:3060] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:06.526026 10822 raft_consensus.cc:3055] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:06.526419 10822 raft_consensus.cc:740] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Running, Role: LEADER
I20260709 13:04:06.527153 10822 consensus_queue.cc:260] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:06.528170 10822 raft_consensus.cc:3060] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:06.531797 11089 raft_consensus.cc:2468] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 2.
I20260709 13:04:06.532919 10861 leader_election.cc:304] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, 6ff3a67a6b814758872d067d3a852116; no voters: 
I20260709 13:04:06.533087 10822 raft_consensus.cc:2468] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 2.
I20260709 13:04:06.533933 11169 raft_consensus.cc:2804] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:06.534433 11169 raft_consensus.cc:697] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [term 2 LEADER]: Becoming Leader. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:04:06.535271 11169 consensus_queue.cc:237] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:06.541846 10644 catalog_manager.cc:5697] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 reported cstate change: term changed from 1 to 2, leader changed from f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194) to 6ff3a67a6b814758872d067d3a852116 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "6ff3a67a6b814758872d067d3a852116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.590556 11171 raft_consensus.cc:993] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a: : Instructing follower 6ff3a67a6b814758872d067d3a852116 to start an election
I20260709 13:04:06.591058 11172 raft_consensus.cc:1081] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Signalling peer 6ff3a67a6b814758872d067d3a852116 to start an election
I20260709 13:04:06.592476 10898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dea67ea321734b05a2c1f920d4fd1eab"
dest_uuid: "6ff3a67a6b814758872d067d3a852116"
 from {username='slave'} at 127.0.0.1:55920
I20260709 13:04:06.593003 10898 raft_consensus.cc:493] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:06.593233 10898 raft_consensus.cc:3060] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:06.598189 10898 raft_consensus.cc:515] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:06.599618 10898 leader_election.cc:290] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 3 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:04:06.600384 11089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea67ea321734b05a2c1f920d4fd1eab" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:04:06.600517 10822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea67ea321734b05a2c1f920d4fd1eab" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
I20260709 13:04:06.601123 11089 raft_consensus.cc:3060] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:06.601190 10822 raft_consensus.cc:3055] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:06.601711 10822 raft_consensus.cc:740] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Running, Role: LEADER
I20260709 13:04:06.602487 10822 consensus_queue.cc:260] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:06.603710 10822 raft_consensus.cc:3060] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:06.604156 11169 raft_consensus.cc:993] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116: : Instructing follower f524ec9f4fca44a4bbf5a5c4b329079a to start an election
I20260709 13:04:06.604671 11149 raft_consensus.cc:1081] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Signalling peer f524ec9f4fca44a4bbf5a5c4b329079a to start an election
I20260709 13:04:06.606451 10824 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01b2d44c8aa74629b6f07f2a05b1255f"
dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
 from {username='slave'} at 127.0.0.1:33218
I20260709 13:04:06.606980 10824 raft_consensus.cc:493] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:06.607369 10824 raft_consensus.cc:3060] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:06.607708 11089 raft_consensus.cc:2468] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 3.
I20260709 13:04:06.608778 10861 leader_election.cc:304] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, 6ff3a67a6b814758872d067d3a852116; no voters: 
I20260709 13:04:06.609360 11149 raft_consensus.cc:2804] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:06.609824 11149 raft_consensus.cc:697] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 3 LEADER]: Becoming Leader. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:04:06.610795 11149 consensus_queue.cc:237] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:06.614321 10822 raft_consensus.cc:2468] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 3.
I20260709 13:04:06.615916 10824 raft_consensus.cc:515] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:06.617836 10824 leader_election.cc:290] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 2 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:04:06.618453 11089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b2d44c8aa74629b6f07f2a05b1255f" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:04:06.618721 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b2d44c8aa74629b6f07f2a05b1255f" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ff3a67a6b814758872d067d3a852116"
I20260709 13:04:06.619302 11089 raft_consensus.cc:3060] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:06.619318 10898 raft_consensus.cc:3055] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:06.618796 10644 catalog_manager.cc:5697] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 reported cstate change: term changed from 2 to 3, leader changed from f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194) to 6ff3a67a6b814758872d067d3a852116 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "6ff3a67a6b814758872d067d3a852116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.619994 10898 raft_consensus.cc:740] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:04:06.620831 10898 consensus_queue.cc:260] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:06.622021 10898 raft_consensus.cc:3060] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:06.626525 11089 raft_consensus.cc:2468] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 2.
I20260709 13:04:06.627686 10787 leader_election.cc:304] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:04:06.628393 11172 raft_consensus.cc:2804] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:06.628860 11172 raft_consensus.cc:697] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Becoming Leader. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Running, Role: LEADER
I20260709 13:04:06.629072 10898 raft_consensus.cc:2468] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 2.
I20260709 13:04:06.629796 11172 consensus_queue.cc:237] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:06.636844 10644 catalog_manager.cc:5697] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a reported cstate change: term changed from 1 to 2, leader changed from 6ff3a67a6b814758872d067d3a852116 (127.0.107.195) to f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.923269 11089 raft_consensus.cc:1275] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Refusing update from remote peer 6ff3a67a6b814758872d067d3a852116: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:06.926543 11183 consensus_queue.cc:1048] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:06.939774 10824 raft_consensus.cc:1275] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Refusing update from remote peer 6ff3a67a6b814758872d067d3a852116: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:06.941216 11149 consensus_queue.cc:1048] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:07.034204 11089 raft_consensus.cc:1275] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [term 3 FOLLOWER]: Refusing update from remote peer 6ff3a67a6b814758872d067d3a852116: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:07.034924 10824 raft_consensus.cc:1275] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 3 FOLLOWER]: Refusing update from remote peer 6ff3a67a6b814758872d067d3a852116: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:07.035511 11183 consensus_queue.cc:1048] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:07.036437 11149 consensus_queue.cc:1048] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:07.045250 11089 raft_consensus.cc:1275] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Refusing update from remote peer f524ec9f4fca44a4bbf5a5c4b329079a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:07.047942 11193 consensus_queue.cc:1048] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:07.063433 10898 raft_consensus.cc:1275] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Refusing update from remote peer f524ec9f4fca44a4bbf5a5c4b329079a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:07.064790 11172 consensus_queue.cc:1048] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:07.206575 10695 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:07.461515   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:07.468622 10824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e"
dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
mode: GRACEFUL
new_leader_uuid: "6ff3a67a6b814758872d067d3a852116"
 from {username='slave'} at 127.0.0.1:37150
I20260709 13:04:07.469165 10824 raft_consensus.cc:606] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 4 LEADER]: Received request to transfer leadership to TS 6ff3a67a6b814758872d067d3a852116
I20260709 13:04:07.471612 10898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "640b1bca020c48d2b5c418402f198ff1"
dest_uuid: "6ff3a67a6b814758872d067d3a852116"
mode: GRACEFUL
new_leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
 from {username='slave'} at 127.0.0.1:41518
I20260709 13:04:07.472033 10898 raft_consensus.cc:606] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 2 LEADER]: Received request to transfer leadership to TS f524ec9f4fca44a4bbf5a5c4b329079a
I20260709 13:04:07.474269 10898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5db8e3237574f9a8836e5e9a88ba2c4"
dest_uuid: "6ff3a67a6b814758872d067d3a852116"
mode: GRACEFUL
new_leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
 from {username='slave'} at 127.0.0.1:41518
I20260709 13:04:07.474681 10898 raft_consensus.cc:606] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Received request to transfer leadership to TS f524ec9f4fca44a4bbf5a5c4b329079a
I20260709 13:04:07.475759   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:07.476293   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:07.476879   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:07.484565 11171 raft_consensus.cc:993] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a: : Instructing follower 6ff3a67a6b814758872d067d3a852116 to start an election
I20260709 13:04:07.485122 11171 raft_consensus.cc:1081] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 4 LEADER]: Signalling peer 6ff3a67a6b814758872d067d3a852116 to start an election
I20260709 13:04:07.486590 10898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e"
dest_uuid: "6ff3a67a6b814758872d067d3a852116"
 from {username='slave'} at 127.0.0.1:55920
I20260709 13:04:07.487449 10898 raft_consensus.cc:493] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:07.487776 10898 raft_consensus.cc:3060] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.488032 11183 raft_consensus.cc:993] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116: : Instructing follower f524ec9f4fca44a4bbf5a5c4b329079a to start an election
I20260709 13:04:07.488562 11169 raft_consensus.cc:1081] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Signalling peer f524ec9f4fca44a4bbf5a5c4b329079a to start an election
I20260709 13:04:07.490141 10824 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5db8e3237574f9a8836e5e9a88ba2c4"
dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
 from {username='slave'} at 127.0.0.1:33218
I20260709 13:04:07.490662 10824 raft_consensus.cc:493] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:07.491009 10824 raft_consensus.cc:3060] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.494755 10898 raft_consensus.cc:515] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:07.496922 10898 leader_election.cc:290] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 5 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591)
I20260709 13:04:07.497750 11089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:04:07.498063 10822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a94d0fa583e4778b899a7c62324e39e" candidate_uuid: "6ff3a67a6b814758872d067d3a852116" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
I20260709 13:04:07.498412 11089 raft_consensus.cc:3060] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.498698 10822 raft_consensus.cc:3055] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:07.499179 10822 raft_consensus.cc:740] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Running, Role: LEADER
I20260709 13:04:07.498795 10824 raft_consensus.cc:515] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:07.500015 10822 consensus_queue.cc:260] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:07.501144 10824 leader_election.cc:290] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 2 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:04:07.501291 10822 raft_consensus.cc:3060] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.501852 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5db8e3237574f9a8836e5e9a88ba2c4" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:04:07.502501 11090 raft_consensus.cc:3060] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.505336 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5db8e3237574f9a8836e5e9a88ba2c4" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ff3a67a6b814758872d067d3a852116"
I20260709 13:04:07.505998 10898 raft_consensus.cc:3055] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:07.506374 10898 raft_consensus.cc:740] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:04:07.507817 11089 raft_consensus.cc:2468] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 5.
I20260709 13:04:07.507321 10898 consensus_queue.cc:260] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:07.508145 10822 raft_consensus.cc:2468] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff3a67a6b814758872d067d3a852116 in term 5.
I20260709 13:04:07.509407 10898 raft_consensus.cc:3060] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.509584 10861 leader_election.cc:304] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff3a67a6b814758872d067d3a852116, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:04:07.510850 11169 raft_consensus.cc:2804] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:07.511379 11090 raft_consensus.cc:2468] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 2.
I20260709 13:04:07.511456 11169 raft_consensus.cc:697] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 5 LEADER]: Becoming Leader. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:04:07.512828 10787 leader_election.cc:304] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:04:07.513044 11169 consensus_queue.cc:237] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:07.513526 11193 raft_consensus.cc:2804] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:07.514035 11193 raft_consensus.cc:697] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Becoming Leader. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Running, Role: LEADER
I20260709 13:04:07.514969 11193 consensus_queue.cc:237] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:07.517632 10898 raft_consensus.cc:2468] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 2.
I20260709 13:04:07.524327 10644 catalog_manager.cc:5697] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 reported cstate change: term changed from 4 to 5, leader changed from f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194) to 6ff3a67a6b814758872d067d3a852116 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "6ff3a67a6b814758872d067d3a852116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.525985 10643 catalog_manager.cc:5697] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a reported cstate change: term changed from 1 to 2, leader changed from 6ff3a67a6b814758872d067d3a852116 (127.0.107.195) to f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.931252 11183 raft_consensus.cc:993] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116: : Instructing follower f524ec9f4fca44a4bbf5a5c4b329079a to start an election
I20260709 13:04:07.931813 11169 raft_consensus.cc:1081] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 2 LEADER]: Signalling peer f524ec9f4fca44a4bbf5a5c4b329079a to start an election
I20260709 13:04:07.933565 10822 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "640b1bca020c48d2b5c418402f198ff1"
dest_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a"
 from {username='slave'} at 127.0.0.1:33218
I20260709 13:04:07.934017 10822 raft_consensus.cc:493] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:07.934274 10822 raft_consensus.cc:3060] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:07.938956 10822 raft_consensus.cc:515] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:07.940689 10822 leader_election.cc:290] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 3 election: Requested vote from peers 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037), 6ff3a67a6b814758872d067d3a852116 (127.0.107.195:46551)
I20260709 13:04:07.941315 11089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640b1bca020c48d2b5c418402f198ff1" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6603ab202ddd40348d5c442a116570d2"
I20260709 13:04:07.941622 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640b1bca020c48d2b5c418402f198ff1" candidate_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ff3a67a6b814758872d067d3a852116"
I20260709 13:04:07.941949 11089 raft_consensus.cc:3060] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:07.942203 10898 raft_consensus.cc:3055] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:07.942541 10898 raft_consensus.cc:740] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ff3a67a6b814758872d067d3a852116, State: Running, Role: LEADER
I20260709 13:04:07.943171 10898 consensus_queue.cc:260] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:07.944162 10898 raft_consensus.cc:3060] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:07.947090 11089 raft_consensus.cc:2468] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 3.
I20260709 13:04:07.948230 10787 leader_election.cc:304] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6603ab202ddd40348d5c442a116570d2, f524ec9f4fca44a4bbf5a5c4b329079a; no voters: 
I20260709 13:04:07.948510 10898 raft_consensus.cc:2468] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f524ec9f4fca44a4bbf5a5c4b329079a in term 3.
I20260709 13:04:07.948896 11172 raft_consensus.cc:2804] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:07.949393 11172 raft_consensus.cc:697] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 3 LEADER]: Becoming Leader. State: Replica: f524ec9f4fca44a4bbf5a5c4b329079a, State: Running, Role: LEADER
I20260709 13:04:07.950160 11172 consensus_queue.cc:237] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } }
I20260709 13:04:07.956621 10643 catalog_manager.cc:5697] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a reported cstate change: term changed from 2 to 3, leader changed from 6ff3a67a6b814758872d067d3a852116 (127.0.107.195) to f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.978605 11089 raft_consensus.cc:1275] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 5 FOLLOWER]: Refusing update from remote peer 6ff3a67a6b814758872d067d3a852116: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:07.979905 11169 consensus_queue.cc:1048] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:07.987634 11089 raft_consensus.cc:1275] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Refusing update from remote peer f524ec9f4fca44a4bbf5a5c4b329079a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:07.989269 11172 consensus_queue.cc:1048] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:07.992350 10822 raft_consensus.cc:1275] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 5 FOLLOWER]: Refusing update from remote peer 6ff3a67a6b814758872d067d3a852116: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:07.994709 11183 consensus_queue.cc:1048] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f524ec9f4fca44a4bbf5a5c4b329079a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:08.006985 10898 raft_consensus.cc:1275] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Refusing update from remote peer f524ec9f4fca44a4bbf5a5c4b329079a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:08.009362 11171 consensus_queue.cc:1048] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:08.207629 10695 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:08.337160 11090 raft_consensus.cc:1275] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 3 FOLLOWER]: Refusing update from remote peer f524ec9f4fca44a4bbf5a5c4b329079a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:08.338660 11221 consensus_queue.cc:1048] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6603ab202ddd40348d5c442a116570d2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:08.347525 10898 raft_consensus.cc:1275] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 3 FOLLOWER]: Refusing update from remote peer f524ec9f4fca44a4bbf5a5c4b329079a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:08.349148 11171 consensus_queue.cc:1048] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff3a67a6b814758872d067d3a852116" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:08.485623   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:08.516985   431 tablet_server.cc:179] TabletServer@127.0.107.193:33037 shutting down...
I20260709 13:04:08.550524   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:08.551451   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:08.552364   431 raft_consensus.cc:2243] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.552908   431 raft_consensus.cc:2272] T dea67ea321734b05a2c1f920d4fd1eab P 6603ab202ddd40348d5c442a116570d2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.555310   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:08.556027   431 raft_consensus.cc:2243] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.556555   431 raft_consensus.cc:2272] T 7b8b72efed2f46e4b7c41a823d941b54 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.558987   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:08.559655   431 raft_consensus.cc:2243] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.560178   431 raft_consensus.cc:2272] T d5f3e403122e4cdfa4c423d00d4c1577 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.562582   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:08.563208   431 raft_consensus.cc:2243] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.563735   431 raft_consensus.cc:2272] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.566358   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:08.566968   431 raft_consensus.cc:2243] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.567520   431 raft_consensus.cc:2272] T 2a94d0fa583e4778b899a7c62324e39e P 6603ab202ddd40348d5c442a116570d2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.571305   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:08.572299   431 raft_consensus.cc:2243] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.572881   431 raft_consensus.cc:2272] T e0f5e456fbfd4fce8e37636881dce2b5 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.576013   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:08.576808   431 raft_consensus.cc:2243] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.577380   431 raft_consensus.cc:2272] T 640b1bca020c48d2b5c418402f198ff1 P 6603ab202ddd40348d5c442a116570d2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.580273   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:08.580780   431 raft_consensus.cc:2243] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.581251   431 raft_consensus.cc:2272] T d89a7a13b88149bd87ba85a0f44c174d P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.583755   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:08.584247   431 raft_consensus.cc:2243] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.584667   431 raft_consensus.cc:2272] T 01b2d44c8aa74629b6f07f2a05b1255f P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.586843   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:08.587421   431 raft_consensus.cc:2243] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.587843   431 raft_consensus.cc:2272] T def0dda674d640a7bf9832c41e6411e8 P 6603ab202ddd40348d5c442a116570d2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:08.607534 10861 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111) [suppressed 92 similar messages]
I20260709 13:04:08.610087   431 tablet_server.cc:196] TabletServer@127.0.107.193:33037 shutdown complete.
W20260709 13:04:08.611258 10861 consensus_peers.cc:597] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:08.639385   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:04:08.661335   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:08.662055   431 tablet_replica.cc:333] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a: stopping tablet replica
I20260709 13:04:08.662798   431 raft_consensus.cc:2243] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.663314   431 raft_consensus.cc:2272] T d89a7a13b88149bd87ba85a0f44c174d P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.665477   431 tablet_replica.cc:333] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a: stopping tablet replica
I20260709 13:04:08.666093   431 raft_consensus.cc:2243] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:08.666846   431 raft_consensus.cc:2272] T 01b2d44c8aa74629b6f07f2a05b1255f P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.669006   431 tablet_replica.cc:333] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a: stopping tablet replica
I20260709 13:04:08.669564   431 raft_consensus.cc:2243] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.669978   431 raft_consensus.cc:2272] T 2a94d0fa583e4778b899a7c62324e39e P f524ec9f4fca44a4bbf5a5c4b329079a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.672600   431 tablet_replica.cc:333] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a: stopping tablet replica
I20260709 13:04:08.673151   431 raft_consensus.cc:2243] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:08.673936   431 raft_consensus.cc:2272] T 640b1bca020c48d2b5c418402f198ff1 P f524ec9f4fca44a4bbf5a5c4b329079a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.676525   431 tablet_replica.cc:333] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a: stopping tablet replica
I20260709 13:04:08.677100   431 raft_consensus.cc:2243] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:08.677810   431 raft_consensus.cc:2272] T e0f5e456fbfd4fce8e37636881dce2b5 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.679863   431 tablet_replica.cc:333] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a: stopping tablet replica
I20260709 13:04:08.680370   431 raft_consensus.cc:2243] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:08.681233   431 raft_consensus.cc:2272] T 7b8b72efed2f46e4b7c41a823d941b54 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.683458   431 tablet_replica.cc:333] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a: stopping tablet replica
I20260709 13:04:08.684006   431 raft_consensus.cc:2243] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.684480   431 raft_consensus.cc:2272] T d5f3e403122e4cdfa4c423d00d4c1577 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.686360   431 tablet_replica.cc:333] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a: stopping tablet replica
I20260709 13:04:08.686856   431 raft_consensus.cc:2243] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:08.687608   431 raft_consensus.cc:2272] T c5db8e3237574f9a8836e5e9a88ba2c4 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.689828   431 tablet_replica.cc:333] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a: stopping tablet replica
I20260709 13:04:08.690387   431 raft_consensus.cc:2243] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.690789   431 raft_consensus.cc:2272] T dea67ea321734b05a2c1f920d4fd1eab P f524ec9f4fca44a4bbf5a5c4b329079a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.692828   431 tablet_replica.cc:333] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a: stopping tablet replica
I20260709 13:04:08.693305   431 raft_consensus.cc:2243] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.693696   431 raft_consensus.cc:2272] T def0dda674d640a7bf9832c41e6411e8 P f524ec9f4fca44a4bbf5a5c4b329079a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.725208   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:04:08.748315 10861 consensus_peers.cc:597] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:08.748934 10861 consensus_peers.cc:597] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 -> Peer 6603ab202ddd40348d5c442a116570d2 (127.0.107.193:33037): Couldn't send request to peer 6603ab202ddd40348d5c442a116570d2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:08.751575   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:04:08.772854 10861 consensus_peers.cc:597] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 -> Peer f524ec9f4fca44a4bbf5a5c4b329079a (127.0.107.194:41591): Couldn't send request to peer f524ec9f4fca44a4bbf5a5c4b329079a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:08.785413   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:08.786190   431 tablet_replica.cc:333] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116: stopping tablet replica
I20260709 13:04:08.786813   431 raft_consensus.cc:2243] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.787410   431 raft_consensus.cc:2272] T 7b8b72efed2f46e4b7c41a823d941b54 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.789574   431 tablet_replica.cc:333] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116: stopping tablet replica
I20260709 13:04:08.790169   431 raft_consensus.cc:2243] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:08.790989   431 raft_consensus.cc:2272] T dea67ea321734b05a2c1f920d4fd1eab P 6ff3a67a6b814758872d067d3a852116 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.793346   431 tablet_replica.cc:333] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116: stopping tablet replica
I20260709 13:04:08.793896   431 raft_consensus.cc:2243] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:08.794646   431 raft_consensus.cc:2272] T d89a7a13b88149bd87ba85a0f44c174d P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.796532   431 tablet_replica.cc:333] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116: stopping tablet replica
I20260709 13:04:08.797099   431 raft_consensus.cc:2243] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.797513   431 raft_consensus.cc:2272] T 01b2d44c8aa74629b6f07f2a05b1255f P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.799388   431 tablet_replica.cc:333] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116: stopping tablet replica
I20260709 13:04:08.799921   431 raft_consensus.cc:2243] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:08.800701   431 raft_consensus.cc:2272] T def0dda674d640a7bf9832c41e6411e8 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.802832   431 tablet_replica.cc:333] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116: stopping tablet replica
I20260709 13:04:08.803457   431 raft_consensus.cc:2243] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:04:08.804162   431 raft_consensus.cc:2272] T 2a94d0fa583e4778b899a7c62324e39e P 6ff3a67a6b814758872d067d3a852116 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.806434   431 tablet_replica.cc:333] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116: stopping tablet replica
I20260709 13:04:08.806989   431 raft_consensus.cc:2243] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.807488   431 raft_consensus.cc:2272] T c5db8e3237574f9a8836e5e9a88ba2c4 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.810124   431 tablet_replica.cc:333] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116: stopping tablet replica
I20260709 13:04:08.810685   431 raft_consensus.cc:2243] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:08.811578   431 raft_consensus.cc:2272] T d5f3e403122e4cdfa4c423d00d4c1577 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.813648   431 tablet_replica.cc:333] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116: stopping tablet replica
I20260709 13:04:08.814157   431 raft_consensus.cc:2243] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.814565   431 raft_consensus.cc:2272] T e0f5e456fbfd4fce8e37636881dce2b5 P 6ff3a67a6b814758872d067d3a852116 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.816546   431 tablet_replica.cc:333] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116: stopping tablet replica
I20260709 13:04:08.817010   431 raft_consensus.cc:2243] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.817417   431 raft_consensus.cc:2272] T 640b1bca020c48d2b5c418402f198ff1 P 6ff3a67a6b814758872d067d3a852116 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.848637   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:08.875350   431 master.cc:562] Master@127.0.107.254:42039 shutting down...
I20260709 13:04:08.903285   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:08.903841   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.904152   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4f7aa3f9f80a44bca1dfd146933195ea: stopping tablet replica
I20260709 13:04:08.943032   431 master.cc:584] Master@127.0.107.254:42039 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12943 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:04:08.990613   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37089
I20260709 13:04:08.991752   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:08.998898 11231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:08.999145 11232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:08.999516 11234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:09.000277   431 server_base.cc:1061] running on GCE node
I20260709 13:04:09.001127   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:09.001324   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:09.001451   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602249001439 us; error 0 us; skew 500 ppm
I20260709 13:04:09.001958   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:09.005124   431 webserver.cc:533] Webserver started at http://127.0.107.254:42933/ using document root <none> and password file <none>
I20260709 13:04:09.005636   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:09.005820   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:09.006047   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:09.007309   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/master-0-root/instance:
uuid: "9a983e5c839b43f9a9dfc865ec6f5fdd"
format_stamp: "Formatted at 2026-07-09 13:04:09 on dist-test-slave-zhw8"
I20260709 13:04:09.012717   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:04:09.017019 11239 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:09.018062   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:04:09.018440   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/master-0-root
uuid: "9a983e5c839b43f9a9dfc865ec6f5fdd"
format_stamp: "Formatted at 2026-07-09 13:04:09 on dist-test-slave-zhw8"
I20260709 13:04:09.018764   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:09.037770   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:09.039039   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:09.077306   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37089
I20260709 13:04:09.077402 11290 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37089 every 8 connection(s)
I20260709 13:04:09.081184 11291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:09.092968 11291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd: Bootstrap starting.
I20260709 13:04:09.098122 11291 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.103135 11291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd: No bootstrap required, opened a new log
I20260709 13:04:09.105369 11291 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a983e5c839b43f9a9dfc865ec6f5fdd" member_type: VOTER }
I20260709 13:04:09.105762 11291 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.105994 11291 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a983e5c839b43f9a9dfc865ec6f5fdd, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.106585 11291 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a983e5c839b43f9a9dfc865ec6f5fdd" member_type: VOTER }
I20260709 13:04:09.107054 11291 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:09.107318 11291 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:09.107589 11291 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.112461 11291 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a983e5c839b43f9a9dfc865ec6f5fdd" member_type: VOTER }
I20260709 13:04:09.112973 11291 leader_election.cc:304] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a983e5c839b43f9a9dfc865ec6f5fdd; no voters: 
I20260709 13:04:09.114049 11291 leader_election.cc:290] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:09.114470 11294 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.115962 11294 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [term 1 LEADER]: Becoming Leader. State: Replica: 9a983e5c839b43f9a9dfc865ec6f5fdd, State: Running, Role: LEADER
I20260709 13:04:09.116698 11294 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a983e5c839b43f9a9dfc865ec6f5fdd" member_type: VOTER }
I20260709 13:04:09.117012 11291 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:09.121768 11296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a983e5c839b43f9a9dfc865ec6f5fdd. Latest consensus state: current_term: 1 leader_uuid: "9a983e5c839b43f9a9dfc865ec6f5fdd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a983e5c839b43f9a9dfc865ec6f5fdd" member_type: VOTER } }
I20260709 13:04:09.122601 11296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:09.122752 11295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a983e5c839b43f9a9dfc865ec6f5fdd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a983e5c839b43f9a9dfc865ec6f5fdd" member_type: VOTER } }
I20260709 13:04:09.123318 11295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:09.124576 11301 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:09.129506 11301 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:09.133853   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:09.138170 11301 catalog_manager.cc:1383] Generated new cluster ID: 7a1a3bcbf45c4d44848ef9bcafe3a9d8
I20260709 13:04:09.138551 11301 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:09.201301 11301 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:09.202584 11301 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:09.221814 11301 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd: Generated new TSK 0
I20260709 13:04:09.222585 11301 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:09.265841   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:09.271852 11312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:09.273005 11313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:09.274367 11315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:09.275559   431 server_base.cc:1061] running on GCE node
I20260709 13:04:09.276834   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:09.277057   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:09.277254   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602249277234 us; error 0 us; skew 500 ppm
I20260709 13:04:09.277889   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:09.280429   431 webserver.cc:533] Webserver started at http://127.0.107.193:34859/ using document root <none> and password file <none>
I20260709 13:04:09.280966   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:09.281194   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:09.281488   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:09.282653   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/ts-0-root/instance:
uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e"
format_stamp: "Formatted at 2026-07-09 13:04:09 on dist-test-slave-zhw8"
I20260709 13:04:09.287611   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:04:09.291045 11320 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:09.292179   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:04:09.292557   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/ts-0-root
uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e"
format_stamp: "Formatted at 2026-07-09 13:04:09 on dist-test-slave-zhw8"
I20260709 13:04:09.292951   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:09.315500   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:09.316790   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:09.318298   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:09.320879   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:09.321074   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:09.321432   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:09.321627   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:09.363296   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:46281
I20260709 13:04:09.363427 11382 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:46281 every 8 connection(s)
I20260709 13:04:09.368561   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:09.376255 11387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:09.376901 11388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:09.379935 11390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:09.380162   431 server_base.cc:1061] running on GCE node
I20260709 13:04:09.381515   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:09.381740   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:09.381827 11383 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37089
I20260709 13:04:09.381958   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602249381938 us; error 0 us; skew 500 ppm
I20260709 13:04:09.382296 11383 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:09.382820   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:09.383257 11383 heartbeater.cc:507] Master 127.0.107.254:37089 requested a full tablet report, sending...
I20260709 13:04:09.385388   431 webserver.cc:533] Webserver started at http://127.0.107.194:35607/ using document root <none> and password file <none>
I20260709 13:04:09.385684 11256 ts_manager.cc:194] Registered new tserver with Master: c6c6a18a2dea4bfb9ff104b548a44a2e (127.0.107.193:46281)
I20260709 13:04:09.385941   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:09.386257   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:09.386528   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:09.387697 11256 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56412
I20260709 13:04:09.387735   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/ts-1-root/instance:
uuid: "36727bb2204243fa870d56382f5d6232"
format_stamp: "Formatted at 2026-07-09 13:04:09 on dist-test-slave-zhw8"
I20260709 13:04:09.392958   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:09.396818 11395 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:09.397719   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:04:09.397974   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/ts-1-root
uuid: "36727bb2204243fa870d56382f5d6232"
format_stamp: "Formatted at 2026-07-09 13:04:09 on dist-test-slave-zhw8"
I20260709 13:04:09.398224   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:09.413096   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:09.414222   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:09.415666   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:09.417856   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:09.418032   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:09.418318   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:09.418457   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:09.458706   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:38395
I20260709 13:04:09.458822 11457 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:38395 every 8 connection(s)
I20260709 13:04:09.463498   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:09.469945 11461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:09.470773 11462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:09.472752   431 server_base.cc:1061] running on GCE node
W20260709 13:04:09.473603 11464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:09.474776   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:09.475013   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:09.475216   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602249475197 us; error 0 us; skew 500 ppm
I20260709 13:04:09.475821   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:09.475893 11458 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37089
I20260709 13:04:09.476382 11458 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:09.477303 11458 heartbeater.cc:507] Master 127.0.107.254:37089 requested a full tablet report, sending...
I20260709 13:04:09.478358   431 webserver.cc:533] Webserver started at http://127.0.107.195:42473/ using document root <none> and password file <none>
I20260709 13:04:09.478976   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:09.479187   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:09.479503   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:09.479494 11256 ts_manager.cc:194] Registered new tserver with Master: 36727bb2204243fa870d56382f5d6232 (127.0.107.194:38395)
I20260709 13:04:09.480901   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/ts-2-root/instance:
uuid: "18128f29308041af86bec1279a210154"
format_stamp: "Formatted at 2026-07-09 13:04:09 on dist-test-slave-zhw8"
I20260709 13:04:09.481058 11256 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56426
I20260709 13:04:09.485486   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:09.489097 11469 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:09.489930   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:04:09.490290   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/ts-2-root
uuid: "18128f29308041af86bec1279a210154"
format_stamp: "Formatted at 2026-07-09 13:04:09 on dist-test-slave-zhw8"
I20260709 13:04:09.490650   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601945298557-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:09.516738   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:09.517982   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:09.519394   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:09.521826   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:09.522058   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:09.522307   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:09.522483   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:09.563938   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:45253
I20260709 13:04:09.564057 11531 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:45253 every 8 connection(s)
I20260709 13:04:09.577962 11532 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37089
I20260709 13:04:09.578491 11532 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:09.579416 11532 heartbeater.cc:507] Master 127.0.107.254:37089 requested a full tablet report, sending...
I20260709 13:04:09.581439 11256 ts_manager.cc:194] Registered new tserver with Master: 18128f29308041af86bec1279a210154 (127.0.107.195:45253)
I20260709 13:04:09.581987   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014652478s
I20260709 13:04:09.583220 11256 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56432
I20260709 13:04:09.608178 11256 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56446:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:09.610219 11256 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:09.656713 11497 tablet_service.cc:1511] Processing CreateTablet for tablet de4f64cdc3c4412a8dadbce64c41aa95 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=7400290bb9da4839ac268e3a707ae850]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:09.657998 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 7555ff6ec65743eaadeb769926ba9072 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=7400290bb9da4839ac268e3a707ae850]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:09.658327 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de4f64cdc3c4412a8dadbce64c41aa95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:09.659899 11423 tablet_service.cc:1511] Processing CreateTablet for tablet de4f64cdc3c4412a8dadbce64c41aa95 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=7400290bb9da4839ac268e3a707ae850]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:09.660305 11422 tablet_service.cc:1511] Processing CreateTablet for tablet 7555ff6ec65743eaadeb769926ba9072 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=7400290bb9da4839ac268e3a707ae850]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:09.661204 11423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de4f64cdc3c4412a8dadbce64c41aa95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:09.661455 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7555ff6ec65743eaadeb769926ba9072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:09.661926 11422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7555ff6ec65743eaadeb769926ba9072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:09.679731 11348 tablet_service.cc:1511] Processing CreateTablet for tablet de4f64cdc3c4412a8dadbce64c41aa95 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=7400290bb9da4839ac268e3a707ae850]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:09.679724 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 7555ff6ec65743eaadeb769926ba9072 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=7400290bb9da4839ac268e3a707ae850]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:09.682314 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7555ff6ec65743eaadeb769926ba9072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:09.685634 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de4f64cdc3c4412a8dadbce64c41aa95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:09.693506 11547 tablet_bootstrap.cc:492] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154: Bootstrap starting.
I20260709 13:04:09.701020 11548 tablet_bootstrap.cc:492] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232: Bootstrap starting.
I20260709 13:04:09.701040 11547 tablet_bootstrap.cc:654] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.706784 11547 tablet_bootstrap.cc:492] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154: No bootstrap required, opened a new log
I20260709 13:04:09.707226 11547 ts_tablet_manager.cc:1403] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154: Time spent bootstrapping tablet: real 0.014s	user 0.003s	sys 0.008s
I20260709 13:04:09.708273 11548 tablet_bootstrap.cc:654] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.709488 11547 raft_consensus.cc:359] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } }
I20260709 13:04:09.710089 11547 raft_consensus.cc:385] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.710431 11547 raft_consensus.cc:740] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18128f29308041af86bec1279a210154, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.711627 11547 consensus_queue.cc:260] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } }
I20260709 13:04:09.716616 11550 tablet_bootstrap.cc:492] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e: Bootstrap starting.
I20260709 13:04:09.718905 11532 heartbeater.cc:499] Master 127.0.107.254:37089 was elected leader, sending a full tablet report...
I20260709 13:04:09.719439 11547 ts_tablet_manager.cc:1434] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.008s
I20260709 13:04:09.719949 11548 tablet_bootstrap.cc:492] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232: No bootstrap required, opened a new log
I20260709 13:04:09.720547 11547 tablet_bootstrap.cc:492] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154: Bootstrap starting.
I20260709 13:04:09.720583 11548 ts_tablet_manager.cc:1403] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 13:04:09.724458 11550 tablet_bootstrap.cc:654] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.724053 11548 raft_consensus.cc:359] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:09.724984 11548 raft_consensus.cc:385] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.725365 11548 raft_consensus.cc:740] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36727bb2204243fa870d56382f5d6232, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.726425 11548 consensus_queue.cc:260] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:09.728116 11547 tablet_bootstrap.cc:654] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.735527 11548 ts_tablet_manager.cc:1434] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:04:09.737603 11458 heartbeater.cc:499] Master 127.0.107.254:37089 was elected leader, sending a full tablet report...
I20260709 13:04:09.737668 11548 tablet_bootstrap.cc:492] T de4f64cdc3c4412a8dadbce64c41aa95 P 36727bb2204243fa870d56382f5d6232: Bootstrap starting.
I20260709 13:04:09.737670 11550 tablet_bootstrap.cc:492] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e: No bootstrap required, opened a new log
I20260709 13:04:09.738428 11550 ts_tablet_manager.cc:1403] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 13:04:09.741058 11547 tablet_bootstrap.cc:492] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154: No bootstrap required, opened a new log
I20260709 13:04:09.741537 11547 ts_tablet_manager.cc:1403] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.001s
I20260709 13:04:09.741482 11550 raft_consensus.cc:359] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } }
I20260709 13:04:09.742563 11550 raft_consensus.cc:385] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.742895 11550 raft_consensus.cc:740] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c6a18a2dea4bfb9ff104b548a44a2e, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.743845 11550 consensus_queue.cc:260] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } }
I20260709 13:04:09.744180 11547 raft_consensus.cc:359] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:09.744917 11547 raft_consensus.cc:385] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.745226 11547 raft_consensus.cc:740] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18128f29308041af86bec1279a210154, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.745940 11547 consensus_queue.cc:260] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:09.748137 11547 ts_tablet_manager.cc:1434] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:09.750568 11548 tablet_bootstrap.cc:654] T de4f64cdc3c4412a8dadbce64c41aa95 P 36727bb2204243fa870d56382f5d6232: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.753291 11550 ts_tablet_manager.cc:1434] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.005s
I20260709 13:04:09.754112 11383 heartbeater.cc:499] Master 127.0.107.254:37089 was elected leader, sending a full tablet report...
I20260709 13:04:09.757302 11550 tablet_bootstrap.cc:492] T 7555ff6ec65743eaadeb769926ba9072 P c6c6a18a2dea4bfb9ff104b548a44a2e: Bootstrap starting.
I20260709 13:04:09.766064 11550 tablet_bootstrap.cc:654] T 7555ff6ec65743eaadeb769926ba9072 P c6c6a18a2dea4bfb9ff104b548a44a2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.766592 11553 raft_consensus.cc:493] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.767166 11553 raft_consensus.cc:515] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:09.768473 11548 tablet_bootstrap.cc:492] T de4f64cdc3c4412a8dadbce64c41aa95 P 36727bb2204243fa870d56382f5d6232: No bootstrap required, opened a new log
I20260709 13:04:09.769044 11548 ts_tablet_manager.cc:1403] T de4f64cdc3c4412a8dadbce64c41aa95 P 36727bb2204243fa870d56382f5d6232: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.009s
I20260709 13:04:09.769876 11553 leader_election.cc:290] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c6a18a2dea4bfb9ff104b548a44a2e (127.0.107.193:46281), 18128f29308041af86bec1279a210154 (127.0.107.195:45253)
I20260709 13:04:09.772449 11548 raft_consensus.cc:359] T de4f64cdc3c4412a8dadbce64c41aa95 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } }
I20260709 13:04:09.773350 11548 raft_consensus.cc:385] T de4f64cdc3c4412a8dadbce64c41aa95 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.773660 11548 raft_consensus.cc:740] T de4f64cdc3c4412a8dadbce64c41aa95 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36727bb2204243fa870d56382f5d6232, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.774444 11548 consensus_queue.cc:260] T de4f64cdc3c4412a8dadbce64c41aa95 P 36727bb2204243fa870d56382f5d6232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } }
I20260709 13:04:09.776608 11548 ts_tablet_manager.cc:1434] T de4f64cdc3c4412a8dadbce64c41aa95 P 36727bb2204243fa870d56382f5d6232: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:09.781230 11358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7555ff6ec65743eaadeb769926ba9072" candidate_uuid: "36727bb2204243fa870d56382f5d6232" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" is_pre_election: true
W20260709 13:04:09.782859 11399 leader_election.cc:343] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c6a18a2dea4bfb9ff104b548a44a2e (127.0.107.193:46281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.786145 11550 tablet_bootstrap.cc:492] T 7555ff6ec65743eaadeb769926ba9072 P c6c6a18a2dea4bfb9ff104b548a44a2e: No bootstrap required, opened a new log
I20260709 13:04:09.786703 11550 ts_tablet_manager.cc:1403] T 7555ff6ec65743eaadeb769926ba9072 P c6c6a18a2dea4bfb9ff104b548a44a2e: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.009s
I20260709 13:04:09.789698 11550 raft_consensus.cc:359] T 7555ff6ec65743eaadeb769926ba9072 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:09.790302 11550 raft_consensus.cc:385] T 7555ff6ec65743eaadeb769926ba9072 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.790621 11550 raft_consensus.cc:740] T 7555ff6ec65743eaadeb769926ba9072 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c6a18a2dea4bfb9ff104b548a44a2e, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.790876 11507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7555ff6ec65743eaadeb769926ba9072" candidate_uuid: "36727bb2204243fa870d56382f5d6232" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18128f29308041af86bec1279a210154" is_pre_election: true
I20260709 13:04:09.791185 11550 consensus_queue.cc:260] T 7555ff6ec65743eaadeb769926ba9072 P c6c6a18a2dea4bfb9ff104b548a44a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:09.791666 11507 raft_consensus.cc:2468] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36727bb2204243fa870d56382f5d6232 in term 0.
I20260709 13:04:09.793159 11396 leader_election.cc:304] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18128f29308041af86bec1279a210154, 36727bb2204243fa870d56382f5d6232; no voters: c6c6a18a2dea4bfb9ff104b548a44a2e
I20260709 13:04:09.793656 11550 ts_tablet_manager.cc:1434] T 7555ff6ec65743eaadeb769926ba9072 P c6c6a18a2dea4bfb9ff104b548a44a2e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:09.794010 11553 raft_consensus.cc:2804] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.794456 11553 raft_consensus.cc:493] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.794799 11553 raft_consensus.cc:3060] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.801013 11552 raft_consensus.cc:493] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.801316 11553 raft_consensus.cc:515] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:09.801604 11552 raft_consensus.cc:515] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } }
I20260709 13:04:09.803458 11553 leader_election.cc:290] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [CANDIDATE]: Term 1 election: Requested vote from peers c6c6a18a2dea4bfb9ff104b548a44a2e (127.0.107.193:46281), 18128f29308041af86bec1279a210154 (127.0.107.195:45253)
I20260709 13:04:09.804020 11358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7555ff6ec65743eaadeb769926ba9072" candidate_uuid: "36727bb2204243fa870d56382f5d6232" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e"
I20260709 13:04:09.804574 11358 raft_consensus.cc:3060] T 7555ff6ec65743eaadeb769926ba9072 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.806710 11507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7555ff6ec65743eaadeb769926ba9072" candidate_uuid: "36727bb2204243fa870d56382f5d6232" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18128f29308041af86bec1279a210154"
I20260709 13:04:09.807360 11507 raft_consensus.cc:3060] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.811703 11358 raft_consensus.cc:2468] T 7555ff6ec65743eaadeb769926ba9072 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36727bb2204243fa870d56382f5d6232 in term 1.
I20260709 13:04:09.812773 11552 leader_election.cc:290] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c6a18a2dea4bfb9ff104b548a44a2e (127.0.107.193:46281), 36727bb2204243fa870d56382f5d6232 (127.0.107.194:38395)
I20260709 13:04:09.812903 11399 leader_election.cc:304] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36727bb2204243fa870d56382f5d6232, c6c6a18a2dea4bfb9ff104b548a44a2e; no voters: 
I20260709 13:04:09.813890 11553 raft_consensus.cc:2804] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.816143 11433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4f64cdc3c4412a8dadbce64c41aa95" candidate_uuid: "18128f29308041af86bec1279a210154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36727bb2204243fa870d56382f5d6232" is_pre_election: true
I20260709 13:04:09.816494 11507 raft_consensus.cc:2468] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36727bb2204243fa870d56382f5d6232 in term 1.
I20260709 13:04:09.816874 11433 raft_consensus.cc:2468] T de4f64cdc3c4412a8dadbce64c41aa95 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18128f29308041af86bec1279a210154 in term 0.
I20260709 13:04:09.819314 11471 leader_election.cc:304] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18128f29308041af86bec1279a210154, 36727bb2204243fa870d56382f5d6232; no voters: 
I20260709 13:04:09.819938 11553 raft_consensus.cc:697] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 1 LEADER]: Becoming Leader. State: Replica: 36727bb2204243fa870d56382f5d6232, State: Running, Role: LEADER
I20260709 13:04:09.820672 11552 raft_consensus.cc:2804] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.821085 11552 raft_consensus.cc:493] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.821502 11552 raft_consensus.cc:3060] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.821058 11553 consensus_queue.cc:237] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:09.823066 11358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4f64cdc3c4412a8dadbce64c41aa95" candidate_uuid: "18128f29308041af86bec1279a210154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" is_pre_election: true
I20260709 13:04:09.823678 11358 raft_consensus.cc:2468] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18128f29308041af86bec1279a210154 in term 0.
I20260709 13:04:09.828780 11552 raft_consensus.cc:515] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } }
I20260709 13:04:09.830507 11552 leader_election.cc:290] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [CANDIDATE]: Term 1 election: Requested vote from peers c6c6a18a2dea4bfb9ff104b548a44a2e (127.0.107.193:46281), 36727bb2204243fa870d56382f5d6232 (127.0.107.194:38395)
I20260709 13:04:09.830325 11255 catalog_manager.cc:5697] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36727bb2204243fa870d56382f5d6232 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "36727bb2204243fa870d56382f5d6232" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.831266 11358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4f64cdc3c4412a8dadbce64c41aa95" candidate_uuid: "18128f29308041af86bec1279a210154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e"
I20260709 13:04:09.831661 11433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4f64cdc3c4412a8dadbce64c41aa95" candidate_uuid: "18128f29308041af86bec1279a210154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36727bb2204243fa870d56382f5d6232"
I20260709 13:04:09.831873 11358 raft_consensus.cc:3060] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.832238 11433 raft_consensus.cc:3060] T de4f64cdc3c4412a8dadbce64c41aa95 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.837852 11358 raft_consensus.cc:2468] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18128f29308041af86bec1279a210154 in term 1.
I20260709 13:04:09.838349 11433 raft_consensus.cc:2468] T de4f64cdc3c4412a8dadbce64c41aa95 P 36727bb2204243fa870d56382f5d6232 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18128f29308041af86bec1279a210154 in term 1.
I20260709 13:04:09.839406 11473 leader_election.cc:304] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18128f29308041af86bec1279a210154, c6c6a18a2dea4bfb9ff104b548a44a2e; no voters: 
I20260709 13:04:09.840317 11552 raft_consensus.cc:2804] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.841591 11552 raft_consensus.cc:697] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 1 LEADER]: Becoming Leader. State: Replica: 18128f29308041af86bec1279a210154, State: Running, Role: LEADER
I20260709 13:04:09.842420 11552 consensus_queue.cc:237] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } }
I20260709 13:04:09.849368 11255 catalog_manager.cc:5697] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18128f29308041af86bec1279a210154 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "18128f29308041af86bec1279a210154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.881232 11255 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56460:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:09.883148 11255 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:09.906209 11348 tablet_service.cc:1511] Processing CreateTablet for tablet c4ad2d051737416dbdd6abc59bff9583 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1d1186563666469a99d4d0d533e7acdf]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:09.907500 11423 tablet_service.cc:1511] Processing CreateTablet for tablet c4ad2d051737416dbdd6abc59bff9583 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1d1186563666469a99d4d0d533e7acdf]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:09.908808 11423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ad2d051737416dbdd6abc59bff9583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:09.909217 11497 tablet_service.cc:1511] Processing CreateTablet for tablet c4ad2d051737416dbdd6abc59bff9583 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1d1186563666469a99d4d0d533e7acdf]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:09.910089 11347 tablet_service.cc:1511] Processing CreateTablet for tablet a57715a2ef8e49a784aa0beb24f79e3a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1d1186563666469a99d4d0d533e7acdf]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:09.910446 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ad2d051737416dbdd6abc59bff9583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:09.913684 11422 tablet_service.cc:1511] Processing CreateTablet for tablet a57715a2ef8e49a784aa0beb24f79e3a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1d1186563666469a99d4d0d533e7acdf]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:09.914901 11496 tablet_service.cc:1511] Processing CreateTablet for tablet a57715a2ef8e49a784aa0beb24f79e3a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1d1186563666469a99d4d0d533e7acdf]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:09.916203 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a57715a2ef8e49a784aa0beb24f79e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:09.914935 11422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a57715a2ef8e49a784aa0beb24f79e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:09.926210 11548 tablet_bootstrap.cc:492] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232: Bootstrap starting.
I20260709 13:04:09.907536 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ad2d051737416dbdd6abc59bff9583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:09.927817 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a57715a2ef8e49a784aa0beb24f79e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:09.927922 11547 tablet_bootstrap.cc:492] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154: Bootstrap starting.
I20260709 13:04:09.932777 11548 tablet_bootstrap.cc:654] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.934253 11547 tablet_bootstrap.cc:654] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.954497 11550 tablet_bootstrap.cc:492] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e: Bootstrap starting.
I20260709 13:04:09.963603 11550 tablet_bootstrap.cc:654] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.970013 11548 tablet_bootstrap.cc:492] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232: No bootstrap required, opened a new log
I20260709 13:04:09.970635 11548 ts_tablet_manager.cc:1403] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.015s
I20260709 13:04:09.972638 11547 tablet_bootstrap.cc:492] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154: No bootstrap required, opened a new log
I20260709 13:04:09.973286 11547 ts_tablet_manager.cc:1403] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.012s
I20260709 13:04:09.973758 11548 raft_consensus.cc:359] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:09.974568 11548 raft_consensus.cc:385] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.974898 11548 raft_consensus.cc:740] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36727bb2204243fa870d56382f5d6232, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.975821 11548 consensus_queue.cc:260] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:09.976850 11550 tablet_bootstrap.cc:492] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e: No bootstrap required, opened a new log
I20260709 13:04:09.976737 11547 raft_consensus.cc:359] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:09.977949 11550 ts_tablet_manager.cc:1403] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.001s
I20260709 13:04:09.978084 11548 ts_tablet_manager.cc:1434] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:04:09.978150 11547 raft_consensus.cc:385] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.979153 11547 raft_consensus.cc:740] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18128f29308041af86bec1279a210154, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.979323 11548 tablet_bootstrap.cc:492] T a57715a2ef8e49a784aa0beb24f79e3a P 36727bb2204243fa870d56382f5d6232: Bootstrap starting.
I20260709 13:04:09.980150 11547 consensus_queue.cc:260] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:09.982559 11547 ts_tablet_manager.cc:1434] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:04:09.983615 11547 tablet_bootstrap.cc:492] T a57715a2ef8e49a784aa0beb24f79e3a P 18128f29308041af86bec1279a210154: Bootstrap starting.
I20260709 13:04:09.985837 11550 raft_consensus.cc:359] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:09.986629 11550 raft_consensus.cc:385] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.986960 11550 raft_consensus.cc:740] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c6a18a2dea4bfb9ff104b548a44a2e, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.987733 11550 consensus_queue.cc:260] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:09.988713 11548 tablet_bootstrap.cc:654] T a57715a2ef8e49a784aa0beb24f79e3a P 36727bb2204243fa870d56382f5d6232: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.990090 11550 ts_tablet_manager.cc:1434] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:09.991024 11547 tablet_bootstrap.cc:654] T a57715a2ef8e49a784aa0beb24f79e3a P 18128f29308041af86bec1279a210154: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.991171 11550 tablet_bootstrap.cc:492] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e: Bootstrap starting.
I20260709 13:04:09.999902 11550 tablet_bootstrap.cc:654] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.000722 11547 tablet_bootstrap.cc:492] T a57715a2ef8e49a784aa0beb24f79e3a P 18128f29308041af86bec1279a210154: No bootstrap required, opened a new log
I20260709 13:04:10.001156 11548 tablet_bootstrap.cc:492] T a57715a2ef8e49a784aa0beb24f79e3a P 36727bb2204243fa870d56382f5d6232: No bootstrap required, opened a new log
I20260709 13:04:10.001389 11547 ts_tablet_manager.cc:1403] T a57715a2ef8e49a784aa0beb24f79e3a P 18128f29308041af86bec1279a210154: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 13:04:10.001742 11548 ts_tablet_manager.cc:1403] T a57715a2ef8e49a784aa0beb24f79e3a P 36727bb2204243fa870d56382f5d6232: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.001s
I20260709 13:04:10.005431 11548 raft_consensus.cc:359] T a57715a2ef8e49a784aa0beb24f79e3a P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.005257 11547 raft_consensus.cc:359] T a57715a2ef8e49a784aa0beb24f79e3a P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.006425 11548 raft_consensus.cc:385] T a57715a2ef8e49a784aa0beb24f79e3a P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.006605 11547 raft_consensus.cc:385] T a57715a2ef8e49a784aa0beb24f79e3a P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.006860 11548 raft_consensus.cc:740] T a57715a2ef8e49a784aa0beb24f79e3a P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36727bb2204243fa870d56382f5d6232, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.007191 11547 raft_consensus.cc:740] T a57715a2ef8e49a784aa0beb24f79e3a P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18128f29308041af86bec1279a210154, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.007851 11548 consensus_queue.cc:260] T a57715a2ef8e49a784aa0beb24f79e3a P 36727bb2204243fa870d56382f5d6232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.008339 11547 consensus_queue.cc:260] T a57715a2ef8e49a784aa0beb24f79e3a P 18128f29308041af86bec1279a210154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.010712 11548 ts_tablet_manager.cc:1434] T a57715a2ef8e49a784aa0beb24f79e3a P 36727bb2204243fa870d56382f5d6232: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:04:10.011821 11547 ts_tablet_manager.cc:1434] T a57715a2ef8e49a784aa0beb24f79e3a P 18128f29308041af86bec1279a210154: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.003s
I20260709 13:04:10.016812 11550 tablet_bootstrap.cc:492] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e: No bootstrap required, opened a new log
I20260709 13:04:10.017341 11550 ts_tablet_manager.cc:1403] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.009s
I20260709 13:04:10.020254 11550 raft_consensus.cc:359] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.020890 11550 raft_consensus.cc:385] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.021143 11550 raft_consensus.cc:740] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c6a18a2dea4bfb9ff104b548a44a2e, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.021781 11550 consensus_queue.cc:260] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.023927 11550 ts_tablet_manager.cc:1434] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
W20260709 13:04:10.128545 11304 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:10.193030 11552 raft_consensus.cc:493] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.193567 11552 raft_consensus.cc:515] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.195279 11552 leader_election.cc:290] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c6a18a2dea4bfb9ff104b548a44a2e (127.0.107.193:46281), 36727bb2204243fa870d56382f5d6232 (127.0.107.194:38395)
I20260709 13:04:10.196194 11358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ad2d051737416dbdd6abc59bff9583" candidate_uuid: "18128f29308041af86bec1279a210154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" is_pre_election: true
I20260709 13:04:10.196437 11433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ad2d051737416dbdd6abc59bff9583" candidate_uuid: "18128f29308041af86bec1279a210154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36727bb2204243fa870d56382f5d6232" is_pre_election: true
I20260709 13:04:10.196925 11358 raft_consensus.cc:2468] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18128f29308041af86bec1279a210154 in term 0.
I20260709 13:04:10.197038 11433 raft_consensus.cc:2468] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18128f29308041af86bec1279a210154 in term 0.
I20260709 13:04:10.198102 11471 leader_election.cc:304] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18128f29308041af86bec1279a210154, 36727bb2204243fa870d56382f5d6232; no voters: 
I20260709 13:04:10.198808 11552 raft_consensus.cc:2804] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:10.199203 11552 raft_consensus.cc:493] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.199544 11552 raft_consensus.cc:3060] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.204963 11552 raft_consensus.cc:515] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.206866 11552 leader_election.cc:290] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [CANDIDATE]: Term 1 election: Requested vote from peers c6c6a18a2dea4bfb9ff104b548a44a2e (127.0.107.193:46281), 36727bb2204243fa870d56382f5d6232 (127.0.107.194:38395)
I20260709 13:04:10.207744 11358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ad2d051737416dbdd6abc59bff9583" candidate_uuid: "18128f29308041af86bec1279a210154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e"
I20260709 13:04:10.207942 11433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ad2d051737416dbdd6abc59bff9583" candidate_uuid: "18128f29308041af86bec1279a210154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36727bb2204243fa870d56382f5d6232"
I20260709 13:04:10.208348 11358 raft_consensus.cc:3060] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.208547 11433 raft_consensus.cc:3060] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.213351 11433 raft_consensus.cc:2468] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18128f29308041af86bec1279a210154 in term 1.
I20260709 13:04:10.213754 11358 raft_consensus.cc:2468] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18128f29308041af86bec1279a210154 in term 1.
I20260709 13:04:10.214385 11471 leader_election.cc:304] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18128f29308041af86bec1279a210154, 36727bb2204243fa870d56382f5d6232; no voters: 
I20260709 13:04:10.215271 11552 raft_consensus.cc:2804] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:10.215839 11552 raft_consensus.cc:697] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 1 LEADER]: Becoming Leader. State: Replica: 18128f29308041af86bec1279a210154, State: Running, Role: LEADER
I20260709 13:04:10.216704 11552 consensus_queue.cc:237] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.223755 11255 catalog_manager.cc:5697] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18128f29308041af86bec1279a210154 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "18128f29308041af86bec1279a210154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:10.272203 11556 raft_consensus.cc:493] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.272761 11556 raft_consensus.cc:515] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.274804 11556 leader_election.cc:290] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36727bb2204243fa870d56382f5d6232 (127.0.107.194:38395), 18128f29308041af86bec1279a210154 (127.0.107.195:45253)
I20260709 13:04:10.286727 11433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a57715a2ef8e49a784aa0beb24f79e3a" candidate_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36727bb2204243fa870d56382f5d6232" is_pre_election: true
I20260709 13:04:10.287460 11507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a57715a2ef8e49a784aa0beb24f79e3a" candidate_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18128f29308041af86bec1279a210154" is_pre_election: true
I20260709 13:04:10.287473 11433 raft_consensus.cc:2468] T a57715a2ef8e49a784aa0beb24f79e3a P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c6a18a2dea4bfb9ff104b548a44a2e in term 0.
I20260709 13:04:10.288123 11507 raft_consensus.cc:2468] T a57715a2ef8e49a784aa0beb24f79e3a P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c6a18a2dea4bfb9ff104b548a44a2e in term 0.
I20260709 13:04:10.288727 11322 leader_election.cc:304] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36727bb2204243fa870d56382f5d6232, c6c6a18a2dea4bfb9ff104b548a44a2e; no voters: 
I20260709 13:04:10.289654 11556 raft_consensus.cc:2804] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:10.289988 11556 raft_consensus.cc:493] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.290211 11556 raft_consensus.cc:3060] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.295576 11556 raft_consensus.cc:515] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.297297 11556 leader_election.cc:290] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [CANDIDATE]: Term 1 election: Requested vote from peers 36727bb2204243fa870d56382f5d6232 (127.0.107.194:38395), 18128f29308041af86bec1279a210154 (127.0.107.195:45253)
I20260709 13:04:10.298151 11433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a57715a2ef8e49a784aa0beb24f79e3a" candidate_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36727bb2204243fa870d56382f5d6232"
I20260709 13:04:10.298859 11433 raft_consensus.cc:3060] T a57715a2ef8e49a784aa0beb24f79e3a P 36727bb2204243fa870d56382f5d6232 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.298620 11507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a57715a2ef8e49a784aa0beb24f79e3a" candidate_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18128f29308041af86bec1279a210154"
I20260709 13:04:10.299443 11507 raft_consensus.cc:3060] T a57715a2ef8e49a784aa0beb24f79e3a P 18128f29308041af86bec1279a210154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.304030 11507 raft_consensus.cc:2468] T a57715a2ef8e49a784aa0beb24f79e3a P 18128f29308041af86bec1279a210154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c6a18a2dea4bfb9ff104b548a44a2e in term 1.
I20260709 13:04:10.304031 11433 raft_consensus.cc:2468] T a57715a2ef8e49a784aa0beb24f79e3a P 36727bb2204243fa870d56382f5d6232 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c6a18a2dea4bfb9ff104b548a44a2e in term 1.
I20260709 13:04:10.304997 11321 leader_election.cc:304] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18128f29308041af86bec1279a210154, c6c6a18a2dea4bfb9ff104b548a44a2e; no voters: 
I20260709 13:04:10.305783 11556 raft_consensus.cc:2804] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:10.306770 11556 raft_consensus.cc:697] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [term 1 LEADER]: Becoming Leader. State: Replica: c6c6a18a2dea4bfb9ff104b548a44a2e, State: Running, Role: LEADER
I20260709 13:04:10.307642 11556 consensus_queue.cc:237] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.314235 11255 catalog_manager.cc:5697] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c6a18a2dea4bfb9ff104b548a44a2e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:10.330343 11552 consensus_queue.cc:1048] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:10.342602 11583 consensus_queue.cc:1048] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:10.356833 11553 consensus_queue.cc:1048] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:10.368916 11553 consensus_queue.cc:1048] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:10.421350 11507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de4f64cdc3c4412a8dadbce64c41aa95"
dest_uuid: "18128f29308041af86bec1279a210154"
mode: GRACEFUL
new_leader_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e"
 from {username='slave'} at 127.0.0.1:42100
I20260709 13:04:10.421911 11507 raft_consensus.cc:606] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 1 LEADER]: Received request to transfer leadership to TS c6c6a18a2dea4bfb9ff104b548a44a2e
I20260709 13:04:10.434837 11433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7555ff6ec65743eaadeb769926ba9072"
dest_uuid: "36727bb2204243fa870d56382f5d6232"
mode: GRACEFUL
new_leader_uuid: "18128f29308041af86bec1279a210154"
 from {username='slave'} at 127.0.0.1:46764
I20260709 13:04:10.435436 11433 raft_consensus.cc:606] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 1 LEADER]: Received request to transfer leadership to TS 18128f29308041af86bec1279a210154
I20260709 13:04:10.441313 11507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4ad2d051737416dbdd6abc59bff9583"
dest_uuid: "18128f29308041af86bec1279a210154"
mode: GRACEFUL
new_leader_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e"
 from {username='slave'} at 127.0.0.1:42100
I20260709 13:04:10.441881 11507 raft_consensus.cc:606] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 1 LEADER]: Received request to transfer leadership to TS c6c6a18a2dea4bfb9ff104b548a44a2e
I20260709 13:04:10.756942 11583 consensus_queue.cc:1048] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:10.763188 11583 consensus_queue.cc:1048] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:10.773296 11552 raft_consensus.cc:993] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154: : Instructing follower c6c6a18a2dea4bfb9ff104b548a44a2e to start an election
I20260709 13:04:10.773778 11552 raft_consensus.cc:1081] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 1 LEADER]: Signalling peer c6c6a18a2dea4bfb9ff104b548a44a2e to start an election
I20260709 13:04:10.775743 11556 consensus_queue.cc:1048] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:10.776117 11357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4ad2d051737416dbdd6abc59bff9583"
dest_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e"
 from {username='slave'} at 127.0.0.1:42984
I20260709 13:04:10.776795 11357 raft_consensus.cc:493] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:10.777158 11357 raft_consensus.cc:3060] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:10.784161 11357 raft_consensus.cc:515] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.785175 11358 raft_consensus.cc:1240] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 FOLLOWER]: Rejecting Update request from peer 18128f29308041af86bec1279a210154 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:10.786245 11357 leader_election.cc:290] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [CANDIDATE]: Term 2 election: Requested vote from peers 36727bb2204243fa870d56382f5d6232 (127.0.107.194:38395), 18128f29308041af86bec1279a210154 (127.0.107.195:45253)
I20260709 13:04:10.787102 11433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ad2d051737416dbdd6abc59bff9583" candidate_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36727bb2204243fa870d56382f5d6232"
I20260709 13:04:10.787832 11433 raft_consensus.cc:3060] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:10.788028 11507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ad2d051737416dbdd6abc59bff9583" candidate_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18128f29308041af86bec1279a210154"
I20260709 13:04:10.788707 11507 raft_consensus.cc:3055] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:10.789057 11507 raft_consensus.cc:740] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18128f29308041af86bec1279a210154, State: Running, Role: LEADER
I20260709 13:04:10.789916 11507 consensus_queue.cc:260] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.791163 11507 raft_consensus.cc:3060] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:10.798884 11556 consensus_queue.cc:1048] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:10.800089 11433 raft_consensus.cc:2468] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c6a18a2dea4bfb9ff104b548a44a2e in term 2.
I20260709 13:04:10.800899 11507 raft_consensus.cc:2468] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c6a18a2dea4bfb9ff104b548a44a2e in term 2.
I20260709 13:04:10.801308 11588 raft_consensus.cc:993] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232: : Instructing follower 18128f29308041af86bec1279a210154 to start an election
I20260709 13:04:10.801443 11322 leader_election.cc:304] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36727bb2204243fa870d56382f5d6232, c6c6a18a2dea4bfb9ff104b548a44a2e; no voters: 
I20260709 13:04:10.801790 11588 raft_consensus.cc:1081] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 1 LEADER]: Signalling peer 18128f29308041af86bec1279a210154 to start an election
I20260709 13:04:10.802464 11556 raft_consensus.cc:2804] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:10.802995 11556 raft_consensus.cc:697] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 LEADER]: Becoming Leader. State: Replica: c6c6a18a2dea4bfb9ff104b548a44a2e, State: Running, Role: LEADER
I20260709 13:04:10.803902 11506 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7555ff6ec65743eaadeb769926ba9072"
dest_uuid: "18128f29308041af86bec1279a210154"
 from {username='slave'} at 127.0.0.1:42082
I20260709 13:04:10.804683 11506 raft_consensus.cc:493] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:10.805171 11506 raft_consensus.cc:3060] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:10.803946 11556 consensus_queue.cc:237] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.818960 11506 raft_consensus.cc:515] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.821731 11506 leader_election.cc:290] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [CANDIDATE]: Term 2 election: Requested vote from peers c6c6a18a2dea4bfb9ff104b548a44a2e (127.0.107.193:46281), 36727bb2204243fa870d56382f5d6232 (127.0.107.194:38395)
I20260709 13:04:10.823132 11358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7555ff6ec65743eaadeb769926ba9072" candidate_uuid: "18128f29308041af86bec1279a210154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e"
I20260709 13:04:10.823360 11432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7555ff6ec65743eaadeb769926ba9072" candidate_uuid: "18128f29308041af86bec1279a210154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36727bb2204243fa870d56382f5d6232"
I20260709 13:04:10.823918 11358 raft_consensus.cc:3060] T 7555ff6ec65743eaadeb769926ba9072 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:10.824009 11432 raft_consensus.cc:3055] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:10.824568 11432 raft_consensus.cc:740] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36727bb2204243fa870d56382f5d6232, State: Running, Role: LEADER
I20260709 13:04:10.825440 11432 consensus_queue.cc:260] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.826558 11432 raft_consensus.cc:3060] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:10.826053 11253 catalog_manager.cc:5697] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e reported cstate change: term changed from 1 to 2, leader changed from 18128f29308041af86bec1279a210154 (127.0.107.195) to c6c6a18a2dea4bfb9ff104b548a44a2e (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:10.832023 11358 raft_consensus.cc:2468] T 7555ff6ec65743eaadeb769926ba9072 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18128f29308041af86bec1279a210154 in term 2.
I20260709 13:04:10.833527 11473 leader_election.cc:304] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18128f29308041af86bec1279a210154, c6c6a18a2dea4bfb9ff104b548a44a2e; no voters: 
I20260709 13:04:10.834350 11552 raft_consensus.cc:2804] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:10.834854 11552 raft_consensus.cc:697] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [term 2 LEADER]: Becoming Leader. State: Replica: 18128f29308041af86bec1279a210154, State: Running, Role: LEADER
I20260709 13:04:10.835662 11432 raft_consensus.cc:2468] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18128f29308041af86bec1279a210154 in term 2.
I20260709 13:04:10.835816 11552 consensus_queue.cc:237] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:10.843823 11253 catalog_manager.cc:5697] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 reported cstate change: term changed from 1 to 2, leader changed from 36727bb2204243fa870d56382f5d6232 (127.0.107.194) to 18128f29308041af86bec1279a210154 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "18128f29308041af86bec1279a210154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:10.933293 11583 raft_consensus.cc:993] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154: : Instructing follower c6c6a18a2dea4bfb9ff104b548a44a2e to start an election
I20260709 13:04:10.933780 11552 raft_consensus.cc:1081] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 1 LEADER]: Signalling peer c6c6a18a2dea4bfb9ff104b548a44a2e to start an election
I20260709 13:04:10.935683 11358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de4f64cdc3c4412a8dadbce64c41aa95"
dest_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e"
 from {username='slave'} at 127.0.0.1:42984
I20260709 13:04:10.936266 11358 raft_consensus.cc:493] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:10.936579 11358 raft_consensus.cc:3060] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:10.941390 11358 raft_consensus.cc:515] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } }
I20260709 13:04:10.943011 11358 leader_election.cc:290] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [CANDIDATE]: Term 2 election: Requested vote from peers 18128f29308041af86bec1279a210154 (127.0.107.195:45253), 36727bb2204243fa870d56382f5d6232 (127.0.107.194:38395)
I20260709 13:04:10.943886 11506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4f64cdc3c4412a8dadbce64c41aa95" candidate_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18128f29308041af86bec1279a210154"
I20260709 13:04:10.944074 11432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4f64cdc3c4412a8dadbce64c41aa95" candidate_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36727bb2204243fa870d56382f5d6232"
I20260709 13:04:10.944548 11506 raft_consensus.cc:3055] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:10.944651 11432 raft_consensus.cc:3060] T de4f64cdc3c4412a8dadbce64c41aa95 P 36727bb2204243fa870d56382f5d6232 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:10.944867 11506 raft_consensus.cc:740] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18128f29308041af86bec1279a210154, State: Running, Role: LEADER
I20260709 13:04:10.945653 11506 consensus_queue.cc:260] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } }
I20260709 13:04:10.946569 11506 raft_consensus.cc:3060] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:10.949821 11432 raft_consensus.cc:2468] T de4f64cdc3c4412a8dadbce64c41aa95 P 36727bb2204243fa870d56382f5d6232 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c6a18a2dea4bfb9ff104b548a44a2e in term 2.
I20260709 13:04:10.951042 11322 leader_election.cc:304] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36727bb2204243fa870d56382f5d6232, c6c6a18a2dea4bfb9ff104b548a44a2e; no voters: 
I20260709 13:04:10.951541 11506 raft_consensus.cc:2468] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c6a18a2dea4bfb9ff104b548a44a2e in term 2.
I20260709 13:04:10.952028 11597 raft_consensus.cc:2804] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:10.952514 11597 raft_consensus.cc:697] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 LEADER]: Becoming Leader. State: Replica: c6c6a18a2dea4bfb9ff104b548a44a2e, State: Running, Role: LEADER
I20260709 13:04:10.953338 11597 consensus_queue.cc:237] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } }
I20260709 13:04:10.959486 11253 catalog_manager.cc:5697] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e reported cstate change: term changed from 1 to 2, leader changed from 18128f29308041af86bec1279a210154 (127.0.107.195) to c6c6a18a2dea4bfb9ff104b548a44a2e (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.164095   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:04:11.165639   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:04:11.166014   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:04:11.178099 11358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4ad2d051737416dbdd6abc59bff9583"
dest_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e"
mode: GRACEFUL
new_leader_uuid: "36727bb2204243fa870d56382f5d6232"
 from {username='slave'} at 127.0.0.1:42992
I20260709 13:04:11.178673 11358 raft_consensus.cc:606] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 LEADER]: Received request to transfer leadership to TS 36727bb2204243fa870d56382f5d6232
I20260709 13:04:11.179949   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:04:11.314260 11432 raft_consensus.cc:1275] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 2 FOLLOWER]: Refusing update from remote peer 18128f29308041af86bec1279a210154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:11.315743 11552 consensus_queue.cc:1048] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:11.328569 11358 raft_consensus.cc:1275] T 7555ff6ec65743eaadeb769926ba9072 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 FOLLOWER]: Refusing update from remote peer 18128f29308041af86bec1279a210154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:11.330050 11552 consensus_queue.cc:1048] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:11.392733 11506 raft_consensus.cc:1275] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 2 FOLLOWER]: Refusing update from remote peer c6c6a18a2dea4bfb9ff104b548a44a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:11.394019 11597 consensus_queue.cc:1048] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:11.397559 11432 raft_consensus.cc:1275] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [term 2 FOLLOWER]: Refusing update from remote peer c6c6a18a2dea4bfb9ff104b548a44a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:11.398985 11597 consensus_queue.cc:1048] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:11.406447 11579 raft_consensus.cc:993] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e: : Instructing follower 36727bb2204243fa870d56382f5d6232 to start an election
I20260709 13:04:11.406955 11579 raft_consensus.cc:1081] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 LEADER]: Signalling peer 36727bb2204243fa870d56382f5d6232 to start an election
I20260709 13:04:11.409971 11432 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4ad2d051737416dbdd6abc59bff9583"
dest_uuid: "36727bb2204243fa870d56382f5d6232"
 from {username='slave'} at 127.0.0.1:46752
I20260709 13:04:11.410569 11432 raft_consensus.cc:493] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:11.410930 11432 raft_consensus.cc:3060] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:11.416327 11432 raft_consensus.cc:515] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:11.417971 11432 leader_election.cc:290] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [CANDIDATE]: Term 3 election: Requested vote from peers c6c6a18a2dea4bfb9ff104b548a44a2e (127.0.107.193:46281), 18128f29308041af86bec1279a210154 (127.0.107.195:45253)
I20260709 13:04:11.418872 11358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ad2d051737416dbdd6abc59bff9583" candidate_uuid: "36727bb2204243fa870d56382f5d6232" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e"
I20260709 13:04:11.419090 11506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ad2d051737416dbdd6abc59bff9583" candidate_uuid: "36727bb2204243fa870d56382f5d6232" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18128f29308041af86bec1279a210154"
I20260709 13:04:11.419570 11358 raft_consensus.cc:3055] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:11.419705 11506 raft_consensus.cc:3060] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:11.419960 11358 raft_consensus.cc:740] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6c6a18a2dea4bfb9ff104b548a44a2e, State: Running, Role: LEADER
I20260709 13:04:11.421043 11358 consensus_queue.cc:260] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:11.421989 11358 raft_consensus.cc:3060] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:11.425781 11506 raft_consensus.cc:2468] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36727bb2204243fa870d56382f5d6232 in term 3.
I20260709 13:04:11.426803 11396 leader_election.cc:304] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18128f29308041af86bec1279a210154, 36727bb2204243fa870d56382f5d6232; no voters: 
I20260709 13:04:11.426888 11358 raft_consensus.cc:2468] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36727bb2204243fa870d56382f5d6232 in term 3.
I20260709 13:04:11.427589 11603 raft_consensus.cc:2804] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:11.428623 11603 raft_consensus.cc:697] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [term 3 LEADER]: Becoming Leader. State: Replica: 36727bb2204243fa870d56382f5d6232, State: Running, Role: LEADER
I20260709 13:04:11.429344 11603 consensus_queue.cc:237] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } }
I20260709 13:04:11.435389 11253 catalog_manager.cc:5697] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 reported cstate change: term changed from 2 to 3, leader changed from c6c6a18a2dea4bfb9ff104b548a44a2e (127.0.107.193) to 36727bb2204243fa870d56382f5d6232 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "36727bb2204243fa870d56382f5d6232" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c6a18a2dea4bfb9ff104b548a44a2e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36727bb2204243fa870d56382f5d6232" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18128f29308041af86bec1279a210154" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.533957   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:04:11.554669   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:11.555356   431 tablet_replica.cc:333] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e: stopping tablet replica
I20260709 13:04:11.555932   431 raft_consensus.cc:2243] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.556332   431 raft_consensus.cc:2272] T c4ad2d051737416dbdd6abc59bff9583 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.558478   431 tablet_replica.cc:333] T 7555ff6ec65743eaadeb769926ba9072 P c6c6a18a2dea4bfb9ff104b548a44a2e: stopping tablet replica
I20260709 13:04:11.558960   431 raft_consensus.cc:2243] T 7555ff6ec65743eaadeb769926ba9072 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.559430   431 raft_consensus.cc:2272] T 7555ff6ec65743eaadeb769926ba9072 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.562055   431 tablet_replica.cc:333] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e: stopping tablet replica
I20260709 13:04:11.562520   431 raft_consensus.cc:2243] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:11.563321   431 raft_consensus.cc:2272] T a57715a2ef8e49a784aa0beb24f79e3a P c6c6a18a2dea4bfb9ff104b548a44a2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.565403   431 tablet_replica.cc:333] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e: stopping tablet replica
I20260709 13:04:11.565896   431 raft_consensus.cc:2243] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:11.566478   431 pending_rounds.cc:70] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e: Trying to abort 1 pending ops.
I20260709 13:04:11.566633   431 pending_rounds.cc:77] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634819911573504 op_type: NO_OP noop_request { }
I20260709 13:04:11.566949   431 raft_consensus.cc:2889] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:11.567284   431 raft_consensus.cc:2272] T de4f64cdc3c4412a8dadbce64c41aa95 P c6c6a18a2dea4bfb9ff104b548a44a2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.581138   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:04:11.593125   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:04:11.614034   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:11.614703   431 tablet_replica.cc:333] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232: stopping tablet replica
I20260709 13:04:11.615409   431 raft_consensus.cc:2243] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:11.616016   431 pending_rounds.cc:70] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232: Trying to abort 1 pending ops.
I20260709 13:04:11.616189   431 pending_rounds.cc:77] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305634821861761024 op_type: NO_OP noop_request { }
I20260709 13:04:11.616430   431 raft_consensus.cc:2889] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:11.616690   431 raft_consensus.cc:2272] T c4ad2d051737416dbdd6abc59bff9583 P 36727bb2204243fa870d56382f5d6232 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.619689   431 tablet_replica.cc:333] T a57715a2ef8e49a784aa0beb24f79e3a P 36727bb2204243fa870d56382f5d6232: stopping tablet replica
I20260709 13:04:11.620237   431 raft_consensus.cc:2243] T a57715a2ef8e49a784aa0beb24f79e3a P 36727bb2204243fa870d56382f5d6232 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.620859   431 raft_consensus.cc:2272] T a57715a2ef8e49a784aa0beb24f79e3a P 36727bb2204243fa870d56382f5d6232 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.623292   431 tablet_replica.cc:333] T de4f64cdc3c4412a8dadbce64c41aa95 P 36727bb2204243fa870d56382f5d6232: stopping tablet replica
I20260709 13:04:11.623839   431 raft_consensus.cc:2243] T de4f64cdc3c4412a8dadbce64c41aa95 P 36727bb2204243fa870d56382f5d6232 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.624264   431 raft_consensus.cc:2272] T de4f64cdc3c4412a8dadbce64c41aa95 P 36727bb2204243fa870d56382f5d6232 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.626014   431 tablet_replica.cc:333] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232: stopping tablet replica
I20260709 13:04:11.626480   431 raft_consensus.cc:2243] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.626906   431 raft_consensus.cc:2272] T 7555ff6ec65743eaadeb769926ba9072 P 36727bb2204243fa870d56382f5d6232 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.638912   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:04:11.650563   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:04:11.668640   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:11.669278   431 tablet_replica.cc:333] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154: stopping tablet replica
I20260709 13:04:11.669857   431 raft_consensus.cc:2243] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.670289   431 raft_consensus.cc:2272] T c4ad2d051737416dbdd6abc59bff9583 P 18128f29308041af86bec1279a210154 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.672382   431 tablet_replica.cc:333] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154: stopping tablet replica
I20260709 13:04:11.672850   431 raft_consensus.cc:2243] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:11.673596   431 raft_consensus.cc:2272] T 7555ff6ec65743eaadeb769926ba9072 P 18128f29308041af86bec1279a210154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.675786   431 tablet_replica.cc:333] T a57715a2ef8e49a784aa0beb24f79e3a P 18128f29308041af86bec1279a210154: stopping tablet replica
I20260709 13:04:11.676232   431 raft_consensus.cc:2243] T a57715a2ef8e49a784aa0beb24f79e3a P 18128f29308041af86bec1279a210154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.676589   431 raft_consensus.cc:2272] T a57715a2ef8e49a784aa0beb24f79e3a P 18128f29308041af86bec1279a210154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.678535   431 tablet_replica.cc:333] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154: stopping tablet replica
I20260709 13:04:11.678946   431 raft_consensus.cc:2243] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.679351   431 raft_consensus.cc:2272] T de4f64cdc3c4412a8dadbce64c41aa95 P 18128f29308041af86bec1279a210154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.701212   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:11.712788   431 master.cc:562] Master@127.0.107.254:37089 shutting down...
I20260709 13:04:11.728122   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:11.728623   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.728888   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9a983e5c839b43f9a9dfc865ec6f5fdd: stopping tablet replica
I20260709 13:04:11.747170   431 master.cc:584] Master@127.0.107.254:37089 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2783 ms)
[----------] 6 tests from LeaderRebalancerTest (306297 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:04:11.774190   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:40827
I20260709 13:04:11.775367   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:11.780504 11609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:11.780524 11610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:11.782188 11612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:11.783046   431 server_base.cc:1061] running on GCE node
I20260709 13:04:11.784021   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:11.784215   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:11.784323   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602251784313 us; error 0 us; skew 500 ppm
I20260709 13:04:11.784812   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:11.787120   431 webserver.cc:533] Webserver started at http://127.0.107.254:34903/ using document root <none> and password file <none>
I20260709 13:04:11.787663   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:11.787823   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:11.788038   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:11.789034   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/master-0-root/instance:
uuid: "39080440bce84283b60f9f14454a2889"
format_stamp: "Formatted at 2026-07-09 13:04:11 on dist-test-slave-zhw8"
I20260709 13:04:11.793574   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:04:11.797232 11617 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:11.798185   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:04:11.798514   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/master-0-root
uuid: "39080440bce84283b60f9f14454a2889"
format_stamp: "Formatted at 2026-07-09 13:04:11 on dist-test-slave-zhw8"
I20260709 13:04:11.798813   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:11.830731   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:11.832464   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:11.870074   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:40827
I20260709 13:04:11.870173 11668 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:40827 every 8 connection(s)
I20260709 13:04:11.874495 11669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:11.885998 11669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889: Bootstrap starting.
I20260709 13:04:11.890535 11669 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.895169 11669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889: No bootstrap required, opened a new log
I20260709 13:04:11.897205 11669 raft_consensus.cc:359] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39080440bce84283b60f9f14454a2889" member_type: VOTER }
I20260709 13:04:11.897590 11669 raft_consensus.cc:385] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.897773 11669 raft_consensus.cc:740] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39080440bce84283b60f9f14454a2889, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.898368 11669 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39080440bce84283b60f9f14454a2889" member_type: VOTER }
I20260709 13:04:11.898775 11669 raft_consensus.cc:399] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:11.898973 11669 raft_consensus.cc:493] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:11.899171 11669 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.903887 11669 raft_consensus.cc:515] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39080440bce84283b60f9f14454a2889" member_type: VOTER }
I20260709 13:04:11.904333 11669 leader_election.cc:304] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39080440bce84283b60f9f14454a2889; no voters: 
I20260709 13:04:11.905445 11669 leader_election.cc:290] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:11.905769 11672 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.907191 11672 raft_consensus.cc:697] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [term 1 LEADER]: Becoming Leader. State: Replica: 39080440bce84283b60f9f14454a2889, State: Running, Role: LEADER
I20260709 13:04:11.907914 11672 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39080440bce84283b60f9f14454a2889" member_type: VOTER }
I20260709 13:04:11.908401 11669 sys_catalog.cc:565] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:11.910751 11673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "39080440bce84283b60f9f14454a2889" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39080440bce84283b60f9f14454a2889" member_type: VOTER } }
I20260709 13:04:11.910751 11674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39080440bce84283b60f9f14454a2889. Latest consensus state: current_term: 1 leader_uuid: "39080440bce84283b60f9f14454a2889" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39080440bce84283b60f9f14454a2889" member_type: VOTER } }
I20260709 13:04:11.911592 11673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:11.911698 11674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:11.914243 11677 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:11.918967 11677 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:11.925741   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:11.928514 11677 catalog_manager.cc:1383] Generated new cluster ID: 56018fe1c14f45e793ede9dde72867fc
I20260709 13:04:11.928807 11677 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:11.954739 11677 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:11.956120 11677 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:11.970197 11677 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889: Generated new TSK 0
I20260709 13:04:11.970804 11677 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:11.993734   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:12.000136 11690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:12.001255 11691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:12.005432 11693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:12.005474   431 server_base.cc:1061] running on GCE node
I20260709 13:04:12.007011   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:12.007292   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:12.007476   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602252007450 us; error 0 us; skew 500 ppm
I20260709 13:04:12.008025   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:12.010910   431 webserver.cc:533] Webserver started at http://127.0.107.193:44089/ using document root <none> and password file <none>
I20260709 13:04:12.011471   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:12.011687   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:12.011963   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:12.013073   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/ts-0-root/instance:
uuid: "3ad798acb86a46218d2b7eb79ab128b1"
format_stamp: "Formatted at 2026-07-09 13:04:12 on dist-test-slave-zhw8"
I20260709 13:04:12.018746   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:04:12.022607 11698 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:12.023545   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:12.023878   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/ts-0-root
uuid: "3ad798acb86a46218d2b7eb79ab128b1"
format_stamp: "Formatted at 2026-07-09 13:04:12 on dist-test-slave-zhw8"
I20260709 13:04:12.024195   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:12.042953   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:12.044124   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:12.045612   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:12.047943   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:12.048178   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:12.048440   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:12.048615   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:12.086391   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:35965
I20260709 13:04:12.086491 11760 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:35965 every 8 connection(s)
I20260709 13:04:12.091503   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:12.099346 11765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:12.101261 11766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:12.104470 11768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:12.106338   431 server_base.cc:1061] running on GCE node
I20260709 13:04:12.106622 11761 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40827
I20260709 13:04:12.107098 11761 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:12.107419   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:12.107686   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:12.107868   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602252107851 us; error 0 us; skew 500 ppm
I20260709 13:04:12.107965 11761 heartbeater.cc:507] Master 127.0.107.254:40827 requested a full tablet report, sending...
I20260709 13:04:12.108559   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:12.110849 11634 ts_manager.cc:194] Registered new tserver with Master: 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965)
I20260709 13:04:12.112389   431 webserver.cc:533] Webserver started at http://127.0.107.194:39049/ using document root <none> and password file <none>
I20260709 13:04:12.113060   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:12.113267   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:12.113395 11634 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48480
I20260709 13:04:12.113552   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:12.114976   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/ts-1-root/instance:
uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
format_stamp: "Formatted at 2026-07-09 13:04:12 on dist-test-slave-zhw8"
I20260709 13:04:12.119663   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:12.123477 11773 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:12.124419   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:04:12.124774   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/ts-1-root
uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
format_stamp: "Formatted at 2026-07-09 13:04:12 on dist-test-slave-zhw8"
I20260709 13:04:12.125164   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:12.145731   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:12.147122   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:12.148742   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:12.151082   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:12.151357   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:04:12.151620   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:12.151830   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:12.193082   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:41983
I20260709 13:04:12.193202 11835 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:41983 every 8 connection(s)
I20260709 13:04:12.198360   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:12.206624 11839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:12.208722 11840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:12.208911 11836 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40827
I20260709 13:04:12.209378 11836 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:12.210644 11836 heartbeater.cc:507] Master 127.0.107.254:40827 requested a full tablet report, sending...
W20260709 13:04:12.212630 11842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:12.213228   431 server_base.cc:1061] running on GCE node
I20260709 13:04:12.213356 11634 ts_manager.cc:194] Registered new tserver with Master: 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:12.214368   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:12.214635   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:12.214847   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602252214827 us; error 0 us; skew 500 ppm
I20260709 13:04:12.215296 11634 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48488
I20260709 13:04:12.215703   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:12.218307   431 webserver.cc:533] Webserver started at http://127.0.107.195:33111/ using document root <none> and password file <none>
I20260709 13:04:12.218823   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:12.218977   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:12.219177   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:12.220280   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/ts-2-root/instance:
uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
format_stamp: "Formatted at 2026-07-09 13:04:12 on dist-test-slave-zhw8"
I20260709 13:04:12.224702   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:12.229223 11847 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:12.230304   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:04:12.230757   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/ts-2-root
uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
format_stamp: "Formatted at 2026-07-09 13:04:12 on dist-test-slave-zhw8"
I20260709 13:04:12.231220   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601945298557-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:12.246179   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:12.247283   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:12.248716   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:12.251089   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:12.251389   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:04:12.251672   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:12.251852   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:12.295121   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:34455
I20260709 13:04:12.295269 11909 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:34455 every 8 connection(s)
I20260709 13:04:12.309671 11910 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40827
I20260709 13:04:12.310232 11910 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:12.311024 11910 heartbeater.cc:507] Master 127.0.107.254:40827 requested a full tablet report, sending...
I20260709 13:04:12.313292 11634 ts_manager.cc:194] Registered new tserver with Master: d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:12.313706   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015210965s
I20260709 13:04:12.314698 11634 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48490
I20260709 13:04:12.340575 11634 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48498:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:12.343083 11634 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:12.423436 11726 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5168c42aa6410e869fa98334a3ec27 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:12.424850 11726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5168c42aa6410e869fa98334a3ec27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.424512 11801 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5168c42aa6410e869fa98334a3ec27 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:12.425937 11801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5168c42aa6410e869fa98334a3ec27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.428294 11721 tablet_service.cc:1511] Processing CreateTablet for tablet fbef4a23506b4e9494f9f021b00eb4bc (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:12.429693 11721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbef4a23506b4e9494f9f021b00eb4bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.429371 11723 tablet_service.cc:1511] Processing CreateTablet for tablet b2d5e43b25f94e5caefe9e5229f7b4c2 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:12.430815 11723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2d5e43b25f94e5caefe9e5229f7b4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.428329 11724 tablet_service.cc:1511] Processing CreateTablet for tablet f1aab8dac20f46d08a9c0ca1b39dd678 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:12.432344 11722 tablet_service.cc:1511] Processing CreateTablet for tablet b784881fc1f242669b6ed0bf16a79b77 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:12.433329 11724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1aab8dac20f46d08a9c0ca1b39dd678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.434515 11720 tablet_service.cc:1511] Processing CreateTablet for tablet c45240651efa4d34bea3f0f3c17695b1 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:12.435972 11720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c45240651efa4d34bea3f0f3c17695b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.437925 11799 tablet_service.cc:1511] Processing CreateTablet for tablet f1aab8dac20f46d08a9c0ca1b39dd678 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:12.438405 11719 tablet_service.cc:1511] Processing CreateTablet for tablet 09934c1c037240c196b3bae228867d4b (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:12.439368 11799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1aab8dac20f46d08a9c0ca1b39dd678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.439726 11719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09934c1c037240c196b3bae228867d4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.443425 11725 tablet_service.cc:1511] Processing CreateTablet for tablet 70f82bef26544ababc7fdd6ec974d800 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:12.444824 11725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70f82bef26544ababc7fdd6ec974d800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.445719 11798 tablet_service.cc:1511] Processing CreateTablet for tablet b2d5e43b25f94e5caefe9e5229f7b4c2 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:12.434624 11800 tablet_service.cc:1511] Processing CreateTablet for tablet 70f82bef26544ababc7fdd6ec974d800 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:12.448122 11722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b784881fc1f242669b6ed0bf16a79b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.448414 11797 tablet_service.cc:1511] Processing CreateTablet for tablet b784881fc1f242669b6ed0bf16a79b77 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:12.450567 11796 tablet_service.cc:1511] Processing CreateTablet for tablet fbef4a23506b4e9494f9f021b00eb4bc (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:12.452858 11795 tablet_service.cc:1511] Processing CreateTablet for tablet c45240651efa4d34bea3f0f3c17695b1 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:12.447082 11798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2d5e43b25f94e5caefe9e5229f7b4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.455569 11800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70f82bef26544ababc7fdd6ec974d800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.457122 11797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b784881fc1f242669b6ed0bf16a79b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.457487 11718 tablet_service.cc:1511] Processing CreateTablet for tablet 1289552d3a3549b5b5112d882715c129 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:12.458856 11718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1289552d3a3549b5b5112d882715c129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.459604 11796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbef4a23506b4e9494f9f021b00eb4bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.463605 11795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c45240651efa4d34bea3f0f3c17695b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.468907 11794 tablet_service.cc:1511] Processing CreateTablet for tablet 09934c1c037240c196b3bae228867d4b (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:12.470383 11794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09934c1c037240c196b3bae228867d4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.469998 11875 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5168c42aa6410e869fa98334a3ec27 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:12.472328 11875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5168c42aa6410e869fa98334a3ec27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.477648 11874 tablet_service.cc:1511] Processing CreateTablet for tablet 70f82bef26544ababc7fdd6ec974d800 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:12.479059 11874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70f82bef26544ababc7fdd6ec974d800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.483214 11873 tablet_service.cc:1511] Processing CreateTablet for tablet f1aab8dac20f46d08a9c0ca1b39dd678 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:12.484799 11873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1aab8dac20f46d08a9c0ca1b39dd678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.486646 11872 tablet_service.cc:1511] Processing CreateTablet for tablet b2d5e43b25f94e5caefe9e5229f7b4c2 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:12.488057 11872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2d5e43b25f94e5caefe9e5229f7b4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.488586 11793 tablet_service.cc:1511] Processing CreateTablet for tablet 1289552d3a3549b5b5112d882715c129 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:12.489908 11793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1289552d3a3549b5b5112d882715c129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.489917 11871 tablet_service.cc:1511] Processing CreateTablet for tablet b784881fc1f242669b6ed0bf16a79b77 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:12.490989 11870 tablet_service.cc:1511] Processing CreateTablet for tablet fbef4a23506b4e9494f9f021b00eb4bc (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:12.492086 11871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b784881fc1f242669b6ed0bf16a79b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.492720 11870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbef4a23506b4e9494f9f021b00eb4bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.509771 11869 tablet_service.cc:1511] Processing CreateTablet for tablet c45240651efa4d34bea3f0f3c17695b1 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:12.512343 11868 tablet_service.cc:1511] Processing CreateTablet for tablet 09934c1c037240c196b3bae228867d4b (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:12.514914 11867 tablet_service.cc:1511] Processing CreateTablet for tablet 1289552d3a3549b5b5112d882715c129 (DEFAULT_TABLE table=test-workload [id=df0a9110222b4f63918e553dddd1f8b6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:12.516299 11869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c45240651efa4d34bea3f0f3c17695b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.518558 11867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1289552d3a3549b5b5112d882715c129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.519637 11868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09934c1c037240c196b3bae228867d4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:12.559850 11925 tablet_bootstrap.cc:492] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
I20260709 13:04:12.586845 11925 tablet_bootstrap.cc:654] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.597079 11927 tablet_bootstrap.cc:492] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
I20260709 13:04:12.601550 11926 tablet_bootstrap.cc:492] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
I20260709 13:04:12.611227 11926 tablet_bootstrap.cc:654] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.625133 11927 tablet_bootstrap.cc:654] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.657299 11926 tablet_bootstrap.cc:492] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:12.657927 11926 ts_tablet_manager.cc:1403] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.016s
I20260709 13:04:12.660816 11926 raft_consensus.cc:359] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.661566 11926 raft_consensus.cc:385] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.661857 11926 raft_consensus.cc:740] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.662612 11926 consensus_queue.cc:260] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.664804 11910 heartbeater.cc:499] Master 127.0.107.254:40827 was elected leader, sending a full tablet report...
I20260709 13:04:12.665444 11927 tablet_bootstrap.cc:492] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:12.665350 11926 ts_tablet_manager.cc:1434] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:04:12.666095 11927 ts_tablet_manager.cc:1403] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.000s
I20260709 13:04:12.666873 11926 tablet_bootstrap.cc:492] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
I20260709 13:04:12.669296 11927 raft_consensus.cc:359] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.670178 11927 raft_consensus.cc:385] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.670415 11925 tablet_bootstrap.cc:492] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
I20260709 13:04:12.670465 11927 raft_consensus.cc:740] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.671216 11925 ts_tablet_manager.cc:1403] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.112s	user 0.018s	sys 0.010s
I20260709 13:04:12.671970 11927 consensus_queue.cc:260] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.673959 11925 raft_consensus.cc:359] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.674989 11925 raft_consensus.cc:385] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.675475 11925 raft_consensus.cc:740] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.676406 11925 consensus_queue.cc:260] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.681084 11836 heartbeater.cc:499] Master 127.0.107.254:40827 was elected leader, sending a full tablet report...
I20260709 13:04:12.683642 11926 tablet_bootstrap.cc:654] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.688292 11927 ts_tablet_manager.cc:1434] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.012s
I20260709 13:04:12.689517 11927 tablet_bootstrap.cc:492] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
I20260709 13:04:12.697955 11925 ts_tablet_manager.cc:1434] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.026s	user 0.014s	sys 0.011s
I20260709 13:04:12.699028 11927 tablet_bootstrap.cc:654] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.699075 11761 heartbeater.cc:499] Master 127.0.107.254:40827 was elected leader, sending a full tablet report...
I20260709 13:04:12.700320 11925 tablet_bootstrap.cc:492] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
I20260709 13:04:12.707213 11925 tablet_bootstrap.cc:654] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.715320 11925 tablet_bootstrap.cc:492] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
I20260709 13:04:12.715618 11927 tablet_bootstrap.cc:492] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:12.715893 11925 ts_tablet_manager.cc:1403] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:04:12.716306 11927 ts_tablet_manager.cc:1403] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.001s
I20260709 13:04:12.717243 11926 tablet_bootstrap.cc:492] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:12.717772 11926 ts_tablet_manager.cc:1403] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.000s
I20260709 13:04:12.719127 11925 raft_consensus.cc:359] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.719986 11925 raft_consensus.cc:385] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.719658 11927 raft_consensus.cc:359] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.720319 11925 raft_consensus.cc:740] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.720512 11927 raft_consensus.cc:385] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.720957 11927 raft_consensus.cc:740] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.721203 11925 consensus_queue.cc:260] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.721887 11927 consensus_queue.cc:260] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.724431 11927 ts_tablet_manager.cc:1434] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:04:12.724936 11925 ts_tablet_manager.cc:1434] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:12.725523 11927 tablet_bootstrap.cc:492] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
I20260709 13:04:12.726059 11925 tablet_bootstrap.cc:492] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
I20260709 13:04:12.720963 11926 raft_consensus.cc:359] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.727603 11926 raft_consensus.cc:385] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.727933 11926 raft_consensus.cc:740] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.728791 11926 consensus_queue.cc:260] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.731168 11926 ts_tablet_manager.cc:1434] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:04:12.732247 11926 tablet_bootstrap.cc:492] T c45240651efa4d34bea3f0f3c17695b1 P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
I20260709 13:04:12.734586 11925 tablet_bootstrap.cc:654] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.738874 11926 tablet_bootstrap.cc:654] T c45240651efa4d34bea3f0f3c17695b1 P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.744987 11927 tablet_bootstrap.cc:654] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.745193 11925 tablet_bootstrap.cc:492] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
I20260709 13:04:12.745339 11931 raft_consensus.cc:493] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.746031 11925 ts_tablet_manager.cc:1403] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 13:04:12.746083 11931 raft_consensus.cc:515] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.749521 11925 raft_consensus.cc:359] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.750092 11925 raft_consensus.cc:385] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.750483 11925 raft_consensus.cc:740] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.750627 11927 tablet_bootstrap.cc:492] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:12.751307 11927 ts_tablet_manager.cc:1403] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.000s
I20260709 13:04:12.751585 11925 consensus_queue.cc:260] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.754478 11927 raft_consensus.cc:359] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.754987 11925 ts_tablet_manager.cc:1434] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.003s
I20260709 13:04:12.755364 11927 raft_consensus.cc:385] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.755764 11927 raft_consensus.cc:740] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.756330 11925 tablet_bootstrap.cc:492] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
I20260709 13:04:12.756585 11927 consensus_queue.cc:260] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.760840 11927 ts_tablet_manager.cc:1434] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:12.761945 11927 tablet_bootstrap.cc:492] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
I20260709 13:04:12.765305 11925 tablet_bootstrap.cc:654] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.768814 11927 tablet_bootstrap.cc:654] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.774930 11931 leader_election.cc:290] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965)
I20260709 13:04:12.777988 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5168c42aa6410e869fa98334a3ec27" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
W20260709 13:04:12.779953 11850 leader_election.cc:343] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.786177 11927 tablet_bootstrap.cc:492] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:12.786818 11927 ts_tablet_manager.cc:1403] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 13:04:12.789716 11927 raft_consensus.cc:359] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.793753 11927 raft_consensus.cc:385] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.793429 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5168c42aa6410e869fa98334a3ec27" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:12.794449 11736 raft_consensus.cc:2468] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 0.
I20260709 13:04:12.795986 11848 leader_election.cc:304] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 4c1bdbc276ed41c4afad0e7bc4842046
I20260709 13:04:12.796952 11931 raft_consensus.cc:2804] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:12.797528 11931 raft_consensus.cc:493] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.797773 11927 raft_consensus.cc:740] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.798086 11931 raft_consensus.cc:3060] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.798930 11927 consensus_queue.cc:260] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.802932 11925 tablet_bootstrap.cc:492] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
I20260709 13:04:12.803601 11925 ts_tablet_manager.cc:1403] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.016s
I20260709 13:04:12.804445 11932 raft_consensus.cc:493] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.805079 11932 raft_consensus.cc:515] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.806896 11931 raft_consensus.cc:515] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.806931 11925 raft_consensus.cc:359] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.808205 11932 leader_election.cc:290] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:12.808368 11925 raft_consensus.cc:385] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.808871 11925 raft_consensus.cc:740] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.810156 11927 ts_tablet_manager.cc:1434] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:04:12.809830 11925 consensus_queue.cc:260] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.810299 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5168c42aa6410e869fa98334a3ec27" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:12.810949 11736 raft_consensus.cc:3060] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.811318 11927 tablet_bootstrap.cc:492] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
I20260709 13:04:12.812392 11925 ts_tablet_manager.cc:1434] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:04:12.813419 11925 tablet_bootstrap.cc:492] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
I20260709 13:04:12.818339 11927 tablet_bootstrap.cc:654] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.803695 11926 tablet_bootstrap.cc:492] T c45240651efa4d34bea3f0f3c17695b1 P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:12.819157 11945 raft_consensus.cc:493] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.819813 11926 ts_tablet_manager.cc:1403] T c45240651efa4d34bea3f0f3c17695b1 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.088s	user 0.030s	sys 0.029s
I20260709 13:04:12.821678 11736 raft_consensus.cc:2468] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 1.
I20260709 13:04:12.823128 11848 leader_election.cc:304] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:12.824214 11926 raft_consensus.cc:359] T c45240651efa4d34bea3f0f3c17695b1 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.825210 11926 raft_consensus.cc:385] T c45240651efa4d34bea3f0f3c17695b1 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.825577 11926 raft_consensus.cc:740] T c45240651efa4d34bea3f0f3c17695b1 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.826670 11931 leader_election.cc:290] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965)
I20260709 13:04:12.826444 11926 consensus_queue.cc:260] T c45240651efa4d34bea3f0f3c17695b1 P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.827807 11931 raft_consensus.cc:2804] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:12.828351 11945 raft_consensus.cc:515] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.828945 11931 raft_consensus.cc:697] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Becoming Leader. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:12.830901 11945 leader_election.cc:290] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:12.821053 11925 tablet_bootstrap.cc:654] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.830641 11931 consensus_queue.cc:237] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.839469 11926 ts_tablet_manager.cc:1434] T c45240651efa4d34bea3f0f3c17695b1 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:04:12.870069 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5168c42aa6410e869fa98334a3ec27" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:12.870438 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbef4a23506b4e9494f9f021b00eb4bc" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:12.871105 11810 raft_consensus.cc:2468] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 0.
W20260709 13:04:12.871747 11850 leader_election.cc:343] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.873153 11850 leader_election.cc:304] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:12.874044 11948 raft_consensus.cc:2804] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:12.874318 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
W20260709 13:04:12.868032 11848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35965, user_credentials={real_user=slave}} blocked reactor thread for 45148.2us
W20260709 13:04:12.875799 11774 leader_election.cc:343] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.876382 11926 tablet_bootstrap.cc:492] T f1aab8dac20f46d08a9c0ca1b39dd678 P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
I20260709 13:04:12.874464 11948 raft_consensus.cc:493] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.879228 11948 raft_consensus.cc:3060] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.881592 11927 tablet_bootstrap.cc:492] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:12.882555 11927 ts_tablet_manager.cc:1403] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.072s	user 0.026s	sys 0.030s
I20260709 13:04:12.883682 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbef4a23506b4e9494f9f021b00eb4bc" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:12.884416 11736 raft_consensus.cc:2468] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 0.
I20260709 13:04:12.884775 11926 tablet_bootstrap.cc:654] T f1aab8dac20f46d08a9c0ca1b39dd678 P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.886070 11927 raft_consensus.cc:359] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.886921 11927 raft_consensus.cc:385] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.887259 11927 raft_consensus.cc:740] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.887717 11885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:12.888162 11927 consensus_queue.cc:260] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.890697 11927 ts_tablet_manager.cc:1434] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:04:12.891712 11927 tablet_bootstrap.cc:492] T f1aab8dac20f46d08a9c0ca1b39dd678 P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
W20260709 13:04:12.895496 11774 leader_election.cc:343] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.896034 11774 leader_election.cc:304] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046; no voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:12.898212 11927 tablet_bootstrap.cc:654] T f1aab8dac20f46d08a9c0ca1b39dd678 P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.896890 11932 raft_consensus.cc:2749] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:12.896591 11632 catalog_manager.cc:5697] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.899812 11948 raft_consensus.cc:515] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.902539 11925 tablet_bootstrap.cc:492] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
I20260709 13:04:12.903080 11925 ts_tablet_manager.cc:1403] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.090s	user 0.010s	sys 0.004s
I20260709 13:04:12.903733 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbef4a23506b4e9494f9f021b00eb4bc" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:12.904330 11736 raft_consensus.cc:3060] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.907090 11925 raft_consensus.cc:359] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.907896 11925 raft_consensus.cc:385] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.908213 11925 raft_consensus.cc:740] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.909091 11925 consensus_queue.cc:260] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.911599 11736 raft_consensus.cc:2468] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 1.
I20260709 13:04:12.912811 11848 leader_election.cc:304] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:12.913790 11947 raft_consensus.cc:2804] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:12.914345 11947 raft_consensus.cc:697] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Becoming Leader. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:12.914557 11925 ts_tablet_manager.cc:1434] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:12.915354 11947 consensus_queue.cc:237] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.916237 11925 tablet_bootstrap.cc:492] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
I20260709 13:04:12.918917 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbef4a23506b4e9494f9f021b00eb4bc" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:12.919692 11810 raft_consensus.cc:3060] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:12.921417 11682 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:12.923965 11933 raft_consensus.cc:493] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.924492 11933 raft_consensus.cc:515] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.929347 11948 leader_election.cc:290] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:12.927170 11933 leader_election.cc:290] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:12.929129 11810 raft_consensus.cc:2468] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 1.
I20260709 13:04:12.945425 11926 tablet_bootstrap.cc:492] T f1aab8dac20f46d08a9c0ca1b39dd678 P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:12.945986 11926 ts_tablet_manager.cc:1403] T f1aab8dac20f46d08a9c0ca1b39dd678 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.077s	user 0.020s	sys 0.028s
I20260709 13:04:12.946257 11925 tablet_bootstrap.cc:654] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.946508 11927 tablet_bootstrap.cc:492] T f1aab8dac20f46d08a9c0ca1b39dd678 P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:12.947045 11927 ts_tablet_manager.cc:1403] T f1aab8dac20f46d08a9c0ca1b39dd678 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.017s
I20260709 13:04:12.949173 11926 raft_consensus.cc:359] T f1aab8dac20f46d08a9c0ca1b39dd678 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.950012 11926 raft_consensus.cc:385] T f1aab8dac20f46d08a9c0ca1b39dd678 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.950212 11927 raft_consensus.cc:359] T f1aab8dac20f46d08a9c0ca1b39dd678 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.951092 11927 raft_consensus.cc:385] T f1aab8dac20f46d08a9c0ca1b39dd678 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.951781 11926 raft_consensus.cc:740] T f1aab8dac20f46d08a9c0ca1b39dd678 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.951854 11927 raft_consensus.cc:740] T f1aab8dac20f46d08a9c0ca1b39dd678 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.952725 11926 consensus_queue.cc:260] T f1aab8dac20f46d08a9c0ca1b39dd678 P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.953087 11927 consensus_queue.cc:260] T f1aab8dac20f46d08a9c0ca1b39dd678 P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.955363 11926 ts_tablet_manager.cc:1434] T f1aab8dac20f46d08a9c0ca1b39dd678 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.002s
I20260709 13:04:12.956415 11926 tablet_bootstrap.cc:492] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
I20260709 13:04:12.956326 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d5e43b25f94e5caefe9e5229f7b4c2" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:12.957816 11927 ts_tablet_manager.cc:1434] T f1aab8dac20f46d08a9c0ca1b39dd678 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
W20260709 13:04:12.957984 11701 leader_election.cc:343] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.958880 11927 tablet_bootstrap.cc:492] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
I20260709 13:04:12.963821 11926 tablet_bootstrap.cc:654] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.965556 11927 tablet_bootstrap.cc:654] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.969156 11885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d5e43b25f94e5caefe9e5229f7b4c2" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
W20260709 13:04:12.971311 11699 leader_election.cc:343] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.971887 11699 leader_election.cc:304] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1; no voters: 4c1bdbc276ed41c4afad0e7bc4842046, d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:12.972720 11933 raft_consensus.cc:2749] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:12.976584 11927 tablet_bootstrap.cc:492] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:12.977173 11927 ts_tablet_manager.cc:1403] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 13:04:12.980005 11927 raft_consensus.cc:359] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.980553 11927 raft_consensus.cc:385] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.980803 11927 raft_consensus.cc:740] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.981436 11927 consensus_queue.cc:260] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.983520 11927 ts_tablet_manager.cc:1434] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:12.987140 11926 tablet_bootstrap.cc:492] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:12.987871 11926 ts_tablet_manager.cc:1403] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.011s
I20260709 13:04:12.984567 11629 catalog_manager.cc:5697] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.986989 11925 tablet_bootstrap.cc:492] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
I20260709 13:04:12.988907 11925 ts_tablet_manager.cc:1403] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.001s
I20260709 13:04:12.991381 11926 raft_consensus.cc:359] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.992308 11926 raft_consensus.cc:385] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.992703 11926 raft_consensus.cc:740] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.992483 11925 raft_consensus.cc:359] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.993480 11925 raft_consensus.cc:385] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.993922 11925 raft_consensus.cc:740] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.993695 11926 consensus_queue.cc:260] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:12.987957 11927 tablet_bootstrap.cc:492] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
I20260709 13:04:12.998306 11926 ts_tablet_manager.cc:1434] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:04:13.000025 11926 tablet_bootstrap.cc:492] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
I20260709 13:04:12.999919 11925 consensus_queue.cc:260] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.000875 11927 tablet_bootstrap.cc:654] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.002837 11925 ts_tablet_manager.cc:1434] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:04:13.004081 11925 tablet_bootstrap.cc:492] T 09934c1c037240c196b3bae228867d4b P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
I20260709 13:04:13.008319 11926 tablet_bootstrap.cc:654] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.012985 11927 tablet_bootstrap.cc:492] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:13.013276 11925 tablet_bootstrap.cc:654] T 09934c1c037240c196b3bae228867d4b P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.013682 11927 ts_tablet_manager.cc:1403] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.005s
I20260709 13:04:13.017918 11927 raft_consensus.cc:359] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.019331 11927 raft_consensus.cc:385] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.019819 11927 raft_consensus.cc:740] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.021060 11927 consensus_queue.cc:260] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.024643 11927 ts_tablet_manager.cc:1434] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:04:13.025453 11926 tablet_bootstrap.cc:492] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:13.026034 11926 ts_tablet_manager.cc:1403] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.009s
I20260709 13:04:13.027266 11927 tablet_bootstrap.cc:492] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
I20260709 13:04:13.028543 11926 raft_consensus.cc:359] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.029155 11926 raft_consensus.cc:385] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.029417 11926 raft_consensus.cc:740] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.030020 11926 consensus_queue.cc:260] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.032160 11926 ts_tablet_manager.cc:1434] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:13.032233 11925 tablet_bootstrap.cc:492] T 09934c1c037240c196b3bae228867d4b P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
I20260709 13:04:13.032872 11925 ts_tablet_manager.cc:1403] T 09934c1c037240c196b3bae228867d4b P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.002s
I20260709 13:04:13.033319 11926 tablet_bootstrap.cc:492] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
I20260709 13:04:13.035998 11925 raft_consensus.cc:359] T 09934c1c037240c196b3bae228867d4b P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.036792 11925 raft_consensus.cc:385] T 09934c1c037240c196b3bae228867d4b P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.037139 11925 raft_consensus.cc:740] T 09934c1c037240c196b3bae228867d4b P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.038121 11925 consensus_queue.cc:260] T 09934c1c037240c196b3bae228867d4b P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.041378 11927 tablet_bootstrap.cc:654] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.041742 11926 tablet_bootstrap.cc:654] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.050778 11925 ts_tablet_manager.cc:1434] T 09934c1c037240c196b3bae228867d4b P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:04:13.052493 11925 tablet_bootstrap.cc:492] T c45240651efa4d34bea3f0f3c17695b1 P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
I20260709 13:04:13.060145 11926 tablet_bootstrap.cc:492] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:13.060844 11926 ts_tablet_manager.cc:1403] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.028s	user 0.022s	sys 0.004s
I20260709 13:04:13.062615 11925 tablet_bootstrap.cc:654] T c45240651efa4d34bea3f0f3c17695b1 P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.063985 11926 raft_consensus.cc:359] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.064930 11926 raft_consensus.cc:385] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.065307 11926 raft_consensus.cc:740] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.065783 11927 tablet_bootstrap.cc:492] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:13.066325 11927 ts_tablet_manager.cc:1403] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.012s
I20260709 13:04:13.066226 11926 consensus_queue.cc:260] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.068856 11926 ts_tablet_manager.cc:1434] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:13.069108 11925 tablet_bootstrap.cc:492] T c45240651efa4d34bea3f0f3c17695b1 P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
I20260709 13:04:13.069201 11927 raft_consensus.cc:359] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.069965 11927 raft_consensus.cc:385] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.070245 11927 raft_consensus.cc:740] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.070333 11926 tablet_bootstrap.cc:492] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
I20260709 13:04:13.070984 11927 consensus_queue.cc:260] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.073030 11927 ts_tablet_manager.cc:1434] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:13.069700 11925 ts_tablet_manager.cc:1403] T c45240651efa4d34bea3f0f3c17695b1 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.001s
I20260709 13:04:13.076133 11925 raft_consensus.cc:359] T c45240651efa4d34bea3f0f3c17695b1 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.076395 11947 raft_consensus.cc:493] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.076843 11925 raft_consensus.cc:385] T c45240651efa4d34bea3f0f3c17695b1 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.077157 11925 raft_consensus.cc:740] T c45240651efa4d34bea3f0f3c17695b1 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.076959 11947 raft_consensus.cc:515] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.077462 11926 tablet_bootstrap.cc:654] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.077936 11925 consensus_queue.cc:260] T c45240651efa4d34bea3f0f3c17695b1 P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.079798 11933 raft_consensus.cc:493] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.079952 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d5e43b25f94e5caefe9e5229f7b4c2" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:13.080305 11933 raft_consensus.cc:515] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.080718 11736 raft_consensus.cc:2468] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 0.
I20260709 13:04:13.081859 11848 leader_election.cc:304] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:13.082377 11933 leader_election.cc:290] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:13.082692 11948 raft_consensus.cc:2804] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.083097 11948 raft_consensus.cc:493] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.083449 11948 raft_consensus.cc:3060] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.086268 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1289552d3a3549b5b5112d882715c129" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:13.086927 11811 raft_consensus.cc:2468] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 0.
I20260709 13:04:13.088212 11701 leader_election.cc:304] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: 
I20260709 13:04:13.088279 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d5e43b25f94e5caefe9e5229f7b4c2" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:13.089205 11810 raft_consensus.cc:2468] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 0.
I20260709 13:04:13.079792 11947 leader_election.cc:290] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:13.089927 11933 raft_consensus.cc:2804] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.090206 11933 raft_consensus.cc:493] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.090409 11933 raft_consensus.cc:3060] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.092677 11925 ts_tablet_manager.cc:1434] T c45240651efa4d34bea3f0f3c17695b1 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:04:13.092916 11932 raft_consensus.cc:493] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.093654 11925 tablet_bootstrap.cc:492] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
I20260709 13:04:13.093567 11932 raft_consensus.cc:515] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.099476 11925 tablet_bootstrap.cc:654] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.100255 11885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1289552d3a3549b5b5112d882715c129" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:13.101208 11885 raft_consensus.cc:2468] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 0.
I20260709 13:04:13.106734 11932 leader_election.cc:290] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:13.109194 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f82bef26544ababc7fdd6ec974d800" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:13.112811 11933 raft_consensus.cc:515] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
W20260709 13:04:13.115947 11774 leader_election.cc:343] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.113540 11925 tablet_bootstrap.cc:492] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
I20260709 13:04:13.114204 11885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f82bef26544ababc7fdd6ec974d800" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:13.117656 11925 ts_tablet_manager.cc:1403] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.009s
I20260709 13:04:13.117674 11885 raft_consensus.cc:2468] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 0.
I20260709 13:04:13.118356 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1289552d3a3549b5b5112d882715c129" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:13.119204 11810 raft_consensus.cc:3060] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.120709 11925 raft_consensus.cc:359] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.121456 11925 raft_consensus.cc:385] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.121256 11948 raft_consensus.cc:515] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.121788 11774 leader_election.cc:304] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 3ad798acb86a46218d2b7eb79ab128b1
I20260709 13:04:13.122437 11933 leader_election.cc:290] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Requested vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:13.122859 11932 raft_consensus.cc:2804] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.123281 11932 raft_consensus.cc:493] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.123579 11932 raft_consensus.cc:3060] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.124845 11885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1289552d3a3549b5b5112d882715c129" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:13.125331 11885 raft_consensus.cc:3060] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.132699 11810 raft_consensus.cc:2468] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 1.
I20260709 13:04:13.132915 11885 raft_consensus.cc:2468] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 1.
I20260709 13:04:13.135426 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d5e43b25f94e5caefe9e5229f7b4c2" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:13.150004 11811 raft_consensus.cc:3060] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.150497 11701 leader_election.cc:304] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: 
I20260709 13:04:13.151587 11933 raft_consensus.cc:2804] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.152143 11933 raft_consensus.cc:697] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Becoming Leader. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:13.152715 11926 tablet_bootstrap.cc:492] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:13.153185 11926 ts_tablet_manager.cc:1403] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.083s	user 0.030s	sys 0.040s
I20260709 13:04:13.153079 11933 consensus_queue.cc:237] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.155637 11926 raft_consensus.cc:359] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.156276 11926 raft_consensus.cc:385] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.156502 11926 raft_consensus.cc:740] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.143080 11932 raft_consensus.cc:515] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.121894 11925 raft_consensus.cc:740] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.157150 11926 consensus_queue.cc:260] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.158201 11925 consensus_queue.cc:260] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.159193 11926 ts_tablet_manager.cc:1434] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:04:13.160115 11926 tablet_bootstrap.cc:492] T 09934c1c037240c196b3bae228867d4b P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
I20260709 13:04:13.160228 11925 ts_tablet_manager.cc:1434] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.005s
I20260709 13:04:13.160629 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f82bef26544ababc7fdd6ec974d800" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:13.161381 11735 raft_consensus.cc:3060] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.163880 11632 catalog_manager.cc:5697] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.165865 11943 raft_consensus.cc:493] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.135007 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d5e43b25f94e5caefe9e5229f7b4c2" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:13.166122 11926 tablet_bootstrap.cc:654] T 09934c1c037240c196b3bae228867d4b P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.166606 11736 raft_consensus.cc:3060] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.166451 11943 raft_consensus.cc:515] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.169005 11943 leader_election.cc:290] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:13.173556 11735 raft_consensus.cc:2468] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 1.
I20260709 13:04:13.174824 11885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45240651efa4d34bea3f0f3c17695b1" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:13.183142 11885 raft_consensus.cc:2468] T c45240651efa4d34bea3f0f3c17695b1 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 0.
I20260709 13:04:13.183642 11774 leader_election.cc:304] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: 
I20260709 13:04:13.177014 11736 raft_consensus.cc:2468] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 1.
I20260709 13:04:13.185097 11848 leader_election.cc:304] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:13.178249 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45240651efa4d34bea3f0f3c17695b1" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:13.186005 11943 raft_consensus.cc:2804] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.186194 11947 raft_consensus.cc:2804] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.186414 11734 raft_consensus.cc:2468] T c45240651efa4d34bea3f0f3c17695b1 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 0.
I20260709 13:04:13.181402 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f82bef26544ababc7fdd6ec974d800" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:13.187065 11947 raft_consensus.cc:697] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Becoming Leader. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:13.187610 11884 raft_consensus.cc:3060] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.144021 11948 leader_election.cc:290] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:13.188094 11947 consensus_queue.cc:237] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.191829 11774 leader_election.cc:304] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:13.198203 11933 raft_consensus.cc:493] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.198877 11933 raft_consensus.cc:515] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.206085 11933 leader_election.cc:290] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:13.207345 11885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1aab8dac20f46d08a9c0ca1b39dd678" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:13.209173 11885 raft_consensus.cc:2468] T f1aab8dac20f46d08a9c0ca1b39dd678 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 0.
I20260709 13:04:13.210565 11699 leader_election.cc:304] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:13.211845 11811 raft_consensus.cc:2468] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 1.
I20260709 13:04:13.211941 11933 raft_consensus.cc:2804] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.212693 11933 raft_consensus.cc:493] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.212916 11884 raft_consensus.cc:2468] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 1.
I20260709 13:04:13.213186 11933 raft_consensus.cc:3060] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.217487 11974 raft_consensus.cc:2804] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.218657 11974 raft_consensus.cc:493] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.215298 11943 raft_consensus.cc:697] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 LEADER]: Becoming Leader. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Running, Role: LEADER
I20260709 13:04:13.219753 11943 consensus_queue.cc:237] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.182264 11932 leader_election.cc:290] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:13.218199 11975 raft_consensus.cc:493] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.221832 11975 raft_consensus.cc:515] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.223343 11974 raft_consensus.cc:3060] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.230875 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09934c1c037240c196b3bae228867d4b" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:13.225059 11975 leader_election.cc:290] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:13.231906 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1aab8dac20f46d08a9c0ca1b39dd678" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:13.234423 11811 raft_consensus.cc:2468] T f1aab8dac20f46d08a9c0ca1b39dd678 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 0.
I20260709 13:04:13.236876 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09934c1c037240c196b3bae228867d4b" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:13.233771 11735 raft_consensus.cc:2468] T 09934c1c037240c196b3bae228867d4b P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 0.
I20260709 13:04:13.238178 11974 raft_consensus.cc:515] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
W20260709 13:04:13.239113 11774 leader_election.cc:343] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.241009 11774 leader_election.cc:304] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:13.241895 11943 raft_consensus.cc:2804] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.242170 11974 leader_election.cc:290] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:13.242280 11943 raft_consensus.cc:493] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.242856 11943 raft_consensus.cc:3060] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.248090 11632 catalog_manager.cc:5697] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.252019 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45240651efa4d34bea3f0f3c17695b1" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:13.252704 11735 raft_consensus.cc:3060] T c45240651efa4d34bea3f0f3c17695b1 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.256649 11933 raft_consensus.cc:515] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.259743 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45240651efa4d34bea3f0f3c17695b1" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:13.260332 11884 raft_consensus.cc:3060] T c45240651efa4d34bea3f0f3c17695b1 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.262732 11974 raft_consensus.cc:493] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.263329 11974 raft_consensus.cc:515] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.264214 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1aab8dac20f46d08a9c0ca1b39dd678" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:13.264838 11811 raft_consensus.cc:3060] T f1aab8dac20f46d08a9c0ca1b39dd678 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.265774 11974 leader_election.cc:290] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:13.267532 11943 raft_consensus.cc:515] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.268414 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5168c42aa6410e869fa98334a3ec27" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:13.274013 11948 consensus_queue.cc:1048] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:13.275761 11734 raft_consensus.cc:2393] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c1bdbc276ed41c4afad0e7bc4842046 in current term 1: Already voted for candidate d8045018ae5f4f18bfde7c44771fd2a5 in this term.
I20260709 13:04:13.276890 11943 leader_election.cc:290] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:13.277935 11885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5168c42aa6410e869fa98334a3ec27" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:13.279119 11933 leader_election.cc:290] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Requested vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:13.280606 11885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1aab8dac20f46d08a9c0ca1b39dd678" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:13.281229 11885 raft_consensus.cc:3060] T f1aab8dac20f46d08a9c0ca1b39dd678 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.281252 11926 tablet_bootstrap.cc:492] T 09934c1c037240c196b3bae228867d4b P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:13.282191 11926 ts_tablet_manager.cc:1403] T 09934c1c037240c196b3bae228867d4b P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.122s	user 0.031s	sys 0.072s
I20260709 13:04:13.282476 11884 raft_consensus.cc:2468] T c45240651efa4d34bea3f0f3c17695b1 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 1.
I20260709 13:04:13.285087 11735 raft_consensus.cc:2468] T c45240651efa4d34bea3f0f3c17695b1 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 1.
I20260709 13:04:13.285468 11926 raft_consensus.cc:359] T 09934c1c037240c196b3bae228867d4b P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.286271 11926 raft_consensus.cc:385] T 09934c1c037240c196b3bae228867d4b P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.286629 11926 raft_consensus.cc:740] T 09934c1c037240c196b3bae228867d4b P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.287716 11926 consensus_queue.cc:260] T 09934c1c037240c196b3bae228867d4b P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.289306 11885 raft_consensus.cc:2468] T f1aab8dac20f46d08a9c0ca1b39dd678 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 1.
I20260709 13:04:13.288596 11632 catalog_manager.cc:5697] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.290347 11926 ts_tablet_manager.cc:1434] T 09934c1c037240c196b3bae228867d4b P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:13.290525 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09934c1c037240c196b3bae228867d4b" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:13.293072 11735 raft_consensus.cc:3060] T 09934c1c037240c196b3bae228867d4b P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.293208 11699 leader_election.cc:304] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:13.294224 11933 raft_consensus.cc:2804] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.294915 11933 raft_consensus.cc:697] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Becoming Leader. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:13.295849 11933 consensus_queue.cc:237] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.275205 11811 raft_consensus.cc:2468] T f1aab8dac20f46d08a9c0ca1b39dd678 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 1.
I20260709 13:04:13.291806 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09934c1c037240c196b3bae228867d4b" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:13.300441 11884 raft_consensus.cc:3060] T 09934c1c037240c196b3bae228867d4b P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.291160 11774 leader_election.cc:304] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:13.300693 11735 raft_consensus.cc:2468] T 09934c1c037240c196b3bae228867d4b P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 1.
I20260709 13:04:13.301443 11943 raft_consensus.cc:2804] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.302747 11943 raft_consensus.cc:697] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 LEADER]: Becoming Leader. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Running, Role: LEADER
I20260709 13:04:13.303635 11943 consensus_queue.cc:237] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.306810 11774 leader_election.cc:304] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046; no voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:13.311523 11974 raft_consensus.cc:3060] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.312662 11774 leader_election.cc:304] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: 
I20260709 13:04:13.316642 11975 raft_consensus.cc:2804] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.317224 11975 raft_consensus.cc:697] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 LEADER]: Becoming Leader. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Running, Role: LEADER
I20260709 13:04:13.318120 11975 consensus_queue.cc:237] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.319351 11974 raft_consensus.cc:2749] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:13.320592 11884 raft_consensus.cc:2468] T 09934c1c037240c196b3bae228867d4b P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 1.
I20260709 13:04:13.322778 11631 catalog_manager.cc:5697] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.324851 11632 catalog_manager.cc:5697] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.333393 11931 consensus_queue.cc:1048] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.351985 11632 catalog_manager.cc:5697] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.366685 11933 raft_consensus.cc:493] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.367318 11933 raft_consensus.cc:515] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.368742 11931 raft_consensus.cc:493] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.369099 11933 leader_election.cc:290] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:13.369278 11931 raft_consensus.cc:515] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.369884 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:13.370499 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:13.371088 11884 raft_consensus.cc:2468] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 0.
I20260709 13:04:13.371503 11931 leader_election.cc:290] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:13.370522 11811 raft_consensus.cc:2468] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 0.
I20260709 13:04:13.371984 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:13.372651 11735 raft_consensus.cc:2468] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 0.
I20260709 13:04:13.372879 11699 leader_election.cc:304] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:13.373433 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:13.373692 11933 raft_consensus.cc:2804] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.373862 11931 consensus_queue.cc:1048] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:13.374289 11848 leader_election.cc:304] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:13.375140 11933 raft_consensus.cc:493] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.375160 11811 raft_consensus.cc:2468] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 0.
I20260709 13:04:13.375694 11933 raft_consensus.cc:3060] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.375759 11948 raft_consensus.cc:2804] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.376668 11948 raft_consensus.cc:493] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.377041 11948 raft_consensus.cc:3060] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.384157 11933 raft_consensus.cc:515] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.384536 11948 raft_consensus.cc:515] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.387089 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:13.390188 11810 raft_consensus.cc:3060] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.391462 11948 leader_election.cc:290] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:13.392534 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:13.388382 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:13.393265 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:13.394062 11735 raft_consensus.cc:2393] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d8045018ae5f4f18bfde7c44771fd2a5 in current term 1: Already voted for candidate 3ad798acb86a46218d2b7eb79ab128b1 in this term.
I20260709 13:04:13.387323 11933 leader_election.cc:290] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Requested vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:13.393433 11884 raft_consensus.cc:2393] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ad798acb86a46218d2b7eb79ab128b1 in current term 1: Already voted for candidate d8045018ae5f4f18bfde7c44771fd2a5 in this term.
I20260709 13:04:13.389035 11931 consensus_queue.cc:1048] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.395092 11848 leader_election.cc:304] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8045018ae5f4f18bfde7c44771fd2a5; no voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046
I20260709 13:04:13.396512 11948 raft_consensus.cc:2749] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:13.401681 11810 raft_consensus.cc:2468] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 1.
I20260709 13:04:13.403013 11701 leader_election.cc:304] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:13.404021 11933 raft_consensus.cc:2804] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.404562 11933 raft_consensus.cc:697] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Becoming Leader. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:13.405473 11933 consensus_queue.cc:237] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.413753 11631 catalog_manager.cc:5697] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.438488 11884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e5168c42aa6410e869fa98334a3ec27"
dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
mode: GRACEFUL
new_leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
 from {username='slave'} at 127.0.0.1:55424
I20260709 13:04:13.438984 11884 raft_consensus.cc:606] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Received request to transfer leadership to TS 3ad798acb86a46218d2b7eb79ab128b1
I20260709 13:04:13.452802 11811 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70f82bef26544ababc7fdd6ec974d800"
dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
mode: GRACEFUL
new_leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
 from {username='slave'} at 127.0.0.1:42856
I20260709 13:04:13.453397 11811 raft_consensus.cc:606] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 LEADER]: Received request to transfer leadership to TS 3ad798acb86a46218d2b7eb79ab128b1
I20260709 13:04:13.462826 11884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2d5e43b25f94e5caefe9e5229f7b4c2"
dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
mode: GRACEFUL
new_leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
 from {username='slave'} at 127.0.0.1:55424
I20260709 13:04:13.463539 11884 raft_consensus.cc:606] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Received request to transfer leadership to TS 3ad798acb86a46218d2b7eb79ab128b1
I20260709 13:04:13.477345 11735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77"
dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
mode: GRACEFUL
new_leader_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
 from {username='slave'} at 127.0.0.1:50732
I20260709 13:04:13.477902 11735 raft_consensus.cc:606] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Received request to transfer leadership to TS 4c1bdbc276ed41c4afad0e7bc4842046
I20260709 13:04:13.483515 11884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbef4a23506b4e9494f9f021b00eb4bc"
dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
mode: GRACEFUL
new_leader_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
 from {username='slave'} at 127.0.0.1:55424
I20260709 13:04:13.484052 11884 raft_consensus.cc:606] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Received request to transfer leadership to TS 4c1bdbc276ed41c4afad0e7bc4842046
I20260709 13:04:13.496696 11735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1289552d3a3549b5b5112d882715c129"
dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
mode: GRACEFUL
new_leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
 from {username='slave'} at 127.0.0.1:50732
I20260709 13:04:13.497205 11735 raft_consensus.cc:606] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Received request to transfer leadership to TS d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:13.546679 11933 consensus_queue.cc:1048] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.561414 11933 consensus_queue.cc:1048] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.569753 11947 consensus_queue.cc:1048] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.570640 11969 raft_consensus.cc:993] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1: : Instructing follower d8045018ae5f4f18bfde7c44771fd2a5 to start an election
I20260709 13:04:13.571216 11933 raft_consensus.cc:1081] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Signalling peer d8045018ae5f4f18bfde7c44771fd2a5 to start an election
I20260709 13:04:13.573369 11884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1289552d3a3549b5b5112d882715c129"
dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
 from {username='slave'} at 127.0.0.1:55408
I20260709 13:04:13.574088 11884 raft_consensus.cc:493] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.574607 11884 raft_consensus.cc:3060] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.577524 11948 raft_consensus.cc:993] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5: : Instructing follower 3ad798acb86a46218d2b7eb79ab128b1 to start an election
I20260709 13:04:13.578048 11948 raft_consensus.cc:1081] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Signalling peer 3ad798acb86a46218d2b7eb79ab128b1 to start an election
I20260709 13:04:13.582370 11734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2d5e43b25f94e5caefe9e5229f7b4c2"
dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
 from {username='slave'} at 127.0.0.1:50712
I20260709 13:04:13.583068 11948 consensus_queue.cc:1048] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:13.583017 11884 raft_consensus.cc:515] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.584350 11734 raft_consensus.cc:493] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.584815 11734 raft_consensus.cc:3060] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.586915 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1289552d3a3549b5b5112d882715c129" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:13.587114 11884 leader_election.cc:290] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 2 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:13.587707 11736 raft_consensus.cc:3055] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:13.588057 11736 raft_consensus.cc:740] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:13.588824 11736 consensus_queue.cc:260] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.590030 11736 raft_consensus.cc:3060] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.590220 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1289552d3a3549b5b5112d882715c129" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:13.590898 11810 raft_consensus.cc:3060] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.598985 11810 raft_consensus.cc:2468] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 2.
I20260709 13:04:13.600399 11850 leader_election.cc:304] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:13.600417 11736 raft_consensus.cc:2468] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 2.
I20260709 13:04:13.601940 11948 raft_consensus.cc:2804] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:13.602607 11948 raft_consensus.cc:697] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 LEADER]: Becoming Leader. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:13.603657 11948 consensus_queue.cc:237] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.600010 11734 raft_consensus.cc:515] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.615168 11734 leader_election.cc:290] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 2 election: Requested vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:13.615444 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d5e43b25f94e5caefe9e5229f7b4c2" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:13.616173 11884 raft_consensus.cc:3055] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:13.616561 11884 raft_consensus.cc:740] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:13.613854 11631 catalog_manager.cc:5697] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 reported cstate change: term changed from 1 to 2, leader changed from 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193) to d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.617861 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d5e43b25f94e5caefe9e5229f7b4c2" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:13.617537 11884 consensus_queue.cc:260] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.618897 11810 raft_consensus.cc:3060] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.619117 11884 raft_consensus.cc:3060] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.626117 11884 raft_consensus.cc:2468] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 2.
I20260709 13:04:13.626117 11810 raft_consensus.cc:2468] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 2.
I20260709 13:04:13.628139 11699 leader_election.cc:304] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:13.628846 11933 raft_consensus.cc:2804] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:13.629257 11933 raft_consensus.cc:697] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Becoming Leader. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:13.630023 11933 consensus_queue.cc:237] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.636479 11631 catalog_manager.cc:5697] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 reported cstate change: term changed from 1 to 2, leader changed from d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195) to 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.664105 11975 consensus_queue.cc:1048] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.674767 11943 consensus_queue.cc:1048] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.682600 11975 raft_consensus.cc:993] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046: : Instructing follower 3ad798acb86a46218d2b7eb79ab128b1 to start an election
I20260709 13:04:13.683125 11943 raft_consensus.cc:1081] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 LEADER]: Signalling peer 3ad798acb86a46218d2b7eb79ab128b1 to start an election
I20260709 13:04:13.684726 11734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70f82bef26544ababc7fdd6ec974d800"
dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
 from {username='slave'} at 127.0.0.1:50728
I20260709 13:04:13.685195 11734 raft_consensus.cc:493] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.685518 11734 raft_consensus.cc:3060] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.690706 11734 raft_consensus.cc:515] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.692765 11734 leader_election.cc:290] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 2 election: Requested vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:13.694087 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f82bef26544ababc7fdd6ec974d800" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:13.694185 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f82bef26544ababc7fdd6ec974d800" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:13.694705 11884 raft_consensus.cc:3060] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.694900 11810 raft_consensus.cc:3055] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:13.695396 11810 raft_consensus.cc:740] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Running, Role: LEADER
I20260709 13:04:13.696310 11810 consensus_queue.cc:260] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.697789 11810 raft_consensus.cc:3060] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.700837 11884 raft_consensus.cc:2468] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 2.
I20260709 13:04:13.701928 11699 leader_election.cc:304] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:13.702642 11933 raft_consensus.cc:2804] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:13.703169 11933 raft_consensus.cc:697] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Becoming Leader. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:13.704174 11810 raft_consensus.cc:2468] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 2.
I20260709 13:04:13.704101 11933 consensus_queue.cc:237] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.711885 11947 raft_consensus.cc:993] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5: : Instructing follower 3ad798acb86a46218d2b7eb79ab128b1 to start an election
I20260709 13:04:13.712390 11947 raft_consensus.cc:1081] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Signalling peer 3ad798acb86a46218d2b7eb79ab128b1 to start an election
I20260709 13:04:13.711777 11629 catalog_manager.cc:5697] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 reported cstate change: term changed from 1 to 2, leader changed from 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194) to 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.714402 11734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e5168c42aa6410e869fa98334a3ec27"
dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
 from {username='slave'} at 127.0.0.1:50712
I20260709 13:04:13.714967 11734 raft_consensus.cc:493] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.715375 11734 raft_consensus.cc:3060] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.722963 11734 raft_consensus.cc:515] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.725586 11734 leader_election.cc:290] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 2 election: Requested vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:13.734647 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5168c42aa6410e869fa98334a3ec27" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:13.735498 11884 raft_consensus.cc:3055] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:13.735914 11884 raft_consensus.cc:740] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:13.736459 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5168c42aa6410e869fa98334a3ec27" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:13.737198 11810 raft_consensus.cc:3060] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.736878 11884 consensus_queue.cc:260] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.753829 11884 raft_consensus.cc:3060] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.766625 11884 raft_consensus.cc:2468] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 2.
I20260709 13:04:13.787766 11699 leader_election.cc:304] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:13.788622 11933 raft_consensus.cc:2804] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:13.789207 11933 raft_consensus.cc:697] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Becoming Leader. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:13.789989 11933 consensus_queue.cc:237] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.790410 11969 consensus_queue.cc:1048] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:13.843834 11810 raft_consensus.cc:2468] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 2.
I20260709 13:04:13.922427 11943 consensus_queue.cc:1048] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.926707 11975 consensus_queue.cc:1048] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.928399 11943 consensus_queue.cc:1048] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:13.929973 11994 consensus_queue.cc:1048] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.934911 11947 raft_consensus.cc:993] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5: : Instructing follower 4c1bdbc276ed41c4afad0e7bc4842046 to start an election
I20260709 13:04:13.935526 11947 raft_consensus.cc:1081] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Signalling peer 4c1bdbc276ed41c4afad0e7bc4842046 to start an election
I20260709 13:04:13.936137 11994 consensus_queue.cc:1048] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.946415 11811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbef4a23506b4e9494f9f021b00eb4bc"
dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
 from {username='slave'} at 127.0.0.1:42842
I20260709 13:04:13.947029 11811 raft_consensus.cc:493] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.947414 11811 raft_consensus.cc:3060] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.958483 11943 consensus_queue.cc:1048] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.970299 11969 consensus_queue.cc:1048] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.979952 11994 raft_consensus.cc:993] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1: : Instructing follower 4c1bdbc276ed41c4afad0e7bc4842046 to start an election
I20260709 13:04:13.980474 11994 raft_consensus.cc:1081] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Signalling peer 4c1bdbc276ed41c4afad0e7bc4842046 to start an election
I20260709 13:04:13.982524 11809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77"
dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
 from {username='slave'} at 127.0.0.1:42854
I20260709 13:04:13.983300 11809 raft_consensus.cc:493] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.983111 11811 raft_consensus.cc:515] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.984091 11809 raft_consensus.cc:3060] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.980563 11629 catalog_manager.cc:5697] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 reported cstate change: term changed from 1 to 2, leader changed from d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195) to 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.986389 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbef4a23506b4e9494f9f021b00eb4bc" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:13.987155 11734 raft_consensus.cc:3060] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.993922 11809 raft_consensus.cc:515] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:13.996591 11809 leader_election.cc:290] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 2 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:13.999142 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:13.999845 11736 raft_consensus.cc:3055] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:13.999892 11811 leader_election.cc:290] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 2 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:14.000247 11736 raft_consensus.cc:740] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:14.001046 11883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:14.001137 11736 consensus_queue.cc:260] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:14.001909 11883 raft_consensus.cc:3060] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.002188 11734 raft_consensus.cc:2468] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 2.
I20260709 13:04:14.002843 11736 raft_consensus.cc:3060] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.003536 11774 leader_election.cc:304] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: 
I20260709 13:04:14.004400 11975 raft_consensus.cc:2804] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:14.004879 11975 raft_consensus.cc:697] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 LEADER]: Becoming Leader. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Running, Role: LEADER
I20260709 13:04:14.005729 11975 consensus_queue.cc:237] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:14.008478 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbef4a23506b4e9494f9f021b00eb4bc" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:14.009205 11884 raft_consensus.cc:3055] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:14.009591 11884 raft_consensus.cc:740] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:14.010161 11811 raft_consensus.cc:1275] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Refusing update from remote peer d8045018ae5f4f18bfde7c44771fd2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.011580 11948 consensus_queue.cc:1048] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.010577 11884 consensus_queue.cc:260] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:14.016839 11884 raft_consensus.cc:3060] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.017191 11883 raft_consensus.cc:2468] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 2.
I20260709 13:04:14.018543 11774 leader_election.cc:304] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:14.024674 11734 raft_consensus.cc:1275] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Refusing update from remote peer d8045018ae5f4f18bfde7c44771fd2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.026543 11948 consensus_queue.cc:1048] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:14.027614 11943 raft_consensus.cc:2804] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:14.028185 11943 raft_consensus.cc:697] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 LEADER]: Becoming Leader. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Running, Role: LEADER
I20260709 13:04:14.029062 11943 consensus_queue.cc:237] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:14.030062 11632 catalog_manager.cc:5697] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 reported cstate change: term changed from 1 to 2, leader changed from d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195) to 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.034579 11884 raft_consensus.cc:2468] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 2.
I20260709 13:04:14.036825 11883 raft_consensus.cc:1275] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Refusing update from remote peer 3ad798acb86a46218d2b7eb79ab128b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.038425 11736 raft_consensus.cc:2468] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 2.
I20260709 13:04:14.041801 11933 consensus_queue.cc:1048] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.052772 11811 raft_consensus.cc:1275] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Refusing update from remote peer 3ad798acb86a46218d2b7eb79ab128b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.054313 11933 consensus_queue.cc:1048] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.058588 11633 catalog_manager.cc:5697] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 reported cstate change: term changed from 1 to 2, leader changed from 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193) to 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.141198 11811 raft_consensus.cc:1275] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Refusing update from remote peer 3ad798acb86a46218d2b7eb79ab128b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.142511 11933 consensus_queue.cc:1048] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.150260 11883 raft_consensus.cc:1275] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Refusing update from remote peer 3ad798acb86a46218d2b7eb79ab128b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.151993 11994 consensus_queue.cc:1048] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:14.196209 11883 raft_consensus.cc:1275] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Refusing update from remote peer 3ad798acb86a46218d2b7eb79ab128b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.197438 11994 consensus_queue.cc:1048] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.206166 11811 raft_consensus.cc:1275] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Refusing update from remote peer 3ad798acb86a46218d2b7eb79ab128b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.208369 12010 consensus_queue.cc:1048] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:14.391868 11883 raft_consensus.cc:1275] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Refusing update from remote peer 4c1bdbc276ed41c4afad0e7bc4842046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.393559 11943 consensus_queue.cc:1048] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:14.406756 11736 raft_consensus.cc:1275] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Refusing update from remote peer 4c1bdbc276ed41c4afad0e7bc4842046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.409085 11974 consensus_queue.cc:1048] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:14.445722 11883 raft_consensus.cc:1275] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Refusing update from remote peer 4c1bdbc276ed41c4afad0e7bc4842046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.446975 11974 consensus_queue.cc:1048] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.457690 11736 raft_consensus.cc:1275] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Refusing update from remote peer 4c1bdbc276ed41c4afad0e7bc4842046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.460256 11975 consensus_queue.cc:1048] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:14.862202 11832 debug-util.cc:398] Leaking SignalData structure 0x7b0800179e80 after lost signal to thread 434
W20260709 13:04:14.863657 11832 debug-util.cc:398] Leaking SignalData structure 0x7b0800127c80 after lost signal to thread 11668
W20260709 13:04:14.865028 11832 debug-util.cc:398] Leaking SignalData structure 0x7b08002a60e0 after lost signal to thread 11760
W20260709 13:04:14.866370 11832 debug-util.cc:398] Leaking SignalData structure 0x7b0800290f80 after lost signal to thread 11835
W20260709 13:04:14.867710 11832 debug-util.cc:398] Leaking SignalData structure 0x7b080039a500 after lost signal to thread 11909
I20260709 13:04:16.543926 11633 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48514:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:16.547676 11633 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:16.621234 11725 tablet_service.cc:1511] Processing CreateTablet for tablet d8186bc9b8544cc6aaa2f11f458c8979 (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:16.623281 11725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8186bc9b8544cc6aaa2f11f458c8979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.622961 11793 tablet_service.cc:1511] Processing CreateTablet for tablet d8186bc9b8544cc6aaa2f11f458c8979 (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:16.624673 11793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8186bc9b8544cc6aaa2f11f458c8979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.627954 11801 tablet_service.cc:1511] Processing CreateTablet for tablet b66275bcb45044b59b00867e3c52f17f (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:16.628145 11868 tablet_service.cc:1511] Processing CreateTablet for tablet d8186bc9b8544cc6aaa2f11f458c8979 (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:16.629523 11801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b66275bcb45044b59b00867e3c52f17f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.629695 11868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8186bc9b8544cc6aaa2f11f458c8979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.632876 11720 tablet_service.cc:1511] Processing CreateTablet for tablet b66275bcb45044b59b00867e3c52f17f (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:16.634404 11720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b66275bcb45044b59b00867e3c52f17f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.645115 11871 tablet_service.cc:1511] Processing CreateTablet for tablet b66275bcb45044b59b00867e3c52f17f (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:16.645887 11798 tablet_service.cc:1511] Processing CreateTablet for tablet 7f215c9fe1104f03a9b0c0344e56fe07 (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:16.646729 11871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b66275bcb45044b59b00867e3c52f17f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.648576 11795 tablet_service.cc:1511] Processing CreateTablet for tablet acafb71e0bfe438b92fa3f198b816f9c (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:16.653729 11872 tablet_service.cc:1511] Processing CreateTablet for tablet 7f215c9fe1104f03a9b0c0344e56fe07 (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:16.655478 11797 tablet_service.cc:1511] Processing CreateTablet for tablet fd4784e607e749dbb858dc1904bfd9a6 (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:16.657876 11719 tablet_service.cc:1511] Processing CreateTablet for tablet 7f215c9fe1104f03a9b0c0344e56fe07 (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:16.657876 11718 tablet_service.cc:1511] Processing CreateTablet for tablet acafb71e0bfe438b92fa3f198b816f9c (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:16.653731 11799 tablet_service.cc:1511] Processing CreateTablet for tablet 93203f863deb439aad4ff1c558273837 (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:16.662009 11722 tablet_service.cc:1511] Processing CreateTablet for tablet 93203f863deb439aad4ff1c558273837 (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:16.664547 11723 tablet_service.cc:1511] Processing CreateTablet for tablet fd4784e607e749dbb858dc1904bfd9a6 (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:16.665727 11867 tablet_service.cc:1511] Processing CreateTablet for tablet 93203f863deb439aad4ff1c558273837 (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:16.664549 11874 tablet_service.cc:1511] Processing CreateTablet for tablet acafb71e0bfe438b92fa3f198b816f9c (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:16.666919 11872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f215c9fe1104f03a9b0c0344e56fe07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.667884 11874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acafb71e0bfe438b92fa3f198b816f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.668519 11724 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf640a08d864ee0b25edcbf0920e77a (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:16.669836 11798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f215c9fe1104f03a9b0c0344e56fe07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.670574 11873 tablet_service.cc:1511] Processing CreateTablet for tablet fd4784e607e749dbb858dc1904bfd9a6 (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:16.672005 11873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd4784e607e749dbb858dc1904bfd9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.673771 11799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93203f863deb439aad4ff1c558273837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.675521 11867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93203f863deb439aad4ff1c558273837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.679632 11797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd4784e607e749dbb858dc1904bfd9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.681265 11721 tablet_service.cc:1511] Processing CreateTablet for tablet b07a160514f5411cbd368ce43c0e8b1c (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:16.683611 11795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acafb71e0bfe438b92fa3f198b816f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.684581 11726 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd9cf1096fb4eb793c0c914de554875 (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:16.688356 11719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f215c9fe1104f03a9b0c0344e56fe07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.689107 11718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acafb71e0bfe438b92fa3f198b816f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.689742 11724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf640a08d864ee0b25edcbf0920e77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.690380 11721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07a160514f5411cbd368ce43c0e8b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.693058 11726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd9cf1096fb4eb793c0c914de554875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.693583 11870 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf640a08d864ee0b25edcbf0920e77a (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:16.695000 11870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf640a08d864ee0b25edcbf0920e77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.701288 11722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93203f863deb439aad4ff1c558273837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.702847 11869 tablet_service.cc:1511] Processing CreateTablet for tablet b07a160514f5411cbd368ce43c0e8b1c (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:16.703645 11723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd4784e607e749dbb858dc1904bfd9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.707554 11869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07a160514f5411cbd368ce43c0e8b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.711930 11794 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf640a08d864ee0b25edcbf0920e77a (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:16.713315 11794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf640a08d864ee0b25edcbf0920e77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.717523 11796 tablet_service.cc:1511] Processing CreateTablet for tablet b07a160514f5411cbd368ce43c0e8b1c (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:16.718937 11796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07a160514f5411cbd368ce43c0e8b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.720522 11800 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd9cf1096fb4eb793c0c914de554875 (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:16.724107 11875 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd9cf1096fb4eb793c0c914de554875 (DEFAULT_TABLE table=soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:16.725097 11800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd9cf1096fb4eb793c0c914de554875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.725498 11875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd9cf1096fb4eb793c0c914de554875. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:16.748533 11774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34455, user_credentials={real_user=slave}} blocked reactor thread for 47222us
I20260709 13:04:16.865886 12027 tablet_bootstrap.cc:492] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
I20260709 13:04:16.874683 12027 tablet_bootstrap.cc:654] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.881000 12025 tablet_bootstrap.cc:492] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
I20260709 13:04:16.888041 12026 tablet_bootstrap.cc:492] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
I20260709 13:04:16.893844 12025 tablet_bootstrap.cc:654] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.897532 12026 tablet_bootstrap.cc:654] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.898509 12027 tablet_bootstrap.cc:492] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
I20260709 13:04:16.899555 12027 ts_tablet_manager.cc:1403] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.010s
I20260709 13:04:16.904245 12027 raft_consensus.cc:359] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:16.905366 12027 raft_consensus.cc:385] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.905853 12027 raft_consensus.cc:740] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.906957 12027 consensus_queue.cc:260] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:16.910672 12025 tablet_bootstrap.cc:492] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:16.911084 12027 ts_tablet_manager.cc:1434] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:04:16.911271 12025 ts_tablet_manager.cc:1403] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.008s
I20260709 13:04:16.912346 12027 tablet_bootstrap.cc:492] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
I20260709 13:04:16.914525 12025 raft_consensus.cc:359] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:16.915374 12025 raft_consensus.cc:385] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.915684 12025 raft_consensus.cc:740] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.916615 12025 consensus_queue.cc:260] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:16.924098 12027 tablet_bootstrap.cc:654] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.927928 12025 ts_tablet_manager.cc:1434] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:04:16.935474 12026 tablet_bootstrap.cc:492] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:16.936108 12026 ts_tablet_manager.cc:1403] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.011s
I20260709 13:04:16.940943 12025 tablet_bootstrap.cc:492] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
I20260709 13:04:16.951165 12025 tablet_bootstrap.cc:654] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.954046 12027 tablet_bootstrap.cc:492] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
I20260709 13:04:16.954733 12027 ts_tablet_manager.cc:1403] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.016s
I20260709 13:04:16.939406 12026 raft_consensus.cc:359] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:16.957093 12026 raft_consensus.cc:385] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.957406 12026 raft_consensus.cc:740] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.958207 12026 consensus_queue.cc:260] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:16.958690 12027 raft_consensus.cc:359] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:16.959918 12027 raft_consensus.cc:385] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.960361 12027 raft_consensus.cc:740] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.961216 12026 ts_tablet_manager.cc:1434] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:04:16.961668 12027 consensus_queue.cc:260] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:16.962342 12026 tablet_bootstrap.cc:492] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
I20260709 13:04:16.964435 12027 ts_tablet_manager.cc:1434] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:16.965440 12027 tablet_bootstrap.cc:492] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
W20260709 13:04:16.974331 11682 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:16.975440 12027 tablet_bootstrap.cc:654] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.980746 12026 tablet_bootstrap.cc:654] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.984611 12025 tablet_bootstrap.cc:492] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:16.985219 12025 ts_tablet_manager.cc:1403] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.004s
I20260709 13:04:16.987262 12027 tablet_bootstrap.cc:492] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
I20260709 13:04:16.987784 12027 ts_tablet_manager.cc:1403] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.003s
I20260709 13:04:16.988585 12025 raft_consensus.cc:359] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:16.989584 12025 raft_consensus.cc:385] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.989936 12025 raft_consensus.cc:740] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.990886 12025 consensus_queue.cc:260] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:16.991034 12027 raft_consensus.cc:359] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:16.991853 12027 raft_consensus.cc:385] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.992149 12027 raft_consensus.cc:740] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.992937 12026 tablet_bootstrap.cc:492] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:16.992857 12027 consensus_queue.cc:260] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:16.993484 12026 ts_tablet_manager.cc:1403] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.004s
I20260709 13:04:16.995332 12027 ts_tablet_manager.cc:1434] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:17.002537 12025 ts_tablet_manager.cc:1434] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:04:17.003219 12027 tablet_bootstrap.cc:492] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
I20260709 13:04:17.008642 12025 tablet_bootstrap.cc:492] T 7f215c9fe1104f03a9b0c0344e56fe07 P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
I20260709 13:04:17.010555 12027 tablet_bootstrap.cc:654] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.014221 12026 raft_consensus.cc:359] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.015053 12026 raft_consensus.cc:385] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.015386 12026 raft_consensus.cc:740] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.017159 12024 raft_consensus.cc:493] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.017732 12024 raft_consensus.cc:515] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.020180 12024 leader_election.cc:290] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:17.020871 12025 tablet_bootstrap.cc:654] T 7f215c9fe1104f03a9b0c0344e56fe07 P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.022477 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8186bc9b8544cc6aaa2f11f458c8979" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:17.023614 12027 tablet_bootstrap.cc:492] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
W20260709 13:04:17.024335 11774 leader_election.cc:343] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.025858 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8186bc9b8544cc6aaa2f11f458c8979" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:17.026592 11736 raft_consensus.cc:2468] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 0.
I20260709 13:04:17.028426 12027 ts_tablet_manager.cc:1403] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 13:04:17.028370 11774 leader_election.cc:304] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:17.029736 12024 raft_consensus.cc:2804] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.030158 12024 raft_consensus.cc:493] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.030529 12024 raft_consensus.cc:3060] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.032776 12027 raft_consensus.cc:359] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.033660 12027 raft_consensus.cc:385] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.034560 12027 raft_consensus.cc:740] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.016224 12026 consensus_queue.cc:260] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.038187 12025 tablet_bootstrap.cc:492] T 7f215c9fe1104f03a9b0c0344e56fe07 P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:17.038766 12025 ts_tablet_manager.cc:1403] T 7f215c9fe1104f03a9b0c0344e56fe07 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.009s
I20260709 13:04:17.041759 12024 raft_consensus.cc:515] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.044117 12026 ts_tablet_manager.cc:1434] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:04:17.045146 12026 tablet_bootstrap.cc:492] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
I20260709 13:04:17.045003 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8186bc9b8544cc6aaa2f11f458c8979" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:17.045607 11736 raft_consensus.cc:3060] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.052604 12026 tablet_bootstrap.cc:654] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.054119 11736 raft_consensus.cc:2468] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 1.
I20260709 13:04:17.036933 12027 consensus_queue.cc:260] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.056792 11883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8186bc9b8544cc6aaa2f11f458c8979" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:17.058699 12027 ts_tablet_manager.cc:1434] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.002s
I20260709 13:04:17.060074 12027 tablet_bootstrap.cc:492] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
W20260709 13:04:17.064141 11774 leader_election.cc:343] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.065448 12026 tablet_bootstrap.cc:492] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:17.065946 12026 ts_tablet_manager.cc:1403] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:04:17.067456 12027 tablet_bootstrap.cc:654] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.071354 12026 raft_consensus.cc:359] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.072137 12026 raft_consensus.cc:385] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.055275 12024 leader_election.cc:290] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:17.072464 12026 raft_consensus.cc:740] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.041910 12025 raft_consensus.cc:359] T 7f215c9fe1104f03a9b0c0344e56fe07 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.073320 12025 raft_consensus.cc:385] T 7f215c9fe1104f03a9b0c0344e56fe07 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.073163 11774 leader_election.cc:304] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:17.073889 12025 raft_consensus.cc:740] T 7f215c9fe1104f03a9b0c0344e56fe07 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.073462 12026 consensus_queue.cc:260] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.074995 12013 raft_consensus.cc:2804] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.074939 12025 consensus_queue.cc:260] T 7f215c9fe1104f03a9b0c0344e56fe07 P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.076005 12026 ts_tablet_manager.cc:1434] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:04:17.076380 12008 raft_consensus.cc:493] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.077317 12026 tablet_bootstrap.cc:492] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
I20260709 13:04:17.077116 12008 raft_consensus.cc:515] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.084093 12008 leader_election.cc:290] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:17.084607 12013 raft_consensus.cc:697] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 LEADER]: Becoming Leader. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Running, Role: LEADER
I20260709 13:04:17.085744 12013 consensus_queue.cc:237] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.087090 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf640a08d864ee0b25edcbf0920e77a" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:17.087695 12026 tablet_bootstrap.cc:654] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.087808 11811 raft_consensus.cc:2468] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 0.
I20260709 13:04:17.089185 11850 leader_election.cc:304] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:17.089535 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf640a08d864ee0b25edcbf0920e77a" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:17.090062 12008 raft_consensus.cc:2804] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.090315 11736 raft_consensus.cc:2468] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 0.
I20260709 13:04:17.090592 12008 raft_consensus.cc:493] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.090955 12008 raft_consensus.cc:3060] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.097008 12027 tablet_bootstrap.cc:492] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
I20260709 13:04:17.097767 12027 ts_tablet_manager.cc:1403] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.008s
I20260709 13:04:17.101425 12027 raft_consensus.cc:359] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.098944 12008 raft_consensus.cc:515] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.102286 12027 raft_consensus.cc:385] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.102773 12027 raft_consensus.cc:740] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.103663 12027 consensus_queue.cc:260] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.104926 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf640a08d864ee0b25edcbf0920e77a" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:17.105513 11736 raft_consensus.cc:3060] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.106050 12027 ts_tablet_manager.cc:1434] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:17.110563 11633 catalog_manager.cc:5697] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.112917 12027 tablet_bootstrap.cc:492] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
I20260709 13:04:17.101464 12025 ts_tablet_manager.cc:1434] T 7f215c9fe1104f03a9b0c0344e56fe07 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.062s	user 0.013s	sys 0.004s
I20260709 13:04:17.114136 11736 raft_consensus.cc:2468] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 1.
I20260709 13:04:17.116313 11848 leader_election.cc:304] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:17.117275 12041 raft_consensus.cc:2804] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.124320 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf640a08d864ee0b25edcbf0920e77a" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:17.125005 12025 tablet_bootstrap.cc:492] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
I20260709 13:04:17.125080 11811 raft_consensus.cc:3060] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.142649 11811 raft_consensus.cc:2468] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 1.
I20260709 13:04:17.145205 12025 tablet_bootstrap.cc:654] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.136330 12041 raft_consensus.cc:697] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Becoming Leader. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:17.148226 12041 consensus_queue.cc:237] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.124338 12008 leader_election.cc:290] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:17.149607 12008 raft_consensus.cc:493] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.157832 12008 raft_consensus.cc:515] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.163933 12008 leader_election.cc:290] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:17.162000 12027 tablet_bootstrap.cc:654] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.151033 12026 tablet_bootstrap.cc:492] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:17.167801 12026 ts_tablet_manager.cc:1403] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.005s
I20260709 13:04:17.168423 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66275bcb45044b59b00867e3c52f17f" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:17.169600 11810 raft_consensus.cc:2468] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 0.
I20260709 13:04:17.171568 11850 leader_election.cc:304] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:17.166575 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66275bcb45044b59b00867e3c52f17f" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:17.172015 12026 raft_consensus.cc:359] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.173130 12026 raft_consensus.cc:385] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.173880 12026 raft_consensus.cc:740] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
W20260709 13:04:17.174342 11848 leader_election.cc:343] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.174772 12026 consensus_queue.cc:260] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.177239 12025 tablet_bootstrap.cc:492] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:17.177405 12026 ts_tablet_manager.cc:1434] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:04:17.179329 12026 tablet_bootstrap.cc:492] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
I20260709 13:04:17.177870 12025 ts_tablet_manager.cc:1403] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.007s
I20260709 13:04:17.183034 12008 raft_consensus.cc:2804] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.183570 12008 raft_consensus.cc:493] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.183957 12008 raft_consensus.cc:3060] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.186084 12025 raft_consensus.cc:359] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.191901 12025 raft_consensus.cc:385] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.192873 12025 raft_consensus.cc:740] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.194737 12025 consensus_queue.cc:260] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.197685 12027 tablet_bootstrap.cc:492] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
I20260709 13:04:17.197751 12025 ts_tablet_manager.cc:1434] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260709 13:04:17.198282 12027 ts_tablet_manager.cc:1403] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.003s
I20260709 13:04:17.200251 12026 tablet_bootstrap.cc:654] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.200917 11633 catalog_manager.cc:5697] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.203420 12027 raft_consensus.cc:359] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.204355 12027 raft_consensus.cc:385] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.204741 12027 raft_consensus.cc:740] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.206008 12025 tablet_bootstrap.cc:492] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
I20260709 13:04:17.191869 12008 raft_consensus.cc:515] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.209728 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66275bcb45044b59b00867e3c52f17f" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
W20260709 13:04:17.211117 11848 leader_election.cc:343] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.212255 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66275bcb45044b59b00867e3c52f17f" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:17.211935 12027 consensus_queue.cc:260] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.212854 11811 raft_consensus.cc:3060] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.214578 12027 ts_tablet_manager.cc:1434] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:04:17.215649 12027 tablet_bootstrap.cc:492] T b07a160514f5411cbd368ce43c0e8b1c P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
I20260709 13:04:17.219420 12008 leader_election.cc:290] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:17.219753 11811 raft_consensus.cc:2468] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 1.
I20260709 13:04:17.221020 11850 leader_election.cc:304] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 3ad798acb86a46218d2b7eb79ab128b1
I20260709 13:04:17.222308 12027 tablet_bootstrap.cc:654] T b07a160514f5411cbd368ce43c0e8b1c P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.222251 12008 raft_consensus.cc:2804] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.222951 12008 raft_consensus.cc:697] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Becoming Leader. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:17.223912 12008 consensus_queue.cc:237] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.225509 12026 tablet_bootstrap.cc:492] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:17.226054 12026 ts_tablet_manager.cc:1403] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.000s
I20260709 13:04:17.229156 12026 raft_consensus.cc:359] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.229854 12026 raft_consensus.cc:385] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.230163 12026 raft_consensus.cc:740] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.230850 12026 consensus_queue.cc:260] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.233209 12026 ts_tablet_manager.cc:1434] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:17.234284 12026 tablet_bootstrap.cc:492] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
I20260709 13:04:17.241223 12026 tablet_bootstrap.cc:654] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.243433 11633 catalog_manager.cc:5697] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.254452 12010 raft_consensus.cc:493] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.255012 12010 raft_consensus.cc:515] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.257490 12010 leader_election.cc:290] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:17.257750 12027 tablet_bootstrap.cc:492] T b07a160514f5411cbd368ce43c0e8b1c P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
I20260709 13:04:17.258323 12027 ts_tablet_manager.cc:1403] T b07a160514f5411cbd368ce43c0e8b1c P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.007s
I20260709 13:04:17.261480 12027 raft_consensus.cc:359] T b07a160514f5411cbd368ce43c0e8b1c P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.263916 12025 tablet_bootstrap.cc:654] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.264438 11883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f215c9fe1104f03a9b0c0344e56fe07" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:17.265125 11883 raft_consensus.cc:2468] T 7f215c9fe1104f03a9b0c0344e56fe07 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 0.
I20260709 13:04:17.266213 12026 tablet_bootstrap.cc:492] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:17.266449 11699 leader_election.cc:304] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:17.266712 12026 ts_tablet_manager.cc:1403] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 13:04:17.262215 12027 raft_consensus.cc:385] T b07a160514f5411cbd368ce43c0e8b1c P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.262831 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f215c9fe1104f03a9b0c0344e56fe07" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:17.267172 12027 raft_consensus.cc:740] T b07a160514f5411cbd368ce43c0e8b1c P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.268074 12027 consensus_queue.cc:260] T b07a160514f5411cbd368ce43c0e8b1c P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
W20260709 13:04:17.268565 11701 leader_election.cc:343] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.269212 12032 raft_consensus.cc:2804] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.269568 12032 raft_consensus.cc:493] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.269883 12032 raft_consensus.cc:3060] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.270512 12027 ts_tablet_manager.cc:1434] T b07a160514f5411cbd368ce43c0e8b1c P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:04:17.271622 12027 tablet_bootstrap.cc:492] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
I20260709 13:04:17.278280 12010 raft_consensus.cc:493] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.279266 12010 raft_consensus.cc:515] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.279917 12032 raft_consensus.cc:515] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.282696 11883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd4784e607e749dbb858dc1904bfd9a6" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:17.283957 12027 tablet_bootstrap.cc:654] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.283905 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f215c9fe1104f03a9b0c0344e56fe07" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:17.286517 11884 raft_consensus.cc:3060] T 7f215c9fe1104f03a9b0c0344e56fe07 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.289215 12010 leader_election.cc:290] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
W20260709 13:04:17.285046 11699 leader_election.cc:343] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.286013 12025 tablet_bootstrap.cc:492] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:17.293625 12025 ts_tablet_manager.cc:1403] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.005s
I20260709 13:04:17.296793 12025 raft_consensus.cc:359] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.297490 12025 raft_consensus.cc:385] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.297773 12025 raft_consensus.cc:740] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.298532 12025 consensus_queue.cc:260] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.300869 12026 raft_consensus.cc:359] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.301656 12026 raft_consensus.cc:385] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.301954 12026 raft_consensus.cc:740] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.302690 12026 consensus_queue.cc:260] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.305037 12026 ts_tablet_manager.cc:1434] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
I20260709 13:04:17.305095 12025 ts_tablet_manager.cc:1434] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:17.298276 11884 raft_consensus.cc:2468] T 7f215c9fe1104f03a9b0c0344e56fe07 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 1.
I20260709 13:04:17.306710 12025 tablet_bootstrap.cc:492] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
I20260709 13:04:17.312841 11699 leader_election.cc:304] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:17.305433 12032 leader_election.cc:290] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Requested vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:17.314198 12025 tablet_bootstrap.cc:654] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.314272 12032 raft_consensus.cc:2804] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.315101 12032 raft_consensus.cc:697] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Becoming Leader. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:17.316243 12032 consensus_queue.cc:237] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.318539 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f215c9fe1104f03a9b0c0344e56fe07" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
W20260709 13:04:17.320130 11701 leader_election.cc:343] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.325413 12027 tablet_bootstrap.cc:492] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
I20260709 13:04:17.326041 12027 ts_tablet_manager.cc:1403] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.010s
I20260709 13:04:17.327427 12026 tablet_bootstrap.cc:492] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
I20260709 13:04:17.328958 12027 raft_consensus.cc:359] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.329702 12027 raft_consensus.cc:385] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.329972 12027 raft_consensus.cc:740] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.330783 12027 consensus_queue.cc:260] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.331166 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd4784e607e749dbb858dc1904bfd9a6" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:17.331923 11810 raft_consensus.cc:2468] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 0.
I20260709 13:04:17.333091 12027 ts_tablet_manager.cc:1434] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:17.334157 11701 leader_election.cc:304] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:17.334371 12027 tablet_bootstrap.cc:492] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1: Bootstrap starting.
I20260709 13:04:17.334246 12008 raft_consensus.cc:493] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.335320 12008 raft_consensus.cc:515] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.337631 12008 leader_election.cc:290] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:17.339804 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8186bc9b8544cc6aaa2f11f458c8979" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:17.340818 11736 raft_consensus.cc:2393] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d8045018ae5f4f18bfde7c44771fd2a5 in current term 1: Already voted for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in this term.
I20260709 13:04:17.342059 12056 raft_consensus.cc:2804] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.342505 12056 raft_consensus.cc:493] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.342907 12027 tablet_bootstrap.cc:654] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.342875 12056 raft_consensus.cc:3060] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.348754 12026 tablet_bootstrap.cc:654] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.349577 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8186bc9b8544cc6aaa2f11f458c8979" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:17.353148 11850 leader_election.cc:304] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8045018ae5f4f18bfde7c44771fd2a5; no voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046
I20260709 13:04:17.354322 12008 raft_consensus.cc:3060] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.363029 12008 raft_consensus.cc:2749] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:17.374737 12056 raft_consensus.cc:515] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.375296 12025 tablet_bootstrap.cc:492] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:17.377135 12025 ts_tablet_manager.cc:1403] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.028s
I20260709 13:04:17.381683 12025 raft_consensus.cc:359] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.382508 12025 raft_consensus.cc:385] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.382827 12025 raft_consensus.cc:740] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.386317 12027 tablet_bootstrap.cc:492] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1: No bootstrap required, opened a new log
I20260709 13:04:17.386932 12027 ts_tablet_manager.cc:1403] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.004s
I20260709 13:04:17.386966 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd4784e607e749dbb858dc1904bfd9a6" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
W20260709 13:04:17.388829 11699 leader_election.cc:343] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.390445 12056 leader_election.cc:290] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Requested vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:17.390198 12027 raft_consensus.cc:359] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.388991 11629 catalog_manager.cc:5697] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.391921 12025 consensus_queue.cc:260] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.391117 12027 raft_consensus.cc:385] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.390091 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd4784e607e749dbb858dc1904bfd9a6" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:17.393234 12027 raft_consensus.cc:740] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.396308 12027 consensus_queue.cc:260] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.398699 12027 ts_tablet_manager.cc:1434] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:04:17.399825 12025 ts_tablet_manager.cc:1434] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:04:17.401001 12025 tablet_bootstrap.cc:492] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
I20260709 13:04:17.393601 11810 raft_consensus.cc:3060] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.407783 12032 raft_consensus.cc:493] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.408514 12025 tablet_bootstrap.cc:654] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.408408 12032 raft_consensus.cc:515] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.394722 12026 tablet_bootstrap.cc:492] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:17.411557 12026 ts_tablet_manager.cc:1403] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.084s	user 0.021s	sys 0.001s
I20260709 13:04:17.411661 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9cf1096fb4eb793c0c914de554875" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:17.412429 11811 raft_consensus.cc:2468] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 0.
I20260709 13:04:17.413673 11701 leader_election.cc:304] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: 
I20260709 13:04:17.414861 12056 raft_consensus.cc:2804] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.415372 12056 raft_consensus.cc:493] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.415778 12056 raft_consensus.cc:3060] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.424409 12056 raft_consensus.cc:515] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.427466 12032 leader_election.cc:290] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:17.427721 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9cf1096fb4eb793c0c914de554875" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:17.426389 12026 raft_consensus.cc:359] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.428287 11811 raft_consensus.cc:3060] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.428580 12026 raft_consensus.cc:385] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.428948 12025 tablet_bootstrap.cc:492] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:17.428889 12026 raft_consensus.cc:740] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.429921 12026 consensus_queue.cc:260] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.432159 11810 raft_consensus.cc:2468] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 1.
I20260709 13:04:17.432768 12025 ts_tablet_manager.cc:1403] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.010s
I20260709 13:04:17.434788 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9cf1096fb4eb793c0c914de554875" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:17.435451 12040 raft_consensus.cc:493] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.435976 12040 raft_consensus.cc:515] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
W20260709 13:04:17.436441 11699 leader_election.cc:343] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.436332 12025 raft_consensus.cc:359] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.437230 12025 raft_consensus.cc:385] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.437583 12025 raft_consensus.cc:740] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.438198 12040 leader_election.cc:290] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:17.438853 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a160514f5411cbd368ce43c0e8b1c" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:17.438493 12025 consensus_queue.cc:260] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.439530 11736 raft_consensus.cc:2468] T b07a160514f5411cbd368ce43c0e8b1c P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 0.
I20260709 13:04:17.442085 11774 leader_election.cc:304] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: 
I20260709 13:04:17.443651 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a160514f5411cbd368ce43c0e8b1c" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:17.444636 12025 ts_tablet_manager.cc:1434] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260709 13:04:17.445420 11774 leader_election.cc:343] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.445753 12025 tablet_bootstrap.cc:492] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
I20260709 13:04:17.448640 12040 raft_consensus.cc:2804] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.449043 12040 raft_consensus.cc:493] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.449401 12040 raft_consensus.cc:3060] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.449522 11811 raft_consensus.cc:2468] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 1.
I20260709 13:04:17.450853 11701 leader_election.cc:304] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: 
I20260709 13:04:17.453296 12025 tablet_bootstrap.cc:654] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.453752 12056 leader_election.cc:290] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Requested vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:17.453680 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9cf1096fb4eb793c0c914de554875" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:17.455329 12032 raft_consensus.cc:2804] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:17.455413 11699 leader_election.cc:343] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.456070 12032 raft_consensus.cc:697] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Becoming Leader. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:17.457013 12032 consensus_queue.cc:237] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.457382 11701 leader_election.cc:304] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:17.465850 12010 raft_consensus.cc:2804] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.466364 12010 raft_consensus.cc:697] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Becoming Leader. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:17.467293 12010 consensus_queue.cc:237] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.473564 12026 ts_tablet_manager.cc:1434] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 13:04:17.487495 12026 tablet_bootstrap.cc:492] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
I20260709 13:04:17.491355 12013 consensus_queue.cc:1048] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:17.496166 12041 raft_consensus.cc:493] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.496999 12041 raft_consensus.cc:515] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.478571 12040 raft_consensus.cc:515] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.504946 12040 leader_election.cc:290] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:17.507284 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a160514f5411cbd368ce43c0e8b1c" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:17.508258 11734 raft_consensus.cc:3060] T b07a160514f5411cbd368ce43c0e8b1c P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.513118 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a160514f5411cbd368ce43c0e8b1c" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:17.513434 12025 tablet_bootstrap.cc:492] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:17.513914 12025 ts_tablet_manager.cc:1403] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.068s	user 0.038s	sys 0.015s
I20260709 13:04:17.514313 12008 raft_consensus.cc:493] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.514972 12026 tablet_bootstrap.cc:654] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.514866 12008 raft_consensus.cc:515] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.516928 12008 leader_election.cc:290] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:17.516654 12025 raft_consensus.cc:359] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.517390 12025 raft_consensus.cc:385] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.517665 12025 raft_consensus.cc:740] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.518507 12025 consensus_queue.cc:260] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.518788 12064 raft_consensus.cc:493] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.519567 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acafb71e0bfe438b92fa3f198b816f9c" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:17.519491 12064 raft_consensus.cc:515] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.520273 11735 raft_consensus.cc:2468] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 0.
I20260709 13:04:17.520987 12025 ts_tablet_manager.cc:1434] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 13:04:17.521515 11774 leader_election.cc:343] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.521905 12064 leader_election.cc:290] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:17.522706 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acafb71e0bfe438b92fa3f198b816f9c" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:17.524442 11848 leader_election.cc:304] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:17.525281 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:17.525597 12045 raft_consensus.cc:2804] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.525955 11884 raft_consensus.cc:2468] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 0.
I20260709 13:04:17.527606 12025 tablet_bootstrap.cc:492] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5: Bootstrap starting.
W20260709 13:04:17.527480 11850 leader_election.cc:343] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.528076 11699 leader_election.cc:304] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:17.529418 12041 leader_election.cc:290] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:17.526062 12045 raft_consensus.cc:493] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.530647 12045 raft_consensus.cc:3060] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.536406 12026 tablet_bootstrap.cc:492] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:17.536984 12026 ts_tablet_manager.cc:1403] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.000s
I20260709 13:04:17.537158 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
W20260709 13:04:17.539038 11850 leader_election.cc:343] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.539186 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:17.539892 11735 raft_consensus.cc:2468] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 0.
I20260709 13:04:17.539929 12026 raft_consensus.cc:359] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.540897 12026 raft_consensus.cc:385] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.541220 12026 raft_consensus.cc:740] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.541872 12025 tablet_bootstrap.cc:654] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.544008 11848 leader_election.cc:304] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 4c1bdbc276ed41c4afad0e7bc4842046
I20260709 13:04:17.545234 12008 raft_consensus.cc:2804] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.545691 12008 raft_consensus.cc:493] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.546018 12008 raft_consensus.cc:3060] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.548558 12026 consensus_queue.cc:260] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.549574 12025 tablet_bootstrap.cc:492] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5: No bootstrap required, opened a new log
I20260709 13:04:17.550082 12025 ts_tablet_manager.cc:1403] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.003s
I20260709 13:04:17.552829 12025 raft_consensus.cc:359] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.553447 12025 raft_consensus.cc:385] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.553699 12025 raft_consensus.cc:740] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.554683 12025 consensus_queue.cc:260] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.556933 12064 raft_consensus.cc:2804] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.557096 12025 ts_tablet_manager.cc:1434] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:17.557392 12064 raft_consensus.cc:493] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.557753 12064 raft_consensus.cc:3060] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.560911 12026 ts_tablet_manager.cc:1434] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
W20260709 13:04:17.561236 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41983, user_credentials={real_user=slave}} blocked reactor thread for 104006us
I20260709 13:04:17.565089 12045 raft_consensus.cc:515] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.568187 11734 raft_consensus.cc:2468] T b07a160514f5411cbd368ce43c0e8b1c P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 1.
I20260709 13:04:17.569844 11774 leader_election.cc:304] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:17.571382 12040 raft_consensus.cc:493] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.571884 12040 raft_consensus.cc:515] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.573292 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:17.573984 12040 leader_election.cc:290] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:17.574625 12040 raft_consensus.cc:2804] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.575069 12040 raft_consensus.cc:697] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 LEADER]: Becoming Leader. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Running, Role: LEADER
I20260709 13:04:17.581983 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f215c9fe1104f03a9b0c0344e56fe07" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:17.582429 12040 consensus_queue.cc:237] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.585247 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f215c9fe1104f03a9b0c0344e56fe07" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:17.586340 11884 raft_consensus.cc:2393] T 7f215c9fe1104f03a9b0c0344e56fe07 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c1bdbc276ed41c4afad0e7bc4842046 in current term 1: Already voted for candidate 3ad798acb86a46218d2b7eb79ab128b1 in this term.
I20260709 13:04:17.588018 11774 leader_election.cc:304] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046; no voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:17.589084 12013 raft_consensus.cc:3060] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.593369 12026 tablet_bootstrap.cc:492] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046: Bootstrap starting.
I20260709 13:04:17.601200 12013 raft_consensus.cc:2749] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:17.610513 11633 catalog_manager.cc:5697] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.613364 12026 tablet_bootstrap.cc:654] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.631657 12056 raft_consensus.cc:493] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.634059 12041 raft_consensus.cc:493] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.636389 12026 tablet_bootstrap.cc:492] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046: No bootstrap required, opened a new log
I20260709 13:04:17.636979 12026 ts_tablet_manager.cc:1403] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent bootstrapping tablet: real 0.044s	user 0.005s	sys 0.007s
I20260709 13:04:17.634119 12056 raft_consensus.cc:515] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.643692 12056 leader_election.cc:290] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:17.634649 12041 raft_consensus.cc:515] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.645253 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66275bcb45044b59b00867e3c52f17f" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:17.645793 12041 leader_election.cc:290] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:17.646566 11632 catalog_manager.cc:5697] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:17.648301 11701 leader_election.cc:343] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.649180 11632 catalog_manager.cc:5697] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.651588 12045 leader_election.cc:290] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:17.580559 12008 raft_consensus.cc:515] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.670632 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66275bcb45044b59b00867e3c52f17f" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:17.671949 11810 raft_consensus.cc:2393] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ad798acb86a46218d2b7eb79ab128b1 in current term 1: Already voted for candidate d8045018ae5f4f18bfde7c44771fd2a5 in this term.
I20260709 13:04:17.671099 12064 raft_consensus.cc:515] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.670132 12008 leader_election.cc:290] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:17.679930 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:17.679425 11734 raft_consensus.cc:3060] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.679514 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acafb71e0bfe438b92fa3f198b816f9c" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:17.682654 11811 raft_consensus.cc:3060] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.682825 11701 leader_election.cc:304] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1; no voters: 4c1bdbc276ed41c4afad0e7bc4842046, d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:17.680589 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd4784e607e749dbb858dc1904bfd9a6" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:17.685673 11810 raft_consensus.cc:2393] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d8045018ae5f4f18bfde7c44771fd2a5 in current term 1: Already voted for candidate 3ad798acb86a46218d2b7eb79ab128b1 in this term.
I20260709 13:04:17.680917 12045 raft_consensus.cc:493] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.686467 12045 raft_consensus.cc:515] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.688293 12045 leader_election.cc:290] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:17.693671 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9cf1096fb4eb793c0c914de554875" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:17.694645 11810 raft_consensus.cc:2393] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d8045018ae5f4f18bfde7c44771fd2a5 in current term 1: Already voted for candidate 3ad798acb86a46218d2b7eb79ab128b1 in this term.
I20260709 13:04:17.694438 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd4784e607e749dbb858dc1904bfd9a6" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:17.695971 11811 raft_consensus.cc:2468] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 1.
I20260709 13:04:17.697469 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:17.695875 12010 raft_consensus.cc:2749] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:17.702029 11850 leader_election.cc:343] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.707448 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
W20260709 13:04:17.708256 11701 leader_election.cc:343] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.708664 11736 raft_consensus.cc:2393] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d8045018ae5f4f18bfde7c44771fd2a5 in current term 1: Already voted for candidate 3ad798acb86a46218d2b7eb79ab128b1 in this term.
I20260709 13:04:17.708328 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acafb71e0bfe438b92fa3f198b816f9c" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:17.709990 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:17.710903 11734 raft_consensus.cc:3060] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.711035 11884 raft_consensus.cc:2393] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ad798acb86a46218d2b7eb79ab128b1 in current term 1: Already voted for candidate d8045018ae5f4f18bfde7c44771fd2a5 in this term.
I20260709 13:04:17.712054 12008 consensus_queue.cc:1048] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.716987 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9cf1096fb4eb793c0c914de554875" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:17.718534 12064 leader_election.cc:290] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Requested vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:17.720737 11734 raft_consensus.cc:2468] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 1.
I20260709 13:04:17.721887 12026 raft_consensus.cc:359] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.722642 12026 raft_consensus.cc:385] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.722908 12026 raft_consensus.cc:740] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.723528 11848 leader_election.cc:304] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8045018ae5f4f18bfde7c44771fd2a5; no voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046
I20260709 13:04:17.724884 12008 raft_consensus.cc:3060] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.724570 12026 consensus_queue.cc:260] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.725131 12075 consensus_queue.cc:1048] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:17.727177 11848 leader_election.cc:304] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8045018ae5f4f18bfde7c44771fd2a5; no voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046
I20260709 13:04:17.727972 12075 raft_consensus.cc:2749] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:17.713502 11850 leader_election.cc:304] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:17.731757 12075 raft_consensus.cc:2804] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.731911 11850 leader_election.cc:304] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8045018ae5f4f18bfde7c44771fd2a5; no voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046
I20260709 13:04:17.732323 12075 raft_consensus.cc:697] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Becoming Leader. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:17.733274 12075 consensus_queue.cc:237] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.733915 12041 raft_consensus.cc:3060] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.736361 12045 consensus_queue.cc:1048] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.742319 12041 raft_consensus.cc:2749] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:17.745241 11699 leader_election.cc:304] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1; no voters: 4c1bdbc276ed41c4afad0e7bc4842046, d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:17.748281 12064 raft_consensus.cc:2749] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:17.753132 12026 ts_tablet_manager.cc:1434] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046: Time spent starting tablet: real 0.116s	user 0.008s	sys 0.000s
I20260709 13:04:17.754230 12024 consensus_queue.cc:1048] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.756100 12008 raft_consensus.cc:2749] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:17.794484 12041 consensus_queue.cc:1048] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:17.815405 11633 catalog_manager.cc:5697] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.818637 12075 raft_consensus.cc:493] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.819346 12075 raft_consensus.cc:515] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:17.825189 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a160514f5411cbd368ce43c0e8b1c" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:17.826205 11735 raft_consensus.cc:2393] T b07a160514f5411cbd368ce43c0e8b1c P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d8045018ae5f4f18bfde7c44771fd2a5 in current term 1: Already voted for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in this term.
I20260709 13:04:17.831470 12075 leader_election.cc:290] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:17.832078 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a160514f5411cbd368ce43c0e8b1c" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:17.833657 11850 leader_election.cc:304] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8045018ae5f4f18bfde7c44771fd2a5; no voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046
I20260709 13:04:17.834838 12075 raft_consensus.cc:3060] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.841566 12075 raft_consensus.cc:2749] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:17.915957 12064 consensus_queue.cc:1048] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.925594 12056 consensus_queue.cc:1048] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.941576 12064 consensus_queue.cc:1048] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.958729 12056 consensus_queue.cc:1048] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:17.980552 11682 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:17.998915 12032 consensus_queue.cc:1048] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:18.010511 12010 consensus_queue.cc:1048] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:18.026302 12024 consensus_queue.cc:1048] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:18.043633 12073 consensus_queue.cc:1048] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:18.125993 12075 consensus_queue.cc:1048] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:18.140890 12075 consensus_queue.cc:1048] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:18.212607 12013 raft_consensus.cc:493] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.213045 12013 raft_consensus.cc:515] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:18.214696 12013 leader_election.cc:290] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:18.215448 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:18.215863 11883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:18.216174 11735 raft_consensus.cc:2393] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c1bdbc276ed41c4afad0e7bc4842046 in current term 1: Already voted for candidate 3ad798acb86a46218d2b7eb79ab128b1 in this term.
I20260709 13:04:18.216820 11883 raft_consensus.cc:2393] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c1bdbc276ed41c4afad0e7bc4842046 in current term 1: Already voted for candidate d8045018ae5f4f18bfde7c44771fd2a5 in this term.
I20260709 13:04:18.217870 11774 leader_election.cc:304] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046; no voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:18.218487 12013 raft_consensus.cc:3060] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.226605 12013 raft_consensus.cc:2749] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:18.984721 11682 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:19.881867 12081 raft_consensus.cc:493] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.882457 12081 raft_consensus.cc:515] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:19.884544 12081 leader_election.cc:290] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:19.885229 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:19.885496 12097 raft_consensus.cc:493] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.885790 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" is_pre_election: true
I20260709 13:04:19.885983 11736 raft_consensus.cc:2468] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 1.
I20260709 13:04:19.886009 12097 raft_consensus.cc:515] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:19.887288 11811 raft_consensus.cc:2468] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 1.
I20260709 13:04:19.887341 11848 leader_election.cc:304] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:19.888192 12081 raft_consensus.cc:2804] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:19.888545 12081 raft_consensus.cc:493] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.888907 12081 raft_consensus.cc:3060] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:19.889724 12097 leader_election.cc:290] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:19.891471 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1" is_pre_election: true
I20260709 13:04:19.892128 11736 raft_consensus.cc:2468] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 1.
I20260709 13:04:19.892185 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" is_pre_election: true
I20260709 13:04:19.893519 11774 leader_election.cc:304] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: 
I20260709 13:04:19.894259 12097 raft_consensus.cc:2804] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:19.894637 12097 raft_consensus.cc:493] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.894958 12097 raft_consensus.cc:3060] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:19.896447 12081 raft_consensus.cc:515] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:19.897591 11884 raft_consensus.cc:2393] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c1bdbc276ed41c4afad0e7bc4842046 in current term 2: Already voted for candidate d8045018ae5f4f18bfde7c44771fd2a5 in this term.
I20260709 13:04:19.898686 12081 leader_election.cc:290] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 2 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:19.899503 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:19.900120 11736 raft_consensus.cc:3060] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:19.900264 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:19.902257 12097 raft_consensus.cc:515] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:19.903288 11811 raft_consensus.cc:2393] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d8045018ae5f4f18bfde7c44771fd2a5 in current term 2: Already voted for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in this term.
I20260709 13:04:19.904062 12097 leader_election.cc:290] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 2 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:19.904656 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:19.905882 11736 raft_consensus.cc:2468] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 2.
I20260709 13:04:19.906514 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:19.907099 11884 raft_consensus.cc:2393] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c1bdbc276ed41c4afad0e7bc4842046 in current term 2: Already voted for candidate d8045018ae5f4f18bfde7c44771fd2a5 in this term.
I20260709 13:04:19.907887 11774 leader_election.cc:304] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046; no voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:19.908110 11848 leader_election.cc:304] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 4c1bdbc276ed41c4afad0e7bc4842046
I20260709 13:04:19.908700 12097 raft_consensus.cc:2749] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:19.909250 12081 raft_consensus.cc:2804] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:19.910475 12081 raft_consensus.cc:697] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 LEADER]: Becoming Leader. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:19.911435 12081 consensus_queue.cc:237] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:19.918432 11632 catalog_manager.cc:5697] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 reported cstate change: term changed from 0 to 2, leader changed from <none> to d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:20.032658 11811 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8186bc9b8544cc6aaa2f11f458c8979"
dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
mode: GRACEFUL
new_leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
 from {username='slave'} at 127.0.0.1:42856
I20260709 13:04:20.033228 11811 raft_consensus.cc:606] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 LEADER]: Received request to transfer leadership to TS 3ad798acb86a46218d2b7eb79ab128b1
I20260709 13:04:20.038378 11884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b66275bcb45044b59b00867e3c52f17f"
dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
mode: GRACEFUL
new_leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
 from {username='slave'} at 127.0.0.1:55424
I20260709 13:04:20.038877 11884 raft_consensus.cc:606] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Received request to transfer leadership to TS 3ad798acb86a46218d2b7eb79ab128b1
I20260709 13:04:20.046578 11884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acafb71e0bfe438b92fa3f198b816f9c"
dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
mode: GRACEFUL
new_leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
 from {username='slave'} at 127.0.0.1:55424
I20260709 13:04:20.047160 11884 raft_consensus.cc:606] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Received request to transfer leadership to TS 3ad798acb86a46218d2b7eb79ab128b1
I20260709 13:04:20.052254 11884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93203f863deb439aad4ff1c558273837"
dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
mode: GRACEFUL
new_leader_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
 from {username='slave'} at 127.0.0.1:55424
I20260709 13:04:20.052735 11884 raft_consensus.cc:606] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 LEADER]: Received request to transfer leadership to TS 4c1bdbc276ed41c4afad0e7bc4842046
I20260709 13:04:20.057514 11736 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd4784e607e749dbb858dc1904bfd9a6"
dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
mode: GRACEFUL
new_leader_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
 from {username='slave'} at 127.0.0.1:50732
I20260709 13:04:20.058094 11736 raft_consensus.cc:606] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Received request to transfer leadership to TS 4c1bdbc276ed41c4afad0e7bc4842046
I20260709 13:04:20.062942 11884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cf640a08d864ee0b25edcbf0920e77a"
dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
mode: GRACEFUL
new_leader_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
 from {username='slave'} at 127.0.0.1:55424
I20260709 13:04:20.063408 11884 raft_consensus.cc:606] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Received request to transfer leadership to TS 4c1bdbc276ed41c4afad0e7bc4842046
I20260709 13:04:20.070609 11736 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dd9cf1096fb4eb793c0c914de554875"
dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
mode: GRACEFUL
new_leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
 from {username='slave'} at 127.0.0.1:50732
I20260709 13:04:20.071157 11736 raft_consensus.cc:606] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Received request to transfer leadership to TS d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:20.109046 12098 raft_consensus.cc:993] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5: : Instructing follower 3ad798acb86a46218d2b7eb79ab128b1 to start an election
I20260709 13:04:20.109551 12081 raft_consensus.cc:1081] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Signalling peer 3ad798acb86a46218d2b7eb79ab128b1 to start an election
I20260709 13:04:20.111372 11736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b66275bcb45044b59b00867e3c52f17f"
dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
 from {username='slave'} at 127.0.0.1:50712
I20260709 13:04:20.111909 11736 raft_consensus.cc:493] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:20.112280 11736 raft_consensus.cc:3060] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.117303 11736 raft_consensus.cc:515] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.118798 11736 leader_election.cc:290] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 2 election: Requested vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:20.119800 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66275bcb45044b59b00867e3c52f17f" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:20.120029 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66275bcb45044b59b00867e3c52f17f" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:20.120388 11811 raft_consensus.cc:3060] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.120683 11884 raft_consensus.cc:3055] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:20.121022 11884 raft_consensus.cc:740] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:20.121759 11884 consensus_queue.cc:260] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.122685 11884 raft_consensus.cc:3060] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.127036 11811 raft_consensus.cc:2468] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 2.
I20260709 13:04:20.128580 11701 leader_election.cc:304] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: 
I20260709 13:04:20.129405 12010 raft_consensus.cc:2804] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:20.129959 12010 raft_consensus.cc:697] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Becoming Leader. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:20.130674 11884 raft_consensus.cc:2468] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 2.
I20260709 13:04:20.130849 12098 raft_consensus.cc:993] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5: : Instructing follower 4c1bdbc276ed41c4afad0e7bc4842046 to start an election
I20260709 13:04:20.130790 12010 consensus_queue.cc:237] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.131547 12081 raft_consensus.cc:1081] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Signalling peer 4c1bdbc276ed41c4afad0e7bc4842046 to start an election
I20260709 13:04:20.133190 11811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cf640a08d864ee0b25edcbf0920e77a"
dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
 from {username='slave'} at 127.0.0.1:42842
I20260709 13:04:20.133701 11811 raft_consensus.cc:493] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:20.134091 11811 raft_consensus.cc:3060] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.139649 11811 raft_consensus.cc:515] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.140339 11632 catalog_manager.cc:5697] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 reported cstate change: term changed from 1 to 2, leader changed from d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195) to 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.141435 11811 leader_election.cc:290] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 2 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:20.143026 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf640a08d864ee0b25edcbf0920e77a" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:20.143572 11736 raft_consensus.cc:3060] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.143774 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf640a08d864ee0b25edcbf0920e77a" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:20.144316 11884 raft_consensus.cc:3055] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:20.144786 11884 raft_consensus.cc:740] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:20.145520 11884 consensus_queue.cc:260] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.146678 11884 raft_consensus.cc:3060] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.146919 12010 raft_consensus.cc:993] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1: : Instructing follower 4c1bdbc276ed41c4afad0e7bc4842046 to start an election
I20260709 13:04:20.147437 12010 raft_consensus.cc:1081] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Signalling peer 4c1bdbc276ed41c4afad0e7bc4842046 to start an election
I20260709 13:04:20.148985 11810 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd4784e607e749dbb858dc1904bfd9a6"
dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
 from {username='slave'} at 127.0.0.1:42854
I20260709 13:04:20.149484 11810 raft_consensus.cc:493] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:20.149807 11810 raft_consensus.cc:3060] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.150484 11736 raft_consensus.cc:2468] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 2.
I20260709 13:04:20.151669 11774 leader_election.cc:304] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: 
I20260709 13:04:20.152467 12097 raft_consensus.cc:2804] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:20.152925 12097 raft_consensus.cc:697] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 LEADER]: Becoming Leader. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Running, Role: LEADER
I20260709 13:04:20.153862 12097 consensus_queue.cc:237] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.155951 11884 raft_consensus.cc:2468] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 2.
I20260709 13:04:20.157006 11810 raft_consensus.cc:515] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.159996 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd4784e607e749dbb858dc1904bfd9a6" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:20.160305 11810 leader_election.cc:290] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 2 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:20.160533 11736 raft_consensus.cc:3055] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:20.160948 11736 raft_consensus.cc:740] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:20.161420 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd4784e607e749dbb858dc1904bfd9a6" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:20.161970 11884 raft_consensus.cc:3060] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.164203 11632 catalog_manager.cc:5697] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 reported cstate change: term changed from 1 to 2, leader changed from d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195) to 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.167076 11736 consensus_queue.cc:260] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.168306 11736 raft_consensus.cc:3060] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.168708 11884 raft_consensus.cc:2468] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 2.
I20260709 13:04:20.169801 11774 leader_election.cc:304] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:20.170532 12097 raft_consensus.cc:2804] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:20.171008 12097 raft_consensus.cc:697] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 LEADER]: Becoming Leader. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Running, Role: LEADER
I20260709 13:04:20.171836 12097 consensus_queue.cc:237] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.174423 11736 raft_consensus.cc:2468] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 2.
I20260709 13:04:20.179388 11632 catalog_manager.cc:5697] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 reported cstate change: term changed from 1 to 2, leader changed from 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193) to 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.321419 12097 raft_consensus.cc:993] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046: : Instructing follower 3ad798acb86a46218d2b7eb79ab128b1 to start an election
I20260709 13:04:20.321938 12094 raft_consensus.cc:1081] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 LEADER]: Signalling peer 3ad798acb86a46218d2b7eb79ab128b1 to start an election
I20260709 13:04:20.323570 11736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8186bc9b8544cc6aaa2f11f458c8979"
dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
 from {username='slave'} at 127.0.0.1:50728
I20260709 13:04:20.324043 11736 raft_consensus.cc:493] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:20.324319 11736 raft_consensus.cc:3060] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.328814 11736 raft_consensus.cc:515] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.330547 11736 leader_election.cc:290] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 2 election: Requested vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:20.331554 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8186bc9b8544cc6aaa2f11f458c8979" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:20.331701 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8186bc9b8544cc6aaa2f11f458c8979" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:20.332374 11810 raft_consensus.cc:3055] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:20.332407 11884 raft_consensus.cc:3060] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.333570 11810 raft_consensus.cc:740] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Running, Role: LEADER
I20260709 13:04:20.334453 11810 consensus_queue.cc:260] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.335455 11810 raft_consensus.cc:3060] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.337745 11884 raft_consensus.cc:2468] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 2.
I20260709 13:04:20.338892 11699 leader_election.cc:304] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:20.339708 12032 raft_consensus.cc:2804] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:20.340411 12032 raft_consensus.cc:697] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Becoming Leader. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:20.340431 11810 raft_consensus.cc:2468] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 2.
I20260709 13:04:20.341375 12032 consensus_queue.cc:237] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.347579 11810 raft_consensus.cc:1275] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Refusing update from remote peer d8045018ae5f4f18bfde7c44771fd2a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:20.348785 12081 consensus_queue.cc:1048] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:20.349004 11632 catalog_manager.cc:5697] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 reported cstate change: term changed from 1 to 2, leader changed from 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194) to 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.356686 12098 raft_consensus.cc:993] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5: : Instructing follower 4c1bdbc276ed41c4afad0e7bc4842046 to start an election
I20260709 13:04:20.358299 12081 raft_consensus.cc:1081] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 LEADER]: Signalling peer 4c1bdbc276ed41c4afad0e7bc4842046 to start an election
I20260709 13:04:20.358939 12010 raft_consensus.cc:993] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1: : Instructing follower d8045018ae5f4f18bfde7c44771fd2a5 to start an election
I20260709 13:04:20.359475 12010 raft_consensus.cc:1081] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Signalling peer d8045018ae5f4f18bfde7c44771fd2a5 to start an election
I20260709 13:04:20.360813 11811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93203f863deb439aad4ff1c558273837"
dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
 from {username='slave'} at 127.0.0.1:42842
I20260709 13:04:20.361987 11884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dd9cf1096fb4eb793c0c914de554875"
dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
 from {username='slave'} at 127.0.0.1:55408
I20260709 13:04:20.362727 11884 raft_consensus.cc:493] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:20.363178 11884 raft_consensus.cc:3060] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.364231 11811 raft_consensus.cc:493] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:20.364642 11811 raft_consensus.cc:3060] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:20.365054 11736 raft_consensus.cc:1275] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Refusing update from remote peer d8045018ae5f4f18bfde7c44771fd2a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:20.366760 12081 consensus_queue.cc:1048] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:20.380313 12081 raft_consensus.cc:993] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5: : Instructing follower 3ad798acb86a46218d2b7eb79ab128b1 to start an election
I20260709 13:04:20.380856 12110 raft_consensus.cc:1081] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Signalling peer 3ad798acb86a46218d2b7eb79ab128b1 to start an election
I20260709 13:04:20.382709 11735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acafb71e0bfe438b92fa3f198b816f9c"
dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
 from {username='slave'} at 127.0.0.1:50712
I20260709 13:04:20.383337 11735 raft_consensus.cc:493] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:20.383729 11735 raft_consensus.cc:3060] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.385087 11811 raft_consensus.cc:515] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.390934 11811 leader_election.cc:290] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 3 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:20.392458 11884 raft_consensus.cc:515] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.393978 11735 raft_consensus.cc:515] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.394515 11884 leader_election.cc:290] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 2 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:20.397375 11735 leader_election.cc:290] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 2 election: Requested vote from peers 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983), d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195:34455)
I20260709 13:04:20.398118 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:20.398242 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9cf1096fb4eb793c0c914de554875" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:20.398711 11736 raft_consensus.cc:3060] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:20.399005 11734 raft_consensus.cc:3055] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:20.399487 11734 raft_consensus.cc:740] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:20.399649 11884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:20.400578 11884 raft_consensus.cc:3055] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:20.400532 11734 consensus_queue.cc:260] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.401149 11884 raft_consensus.cc:740] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:20.401836 11734 raft_consensus.cc:3060] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.402247 11884 consensus_queue.cc:260] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.403688 11884 raft_consensus.cc:3060] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:20.404139 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acafb71e0bfe438b92fa3f198b816f9c" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:20.404827 11810 raft_consensus.cc:3060] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.407068 11883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acafb71e0bfe438b92fa3f198b816f9c" candidate_uuid: "3ad798acb86a46218d2b7eb79ab128b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
I20260709 13:04:20.407729 11883 raft_consensus.cc:3055] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:20.408033 11883 raft_consensus.cc:740] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:20.408816 11883 consensus_queue.cc:260] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.409511 11734 raft_consensus.cc:2468] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 2.
I20260709 13:04:20.409922 11883 raft_consensus.cc:3060] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.411209 11810 raft_consensus.cc:2468] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 2.
I20260709 13:04:20.411295 11884 raft_consensus.cc:2468] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 3.
I20260709 13:04:20.412698 11701 leader_election.cc:304] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, 4c1bdbc276ed41c4afad0e7bc4842046; no voters: 
I20260709 13:04:20.411473 11848 leader_election.cc:304] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:20.413486 12010 raft_consensus.cc:2804] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:20.413686 12081 raft_consensus.cc:2804] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:20.414027 12010 raft_consensus.cc:697] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Becoming Leader. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:20.414377 12081 raft_consensus.cc:697] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 LEADER]: Becoming Leader. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:20.414862 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9cf1096fb4eb793c0c914de554875" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:20.414961 12010 consensus_queue.cc:237] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.415910 12081 consensus_queue.cc:237] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.416852 11811 raft_consensus.cc:3060] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.419301 11736 raft_consensus.cc:2468] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c1bdbc276ed41c4afad0e7bc4842046 in term 3.
I20260709 13:04:20.419344 11774 leader_election.cc:304] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:20.420691 12094 raft_consensus.cc:2804] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:20.421136 12094 raft_consensus.cc:697] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 LEADER]: Becoming Leader. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Running, Role: LEADER
I20260709 13:04:20.421972 11883 raft_consensus.cc:2468] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ad798acb86a46218d2b7eb79ab128b1 in term 2.
I20260709 13:04:20.422101 12094 consensus_queue.cc:237] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:20.436041 11632 catalog_manager.cc:5697] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 reported cstate change: term changed from 2 to 3, leader changed from d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195) to 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.436848 11629 catalog_manager.cc:5697] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 reported cstate change: term changed from 1 to 2, leader changed from 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193) to d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:20.437621 11633 catalog_manager.cc:5697] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 reported cstate change: term changed from 1 to 2, leader changed from d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195) to 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "3ad798acb86a46218d2b7eb79ab128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.438231 11811 raft_consensus.cc:2468] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 2.
I20260709 13:04:20.556469 11811 raft_consensus.cc:1275] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Refusing update from remote peer 3ad798acb86a46218d2b7eb79ab128b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:20.557832 12010 consensus_queue.cc:1048] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.566474 11883 raft_consensus.cc:1275] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Refusing update from remote peer 3ad798acb86a46218d2b7eb79ab128b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:20.568060 12117 consensus_queue.cc:1048] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.632717 11883 raft_consensus.cc:1275] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Refusing update from remote peer 4c1bdbc276ed41c4afad0e7bc4842046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:20.634214 12094 consensus_queue.cc:1048] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.644121 11734 raft_consensus.cc:1275] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Refusing update from remote peer 4c1bdbc276ed41c4afad0e7bc4842046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:20.645490 12107 consensus_queue.cc:1048] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.662393 11884 raft_consensus.cc:1275] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Refusing update from remote peer 4c1bdbc276ed41c4afad0e7bc4842046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:20.663621 12094 consensus_queue.cc:1048] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:20.673663 11734 raft_consensus.cc:1275] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Refusing update from remote peer 4c1bdbc276ed41c4afad0e7bc4842046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:20.675187 12125 consensus_queue.cc:1048] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.727927 11884 raft_consensus.cc:1275] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Refusing update from remote peer 3ad798acb86a46218d2b7eb79ab128b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:20.729223 12117 consensus_queue.cc:1048] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.738154 11811 raft_consensus.cc:1275] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Refusing update from remote peer 3ad798acb86a46218d2b7eb79ab128b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:20.739499 12032 consensus_queue.cc:1048] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.836966 11811 raft_consensus.cc:1275] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Refusing update from remote peer 3ad798acb86a46218d2b7eb79ab128b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:20.838411 12032 consensus_queue.cc:1048] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.848002 11884 raft_consensus.cc:1275] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Refusing update from remote peer 3ad798acb86a46218d2b7eb79ab128b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:20.848593 11734 raft_consensus.cc:1275] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Refusing update from remote peer d8045018ae5f4f18bfde7c44771fd2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:20.850296 12117 consensus_queue.cc:1048] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:20.851562 12081 consensus_queue.cc:1048] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:20.860965 11811 raft_consensus.cc:1275] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Refusing update from remote peer d8045018ae5f4f18bfde7c44771fd2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:20.862502 12110 consensus_queue.cc:1048] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.953140 11736 raft_consensus.cc:1275] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 3 FOLLOWER]: Refusing update from remote peer 4c1bdbc276ed41c4afad0e7bc4842046: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:20.954226 12125 consensus_queue.cc:1048] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.959668 11884 raft_consensus.cc:1275] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 FOLLOWER]: Refusing update from remote peer 4c1bdbc276ed41c4afad0e7bc4842046: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:20.961081 12094 consensus_queue.cc:1048] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:23.074759 11633 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48514:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:04:23.096144 11633 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48514:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:04:23.126593   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:04:23.298987 12154 log.cc:927] Time spent T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:04:23.373468 12184 tablet.cc:1724] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.446904 12188 tablet.cc:1724] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.452543 12195 tablet.cc:1724] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.455068 12196 tablet.cc:1724] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:23.488226 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34455, user_credentials={real_user=slave}} blocked reactor thread for 55537.2us
W20260709 13:04:23.500669 12192 log.cc:927] Time spent T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:04:23.518687 12203 tablet.cc:1724] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.458825 12181 tablet.cc:1724] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.523589 12205 tablet.cc:1724] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.494534 12186 tablet.cc:1724] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.492525 12187 tablet.cc:1724] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.525698 12197 tablet.cc:1724] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.541947 12204 tablet.cc:1724] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.549208 11808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93203f863deb439aad4ff1c558273837"
dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
mode: GRACEFUL
new_leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
 from {username='slave'} at 127.0.0.1:54276
I20260709 13:04:23.554914 11808 raft_consensus.cc:606] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 LEADER]: Received request to transfer leadership to TS d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:23.560820 12184 tablet.cc:1724] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.560992 12205 tablet.cc:1724] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.581945 12186 tablet.cc:1724] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:23.588985 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41983, user_credentials={real_user=slave}} blocked reactor thread for 92694.6us
I20260709 13:04:23.597609 12181 tablet.cc:1724] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.599689 12203 tablet.cc:1724] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.613013 12209 tablet.cc:1724] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.606844 12196 tablet.cc:1724] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.625952 12195 tablet.cc:1724] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.616945 12187 tablet.cc:1724] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.632881 12186 tablet.cc:1724] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.638157 12188 tablet.cc:1724] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.642515 12197 tablet.cc:1724] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.649343 12184 tablet.cc:1724] T 7f215c9fe1104f03a9b0c0344e56fe07 P d8045018ae5f4f18bfde7c44771fd2a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.650624 12205 tablet.cc:1724] T b07a160514f5411cbd368ce43c0e8b1c P 3ad798acb86a46218d2b7eb79ab128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.663543 12209 tablet.cc:1724] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.674676 11733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b66275bcb45044b59b00867e3c52f17f"
dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
mode: GRACEFUL
new_leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
 from {username='slave'} at 127.0.0.1:47290
I20260709 13:04:23.675418 11733 raft_consensus.cc:606] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Received request to transfer leadership to TS d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:23.677886   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:04:23.678550   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:23.682658 12205 tablet.cc:1724] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:23.700754 11733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70f82bef26544ababc7fdd6ec974d800"
dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
mode: GRACEFUL
new_leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
 from {username='slave'} at 127.0.0.1:47290
I20260709 13:04:23.701387 11733 raft_consensus.cc:606] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Received request to transfer leadership to TS d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:23.707785 11809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77"
dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
mode: GRACEFUL
new_leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
 from {username='slave'} at 127.0.0.1:54276
I20260709 13:04:23.708400 11809 raft_consensus.cc:606] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 LEADER]: Received request to transfer leadership to TS d8045018ae5f4f18bfde7c44771fd2a5
I20260709 13:04:23.710101   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:23.710716   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:23.723464 11631 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889: soft_deleted_table [id=b9aa12c5bf59431582b5e581a95d7107] alter complete (version 1)
I20260709 13:04:23.802417 12159 raft_consensus.cc:993] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046: : Instructing follower d8045018ae5f4f18bfde7c44771fd2a5 to start an election
I20260709 13:04:23.802975 12163 raft_consensus.cc:1081] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 LEADER]: Signalling peer d8045018ae5f4f18bfde7c44771fd2a5 to start an election
I20260709 13:04:23.804469 11877 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93203f863deb439aad4ff1c558273837"
dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
 from {username='slave'} at 127.0.0.1:55404
I20260709 13:04:23.804900 11877 raft_consensus.cc:493] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:23.805199 11877 raft_consensus.cc:3060] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:23.811110 11877 raft_consensus.cc:515] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:23.812659 11877 leader_election.cc:290] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 4 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:23.813369 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:23.813624 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93203f863deb439aad4ff1c558273837" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:23.813939 11733 raft_consensus.cc:3060] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:23.814327 11809 raft_consensus.cc:3055] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:23.814667 11809 raft_consensus.cc:740] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Running, Role: LEADER
I20260709 13:04:23.815443 11809 consensus_queue.cc:260] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:23.816349 11809 raft_consensus.cc:3060] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:23.820021 11733 raft_consensus.cc:2468] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 4.
I20260709 13:04:23.821120 11848 leader_election.cc:304] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:23.821745 12110 raft_consensus.cc:2804] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:23.822167 12110 raft_consensus.cc:697] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 4 LEADER]: Becoming Leader. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:23.822443 11809 raft_consensus.cc:2468] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 4.
I20260709 13:04:23.822897 12110 consensus_queue.cc:237] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:23.830662 11629 catalog_manager.cc:5697] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 reported cstate change: term changed from 3 to 4, leader changed from 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194) to d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:23.966468 12206 raft_consensus.cc:993] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1: : Instructing follower d8045018ae5f4f18bfde7c44771fd2a5 to start an election
I20260709 13:04:23.967093 12208 raft_consensus.cc:1081] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Signalling peer d8045018ae5f4f18bfde7c44771fd2a5 to start an election
I20260709 13:04:23.968551 11877 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70f82bef26544ababc7fdd6ec974d800"
dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
 from {username='slave'} at 127.0.0.1:55408
I20260709 13:04:23.969048 11877 raft_consensus.cc:493] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:23.969347 11877 raft_consensus.cc:3060] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:23.974521 11877 raft_consensus.cc:515] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:23.976284 11877 leader_election.cc:290] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:23.976956 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f82bef26544ababc7fdd6ec974d800" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:23.977281 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f82bef26544ababc7fdd6ec974d800" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:23.977608 11733 raft_consensus.cc:3055] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:23.977864 11809 raft_consensus.cc:3060] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:23.977982 11733 raft_consensus.cc:740] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:23.978834 11733 consensus_queue.cc:260] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:23.979842 11733 raft_consensus.cc:3060] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:23.982968 11809 raft_consensus.cc:2468] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 3.
I20260709 13:04:23.984097 11850 leader_election.cc:304] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:23.985129 12110 raft_consensus.cc:2804] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:23.985473 11733 raft_consensus.cc:2468] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 3.
I20260709 13:04:23.985584 12110 raft_consensus.cc:697] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 LEADER]: Becoming Leader. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:23.986552 12110 consensus_queue.cc:237] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:23.994606 11629 catalog_manager.cc:5697] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 reported cstate change: term changed from 2 to 3, leader changed from 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193) to d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:24.028843 12200 raft_consensus.cc:993] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1: : Instructing follower d8045018ae5f4f18bfde7c44771fd2a5 to start an election
I20260709 13:04:24.029356 12208 raft_consensus.cc:1081] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Signalling peer d8045018ae5f4f18bfde7c44771fd2a5 to start an election
I20260709 13:04:24.030906 11877 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b66275bcb45044b59b00867e3c52f17f"
dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
 from {username='slave'} at 127.0.0.1:55408
I20260709 13:04:24.031442 11877 raft_consensus.cc:493] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.031780 11877 raft_consensus.cc:3060] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.038518 11877 raft_consensus.cc:515] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:24.040421 11877 leader_election.cc:290] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:24.041049 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66275bcb45044b59b00867e3c52f17f" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:24.041349 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66275bcb45044b59b00867e3c52f17f" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:24.041775 11733 raft_consensus.cc:3055] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:24.041952 11809 raft_consensus.cc:3060] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.042105 11733 raft_consensus.cc:740] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ad798acb86a46218d2b7eb79ab128b1, State: Running, Role: LEADER
I20260709 13:04:24.042959 11733 consensus_queue.cc:260] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:24.043982 11733 raft_consensus.cc:3060] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.047130 11809 raft_consensus.cc:2468] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 3.
I20260709 13:04:24.048224 11850 leader_election.cc:304] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c1bdbc276ed41c4afad0e7bc4842046, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:24.048970 12110 raft_consensus.cc:2804] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:24.048971 11733 raft_consensus.cc:2468] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 3.
I20260709 13:04:24.049544 12110 raft_consensus.cc:697] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 LEADER]: Becoming Leader. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:24.050467 12110 consensus_queue.cc:237] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:24.056866 11629 catalog_manager.cc:5697] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 reported cstate change: term changed from 2 to 3, leader changed from 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193) to d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:24.153285 12163 raft_consensus.cc:993] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046: : Instructing follower d8045018ae5f4f18bfde7c44771fd2a5 to start an election
I20260709 13:04:24.153849 12159 raft_consensus.cc:1081] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 LEADER]: Signalling peer d8045018ae5f4f18bfde7c44771fd2a5 to start an election
I20260709 13:04:24.155748 11877 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77"
dest_uuid: "d8045018ae5f4f18bfde7c44771fd2a5"
 from {username='slave'} at 127.0.0.1:55404
I20260709 13:04:24.156337 11877 raft_consensus.cc:493] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.156657 11877 raft_consensus.cc:3060] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.161846 11877 raft_consensus.cc:515] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:24.163525 11877 leader_election.cc:290] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965), 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983)
I20260709 13:04:24.164152 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3ad798acb86a46218d2b7eb79ab128b1"
I20260709 13:04:24.164423 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b784881fc1f242669b6ed0bf16a79b77" candidate_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4c1bdbc276ed41c4afad0e7bc4842046"
I20260709 13:04:24.164805 11733 raft_consensus.cc:3060] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.165001 11809 raft_consensus.cc:3055] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:24.165380 11809 raft_consensus.cc:740] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4c1bdbc276ed41c4afad0e7bc4842046, State: Running, Role: LEADER
I20260709 13:04:24.166075 11809 consensus_queue.cc:260] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:24.167013 11809 raft_consensus.cc:3060] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.170423 11733 raft_consensus.cc:2468] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 3.
I20260709 13:04:24.171504 11848 leader_election.cc:304] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad798acb86a46218d2b7eb79ab128b1, d8045018ae5f4f18bfde7c44771fd2a5; no voters: 
I20260709 13:04:24.172279 12110 raft_consensus.cc:2804] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:24.172335 11809 raft_consensus.cc:2468] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8045018ae5f4f18bfde7c44771fd2a5 in term 3.
I20260709 13:04:24.172852 12110 raft_consensus.cc:697] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 LEADER]: Becoming Leader. State: Replica: d8045018ae5f4f18bfde7c44771fd2a5, State: Running, Role: LEADER
I20260709 13:04:24.173710 12110 consensus_queue.cc:237] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } }
I20260709 13:04:24.181161 11629 catalog_manager.cc:5697] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 reported cstate change: term changed from 2 to 3, leader changed from 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194) to d8045018ae5f4f18bfde7c44771fd2a5 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8045018ae5f4f18bfde7c44771fd2a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34455 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:24.216393 11733 raft_consensus.cc:1275] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 4 FOLLOWER]: Refusing update from remote peer d8045018ae5f4f18bfde7c44771fd2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:24.217609 12110 consensus_queue.cc:1048] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:24.226084 11809 raft_consensus.cc:1275] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 4 FOLLOWER]: Refusing update from remote peer d8045018ae5f4f18bfde7c44771fd2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:24.228096 12110 consensus_queue.cc:1048] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:24.399735 11733 raft_consensus.cc:1275] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 3 FOLLOWER]: Refusing update from remote peer d8045018ae5f4f18bfde7c44771fd2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:24.402307 12110 consensus_queue.cc:1048] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:24.420573 11808 raft_consensus.cc:1275] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 FOLLOWER]: Refusing update from remote peer d8045018ae5f4f18bfde7c44771fd2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:24.428313 12217 consensus_queue.cc:1048] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:24.577991 11809 raft_consensus.cc:1275] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 FOLLOWER]: Refusing update from remote peer d8045018ae5f4f18bfde7c44771fd2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:24.579442 12217 consensus_queue.cc:1048] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:24.592710 11733 raft_consensus.cc:1275] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 3 FOLLOWER]: Refusing update from remote peer d8045018ae5f4f18bfde7c44771fd2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:24.595359 12222 consensus_queue.cc:1048] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:24.613201 11733 raft_consensus.cc:1275] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 3 FOLLOWER]: Refusing update from remote peer d8045018ae5f4f18bfde7c44771fd2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:04:24.614786 12222 consensus_queue.cc:1048] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad798acb86a46218d2b7eb79ab128b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:24.624681 11809 raft_consensus.cc:1275] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 FOLLOWER]: Refusing update from remote peer d8045018ae5f4f18bfde7c44771fd2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:04:24.626842 12222 consensus_queue.cc:1048] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c1bdbc276ed41c4afad0e7bc4842046" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:24.776527   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:04:24.781287   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:04:24.781716   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:24.786525   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:04:24.786916   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:25.818284   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:04:25.855075   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:25.855994   431 tablet_replica.cc:333] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
I20260709 13:04:25.857205   431 raft_consensus.cc:2243] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.857843   431 raft_consensus.cc:2272] T b66275bcb45044b59b00867e3c52f17f P 3ad798acb86a46218d2b7eb79ab128b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.861415   431 tablet_replica.cc:333] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
I20260709 13:04:25.862228   431 raft_consensus.cc:2243] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.862864   431 raft_consensus.cc:2272] T fd4784e607e749dbb858dc1904bfd9a6 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.865522   431 tablet_replica.cc:333] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
I20260709 13:04:25.866257   431 raft_consensus.cc:2243] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.866936   431 raft_consensus.cc:2272] T 8dd9cf1096fb4eb793c0c914de554875 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.869518   431 tablet_replica.cc:333] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
I20260709 13:04:25.870461   431 raft_consensus.cc:2243] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.871438   431 raft_consensus.cc:2272] T 93203f863deb439aad4ff1c558273837 P 3ad798acb86a46218d2b7eb79ab128b1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.875075   431 tablet_replica.cc:333] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
I20260709 13:04:25.876235   431 raft_consensus.cc:2243] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.877197   431 raft_consensus.cc:2272] T 8cf640a08d864ee0b25edcbf0920e77a P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:25.878450 11774 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 13:04:25.881371   431 tablet_replica.cc:333] T c45240651efa4d34bea3f0f3c17695b1 P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
W20260709 13:04:25.882015 11774 consensus_peers.cc:597] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 -> Peer 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965): Couldn't send request to peer 3ad798acb86a46218d2b7eb79ab128b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:25.882223   431 raft_consensus.cc:2243] T c45240651efa4d34bea3f0f3c17695b1 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.882982   431 raft_consensus.cc:2272] T c45240651efa4d34bea3f0f3c17695b1 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.885721   431 tablet_replica.cc:333] T 09934c1c037240c196b3bae228867d4b P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
I20260709 13:04:25.886409   431 raft_consensus.cc:2243] T 09934c1c037240c196b3bae228867d4b P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.886966   431 raft_consensus.cc:2272] T 09934c1c037240c196b3bae228867d4b P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.889624   431 tablet_replica.cc:333] T b07a160514f5411cbd368ce43c0e8b1c P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
I20260709 13:04:25.890296   431 raft_consensus.cc:2243] T b07a160514f5411cbd368ce43c0e8b1c P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.890883   431 raft_consensus.cc:2272] T b07a160514f5411cbd368ce43c0e8b1c P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.893908   431 tablet_replica.cc:333] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
I20260709 13:04:25.894510   431 raft_consensus.cc:2243] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:25.894608 11774 consensus_peers.cc:597] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 -> Peer 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965): Couldn't send request to peer 3ad798acb86a46218d2b7eb79ab128b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:25.895195   431 raft_consensus.cc:2272] T 1289552d3a3549b5b5112d882715c129 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.897946   431 tablet_replica.cc:333] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
I20260709 13:04:25.898603   431 raft_consensus.cc:2243] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.899174   431 raft_consensus.cc:2272] T b784881fc1f242669b6ed0bf16a79b77 P 3ad798acb86a46218d2b7eb79ab128b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.901872   431 tablet_replica.cc:333] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
I20260709 13:04:25.902474   431 raft_consensus.cc:2243] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.903478   431 raft_consensus.cc:2272] T f1aab8dac20f46d08a9c0ca1b39dd678 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.906049   431 tablet_replica.cc:333] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
I20260709 13:04:25.906749   431 raft_consensus.cc:2243] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.907819   431 raft_consensus.cc:2272] T acafb71e0bfe438b92fa3f198b816f9c P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.910444   431 tablet_replica.cc:333] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
I20260709 13:04:25.911042   431 raft_consensus.cc:2243] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.911571   431 raft_consensus.cc:2272] T fbef4a23506b4e9494f9f021b00eb4bc P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.914037   431 tablet_replica.cc:333] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
I20260709 13:04:25.914690   431 raft_consensus.cc:2243] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.915624   431 raft_consensus.cc:2272] T 7f215c9fe1104f03a9b0c0344e56fe07 P 3ad798acb86a46218d2b7eb79ab128b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.918231   431 tablet_replica.cc:333] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
I20260709 13:04:25.918924   431 raft_consensus.cc:2243] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.920100   431 raft_consensus.cc:2272] T d8186bc9b8544cc6aaa2f11f458c8979 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.923458   431 tablet_replica.cc:333] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
I20260709 13:04:25.924144   431 raft_consensus.cc:2243] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.924809   431 raft_consensus.cc:2272] T 70f82bef26544ababc7fdd6ec974d800 P 3ad798acb86a46218d2b7eb79ab128b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.928808   431 tablet_replica.cc:333] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
W20260709 13:04:25.928850 11848 consensus_peers.cc:597] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 -> Peer 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965): Couldn't send request to peer 3ad798acb86a46218d2b7eb79ab128b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:25.928725 11774 consensus_peers.cc:597] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 -> Peer 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965): Couldn't send request to peer 3ad798acb86a46218d2b7eb79ab128b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:25.930012   431 raft_consensus.cc:2243] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.930992   431 raft_consensus.cc:2272] T 2e5168c42aa6410e869fa98334a3ec27 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.934201   431 tablet_replica.cc:333] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1: stopping tablet replica
I20260709 13:04:25.934934   431 raft_consensus.cc:2243] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.936152   431 raft_consensus.cc:2272] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 3ad798acb86a46218d2b7eb79ab128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:25.975649 11848 consensus_peers.cc:597] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 -> Peer 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965): Couldn't send request to peer 3ad798acb86a46218d2b7eb79ab128b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:25.976238 11848 consensus_peers.cc:597] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 -> Peer 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965): Couldn't send request to peer 3ad798acb86a46218d2b7eb79ab128b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:25.989439   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:04:26.036280   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:04:26.062896 11774 consensus_peers.cc:597] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 -> Peer 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965): Couldn't send request to peer 3ad798acb86a46218d2b7eb79ab128b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:26.067050   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:26.067849   431 tablet_replica.cc:333] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.068688   431 raft_consensus.cc:2243] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.069206   431 raft_consensus.cc:2272] T 93203f863deb439aad4ff1c558273837 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.071698   431 tablet_replica.cc:333] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.072324   431 raft_consensus.cc:2243] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.072841   431 raft_consensus.cc:2272] T 8dd9cf1096fb4eb793c0c914de554875 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.075148   431 tablet_replica.cc:333] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.075899   431 raft_consensus.cc:2243] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:26.076738   431 raft_consensus.cc:2272] T fd4784e607e749dbb858dc1904bfd9a6 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.078851   431 tablet_replica.cc:333] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.079515   431 raft_consensus.cc:2243] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.079983   431 raft_consensus.cc:2272] T b66275bcb45044b59b00867e3c52f17f P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.081943   431 tablet_replica.cc:333] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.082501   431 raft_consensus.cc:2243] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.082962   431 raft_consensus.cc:2272] T b2d5e43b25f94e5caefe9e5229f7b4c2 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.085067   431 tablet_replica.cc:333] T f1aab8dac20f46d08a9c0ca1b39dd678 P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.085642   431 raft_consensus.cc:2243] T f1aab8dac20f46d08a9c0ca1b39dd678 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.086097   431 raft_consensus.cc:2272] T f1aab8dac20f46d08a9c0ca1b39dd678 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.088380   431 tablet_replica.cc:333] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.088922   431 raft_consensus.cc:2243] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.089403   431 raft_consensus.cc:2272] T acafb71e0bfe438b92fa3f198b816f9c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.091382   431 tablet_replica.cc:333] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.091902   431 raft_consensus.cc:2243] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:26.092770   431 raft_consensus.cc:2272] T fbef4a23506b4e9494f9f021b00eb4bc P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.094807   431 tablet_replica.cc:333] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.095417   431 raft_consensus.cc:2243] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:26.096280   431 raft_consensus.cc:2272] T 8cf640a08d864ee0b25edcbf0920e77a P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.098455   431 tablet_replica.cc:333] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.099082   431 raft_consensus.cc:2243] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:26.100134   431 raft_consensus.cc:2272] T 09934c1c037240c196b3bae228867d4b P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.102818   431 tablet_replica.cc:333] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.103461   431 raft_consensus.cc:2243] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:26.104501   431 raft_consensus.cc:2272] T c45240651efa4d34bea3f0f3c17695b1 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.107511   431 tablet_replica.cc:333] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.108458   431 raft_consensus.cc:2243] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:26.109620   431 raft_consensus.cc:2272] T b07a160514f5411cbd368ce43c0e8b1c P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:26.109951 11848 consensus_peers.cc:597] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 -> Peer 3ad798acb86a46218d2b7eb79ab128b1 (127.0.107.193:35965): Couldn't send request to peer 3ad798acb86a46218d2b7eb79ab128b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:26.112287   431 tablet_replica.cc:333] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.112914   431 raft_consensus.cc:2243] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.113437   431 raft_consensus.cc:2272] T 1289552d3a3549b5b5112d882715c129 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.115810   431 tablet_replica.cc:333] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.116400   431 raft_consensus.cc:2243] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.116837   431 raft_consensus.cc:2272] T b784881fc1f242669b6ed0bf16a79b77 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.119424   431 tablet_replica.cc:333] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.119964   431 raft_consensus.cc:2243] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.120540   431 raft_consensus.cc:2272] T 7f215c9fe1104f03a9b0c0344e56fe07 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.122615   431 tablet_replica.cc:333] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.123162   431 raft_consensus.cc:2243] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.123773   431 raft_consensus.cc:2272] T 70f82bef26544ababc7fdd6ec974d800 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.126015   431 tablet_replica.cc:333] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.126497   431 raft_consensus.cc:2243] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.127102   431 raft_consensus.cc:2272] T d8186bc9b8544cc6aaa2f11f458c8979 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.129254   431 tablet_replica.cc:333] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046: stopping tablet replica
I20260709 13:04:26.129738   431 raft_consensus.cc:2243] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.130185   431 raft_consensus.cc:2272] T 2e5168c42aa6410e869fa98334a3ec27 P 4c1bdbc276ed41c4afad0e7bc4842046 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.194186   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:04:26.233187 11850 consensus_peers.cc:597] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 -> Peer 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983): Couldn't send request to peer 4c1bdbc276ed41c4afad0e7bc4842046. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41983: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:26.241706   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:04:26.268195 11850 consensus_peers.cc:597] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 -> Peer 4c1bdbc276ed41c4afad0e7bc4842046 (127.0.107.194:41983): Couldn't send request to peer 4c1bdbc276ed41c4afad0e7bc4842046. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41983: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:26.272890   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:26.273669   431 tablet_replica.cc:333] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.274358   431 raft_consensus.cc:2243] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:26.275328   431 raft_consensus.cc:2272] T 8dd9cf1096fb4eb793c0c914de554875 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.277475   431 tablet_replica.cc:333] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.278031   431 raft_consensus.cc:2243] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:26.278775   431 raft_consensus.cc:2272] T 93203f863deb439aad4ff1c558273837 P d8045018ae5f4f18bfde7c44771fd2a5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.280757   431 tablet_replica.cc:333] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.281332   431 raft_consensus.cc:2243] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.281823   431 raft_consensus.cc:2272] T fd4784e607e749dbb858dc1904bfd9a6 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.284003   431 tablet_replica.cc:333] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.284541   431 raft_consensus.cc:2243] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:26.285281   431 raft_consensus.cc:2272] T b66275bcb45044b59b00867e3c52f17f P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.287387   431 tablet_replica.cc:333] T c45240651efa4d34bea3f0f3c17695b1 P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.287926   431 raft_consensus.cc:2243] T c45240651efa4d34bea3f0f3c17695b1 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.288355   431 raft_consensus.cc:2272] T c45240651efa4d34bea3f0f3c17695b1 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.290373   431 tablet_replica.cc:333] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.290920   431 raft_consensus.cc:2243] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.291493   431 raft_consensus.cc:2272] T 8cf640a08d864ee0b25edcbf0920e77a P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.293412   431 tablet_replica.cc:333] T 09934c1c037240c196b3bae228867d4b P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.293920   431 raft_consensus.cc:2243] T 09934c1c037240c196b3bae228867d4b P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.294358   431 raft_consensus.cc:2272] T 09934c1c037240c196b3bae228867d4b P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.296476   431 tablet_replica.cc:333] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.296995   431 raft_consensus.cc:2243] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:26.297739   431 raft_consensus.cc:2272] T b784881fc1f242669b6ed0bf16a79b77 P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.299690   431 tablet_replica.cc:333] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.300231   431 raft_consensus.cc:2243] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.300766   431 raft_consensus.cc:2272] T b07a160514f5411cbd368ce43c0e8b1c P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.303151   431 tablet_replica.cc:333] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.303982   431 raft_consensus.cc:2243] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:26.305281   431 raft_consensus.cc:2272] T 1289552d3a3549b5b5112d882715c129 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.308010   431 tablet_replica.cc:333] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.308796   431 raft_consensus.cc:2243] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.309324   431 raft_consensus.cc:2272] T b2d5e43b25f94e5caefe9e5229f7b4c2 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.311995   431 tablet_replica.cc:333] T f1aab8dac20f46d08a9c0ca1b39dd678 P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.312579   431 raft_consensus.cc:2243] T f1aab8dac20f46d08a9c0ca1b39dd678 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.313072   431 raft_consensus.cc:2272] T f1aab8dac20f46d08a9c0ca1b39dd678 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.315392   431 tablet_replica.cc:333] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.315981   431 raft_consensus.cc:2243] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.316519   431 raft_consensus.cc:2272] T acafb71e0bfe438b92fa3f198b816f9c P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.319173   431 tablet_replica.cc:333] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.319782   431 raft_consensus.cc:2243] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.320312   431 raft_consensus.cc:2272] T fbef4a23506b4e9494f9f021b00eb4bc P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.323015   431 tablet_replica.cc:333] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.323776   431 raft_consensus.cc:2243] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.324321   431 raft_consensus.cc:2272] T d8186bc9b8544cc6aaa2f11f458c8979 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.326709   431 tablet_replica.cc:333] T 7f215c9fe1104f03a9b0c0344e56fe07 P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.327283   431 raft_consensus.cc:2243] T 7f215c9fe1104f03a9b0c0344e56fe07 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.327878   431 raft_consensus.cc:2272] T 7f215c9fe1104f03a9b0c0344e56fe07 P d8045018ae5f4f18bfde7c44771fd2a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.330071   431 tablet_replica.cc:333] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.330626   431 raft_consensus.cc:2243] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:26.331486   431 raft_consensus.cc:2272] T 70f82bef26544ababc7fdd6ec974d800 P d8045018ae5f4f18bfde7c44771fd2a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.333771   431 tablet_replica.cc:333] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5: stopping tablet replica
I20260709 13:04:26.334265   431 raft_consensus.cc:2243] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.334800   431 raft_consensus.cc:2272] T 2e5168c42aa6410e869fa98334a3ec27 P d8045018ae5f4f18bfde7c44771fd2a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.377149   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:26.419332   431 master.cc:562] Master@127.0.107.254:40827 shutting down...
I20260709 13:04:26.442186   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:26.442791   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.443120   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 39080440bce84283b60f9f14454a2889: stopping tablet replica
I20260709 13:04:26.465757   431 master.cc:584] Master@127.0.107.254:40827 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (14750 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:04:26.524896   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37827
I20260709 13:04:26.526146   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:26.532678 12234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:26.533509 12236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:26.532784 12233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:26.533849   431 server_base.cc:1061] running on GCE node
I20260709 13:04:26.534946   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:26.535154   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:26.535359   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602266535341 us; error 0 us; skew 500 ppm
I20260709 13:04:26.535871   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:26.538427   431 webserver.cc:533] Webserver started at http://127.0.107.254:45921/ using document root <none> and password file <none>
I20260709 13:04:26.538929   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:26.539137   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:26.539448   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:26.540586   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/master-0-root/instance:
uuid: "19f5d46ebf48429398aff61742f42949"
format_stamp: "Formatted at 2026-07-09 13:04:26 on dist-test-slave-zhw8"
I20260709 13:04:26.544911   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:26.548380 12241 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:26.549224   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:26.549625   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/master-0-root
uuid: "19f5d46ebf48429398aff61742f42949"
format_stamp: "Formatted at 2026-07-09 13:04:26 on dist-test-slave-zhw8"
I20260709 13:04:26.549942   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:26.575515   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:26.576856   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:26.617565   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37827
I20260709 13:04:26.617686 12292 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37827 every 8 connection(s)
I20260709 13:04:26.621537 12293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.632617 12293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949: Bootstrap starting.
I20260709 13:04:26.637517 12293 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:26.641825 12293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949: No bootstrap required, opened a new log
I20260709 13:04:26.644039 12293 raft_consensus.cc:359] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19f5d46ebf48429398aff61742f42949" member_type: VOTER }
I20260709 13:04:26.644414 12293 raft_consensus.cc:385] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:26.644659 12293 raft_consensus.cc:740] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f5d46ebf48429398aff61742f42949, State: Initialized, Role: FOLLOWER
I20260709 13:04:26.645321 12293 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19f5d46ebf48429398aff61742f42949" member_type: VOTER }
I20260709 13:04:26.645782 12293 raft_consensus.cc:399] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:26.646001 12293 raft_consensus.cc:493] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:26.646276 12293 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:26.650986 12293 raft_consensus.cc:515] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19f5d46ebf48429398aff61742f42949" member_type: VOTER }
I20260709 13:04:26.651543 12293 leader_election.cc:304] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19f5d46ebf48429398aff61742f42949; no voters: 
I20260709 13:04:26.652760 12293 leader_election.cc:290] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:26.653177 12296 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:26.654568 12296 raft_consensus.cc:697] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [term 1 LEADER]: Becoming Leader. State: Replica: 19f5d46ebf48429398aff61742f42949, State: Running, Role: LEADER
I20260709 13:04:26.655222 12296 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19f5d46ebf48429398aff61742f42949" member_type: VOTER }
I20260709 13:04:26.655921 12293 sys_catalog.cc:565] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:26.659974 12297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19f5d46ebf48429398aff61742f42949" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19f5d46ebf48429398aff61742f42949" member_type: VOTER } }
I20260709 13:04:26.660959 12298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19f5d46ebf48429398aff61742f42949. Latest consensus state: current_term: 1 leader_uuid: "19f5d46ebf48429398aff61742f42949" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19f5d46ebf48429398aff61742f42949" member_type: VOTER } }
I20260709 13:04:26.661618 12297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:26.661679 12298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:26.663837 12303 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:26.669139 12303 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:26.672330   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:26.678718 12303 catalog_manager.cc:1383] Generated new cluster ID: 6cc4fb08303146e9a77caf4e3fb40f6e
I20260709 13:04:26.679031 12303 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:26.718880 12303 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:26.720542 12303 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:26.742404 12303 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949: Generated new TSK 0
I20260709 13:04:26.743028 12303 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:26.804431   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:26.810812 12314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:26.812119 12315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:26.813946   431 server_base.cc:1061] running on GCE node
W20260709 13:04:26.813985 12317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:26.815143   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:26.815424   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:26.815590   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602266815574 us; error 0 us; skew 500 ppm
I20260709 13:04:26.816143   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:26.818822   431 webserver.cc:533] Webserver started at http://127.0.107.193:33971/ using document root <none> and password file <none>
I20260709 13:04:26.819463   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:26.819680   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:26.819954   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:26.821265   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/ts-0-root/instance:
uuid: "490d760480074f44856a0eea650897e2"
format_stamp: "Formatted at 2026-07-09 13:04:26 on dist-test-slave-zhw8"
I20260709 13:04:26.826122   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:04:26.829540 12322 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:26.830344   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:26.830647   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/ts-0-root
uuid: "490d760480074f44856a0eea650897e2"
format_stamp: "Formatted at 2026-07-09 13:04:26 on dist-test-slave-zhw8"
I20260709 13:04:26.830981   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:26.846526   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:26.847863   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:26.849328   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:26.851727   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:26.852035   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:26.852311   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:26.852546   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:26.894769   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:42707
I20260709 13:04:26.894855 12384 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:42707 every 8 connection(s)
I20260709 13:04:26.899890   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:26.907593 12389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:26.910537   431 server_base.cc:1061] running on GCE node
W20260709 13:04:26.910832 12390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:26.911763 12392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:26.912925   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:26.913184   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:26.913383   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602266913366 us; error 0 us; skew 500 ppm
I20260709 13:04:26.914083   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:26.914281 12385 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37827
I20260709 13:04:26.914749 12385 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:26.915575 12385 heartbeater.cc:507] Master 127.0.107.254:37827 requested a full tablet report, sending...
I20260709 13:04:26.916953   431 webserver.cc:533] Webserver started at http://127.0.107.194:43603/ using document root <none> and password file <none>
I20260709 13:04:26.917654   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:26.917661 12258 ts_manager.cc:194] Registered new tserver with Master: 490d760480074f44856a0eea650897e2 (127.0.107.193:42707)
I20260709 13:04:26.917991   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:26.918375   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:26.920006   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/ts-1-root/instance:
uuid: "94843016eb774f7a86692342c1b4c192"
format_stamp: "Formatted at 2026-07-09 13:04:26 on dist-test-slave-zhw8"
I20260709 13:04:26.920318 12258 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51864
I20260709 13:04:26.924980   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:26.929075 12397 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:26.929934   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:04:26.930255   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/ts-1-root
uuid: "94843016eb774f7a86692342c1b4c192"
format_stamp: "Formatted at 2026-07-09 13:04:26 on dist-test-slave-zhw8"
I20260709 13:04:26.930531   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:26.961681   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:26.962883   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:26.964411   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:26.966828   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:26.967051   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:26.967309   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:26.967489   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:27.012856   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:40729
I20260709 13:04:27.012959 12459 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:40729 every 8 connection(s)
I20260709 13:04:27.018244   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:27.026782 12463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:27.028425 12464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:27.032490 12466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:27.032899 12460 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37827
I20260709 13:04:27.033401 12460 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:27.033645   431 server_base.cc:1061] running on GCE node
I20260709 13:04:27.034353 12460 heartbeater.cc:507] Master 127.0.107.254:37827 requested a full tablet report, sending...
I20260709 13:04:27.034618   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:27.034926   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:27.035113   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602267035097 us; error 0 us; skew 500 ppm
I20260709 13:04:27.035899   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:27.036695 12258 ts_manager.cc:194] Registered new tserver with Master: 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729)
I20260709 13:04:27.038791 12258 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51868
I20260709 13:04:27.038949   431 webserver.cc:533] Webserver started at http://127.0.107.195:34769/ using document root <none> and password file <none>
I20260709 13:04:27.039659   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:27.039917   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:27.040239   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:27.041422   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/ts-2-root/instance:
uuid: "fd48f77857a446d7b9a780d156984eda"
format_stamp: "Formatted at 2026-07-09 13:04:27 on dist-test-slave-zhw8"
I20260709 13:04:27.045818   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:04:27.050042 12471 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:27.050918   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:04:27.051326   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/ts-2-root
uuid: "fd48f77857a446d7b9a780d156984eda"
format_stamp: "Formatted at 2026-07-09 13:04:27 on dist-test-slave-zhw8"
I20260709 13:04:27.051662   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPqmK0b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601945298557-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:27.076418   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:27.077757   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:27.079433   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:27.081935   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:27.082201   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:27.082466   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:27.082666   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:27.126750   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:39735
I20260709 13:04:27.126860 12533 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:39735 every 8 connection(s)
I20260709 13:04:27.141099 12534 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37827
I20260709 13:04:27.141605 12534 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:27.142412 12534 heartbeater.cc:507] Master 127.0.107.254:37827 requested a full tablet report, sending...
I20260709 13:04:27.144447 12258 ts_manager.cc:194] Registered new tserver with Master: fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:27.144753   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014689553s
I20260709 13:04:27.146287 12258 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51880
I20260709 13:04:27.173981 12258 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51882:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:27.176957 12258 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:27.247550 12497 tablet_service.cc:1511] Processing CreateTablet for tablet 6fc12318d797492499c5bab80be4aa39 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:27.247746 12499 tablet_service.cc:1511] Processing CreateTablet for tablet d6867276dd8a48728dabeb52c4d3c2e9 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:27.249027 12497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc12318d797492499c5bab80be4aa39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.250831 12498 tablet_service.cc:1511] Processing CreateTablet for tablet ef0bf6a51c1749f18728e522847937c4 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:27.252815 12498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef0bf6a51c1749f18728e522847937c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.255064 12424 tablet_service.cc:1511] Processing CreateTablet for tablet ef0bf6a51c1749f18728e522847937c4 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:27.255389 12423 tablet_service.cc:1511] Processing CreateTablet for tablet 6fc12318d797492499c5bab80be4aa39 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:27.256294 12499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6867276dd8a48728dabeb52c4d3c2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.256554 12424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef0bf6a51c1749f18728e522847937c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.257750 12425 tablet_service.cc:1511] Processing CreateTablet for tablet d6867276dd8a48728dabeb52c4d3c2e9 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:27.261924 12425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6867276dd8a48728dabeb52c4d3c2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.267087 12423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc12318d797492499c5bab80be4aa39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.279907 12350 tablet_service.cc:1511] Processing CreateTablet for tablet d6867276dd8a48728dabeb52c4d3c2e9 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:27.281495 12350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6867276dd8a48728dabeb52c4d3c2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.284570 12349 tablet_service.cc:1511] Processing CreateTablet for tablet ef0bf6a51c1749f18728e522847937c4 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:27.286069 12349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef0bf6a51c1749f18728e522847937c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.292119 12348 tablet_service.cc:1511] Processing CreateTablet for tablet 6fc12318d797492499c5bab80be4aa39 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:27.293673 12348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc12318d797492499c5bab80be4aa39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.293903 12347 tablet_service.cc:1511] Processing CreateTablet for tablet 327fa75753f149959a81b96b9b3635ff (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:27.295374 12347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327fa75753f149959a81b96b9b3635ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.302037 12422 tablet_service.cc:1511] Processing CreateTablet for tablet 327fa75753f149959a81b96b9b3635ff (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:27.304371 12422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327fa75753f149959a81b96b9b3635ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.308665 12496 tablet_service.cc:1511] Processing CreateTablet for tablet 327fa75753f149959a81b96b9b3635ff (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:27.310619 12496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327fa75753f149959a81b96b9b3635ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.312731 12346 tablet_service.cc:1511] Processing CreateTablet for tablet 3985047828c145d4bb0f8b39d1216080 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:27.313570 12421 tablet_service.cc:1511] Processing CreateTablet for tablet 3985047828c145d4bb0f8b39d1216080 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:27.314181 12346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3985047828c145d4bb0f8b39d1216080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.314935 12421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3985047828c145d4bb0f8b39d1216080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.317273 12495 tablet_service.cc:1511] Processing CreateTablet for tablet 3985047828c145d4bb0f8b39d1216080 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:27.318584 12495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3985047828c145d4bb0f8b39d1216080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.323801 12549 tablet_bootstrap.cc:492] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
I20260709 13:04:27.327387 12345 tablet_service.cc:1511] Processing CreateTablet for tablet e92397046da34f10a3938976d5d581b1 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:27.329955 12345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e92397046da34f10a3938976d5d581b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.364408 12549 tablet_bootstrap.cc:654] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.364327 12421 tablet_service.cc:1511] Processing CreateTablet for tablet e92397046da34f10a3938976d5d581b1 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:27.365708 12421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e92397046da34f10a3938976d5d581b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.370086 12550 tablet_bootstrap.cc:492] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2: Bootstrap starting.
I20260709 13:04:27.374121 12549 tablet_bootstrap.cc:492] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:27.374749 12549 ts_tablet_manager.cc:1403] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.003s
I20260709 13:04:27.380832 12550 tablet_bootstrap.cc:654] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.384580 12496 tablet_service.cc:1511] Processing CreateTablet for tablet e92397046da34f10a3938976d5d581b1 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:27.386117 12496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e92397046da34f10a3938976d5d581b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.386582 12347 tablet_service.cc:1511] Processing CreateTablet for tablet 69e626ea4434444da48e89a36f490386 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:27.387969 12347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69e626ea4434444da48e89a36f490386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.390241 12551 tablet_bootstrap.cc:492] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
I20260709 13:04:27.388769 12422 tablet_service.cc:1511] Processing CreateTablet for tablet 69e626ea4434444da48e89a36f490386 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:27.392124 12422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69e626ea4434444da48e89a36f490386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.411212 12550 tablet_bootstrap.cc:492] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:27.411782 12551 tablet_bootstrap.cc:654] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.411615 12549 raft_consensus.cc:359] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.412518 12549 raft_consensus.cc:385] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.412875 12549 raft_consensus.cc:740] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.414552 12549 consensus_queue.cc:260] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.411803 12550 ts_tablet_manager.cc:1403] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.021s
I20260709 13:04:27.415980 12496 tablet_service.cc:1511] Processing CreateTablet for tablet 69e626ea4434444da48e89a36f490386 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:27.417444 12496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69e626ea4434444da48e89a36f490386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.424188 12550 raft_consensus.cc:359] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.424459 12350 tablet_service.cc:1511] Processing CreateTablet for tablet 4d6ea491b3804e65afcf8825807fd5b0 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:27.425251 12550 raft_consensus.cc:385] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.425777 12550 raft_consensus.cc:740] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.426457 12350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d6ea491b3804e65afcf8825807fd5b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.426669 12550 consensus_queue.cc:260] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.433957 12495 tablet_service.cc:1511] Processing CreateTablet for tablet 4d6ea491b3804e65afcf8825807fd5b0 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:27.435366 12495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d6ea491b3804e65afcf8825807fd5b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.436746 12347 tablet_service.cc:1511] Processing CreateTablet for tablet b6c8ea1f5f3e49c9a64a36b9d8dc4370 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:27.438053 12347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c8ea1f5f3e49c9a64a36b9d8dc4370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.439047 12423 tablet_service.cc:1511] Processing CreateTablet for tablet b6c8ea1f5f3e49c9a64a36b9d8dc4370 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:27.440419 12423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c8ea1f5f3e49c9a64a36b9d8dc4370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.443799 12549 ts_tablet_manager.cc:1434] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.069s	user 0.010s	sys 0.006s
I20260709 13:04:27.444298 12498 tablet_service.cc:1511] Processing CreateTablet for tablet b6c8ea1f5f3e49c9a64a36b9d8dc4370 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:27.445513 12549 tablet_bootstrap.cc:492] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
I20260709 13:04:27.444633 12460 heartbeater.cc:499] Master 127.0.107.254:37827 was elected leader, sending a full tablet report...
I20260709 13:04:27.445544 12498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c8ea1f5f3e49c9a64a36b9d8dc4370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.459299 12421 tablet_service.cc:1511] Processing CreateTablet for tablet 4d6ea491b3804e65afcf8825807fd5b0 (DEFAULT_TABLE table=test-workload [id=6d45f12b3610480dbf30c218fb72ae98]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:27.460861 12421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d6ea491b3804e65afcf8825807fd5b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.482693 12551 tablet_bootstrap.cc:492] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:27.483588 12551 ts_tablet_manager.cc:1403] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.094s	user 0.018s	sys 0.027s
I20260709 13:04:27.488010 12551 raft_consensus.cc:359] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.489182 12551 raft_consensus.cc:385] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.489655 12551 raft_consensus.cc:740] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.488745 12549 tablet_bootstrap.cc:654] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.491925 12385 heartbeater.cc:499] Master 127.0.107.254:37827 was elected leader, sending a full tablet report...
I20260709 13:04:27.490741 12551 consensus_queue.cc:260] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.495014 12550 ts_tablet_manager.cc:1434] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.079s	user 0.019s	sys 0.030s
I20260709 13:04:27.496469 12550 tablet_bootstrap.cc:492] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2: Bootstrap starting.
I20260709 13:04:27.503511 12551 ts_tablet_manager.cc:1434] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 13:04:27.504863 12550 tablet_bootstrap.cc:654] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.505410 12534 heartbeater.cc:499] Master 127.0.107.254:37827 was elected leader, sending a full tablet report...
I20260709 13:04:27.512032 12551 tablet_bootstrap.cc:492] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
W20260709 13:04:27.517474 12461 tablet.cc:2406] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:27.519702 12551 tablet_bootstrap.cc:654] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.525429 12549 tablet_bootstrap.cc:492] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:27.525730 12551 tablet_bootstrap.cc:492] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:27.526044 12549 ts_tablet_manager.cc:1403] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.081s	user 0.007s	sys 0.018s
I20260709 13:04:27.526119 12550 tablet_bootstrap.cc:492] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:27.526306 12551 ts_tablet_manager.cc:1403] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.002s
I20260709 13:04:27.526961 12550 ts_tablet_manager.cc:1403] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.007s
I20260709 13:04:27.530066 12549 raft_consensus.cc:359] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.530109 12551 raft_consensus.cc:359] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.530349 12550 raft_consensus.cc:359] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.531179 12551 raft_consensus.cc:385] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.531257 12550 raft_consensus.cc:385] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.531033 12549 raft_consensus.cc:385] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.531733 12550 raft_consensus.cc:740] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.531654 12551 raft_consensus.cc:740] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.532260 12549 raft_consensus.cc:740] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.532776 12550 consensus_queue.cc:260] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.533265 12549 consensus_queue.cc:260] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.532946 12551 consensus_queue.cc:260] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.535549 12550 ts_tablet_manager.cc:1434] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:27.535888 12549 ts_tablet_manager.cc:1434] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.005s
I20260709 13:04:27.536545 12550 tablet_bootstrap.cc:492] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2: Bootstrap starting.
I20260709 13:04:27.536623 12551 ts_tablet_manager.cc:1434] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.007s
I20260709 13:04:27.536988 12549 tablet_bootstrap.cc:492] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
I20260709 13:04:27.543475 12549 tablet_bootstrap.cc:654] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.543787 12550 tablet_bootstrap.cc:654] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.548620 12551 tablet_bootstrap.cc:492] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
I20260709 13:04:27.552574 12550 tablet_bootstrap.cc:492] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:27.553179 12550 ts_tablet_manager.cc:1403] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:04:27.556542 12551 tablet_bootstrap.cc:654] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.556246 12550 raft_consensus.cc:359] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.557014 12550 raft_consensus.cc:385] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.557318 12550 raft_consensus.cc:740] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.559499 12550 consensus_queue.cc:260] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.560230 12549 tablet_bootstrap.cc:492] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:27.560844 12549 ts_tablet_manager.cc:1403] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.011s
I20260709 13:04:27.562512 12550 ts_tablet_manager.cc:1434] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:27.563853 12550 tablet_bootstrap.cc:492] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2: Bootstrap starting.
I20260709 13:04:27.564087 12549 raft_consensus.cc:359] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } }
I20260709 13:04:27.565001 12549 raft_consensus.cc:385] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.565351 12549 raft_consensus.cc:740] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.566160 12549 consensus_queue.cc:260] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } }
I20260709 13:04:27.568686 12549 ts_tablet_manager.cc:1434] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:27.569605 12549 tablet_bootstrap.cc:492] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
I20260709 13:04:27.573611 12550 tablet_bootstrap.cc:654] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.576133 12549 tablet_bootstrap.cc:654] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.580878 12549 tablet_bootstrap.cc:492] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:27.581054 12550 tablet_bootstrap.cc:492] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:27.581369 12549 ts_tablet_manager.cc:1403] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.005s
I20260709 13:04:27.582080 12550 ts_tablet_manager.cc:1403] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:04:27.584357 12551 tablet_bootstrap.cc:492] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:27.584599 12549 raft_consensus.cc:359] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.584995 12551 ts_tablet_manager.cc:1403] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.018s
I20260709 13:04:27.585361 12549 raft_consensus.cc:385] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.585155 12550 raft_consensus.cc:359] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.586012 12549 raft_consensus.cc:740] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.586084 12550 raft_consensus.cc:385] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.586506 12550 raft_consensus.cc:740] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.586822 12549 consensus_queue.cc:260] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.587277 12550 consensus_queue.cc:260] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.589160 12549 ts_tablet_manager.cc:1434] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:04:27.589551 12550 ts_tablet_manager.cc:1434] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:27.590167 12549 tablet_bootstrap.cc:492] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
I20260709 13:04:27.590564 12550 tablet_bootstrap.cc:492] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2: Bootstrap starting.
I20260709 13:04:27.591212 12551 raft_consensus.cc:359] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } }
I20260709 13:04:27.592013 12551 raft_consensus.cc:385] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.592307 12551 raft_consensus.cc:740] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.593174 12551 consensus_queue.cc:260] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } }
I20260709 13:04:27.594660 12556 raft_consensus.cc:493] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.595184 12556 raft_consensus.cc:515] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.597483 12549 tablet_bootstrap.cc:654] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.597543 12550 tablet_bootstrap.cc:654] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.597899 12551 ts_tablet_manager.cc:1434] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:04:27.599123 12551 tablet_bootstrap.cc:492] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
I20260709 13:04:27.607079 12551 tablet_bootstrap.cc:654] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.609520 12550 tablet_bootstrap.cc:492] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:27.610137 12550 ts_tablet_manager.cc:1403] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:04:27.611987 12556 leader_election.cc:290] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:27.614073 12550 raft_consensus.cc:359] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.624042 12550 raft_consensus.cc:385] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.624423 12550 raft_consensus.cc:740] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.618147 12551 tablet_bootstrap.cc:492] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:27.625273 12550 consensus_queue.cc:260] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.625984 12551 ts_tablet_manager.cc:1403] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.007s
I20260709 13:04:27.627655 12550 ts_tablet_manager.cc:1434] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.004s
I20260709 13:04:27.629230 12551 raft_consensus.cc:359] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.630036 12551 raft_consensus.cc:385] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.630342 12551 raft_consensus.cc:740] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.631451 12551 consensus_queue.cc:260] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.634598 12550 tablet_bootstrap.cc:492] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2: Bootstrap starting.
I20260709 13:04:27.637228 12551 ts_tablet_manager.cc:1434] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:27.639956 12551 tablet_bootstrap.cc:492] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
I20260709 13:04:27.647200 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327fa75753f149959a81b96b9b3635ff" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
I20260709 13:04:27.648032 12435 raft_consensus.cc:2468] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 0.
I20260709 13:04:27.649490 12326 leader_election.cc:304] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:27.649852 12551 tablet_bootstrap.cc:654] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.650386 12556 raft_consensus.cc:2804] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:27.650818 12556 raft_consensus.cc:493] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.651248 12556 raft_consensus.cc:3060] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.651510 12550 tablet_bootstrap.cc:654] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.655740 12549 tablet_bootstrap.cc:492] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:27.656424 12549 ts_tablet_manager.cc:1403] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.066s	user 0.019s	sys 0.026s
I20260709 13:04:27.666204 12556 raft_consensus.cc:515] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
W20260709 13:04:27.668021 12306 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:27.669397 12556 leader_election.cc:290] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 election: Requested vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:27.669000 12549 raft_consensus.cc:359] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.671458 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327fa75753f149959a81b96b9b3635ff" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:27.674650 12435 raft_consensus.cc:3060] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.675258 12550 tablet_bootstrap.cc:492] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:27.675792 12550 ts_tablet_manager.cc:1403] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.015s
I20260709 13:04:27.676110 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327fa75753f149959a81b96b9b3635ff" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
I20260709 13:04:27.677034 12509 raft_consensus.cc:2468] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 0.
I20260709 13:04:27.678884 12550 raft_consensus.cc:359] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } }
I20260709 13:04:27.679703 12550 raft_consensus.cc:385] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.679513 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327fa75753f149959a81b96b9b3635ff" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:27.680225 12550 raft_consensus.cc:740] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.680471 12509 raft_consensus.cc:3060] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.681078 12550 consensus_queue.cc:260] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } }
I20260709 13:04:27.679679 12554 raft_consensus.cc:493] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.683419 12550 ts_tablet_manager.cc:1434] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:27.683779 12549 raft_consensus.cc:385] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.683583 12554 raft_consensus.cc:515] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.684823 12549 raft_consensus.cc:740] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.685720 12549 consensus_queue.cc:260] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.687831 12550 tablet_bootstrap.cc:492] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2: Bootstrap starting.
I20260709 13:04:27.692467 12554 leader_election.cc:290] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:27.694702 12550 tablet_bootstrap.cc:654] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.710600 12550 tablet_bootstrap.cc:492] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:27.711316 12550 ts_tablet_manager.cc:1403] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.024s	user 0.021s	sys 0.002s
I20260709 13:04:27.684283 12435 raft_consensus.cc:2468] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 1.
I20260709 13:04:27.715281 12550 raft_consensus.cc:359] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.716307 12550 raft_consensus.cc:385] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.716044 12326 leader_election.cc:304] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:27.716892 12550 raft_consensus.cc:740] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.717600 12556 raft_consensus.cc:2804] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:27.724563 12550 consensus_queue.cc:260] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.734557 12556 raft_consensus.cc:697] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Becoming Leader. State: Replica: 490d760480074f44856a0eea650897e2, State: Running, Role: LEADER
I20260709 13:04:27.736135 12556 consensus_queue.cc:237] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.742205 12509 raft_consensus.cc:2468] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 1.
I20260709 13:04:27.743696 12550 ts_tablet_manager.cc:1434] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.002s
I20260709 13:04:27.745707 12550 tablet_bootstrap.cc:492] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 490d760480074f44856a0eea650897e2: Bootstrap starting.
I20260709 13:04:27.747576 12551 tablet_bootstrap.cc:492] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:27.751703 12551 ts_tablet_manager.cc:1403] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.112s	user 0.044s	sys 0.051s
I20260709 13:04:27.747576 12549 ts_tablet_manager.cc:1434] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.091s	user 0.015s	sys 0.037s
I20260709 13:04:27.753136 12360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0bf6a51c1749f18728e522847937c4" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2" is_pre_election: true
I20260709 13:04:27.753983 12360 raft_consensus.cc:2468] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 0.
I20260709 13:04:27.755401 12400 leader_election.cc:304] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:27.756592 12576 raft_consensus.cc:2804] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:27.756983 12576 raft_consensus.cc:493] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.757301 12576 raft_consensus.cc:3060] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.762578 12549 tablet_bootstrap.cc:492] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
I20260709 13:04:27.763803 12558 raft_consensus.cc:493] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.764341 12558 raft_consensus.cc:515] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } }
I20260709 13:04:27.767443 12558 leader_election.cc:290] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), 490d760480074f44856a0eea650897e2 (127.0.107.193:42707)
I20260709 13:04:27.759789 12551 raft_consensus.cc:359] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.766409 12257 catalog_manager.cc:5697] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 490d760480074f44856a0eea650897e2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "490d760480074f44856a0eea650897e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.768317 12551 raft_consensus.cc:385] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.768810 12551 raft_consensus.cc:740] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.769613 12551 consensus_queue.cc:260] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.773088 12551 ts_tablet_manager.cc:1434] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:04:27.774080 12550 tablet_bootstrap.cc:654] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.777442 12551 tablet_bootstrap.cc:492] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
I20260709 13:04:27.778632 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0bf6a51c1749f18728e522847937c4" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
I20260709 13:04:27.779420 12509 raft_consensus.cc:2468] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 0.
I20260709 13:04:27.781500 12576 raft_consensus.cc:515] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.785128 12360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0bf6a51c1749f18728e522847937c4" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:27.785749 12360 raft_consensus.cc:3060] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.787072 12551 tablet_bootstrap.cc:654] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.790927 12550 tablet_bootstrap.cc:492] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:27.791666 12550 ts_tablet_manager.cc:1403] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.005s
I20260709 13:04:27.790742 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6867276dd8a48728dabeb52c4d3c2e9" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
I20260709 13:04:27.794857 12550 raft_consensus.cc:359] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.795601 12550 raft_consensus.cc:385] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.795938 12550 raft_consensus.cc:740] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.795650 12435 raft_consensus.cc:2468] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 0.
I20260709 13:04:27.797935 12556 raft_consensus.cc:493] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.798172 12475 leader_election.cc:304] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:27.798512 12556 raft_consensus.cc:515] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.799451 12558 raft_consensus.cc:2804] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:27.799844 12558 raft_consensus.cc:493] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.800173 12558 raft_consensus.cc:3060] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.802130 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92397046da34f10a3938976d5d581b1" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
I20260709 13:04:27.803540 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0bf6a51c1749f18728e522847937c4" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda"
W20260709 13:04:27.803665 12326 leader_election.cc:343] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.804160 12509 raft_consensus.cc:3060] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.805123 12556 leader_election.cc:290] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:27.797048 12550 consensus_queue.cc:260] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.807410 12508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92397046da34f10a3938976d5d581b1" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
I20260709 13:04:27.808228 12550 ts_tablet_manager.cc:1434] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
W20260709 13:04:27.808884 12326 leader_election.cc:343] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.809366 12326 leader_election.cc:304] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 490d760480074f44856a0eea650897e2; no voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda
I20260709 13:04:27.809804 12558 raft_consensus.cc:515] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } }
I20260709 13:04:27.810281 12550 tablet_bootstrap.cc:492] T 4d6ea491b3804e65afcf8825807fd5b0 P 490d760480074f44856a0eea650897e2: Bootstrap starting.
I20260709 13:04:27.810398 12556 raft_consensus.cc:2749] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:27.811717 12509 raft_consensus.cc:2468] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 1.
I20260709 13:04:27.812536 12576 leader_election.cc:290] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:27.813050 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6867276dd8a48728dabeb52c4d3c2e9" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:27.813603 12435 raft_consensus.cc:3060] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.814867 12360 raft_consensus.cc:2468] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 1.
I20260709 13:04:27.816119 12400 leader_election.cc:304] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:27.816929 12554 raft_consensus.cc:493] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.817380 12554 raft_consensus.cc:515] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.818264 12550 tablet_bootstrap.cc:654] T 4d6ea491b3804e65afcf8825807fd5b0 P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.820554 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc12318d797492499c5bab80be4aa39" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2" is_pre_election: true
I20260709 13:04:27.821259 12359 raft_consensus.cc:2468] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 0.
I20260709 13:04:27.822165 12435 raft_consensus.cc:2468] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 1.
I20260709 13:04:27.822537 12400 leader_election.cc:304] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:27.823514 12475 leader_election.cc:304] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:27.824069 12554 leader_election.cc:290] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:27.825328 12554 raft_consensus.cc:2804] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:27.825680 12554 raft_consensus.cc:493] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.826025 12554 raft_consensus.cc:3060] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.826092 12589 raft_consensus.cc:2804] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:27.824667 12587 raft_consensus.cc:2804] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:27.798696 12549 tablet_bootstrap.cc:654] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.829866 12587 raft_consensus.cc:697] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Becoming Leader. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Running, Role: LEADER
I20260709 13:04:27.830644 12360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6867276dd8a48728dabeb52c4d3c2e9" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2" is_pre_election: true
I20260709 13:04:27.830816 12587 consensus_queue.cc:237] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.831372 12360 raft_consensus.cc:2468] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 0.
I20260709 13:04:27.832440 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc12318d797492499c5bab80be4aa39" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
I20260709 13:04:27.835148 12509 raft_consensus.cc:2468] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 0.
I20260709 13:04:27.833851 12589 raft_consensus.cc:697] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Becoming Leader. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Running, Role: LEADER
I20260709 13:04:27.836856 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6867276dd8a48728dabeb52c4d3c2e9" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:27.836660 12589 consensus_queue.cc:237] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } }
I20260709 13:04:27.837491 12359 raft_consensus.cc:3060] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.842586 12549 tablet_bootstrap.cc:492] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:27.843225 12549 ts_tablet_manager.cc:1403] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.000s
I20260709 13:04:27.843705 12550 tablet_bootstrap.cc:492] T 4d6ea491b3804e65afcf8825807fd5b0 P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:27.844885 12550 ts_tablet_manager.cc:1403] T 4d6ea491b3804e65afcf8825807fd5b0 P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.004s
I20260709 13:04:27.847056 12359 raft_consensus.cc:2468] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 1.
I20260709 13:04:27.846799 12549 raft_consensus.cc:359] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.848028 12549 raft_consensus.cc:385] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.848385 12549 raft_consensus.cc:740] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.848562 12550 raft_consensus.cc:359] T 4d6ea491b3804e65afcf8825807fd5b0 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.856027 12550 raft_consensus.cc:385] T 4d6ea491b3804e65afcf8825807fd5b0 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.856338 12550 raft_consensus.cc:740] T 4d6ea491b3804e65afcf8825807fd5b0 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.850155 12554 raft_consensus.cc:515] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.849442 12549 consensus_queue.cc:260] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.860001 12549 ts_tablet_manager.cc:1434] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:04:27.859890 12550 consensus_queue.cc:260] T 4d6ea491b3804e65afcf8825807fd5b0 P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.861125 12549 tablet_bootstrap.cc:492] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
I20260709 13:04:27.861042 12255 catalog_manager.cc:5697] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94843016eb774f7a86692342c1b4c192 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "94843016eb774f7a86692342c1b4c192" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.864039 12550 ts_tablet_manager.cc:1434] T 4d6ea491b3804e65afcf8825807fd5b0 P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:04:27.864478 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc12318d797492499c5bab80be4aa39" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:27.864753 12554 leader_election.cc:290] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:27.865162 12509 raft_consensus.cc:3060] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.852728 12551 tablet_bootstrap.cc:492] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:27.866539 12551 ts_tablet_manager.cc:1403] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.009s
I20260709 13:04:27.868079 12258 catalog_manager.cc:5697] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda reported cstate change: term changed from 0 to 1, leader changed from <none> to fd48f77857a446d7b9a780d156984eda (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fd48f77857a446d7b9a780d156984eda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.869606 12551 raft_consensus.cc:359] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.870355 12551 raft_consensus.cc:385] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.870636 12551 raft_consensus.cc:740] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.850230 12558 leader_election.cc:290] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 election: Requested vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), 490d760480074f44856a0eea650897e2 (127.0.107.193:42707)
I20260709 13:04:27.873175 12509 raft_consensus.cc:2468] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 1.
I20260709 13:04:27.864531 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc12318d797492499c5bab80be4aa39" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:27.874212 12549 tablet_bootstrap.cc:654] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.875651 12359 raft_consensus.cc:3060] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.876000 12401 leader_election.cc:304] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:27.877486 12554 raft_consensus.cc:2804] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:27.874689 12551 consensus_queue.cc:260] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.878229 12554 raft_consensus.cc:697] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Becoming Leader. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Running, Role: LEADER
I20260709 13:04:27.879379 12554 consensus_queue.cc:237] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.879866 12551 ts_tablet_manager.cc:1434] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:04:27.881016 12551 tablet_bootstrap.cc:492] T 4d6ea491b3804e65afcf8825807fd5b0 P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
I20260709 13:04:27.883744 12359 raft_consensus.cc:2468] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 1.
I20260709 13:04:27.887426 12551 tablet_bootstrap.cc:654] T 4d6ea491b3804e65afcf8825807fd5b0 P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.888693 12549 tablet_bootstrap.cc:492] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:27.889308 12549 ts_tablet_manager.cc:1403] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 13:04:27.893110 12549 raft_consensus.cc:359] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.894110 12549 raft_consensus.cc:385] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.894538 12549 raft_consensus.cc:740] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.895525 12549 consensus_queue.cc:260] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.897964 12549 ts_tablet_manager.cc:1434] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:27.900935 12549 tablet_bootstrap.cc:492] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
I20260709 13:04:27.901324 12551 tablet_bootstrap.cc:492] T 4d6ea491b3804e65afcf8825807fd5b0 P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:27.901854 12551 ts_tablet_manager.cc:1403] T 4d6ea491b3804e65afcf8825807fd5b0 P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.010s
I20260709 13:04:27.904297 12258 catalog_manager.cc:5697] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94843016eb774f7a86692342c1b4c192 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "94843016eb774f7a86692342c1b4c192" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.904764 12551 raft_consensus.cc:359] T 4d6ea491b3804e65afcf8825807fd5b0 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.905586 12551 raft_consensus.cc:385] T 4d6ea491b3804e65afcf8825807fd5b0 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.905894 12551 raft_consensus.cc:740] T 4d6ea491b3804e65afcf8825807fd5b0 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.906728 12551 consensus_queue.cc:260] T 4d6ea491b3804e65afcf8825807fd5b0 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.909344 12551 ts_tablet_manager.cc:1434] T 4d6ea491b3804e65afcf8825807fd5b0 P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:27.909492 12549 tablet_bootstrap.cc:654] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.910821 12556 raft_consensus.cc:493] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.911355 12556 raft_consensus.cc:515] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.913409 12556 leader_election.cc:290] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:27.914536 12551 tablet_bootstrap.cc:492] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
I20260709 13:04:27.914584 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e626ea4434444da48e89a36f490386" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
I20260709 13:04:27.916113 12435 raft_consensus.cc:2468] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 0.
I20260709 13:04:27.914970 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e626ea4434444da48e89a36f490386" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
W20260709 13:04:27.918694 12326 leader_election.cc:343] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.919764 12326 leader_election.cc:304] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: fd48f77857a446d7b9a780d156984eda
I20260709 13:04:27.920907 12551 tablet_bootstrap.cc:654] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.921197 12556 raft_consensus.cc:2804] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:27.921737 12556 raft_consensus.cc:493] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.922183 12556 raft_consensus.cc:3060] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.930542 12549 tablet_bootstrap.cc:492] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:27.931187 12549 ts_tablet_manager.cc:1403] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.018s
I20260709 13:04:27.934221 12549 raft_consensus.cc:359] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.934453 12556 raft_consensus.cc:515] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.935020 12549 raft_consensus.cc:385] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.935444 12549 raft_consensus.cc:740] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.936272 12549 consensus_queue.cc:260] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.937322 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e626ea4434444da48e89a36f490386" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:27.937929 12435 raft_consensus.cc:3060] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.938827 12549 ts_tablet_manager.cc:1434] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:27.939894 12549 tablet_bootstrap.cc:492] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
I20260709 13:04:27.944088 12556 leader_election.cc:290] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 election: Requested vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:27.945389 12549 tablet_bootstrap.cc:654] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.945274 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e626ea4434444da48e89a36f490386" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda"
W20260709 13:04:27.946849 12326 leader_election.cc:343] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.948724 12435 raft_consensus.cc:2468] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 1.
I20260709 13:04:27.950053 12551 tablet_bootstrap.cc:492] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:27.949997 12326 leader_election.cc:304] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: fd48f77857a446d7b9a780d156984eda
I20260709 13:04:27.950357 12558 raft_consensus.cc:493] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.950862 12558 raft_consensus.cc:515] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.951349 12551 ts_tablet_manager.cc:1403] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.037s	user 0.029s	sys 0.004s
I20260709 13:04:27.951489 12549 tablet_bootstrap.cc:492] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:27.951992 12549 ts_tablet_manager.cc:1403] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:04:27.952975 12558 leader_election.cc:290] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729)
I20260709 13:04:27.954319 12551 raft_consensus.cc:359] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.954728 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3985047828c145d4bb0f8b39d1216080" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2" is_pre_election: true
I20260709 13:04:27.954663 12549 raft_consensus.cc:359] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.955096 12556 raft_consensus.cc:2804] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:27.955466 12549 raft_consensus.cc:385] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.955494 12359 raft_consensus.cc:2468] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 0.
I20260709 13:04:27.955925 12549 raft_consensus.cc:740] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.956422 12556 raft_consensus.cc:697] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Becoming Leader. State: Replica: 490d760480074f44856a0eea650897e2, State: Running, Role: LEADER
I20260709 13:04:27.955075 12551 raft_consensus.cc:385] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.957610 12551 raft_consensus.cc:740] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.957396 12474 leader_election.cc:304] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:27.957351 12556 consensus_queue.cc:237] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.958575 12558 raft_consensus.cc:2804] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:27.958492 12551 consensus_queue.cc:260] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.958989 12558 raft_consensus.cc:493] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.959708 12558 raft_consensus.cc:3060] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.960574 12551 ts_tablet_manager.cc:1434] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:04:27.961517 12551 tablet_bootstrap.cc:492] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
I20260709 13:04:27.956637 12549 consensus_queue.cc:260] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.967796 12549 ts_tablet_manager.cc:1434] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:04:27.969383 12551 tablet_bootstrap.cc:654] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.969043 12558 raft_consensus.cc:515] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.971611 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3985047828c145d4bb0f8b39d1216080" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
I20260709 13:04:27.972060 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3985047828c145d4bb0f8b39d1216080" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:27.972314 12435 raft_consensus.cc:2468] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 0.
I20260709 13:04:27.972896 12359 raft_consensus.cc:3060] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.976743 12255 catalog_manager.cc:5697] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 490d760480074f44856a0eea650897e2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "490d760480074f44856a0eea650897e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.978468 12551 tablet_bootstrap.cc:492] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:27.978965 12551 ts_tablet_manager.cc:1403] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.006s
I20260709 13:04:27.981726 12551 raft_consensus.cc:359] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.981987 12359 raft_consensus.cc:2468] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 1.
I20260709 13:04:27.982403 12551 raft_consensus.cc:385] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.982884 12551 raft_consensus.cc:740] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.983577 12474 leader_election.cc:304] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:27.983605 12551 consensus_queue.cc:260] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.984464 12589 raft_consensus.cc:2804] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:27.985520 12554 raft_consensus.cc:493] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.985749 12551 ts_tablet_manager.cc:1434] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:27.985756 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3985047828c145d4bb0f8b39d1216080" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:27.986948 12435 raft_consensus.cc:3060] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.986537 12554 raft_consensus.cc:515] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:27.987951 12558 leader_election.cc:290] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729)
I20260709 13:04:27.990988 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92397046da34f10a3938976d5d581b1" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2" is_pre_election: true
I20260709 13:04:27.991623 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92397046da34f10a3938976d5d581b1" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
I20260709 13:04:27.992157 12359 raft_consensus.cc:2468] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 0.
I20260709 13:04:27.992216 12509 raft_consensus.cc:2468] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 0.
I20260709 13:04:27.990906 12554 leader_election.cc:290] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:27.993402 12401 leader_election.cc:304] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:27.994491 12554 raft_consensus.cc:2804] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:27.994974 12554 raft_consensus.cc:493] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.996088 12554 raft_consensus.cc:3060] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.997219 12435 raft_consensus.cc:2468] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 1.
I20260709 13:04:27.998790 12589 raft_consensus.cc:697] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Becoming Leader. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Running, Role: LEADER
I20260709 13:04:27.999758 12589 consensus_queue.cc:237] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.004276 12554 raft_consensus.cc:515] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.006721 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92397046da34f10a3938976d5d581b1" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:28.006894 12554 leader_election.cc:290] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:28.007416 12359 raft_consensus.cc:3060] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.007118 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92397046da34f10a3938976d5d581b1" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:28.008016 12509 raft_consensus.cc:3060] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.009892 12255 catalog_manager.cc:5697] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda reported cstate change: term changed from 0 to 1, leader changed from <none> to fd48f77857a446d7b9a780d156984eda (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fd48f77857a446d7b9a780d156984eda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:28.011758 12554 raft_consensus.cc:493] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.012373 12554 raft_consensus.cc:515] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.015166 12359 raft_consensus.cc:2468] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 1.
I20260709 13:04:28.015772 12360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6ea491b3804e65afcf8825807fd5b0" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2" is_pre_election: true
I20260709 13:04:28.016072 12508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6ea491b3804e65afcf8825807fd5b0" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
I20260709 13:04:28.016455 12360 raft_consensus.cc:2468] T 4d6ea491b3804e65afcf8825807fd5b0 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 0.
I20260709 13:04:28.016695 12508 raft_consensus.cc:2468] T 4d6ea491b3804e65afcf8825807fd5b0 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 0.
I20260709 13:04:28.017525 12400 leader_election.cc:304] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:28.018047 12401 leader_election.cc:304] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:28.018338 12587 raft_consensus.cc:2804] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.018986 12576 raft_consensus.cc:2804] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.019464 12509 raft_consensus.cc:2468] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 1.
I20260709 13:04:28.019423 12576 raft_consensus.cc:493] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.020460 12576 raft_consensus.cc:3060] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.020888 12587 raft_consensus.cc:697] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Becoming Leader. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Running, Role: LEADER
I20260709 13:04:28.021850 12587 consensus_queue.cc:237] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.024837 12554 leader_election.cc:290] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:28.028988 12576 raft_consensus.cc:515] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.030779 12576 leader_election.cc:290] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:28.031670 12360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6ea491b3804e65afcf8825807fd5b0" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:28.031904 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6ea491b3804e65afcf8825807fd5b0" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:28.032387 12360 raft_consensus.cc:3060] T 4d6ea491b3804e65afcf8825807fd5b0 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.032670 12509 raft_consensus.cc:3060] T 4d6ea491b3804e65afcf8825807fd5b0 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.032083 12255 catalog_manager.cc:5697] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94843016eb774f7a86692342c1b4c192 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "94843016eb774f7a86692342c1b4c192" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.038630 12360 raft_consensus.cc:2468] T 4d6ea491b3804e65afcf8825807fd5b0 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 1.
I20260709 13:04:28.039579 12509 raft_consensus.cc:2468] T 4d6ea491b3804e65afcf8825807fd5b0 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 1.
I20260709 13:04:28.039822 12400 leader_election.cc:304] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:28.040855 12576 raft_consensus.cc:2804] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.041325 12576 raft_consensus.cc:697] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Becoming Leader. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Running, Role: LEADER
I20260709 13:04:28.042124 12576 consensus_queue.cc:237] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.051064 12255 catalog_manager.cc:5697] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94843016eb774f7a86692342c1b4c192 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "94843016eb774f7a86692342c1b4c192" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.090904 12589 raft_consensus.cc:493] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.091586 12589 raft_consensus.cc:515] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.093291 12589 leader_election.cc:290] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729)
I20260709 13:04:28.094472 12360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c8ea1f5f3e49c9a64a36b9d8dc4370" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2" is_pre_election: true
I20260709 13:04:28.094537 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c8ea1f5f3e49c9a64a36b9d8dc4370" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
I20260709 13:04:28.095178 12360 raft_consensus.cc:2468] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 0.
I20260709 13:04:28.095422 12435 raft_consensus.cc:2468] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 0.
I20260709 13:04:28.096244 12474 leader_election.cc:304] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:28.097060 12589 raft_consensus.cc:2804] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.097361 12589 raft_consensus.cc:493] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.097594 12589 raft_consensus.cc:3060] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.103219 12589 raft_consensus.cc:515] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.105198 12589 leader_election.cc:290] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729)
I20260709 13:04:28.106309 12360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c8ea1f5f3e49c9a64a36b9d8dc4370" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:28.106376 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c8ea1f5f3e49c9a64a36b9d8dc4370" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:28.106892 12360 raft_consensus.cc:3060] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.107132 12435 raft_consensus.cc:3060] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.112097 12360 raft_consensus.cc:2468] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 1.
I20260709 13:04:28.112201 12435 raft_consensus.cc:2468] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 1.
I20260709 13:04:28.113463 12475 leader_election.cc:304] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:28.114243 12589 raft_consensus.cc:2804] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.114673 12589 raft_consensus.cc:697] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Becoming Leader. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Running, Role: LEADER
I20260709 13:04:28.115619 12589 consensus_queue.cc:237] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.119002 12603 raft_consensus.cc:493] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.119619 12603 raft_consensus.cc:515] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.121595 12603 leader_election.cc:290] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729)
I20260709 13:04:28.122618 12360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e626ea4434444da48e89a36f490386" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2" is_pre_election: true
I20260709 13:04:28.122768 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e626ea4434444da48e89a36f490386" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
I20260709 13:04:28.123698 12435 raft_consensus.cc:2393] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd48f77857a446d7b9a780d156984eda in current term 1: Already voted for candidate 490d760480074f44856a0eea650897e2 in this term.
I20260709 13:04:28.124715 12475 leader_election.cc:304] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd48f77857a446d7b9a780d156984eda; no voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192
I20260709 13:04:28.125540 12603 raft_consensus.cc:3060] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.125247 12255 catalog_manager.cc:5697] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda reported cstate change: term changed from 0 to 1, leader changed from <none> to fd48f77857a446d7b9a780d156984eda (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fd48f77857a446d7b9a780d156984eda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:28.132023 12603 raft_consensus.cc:2749] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:28.192795 12509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6867276dd8a48728dabeb52c4d3c2e9"
dest_uuid: "fd48f77857a446d7b9a780d156984eda"
mode: GRACEFUL
new_leader_uuid: "490d760480074f44856a0eea650897e2"
 from {username='slave'} at 127.0.0.1:35374
I20260709 13:04:28.193508 12509 raft_consensus.cc:606] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Received request to transfer leadership to TS 490d760480074f44856a0eea650897e2
I20260709 13:04:28.197721 12556 consensus_queue.cc:1048] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.212019 12435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef0bf6a51c1749f18728e522847937c4"
dest_uuid: "94843016eb774f7a86692342c1b4c192"
mode: GRACEFUL
new_leader_uuid: "490d760480074f44856a0eea650897e2"
 from {username='slave'} at 127.0.0.1:49122
I20260709 13:04:28.213080 12435 raft_consensus.cc:606] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Received request to transfer leadership to TS 490d760480074f44856a0eea650897e2
I20260709 13:04:28.219198 12577 consensus_queue.cc:1048] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:28.220176 12435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fc12318d797492499c5bab80be4aa39"
dest_uuid: "94843016eb774f7a86692342c1b4c192"
mode: GRACEFUL
new_leader_uuid: "490d760480074f44856a0eea650897e2"
 from {username='slave'} at 127.0.0.1:49122
I20260709 13:04:28.220803 12435 raft_consensus.cc:606] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Received request to transfer leadership to TS 490d760480074f44856a0eea650897e2
I20260709 13:04:28.234126 12509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3985047828c145d4bb0f8b39d1216080"
dest_uuid: "fd48f77857a446d7b9a780d156984eda"
mode: GRACEFUL
new_leader_uuid: "94843016eb774f7a86692342c1b4c192"
 from {username='slave'} at 127.0.0.1:35374
I20260709 13:04:28.234750 12509 raft_consensus.cc:606] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Received request to transfer leadership to TS 94843016eb774f7a86692342c1b4c192
I20260709 13:04:28.256069 12360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69e626ea4434444da48e89a36f490386"
dest_uuid: "490d760480074f44856a0eea650897e2"
mode: GRACEFUL
new_leader_uuid: "94843016eb774f7a86692342c1b4c192"
 from {username='slave'} at 127.0.0.1:55896
I20260709 13:04:28.256644 12360 raft_consensus.cc:606] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Received request to transfer leadership to TS 94843016eb774f7a86692342c1b4c192
I20260709 13:04:28.290577 12576 consensus_queue.cc:1048] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.297803 12587 raft_consensus.cc:993] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192: : Instructing follower 490d760480074f44856a0eea650897e2 to start an election
I20260709 13:04:28.298476 12605 raft_consensus.cc:1081] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Signalling peer 490d760480074f44856a0eea650897e2 to start an election
I20260709 13:04:28.300818 12359 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef0bf6a51c1749f18728e522847937c4"
dest_uuid: "490d760480074f44856a0eea650897e2"
 from {username='slave'} at 127.0.0.1:55870
I20260709 13:04:28.301433 12359 raft_consensus.cc:493] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.301816 12359 raft_consensus.cc:3060] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.303509 12605 consensus_queue.cc:1048] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.309193 12359 raft_consensus.cc:515] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.312640 12359 leader_election.cc:290] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 2 election: Requested vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:28.313753 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0bf6a51c1749f18728e522847937c4" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:28.314152 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0bf6a51c1749f18728e522847937c4" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:28.314483 12435 raft_consensus.cc:3055] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:28.314760 12509 raft_consensus.cc:3060] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.314881 12435 raft_consensus.cc:740] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Running, Role: LEADER
I20260709 13:04:28.315872 12435 consensus_queue.cc:260] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.316898 12435 raft_consensus.cc:3060] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.320422 12509 raft_consensus.cc:2468] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 2.
I20260709 13:04:28.321848 12326 leader_election.cc:304] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:28.322876 12578 raft_consensus.cc:2804] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:28.323361 12578 raft_consensus.cc:697] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [term 2 LEADER]: Becoming Leader. State: Replica: 490d760480074f44856a0eea650897e2, State: Running, Role: LEADER
I20260709 13:04:28.324186 12578 consensus_queue.cc:237] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.324934 12435 raft_consensus.cc:2468] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 2.
I20260709 13:04:28.325799 12605 consensus_queue.cc:1048] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.337093 12554 consensus_queue.cc:1048] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.334126 12255 catalog_manager.cc:5697] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 reported cstate change: term changed from 1 to 2, leader changed from 94843016eb774f7a86692342c1b4c192 (127.0.107.194) to 490d760480074f44856a0eea650897e2 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "490d760480074f44856a0eea650897e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.348006 12576 raft_consensus.cc:993] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192: : Instructing follower 490d760480074f44856a0eea650897e2 to start an election
I20260709 13:04:28.348424 12576 raft_consensus.cc:1081] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Signalling peer 490d760480074f44856a0eea650897e2 to start an election
I20260709 13:04:28.350071 12360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fc12318d797492499c5bab80be4aa39"
dest_uuid: "490d760480074f44856a0eea650897e2"
 from {username='slave'} at 127.0.0.1:55870
I20260709 13:04:28.350565 12360 raft_consensus.cc:493] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.350919 12360 raft_consensus.cc:3060] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.352228 12603 consensus_queue.cc:1048] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.356514 12360 raft_consensus.cc:515] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.358635 12589 raft_consensus.cc:993] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda: : Instructing follower 490d760480074f44856a0eea650897e2 to start an election
I20260709 13:04:28.359112 12589 raft_consensus.cc:1081] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Signalling peer 490d760480074f44856a0eea650897e2 to start an election
I20260709 13:04:28.359732 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc12318d797492499c5bab80be4aa39" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:28.360401 12435 raft_consensus.cc:3055] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:28.360410 12360 leader_election.cc:290] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 2 election: Requested vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:28.360888 12435 raft_consensus.cc:740] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Running, Role: LEADER
I20260709 13:04:28.361502 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc12318d797492499c5bab80be4aa39" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:28.361932 12358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6867276dd8a48728dabeb52c4d3c2e9"
dest_uuid: "490d760480074f44856a0eea650897e2"
 from {username='slave'} at 127.0.0.1:55880
I20260709 13:04:28.362169 12509 raft_consensus.cc:3060] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.362603 12358 raft_consensus.cc:493] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.363118 12358 raft_consensus.cc:3060] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.362653 12435 consensus_queue.cc:260] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.365013 12435 raft_consensus.cc:3060] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.369786 12509 raft_consensus.cc:2468] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 2.
I20260709 13:04:28.370975 12326 leader_election.cc:304] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:28.371249 12589 consensus_queue.cc:1048] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.371889 12578 raft_consensus.cc:2804] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:28.372342 12578 raft_consensus.cc:697] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [term 2 LEADER]: Becoming Leader. State: Replica: 490d760480074f44856a0eea650897e2, State: Running, Role: LEADER
I20260709 13:04:28.372838 12358 raft_consensus.cc:515] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } }
I20260709 13:04:28.373162 12578 consensus_queue.cc:237] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.377377 12359 raft_consensus.cc:1240] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Rejecting Update request from peer fd48f77857a446d7b9a780d156984eda for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:28.379769 12578 consensus_queue.cc:1048] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.381578 12358 leader_election.cc:290] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 2 election: Requested vote from peers fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735), 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729)
I20260709 13:04:28.382886 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6867276dd8a48728dabeb52c4d3c2e9" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:28.383750 12509 raft_consensus.cc:3055] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:28.384127 12509 raft_consensus.cc:740] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Running, Role: LEADER
I20260709 13:04:28.384629 12589 consensus_queue.cc:1059] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.385663 12509 consensus_queue.cc:260] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } }
I20260709 13:04:28.387053 12509 raft_consensus.cc:3060] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.382886 12433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6867276dd8a48728dabeb52c4d3c2e9" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:28.389196 12433 raft_consensus.cc:3060] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.393260 12258 catalog_manager.cc:5697] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 reported cstate change: term changed from 1 to 2, leader changed from 94843016eb774f7a86692342c1b4c192 (127.0.107.194) to 490d760480074f44856a0eea650897e2 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "490d760480074f44856a0eea650897e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.394749 12509 raft_consensus.cc:2468] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 2.
W20260709 13:04:28.395386 12603 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:04:28.398420 12433 raft_consensus.cc:2468] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 2.
I20260709 13:04:28.399716 12326 leader_election.cc:304] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:28.401036 12578 raft_consensus.cc:2804] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:28.401564 12578 raft_consensus.cc:697] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [term 2 LEADER]: Becoming Leader. State: Replica: 490d760480074f44856a0eea650897e2, State: Running, Role: LEADER
I20260709 13:04:28.402393 12578 consensus_queue.cc:237] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } }
I20260709 13:04:28.409395 12435 raft_consensus.cc:2468] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 2.
I20260709 13:04:28.410456 12258 catalog_manager.cc:5697] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 reported cstate change: term changed from 1 to 2, leader changed from fd48f77857a446d7b9a780d156984eda (127.0.107.195) to 490d760480074f44856a0eea650897e2 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "490d760480074f44856a0eea650897e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:28.415701 12577 raft_consensus.cc:993] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2: : Instructing follower 94843016eb774f7a86692342c1b4c192 to start an election
I20260709 13:04:28.417059 12578 raft_consensus.cc:1081] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Signalling peer 94843016eb774f7a86692342c1b4c192 to start an election
I20260709 13:04:28.418916 12435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69e626ea4434444da48e89a36f490386"
dest_uuid: "94843016eb774f7a86692342c1b4c192"
 from {username='slave'} at 127.0.0.1:49104
I20260709 13:04:28.419574 12435 raft_consensus.cc:493] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.419982 12435 raft_consensus.cc:3060] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.423585 12556 consensus_queue.cc:1048] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.427302 12435 raft_consensus.cc:515] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.428771 12434 raft_consensus.cc:1240] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Rejecting Update request from peer 490d760480074f44856a0eea650897e2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:28.430876 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e626ea4434444da48e89a36f490386" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:28.431684 12359 raft_consensus.cc:3055] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:28.431929 12359 raft_consensus.cc:740] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Running, Role: LEADER
I20260709 13:04:28.432705 12359 consensus_queue.cc:260] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.433447 12359 raft_consensus.cc:3060] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.435598 12435 leader_election.cc:290] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 2 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:28.436776 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e626ea4434444da48e89a36f490386" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:28.437382 12509 raft_consensus.cc:3060] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.440447 12359 raft_consensus.cc:2468] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 2.
I20260709 13:04:28.441695 12400 leader_election.cc:304] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:28.442699 12576 raft_consensus.cc:2804] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:28.442833 12509 raft_consensus.cc:2468] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 2.
I20260709 13:04:28.443277 12576 raft_consensus.cc:697] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [term 2 LEADER]: Becoming Leader. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Running, Role: LEADER
I20260709 13:04:28.444165 12576 consensus_queue.cc:237] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.451122 12258 catalog_manager.cc:5697] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 reported cstate change: term changed from 1 to 2, leader changed from 490d760480074f44856a0eea650897e2 (127.0.107.193) to 94843016eb774f7a86692342c1b4c192 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "94843016eb774f7a86692342c1b4c192" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.459169 12603 consensus_queue.cc:1048] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.465998 12589 raft_consensus.cc:993] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda: : Instructing follower 94843016eb774f7a86692342c1b4c192 to start an election
I20260709 13:04:28.466511 12558 raft_consensus.cc:1081] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Signalling peer 94843016eb774f7a86692342c1b4c192 to start an election
I20260709 13:04:28.468094 12434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3985047828c145d4bb0f8b39d1216080"
dest_uuid: "94843016eb774f7a86692342c1b4c192"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:04:28.469631 12434 raft_consensus.cc:493] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.470032 12434 raft_consensus.cc:3060] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.472764 12603 consensus_queue.cc:1048] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.477123 12434 raft_consensus.cc:515] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.483018 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3985047828c145d4bb0f8b39d1216080" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:28.483009 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3985047828c145d4bb0f8b39d1216080" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:28.483820 12509 raft_consensus.cc:3055] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:28.484130 12359 raft_consensus.cc:3060] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.484261 12509 raft_consensus.cc:740] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Running, Role: LEADER
I20260709 13:04:28.485723 12509 consensus_queue.cc:260] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.486640 12509 raft_consensus.cc:3060] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.489763 12359 raft_consensus.cc:2468] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 2.
I20260709 13:04:28.483098 12434 leader_election.cc:290] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 2 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:28.491653 12400 leader_election.cc:304] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:28.492690 12509 raft_consensus.cc:2468] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 2.
I20260709 13:04:28.493095 12576 raft_consensus.cc:2804] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:28.493645 12576 raft_consensus.cc:697] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [term 2 LEADER]: Becoming Leader. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Running, Role: LEADER
I20260709 13:04:28.494635 12554 consensus_queue.cc:1048] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.494462 12576 consensus_queue.cc:237] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:28.502189 12255 catalog_manager.cc:5697] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 reported cstate change: term changed from 1 to 2, leader changed from fd48f77857a446d7b9a780d156984eda (127.0.107.195) to 94843016eb774f7a86692342c1b4c192 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "94843016eb774f7a86692342c1b4c192" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.506976 12605 consensus_queue.cc:1048] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.532913 12605 consensus_queue.cc:1048] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.542865 12587 consensus_queue.cc:1048] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.571936 12603 consensus_queue.cc:1048] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.582952 12558 consensus_queue.cc:1048] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.718324 12434 raft_consensus.cc:1275] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Refusing update from remote peer 490d760480074f44856a0eea650897e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.719677 12556 consensus_queue.cc:1048] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.727495 12509 raft_consensus.cc:1275] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Refusing update from remote peer 490d760480074f44856a0eea650897e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.729105 12578 consensus_queue.cc:1048] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.789141 12509 raft_consensus.cc:1275] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Refusing update from remote peer 490d760480074f44856a0eea650897e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.790282 12578 consensus_queue.cc:1048] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.798594 12434 raft_consensus.cc:1275] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Refusing update from remote peer 490d760480074f44856a0eea650897e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.800464 12578 consensus_queue.cc:1048] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.866559 12509 raft_consensus.cc:1275] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Refusing update from remote peer 94843016eb774f7a86692342c1b4c192: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.867779 12554 consensus_queue.cc:1048] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.875355 12359 raft_consensus.cc:1275] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Refusing update from remote peer 94843016eb774f7a86692342c1b4c192: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.876789 12554 consensus_queue.cc:1048] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.885241 12359 raft_consensus.cc:1275] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Refusing update from remote peer 94843016eb774f7a86692342c1b4c192: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.886544 12554 consensus_queue.cc:1048] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.897840 12509 raft_consensus.cc:1275] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Refusing update from remote peer 94843016eb774f7a86692342c1b4c192: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.899063 12576 consensus_queue.cc:1048] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.982993 12509 raft_consensus.cc:1275] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Refusing update from remote peer 490d760480074f44856a0eea650897e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.984270 12578 consensus_queue.cc:1048] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.991461 12434 raft_consensus.cc:1275] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Refusing update from remote peer 490d760480074f44856a0eea650897e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.993593 12577 consensus_queue.cc:1048] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:31.289042 12257 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60536:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:31.291322 12257 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:31.343374 12350 tablet_service.cc:1511] Processing CreateTablet for tablet b1f16efa64af4b928338edba11a61db4 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:31.344719 12350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f16efa64af4b928338edba11a61db4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.344342 12421 tablet_service.cc:1511] Processing CreateTablet for tablet b1f16efa64af4b928338edba11a61db4 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:31.345779 12421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f16efa64af4b928338edba11a61db4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.348109 12498 tablet_service.cc:1511] Processing CreateTablet for tablet b1f16efa64af4b928338edba11a61db4 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:31.349143 12347 tablet_service.cc:1511] Processing CreateTablet for tablet 15334a8c7e314a87a6ece58b7a573915 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:31.349583 12498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f16efa64af4b928338edba11a61db4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.350308 12347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15334a8c7e314a87a6ece58b7a573915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.352275 12423 tablet_service.cc:1511] Processing CreateTablet for tablet 15334a8c7e314a87a6ece58b7a573915 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:31.353618 12423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15334a8c7e314a87a6ece58b7a573915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.356284 12496 tablet_service.cc:1511] Processing CreateTablet for tablet 15334a8c7e314a87a6ece58b7a573915 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:31.357645 12496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15334a8c7e314a87a6ece58b7a573915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.361768 12348 tablet_service.cc:1511] Processing CreateTablet for tablet e01194ca40c845d0b41ecf6fb3353508 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:31.363286 12348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01194ca40c845d0b41ecf6fb3353508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.382833 12422 tablet_service.cc:1511] Processing CreateTablet for tablet e01194ca40c845d0b41ecf6fb3353508 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:31.384680 12422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01194ca40c845d0b41ecf6fb3353508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.427162 12346 tablet_service.cc:1511] Processing CreateTablet for tablet ea33b6b17e8d42218e76a3d80c4cc5fc (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:31.439105 12346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea33b6b17e8d42218e76a3d80c4cc5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.428997 12495 tablet_service.cc:1511] Processing CreateTablet for tablet e01194ca40c845d0b41ecf6fb3353508 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:31.444782 12495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01194ca40c845d0b41ecf6fb3353508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.433636 12499 tablet_service.cc:1511] Processing CreateTablet for tablet ea33b6b17e8d42218e76a3d80c4cc5fc (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:31.448081 12348 tablet_service.cc:1511] Processing CreateTablet for tablet b4aa4540d1c44661bf0a4c579cd11f23 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:31.449493 12499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea33b6b17e8d42218e76a3d80c4cc5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.449493 12348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4aa4540d1c44661bf0a4c579cd11f23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.431949 12425 tablet_service.cc:1511] Processing CreateTablet for tablet ea33b6b17e8d42218e76a3d80c4cc5fc (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:31.451541 12425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea33b6b17e8d42218e76a3d80c4cc5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.452854 12424 tablet_service.cc:1511] Processing CreateTablet for tablet b4aa4540d1c44661bf0a4c579cd11f23 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:31.454414 12424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4aa4540d1c44661bf0a4c579cd11f23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.455871 12493 tablet_service.cc:1511] Processing CreateTablet for tablet 6410f7906fb748fa9b06db7eecc3a0b0 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:31.456382 12497 tablet_service.cc:1511] Processing CreateTablet for tablet b4aa4540d1c44661bf0a4c579cd11f23 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:31.457166 12349 tablet_service.cc:1511] Processing CreateTablet for tablet 6410f7906fb748fa9b06db7eecc3a0b0 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:31.458544 12349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6410f7906fb748fa9b06db7eecc3a0b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.458797 12420 tablet_service.cc:1511] Processing CreateTablet for tablet 1b3f0eb1d7da4f359a5e57615d3dd37f (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:31.460402 12420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b3f0eb1d7da4f359a5e57615d3dd37f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.461400 12344 tablet_service.cc:1511] Processing CreateTablet for tablet 61e34d4f09424e2eac64767bc97145b7 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:31.462951 12344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e34d4f09424e2eac64767bc97145b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.464376 12419 tablet_service.cc:1511] Processing CreateTablet for tablet 6410f7906fb748fa9b06db7eecc3a0b0 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:31.465960 12419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6410f7906fb748fa9b06db7eecc3a0b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.464376 12343 tablet_service.cc:1511] Processing CreateTablet for tablet d03aadeada614ceab91c7881ef056cfe (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:31.468403 12418 tablet_service.cc:1511] Processing CreateTablet for tablet 61e34d4f09424e2eac64767bc97145b7 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:31.469237 12646 tablet_bootstrap.cc:492] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2: Bootstrap starting.
I20260709 13:04:31.469883 12418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e34d4f09424e2eac64767bc97145b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.472935 12417 tablet_service.cc:1511] Processing CreateTablet for tablet d03aadeada614ceab91c7881ef056cfe (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:31.474398 12417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03aadeada614ceab91c7881ef056cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.458914 12345 tablet_service.cc:1511] Processing CreateTablet for tablet 1b3f0eb1d7da4f359a5e57615d3dd37f (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:31.475680 12343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03aadeada614ceab91c7881ef056cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.453981 12494 tablet_service.cc:1511] Processing CreateTablet for tablet 1b3f0eb1d7da4f359a5e57615d3dd37f (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:31.465574 12492 tablet_service.cc:1511] Processing CreateTablet for tablet 61e34d4f09424e2eac64767bc97145b7 (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:31.477460 12345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b3f0eb1d7da4f359a5e57615d3dd37f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.480916 12491 tablet_service.cc:1511] Processing CreateTablet for tablet d03aadeada614ceab91c7881ef056cfe (DEFAULT_TABLE table=soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:31.457535 12493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6410f7906fb748fa9b06db7eecc3a0b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.488075 12491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03aadeada614ceab91c7881ef056cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.491605 12492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e34d4f09424e2eac64767bc97145b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.495852 12494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b3f0eb1d7da4f359a5e57615d3dd37f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.503150 12497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4aa4540d1c44661bf0a4c579cd11f23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.605230 12648 tablet_bootstrap.cc:492] T b1f16efa64af4b928338edba11a61db4 P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
I20260709 13:04:31.609349 12646 tablet_bootstrap.cc:654] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.615447 12647 tablet_bootstrap.cc:492] T 15334a8c7e314a87a6ece58b7a573915 P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
I20260709 13:04:31.627107 12647 tablet_bootstrap.cc:654] T 15334a8c7e314a87a6ece58b7a573915 P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.627907 12648 tablet_bootstrap.cc:654] T b1f16efa64af4b928338edba11a61db4 P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.660010 12647 tablet_bootstrap.cc:492] T 15334a8c7e314a87a6ece58b7a573915 P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:31.660529 12647 ts_tablet_manager.cc:1403] T 15334a8c7e314a87a6ece58b7a573915 P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.000s
I20260709 13:04:31.663350 12647 raft_consensus.cc:359] T 15334a8c7e314a87a6ece58b7a573915 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.663923 12646 tablet_bootstrap.cc:492] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:31.663951 12647 raft_consensus.cc:385] T 15334a8c7e314a87a6ece58b7a573915 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.664610 12647 raft_consensus.cc:740] T 15334a8c7e314a87a6ece58b7a573915 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.664685 12646 ts_tablet_manager.cc:1403] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.196s	user 0.009s	sys 0.008s
I20260709 13:04:31.665383 12647 consensus_queue.cc:260] T 15334a8c7e314a87a6ece58b7a573915 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.666224 12648 tablet_bootstrap.cc:492] T b1f16efa64af4b928338edba11a61db4 P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:31.666728 12648 ts_tablet_manager.cc:1403] T b1f16efa64af4b928338edba11a61db4 P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.000s
I20260709 13:04:31.667516 12647 ts_tablet_manager.cc:1434] T 15334a8c7e314a87a6ece58b7a573915 P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:04:31.668074 12646 raft_consensus.cc:359] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.668793 12647 tablet_bootstrap.cc:492] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
I20260709 13:04:31.668862 12646 raft_consensus.cc:385] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.669399 12646 raft_consensus.cc:740] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.669862 12648 raft_consensus.cc:359] T b1f16efa64af4b928338edba11a61db4 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.670122 12646 consensus_queue.cc:260] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.670780 12648 raft_consensus.cc:385] T b1f16efa64af4b928338edba11a61db4 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.671104 12648 raft_consensus.cc:740] T b1f16efa64af4b928338edba11a61db4 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.671996 12648 consensus_queue.cc:260] T b1f16efa64af4b928338edba11a61db4 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.676057 12647 tablet_bootstrap.cc:654] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.680853 12648 ts_tablet_manager.cc:1434] T b1f16efa64af4b928338edba11a61db4 P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:04:31.683909 12646 ts_tablet_manager.cc:1434] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:04:31.685092 12646 tablet_bootstrap.cc:492] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2: Bootstrap starting.
I20260709 13:04:31.686429 12648 tablet_bootstrap.cc:492] T 15334a8c7e314a87a6ece58b7a573915 P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
I20260709 13:04:31.690778 12647 tablet_bootstrap.cc:492] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:31.691514 12647 ts_tablet_manager.cc:1403] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 13:04:31.693691 12648 tablet_bootstrap.cc:654] T 15334a8c7e314a87a6ece58b7a573915 P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.694525 12647 raft_consensus.cc:359] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.695132 12647 raft_consensus.cc:385] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.695442 12647 raft_consensus.cc:740] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.695833 12646 tablet_bootstrap.cc:654] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.696177 12647 consensus_queue.cc:260] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.699975 12648 tablet_bootstrap.cc:492] T 15334a8c7e314a87a6ece58b7a573915 P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:31.700528 12648 ts_tablet_manager.cc:1403] T 15334a8c7e314a87a6ece58b7a573915 P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:04:31.701056 12647 ts_tablet_manager.cc:1434] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:31.702088 12647 tablet_bootstrap.cc:492] T b1f16efa64af4b928338edba11a61db4 P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
W20260709 13:04:31.704771 12306 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:31.705694 12648 raft_consensus.cc:359] T 15334a8c7e314a87a6ece58b7a573915 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.706369 12646 tablet_bootstrap.cc:492] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:31.706691 12648 raft_consensus.cc:385] T 15334a8c7e314a87a6ece58b7a573915 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.707206 12648 raft_consensus.cc:740] T 15334a8c7e314a87a6ece58b7a573915 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.707388 12646 ts_tablet_manager.cc:1403] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.003s
I20260709 13:04:31.708132 12648 consensus_queue.cc:260] T 15334a8c7e314a87a6ece58b7a573915 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.709164 12647 tablet_bootstrap.cc:654] T b1f16efa64af4b928338edba11a61db4 P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.713699 12646 raft_consensus.cc:359] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.714372 12648 ts_tablet_manager.cc:1434] T 15334a8c7e314a87a6ece58b7a573915 P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.007s
I20260709 13:04:31.714636 12646 raft_consensus.cc:385] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.715155 12646 raft_consensus.cc:740] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.716006 12648 tablet_bootstrap.cc:492] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
I20260709 13:04:31.715988 12646 consensus_queue.cc:260] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.721629 12646 ts_tablet_manager.cc:1434] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 13:04:31.722729 12646 tablet_bootstrap.cc:492] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2: Bootstrap starting.
I20260709 13:04:31.724681 12647 tablet_bootstrap.cc:492] T b1f16efa64af4b928338edba11a61db4 P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:31.725267 12647 ts_tablet_manager.cc:1403] T b1f16efa64af4b928338edba11a61db4 P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 13:04:31.725484 12648 tablet_bootstrap.cc:654] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.728433 12647 raft_consensus.cc:359] T b1f16efa64af4b928338edba11a61db4 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.729501 12647 raft_consensus.cc:385] T b1f16efa64af4b928338edba11a61db4 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.729625 12646 tablet_bootstrap.cc:654] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.729919 12647 raft_consensus.cc:740] T b1f16efa64af4b928338edba11a61db4 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.731093 12647 consensus_queue.cc:260] T b1f16efa64af4b928338edba11a61db4 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.734484 12647 ts_tablet_manager.cc:1434] T b1f16efa64af4b928338edba11a61db4 P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:04:31.735838 12647 tablet_bootstrap.cc:492] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
I20260709 13:04:31.742034 12646 tablet_bootstrap.cc:492] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:31.742645 12646 ts_tablet_manager.cc:1403] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:04:31.745568 12647 tablet_bootstrap.cc:654] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.746250 12648 tablet_bootstrap.cc:492] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:31.745775 12646 raft_consensus.cc:359] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.747004 12648 ts_tablet_manager.cc:1403] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.015s
I20260709 13:04:31.747100 12646 raft_consensus.cc:385] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.747632 12646 raft_consensus.cc:740] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.748448 12646 consensus_queue.cc:260] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.752746 12648 raft_consensus.cc:359] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.753661 12646 ts_tablet_manager.cc:1434] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:04:31.753975 12648 raft_consensus.cc:385] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.754451 12648 raft_consensus.cc:740] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.755123 12646 tablet_bootstrap.cc:492] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2: Bootstrap starting.
I20260709 13:04:31.755422 12648 consensus_queue.cc:260] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.758490 12648 ts_tablet_manager.cc:1434] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:31.759445 12647 tablet_bootstrap.cc:492] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:31.759737 12648 tablet_bootstrap.cc:492] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
I20260709 13:04:31.760057 12647 ts_tablet_manager.cc:1403] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 13:04:31.763063 12646 tablet_bootstrap.cc:654] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.763677 12647 raft_consensus.cc:359] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.764572 12647 raft_consensus.cc:385] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.764927 12647 raft_consensus.cc:740] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.765829 12647 consensus_queue.cc:260] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.767771 12648 tablet_bootstrap.cc:654] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.768914 12647 ts_tablet_manager.cc:1434] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:04:31.770008 12647 tablet_bootstrap.cc:492] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
I20260709 13:04:31.776461 12646 tablet_bootstrap.cc:492] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:31.777117 12646 ts_tablet_manager.cc:1403] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:04:31.777849 12647 tablet_bootstrap.cc:654] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.782733 12646 raft_consensus.cc:359] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.784106 12646 raft_consensus.cc:385] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.784641 12646 raft_consensus.cc:740] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.786024 12646 consensus_queue.cc:260] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.789435 12646 ts_tablet_manager.cc:1434] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:04:31.790930 12646 tablet_bootstrap.cc:492] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2: Bootstrap starting.
I20260709 13:04:31.792673 12648 tablet_bootstrap.cc:492] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:31.793037 12647 tablet_bootstrap.cc:492] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:31.793237 12648 ts_tablet_manager.cc:1403] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 13:04:31.793740 12647 ts_tablet_manager.cc:1403] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 13:04:31.796586 12648 raft_consensus.cc:359] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.796859 12647 raft_consensus.cc:359] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.797365 12648 raft_consensus.cc:385] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.797667 12647 raft_consensus.cc:385] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.797847 12648 raft_consensus.cc:740] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.798048 12647 raft_consensus.cc:740] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.798784 12648 consensus_queue.cc:260] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.799265 12647 consensus_queue.cc:260] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.801292 12648 ts_tablet_manager.cc:1434] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:31.801622 12647 ts_tablet_manager.cc:1434] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:31.802358 12648 tablet_bootstrap.cc:492] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
I20260709 13:04:31.802701 12647 tablet_bootstrap.cc:492] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
I20260709 13:04:31.798026 12646 tablet_bootstrap.cc:654] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.809463 12647 tablet_bootstrap.cc:654] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.814204 12648 tablet_bootstrap.cc:654] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.821516 12646 tablet_bootstrap.cc:492] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:31.822044 12646 ts_tablet_manager.cc:1403] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.008s
I20260709 13:04:31.822359 12647 tablet_bootstrap.cc:492] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:31.822947 12647 ts_tablet_manager.cc:1403] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:04:31.825352 12648 tablet_bootstrap.cc:492] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:31.825083 12646 raft_consensus.cc:359] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.825912 12648 ts_tablet_manager.cc:1403] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.007s
I20260709 13:04:31.825911 12646 raft_consensus.cc:385] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.826022 12647 raft_consensus.cc:359] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.826592 12646 raft_consensus.cc:740] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.826969 12647 raft_consensus.cc:385] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.827327 12647 raft_consensus.cc:740] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.827598 12646 consensus_queue.cc:260] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.828321 12647 consensus_queue.cc:260] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.830083 12647 ts_tablet_manager.cc:1434] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:31.828936 12648 raft_consensus.cc:359] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.832798 12648 raft_consensus.cc:385] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.833218 12648 raft_consensus.cc:740] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.834026 12647 tablet_bootstrap.cc:492] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
I20260709 13:04:31.833931 12648 consensus_queue.cc:260] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.839289 12646 ts_tablet_manager.cc:1434] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 13:04:31.842425 12647 tablet_bootstrap.cc:654] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.842734 12648 ts_tablet_manager.cc:1434] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 13:04:31.843869 12648 tablet_bootstrap.cc:492] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
I20260709 13:04:31.844311 12635 raft_consensus.cc:493] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.845090 12635 raft_consensus.cc:515] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.848913 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e34d4f09424e2eac64767bc97145b7" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
W20260709 13:04:31.850582 12326 leader_election.cc:343] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.851152 12648 tablet_bootstrap.cc:654] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.851634 12635 leader_election.cc:290] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:31.852532 12508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e34d4f09424e2eac64767bc97145b7" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
I20260709 13:04:31.853499 12646 tablet_bootstrap.cc:492] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2: Bootstrap starting.
W20260709 13:04:31.854442 12326 leader_election.cc:343] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.855078 12326 leader_election.cc:304] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 490d760480074f44856a0eea650897e2; no voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda
I20260709 13:04:31.855189 12635 raft_consensus.cc:493] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.856133 12652 raft_consensus.cc:2749] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.856503 12635 raft_consensus.cc:515] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.861016 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15334a8c7e314a87a6ece58b7a573915" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
I20260709 13:04:31.861793 12434 raft_consensus.cc:2468] T 15334a8c7e314a87a6ece58b7a573915 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 0.
I20260709 13:04:31.861937 12508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15334a8c7e314a87a6ece58b7a573915" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
I20260709 13:04:31.862648 12508 raft_consensus.cc:2468] T 15334a8c7e314a87a6ece58b7a573915 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 0.
I20260709 13:04:31.863082 12648 tablet_bootstrap.cc:492] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:31.863698 12648 ts_tablet_manager.cc:1403] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.012s
I20260709 13:04:31.864223 12326 leader_election.cc:304] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:31.865049 12652 raft_consensus.cc:2804] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.865417 12652 raft_consensus.cc:493] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.865741 12652 raft_consensus.cc:3060] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.861344 12635 leader_election.cc:290] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:31.866746 12648 raft_consensus.cc:359] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.867619 12648 raft_consensus.cc:385] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.867914 12648 raft_consensus.cc:740] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.871938 12646 tablet_bootstrap.cc:654] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.868947 12648 consensus_queue.cc:260] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.875764 12647 tablet_bootstrap.cc:492] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:31.876251 12631 raft_consensus.cc:493] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.874945 12652 raft_consensus.cc:515] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.876730 12631 raft_consensus.cc:515] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.876421 12647 ts_tablet_manager.cc:1403] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.000s
I20260709 13:04:31.879595 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03aadeada614ceab91c7881ef056cfe" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2" is_pre_election: true
I20260709 13:04:31.879976 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03aadeada614ceab91c7881ef056cfe" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
W20260709 13:04:31.881577 12474 leader_election.cc:343] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 490d760480074f44856a0eea650897e2 (127.0.107.193:42707): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:31.882419 12475 leader_election.cc:343] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.882946 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15334a8c7e314a87a6ece58b7a573915" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:31.883121 12475 leader_election.cc:304] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd48f77857a446d7b9a780d156984eda; no voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192
I20260709 13:04:31.883562 12434 raft_consensus.cc:3060] T 15334a8c7e314a87a6ece58b7a573915 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.883731 12508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15334a8c7e314a87a6ece58b7a573915" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:31.884348 12508 raft_consensus.cc:3060] T 15334a8c7e314a87a6ece58b7a573915 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.879762 12631 leader_election.cc:290] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729)
I20260709 13:04:31.885430 12631 raft_consensus.cc:2749] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.878342 12652 leader_election.cc:290] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 election: Requested vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:31.891041 12434 raft_consensus.cc:2468] T 15334a8c7e314a87a6ece58b7a573915 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 1.
I20260709 13:04:31.882081 12647 raft_consensus.cc:359] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.892488 12647 raft_consensus.cc:385] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.892673 12326 leader_election.cc:304] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:31.893999 12652 raft_consensus.cc:2804] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.894603 12652 raft_consensus.cc:697] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Becoming Leader. State: Replica: 490d760480074f44856a0eea650897e2, State: Running, Role: LEADER
I20260709 13:04:31.891973 12508 raft_consensus.cc:2468] T 15334a8c7e314a87a6ece58b7a573915 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 1.
I20260709 13:04:31.893280 12647 raft_consensus.cc:740] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.898619 12647 consensus_queue.cc:260] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.897145 12652 consensus_queue.cc:237] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.899811 12648 ts_tablet_manager.cc:1434] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 13:04:31.900805 12648 tablet_bootstrap.cc:492] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
I20260709 13:04:31.904000 12647 ts_tablet_manager.cc:1434] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:04:31.905156 12647 tablet_bootstrap.cc:492] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
I20260709 13:04:31.911863 12647 tablet_bootstrap.cc:654] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.912066 12646 tablet_bootstrap.cc:492] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:31.913378 12646 ts_tablet_manager.cc:1403] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.018s
I20260709 13:04:31.917907 12646 raft_consensus.cc:359] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.918838 12648 tablet_bootstrap.cc:654] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.919055 12646 raft_consensus.cc:385] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.919672 12646 raft_consensus.cc:740] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.920740 12646 consensus_queue.cc:260] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.925436 12648 tablet_bootstrap.cc:492] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:31.926841 12646 ts_tablet_manager.cc:1434] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 13:04:31.926864 12648 ts_tablet_manager.cc:1403] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.001s
I20260709 13:04:31.928282 12646 tablet_bootstrap.cc:492] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2: Bootstrap starting.
I20260709 13:04:31.928483 12647 tablet_bootstrap.cc:492] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:31.929107 12647 ts_tablet_manager.cc:1403] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.007s
I20260709 13:04:31.929675 12256 catalog_manager.cc:5697] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 490d760480074f44856a0eea650897e2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "490d760480074f44856a0eea650897e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.930336 12648 raft_consensus.cc:359] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.931089 12648 raft_consensus.cc:385] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.931465 12648 raft_consensus.cc:740] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.932467 12648 consensus_queue.cc:260] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.934206 12648 ts_tablet_manager.cc:1434] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:31.935532 12648 tablet_bootstrap.cc:492] T 61e34d4f09424e2eac64767bc97145b7 P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
I20260709 13:04:31.940056 12646 tablet_bootstrap.cc:654] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.932206 12647 raft_consensus.cc:359] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.940608 12647 raft_consensus.cc:385] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.940980 12647 raft_consensus.cc:740] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.942075 12648 tablet_bootstrap.cc:654] T 61e34d4f09424e2eac64767bc97145b7 P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.942080 12634 raft_consensus.cc:493] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.942746 12634 raft_consensus.cc:515] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.945142 12634 leader_election.cc:290] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:31.946319 12508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e34d4f09424e2eac64767bc97145b7" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
I20260709 13:04:31.946883 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e34d4f09424e2eac64767bc97145b7" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2" is_pre_election: true
I20260709 13:04:31.946730 12647 consensus_queue.cc:260] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.947583 12359 raft_consensus.cc:2468] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 0.
W20260709 13:04:31.948602 12401 leader_election.cc:343] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.947636 12671 raft_consensus.cc:493] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.949297 12671 raft_consensus.cc:515] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.951581 12671 leader_election.cc:290] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729)
I20260709 13:04:31.953073 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aa4540d1c44661bf0a4c579cd11f23" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2" is_pre_election: true
I20260709 13:04:31.953886 12647 ts_tablet_manager.cc:1434] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
W20260709 13:04:31.954627 12474 leader_election.cc:343] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 490d760480074f44856a0eea650897e2 (127.0.107.193:42707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.951387 12400 leader_election.cc:304] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: fd48f77857a446d7b9a780d156984eda
I20260709 13:04:31.956003 12634 raft_consensus.cc:2804] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.956367 12634 raft_consensus.cc:493] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.956703 12634 raft_consensus.cc:3060] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.964536 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aa4540d1c44661bf0a4c579cd11f23" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
I20260709 13:04:31.965312 12434 raft_consensus.cc:2468] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 0.
I20260709 13:04:31.966233 12650 raft_consensus.cc:493] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.966758 12650 raft_consensus.cc:515] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.967707 12647 tablet_bootstrap.cc:492] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192: Bootstrap starting.
I20260709 13:04:31.968302 12646 tablet_bootstrap.cc:492] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:31.970674 12646 ts_tablet_manager.cc:1403] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.043s	user 0.024s	sys 0.010s
I20260709 13:04:31.971573 12508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01194ca40c845d0b41ecf6fb3353508" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
I20260709 13:04:31.972259 12508 raft_consensus.cc:2468] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 0.
I20260709 13:04:31.974114 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01194ca40c845d0b41ecf6fb3353508" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2" is_pre_election: true
I20260709 13:04:31.974809 12359 raft_consensus.cc:2468] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 0.
I20260709 13:04:31.970808 12475 leader_election.cc:304] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda; no voters: 490d760480074f44856a0eea650897e2
I20260709 13:04:31.974872 12646 raft_consensus.cc:359] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.975977 12646 raft_consensus.cc:385] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.975981 12631 raft_consensus.cc:493] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.976442 12646 raft_consensus.cc:740] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.968979 12650 leader_election.cc:290] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:31.976078 12400 leader_election.cc:304] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:31.976691 12631 raft_consensus.cc:515] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.977140 12671 raft_consensus.cc:2804] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.977696 12671 raft_consensus.cc:493] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.977246 12646 consensus_queue.cc:260] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.978051 12671 raft_consensus.cc:3060] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.978040 12650 raft_consensus.cc:2804] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.978698 12650 raft_consensus.cc:493] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.978840 12631 leader_election.cc:290] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729)
I20260709 13:04:31.979135 12650 raft_consensus.cc:3060] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.980082 12646 ts_tablet_manager.cc:1434] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:04:31.981196 12646 tablet_bootstrap.cc:492] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2: Bootstrap starting.
I20260709 13:04:31.981698 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6410f7906fb748fa9b06db7eecc3a0b0" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
I20260709 13:04:31.982372 12434 raft_consensus.cc:2468] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 0.
I20260709 13:04:31.983575 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6410f7906fb748fa9b06db7eecc3a0b0" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2" is_pre_election: true
I20260709 13:04:31.984477 12359 raft_consensus.cc:2468] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 0.
I20260709 13:04:31.985706 12474 leader_election.cc:304] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:31.986636 12631 raft_consensus.cc:2804] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.986979 12652 raft_consensus.cc:493] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.987851 12646 tablet_bootstrap.cc:654] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.987608 12652 raft_consensus.cc:515] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.987002 12631 raft_consensus.cc:493] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.988565 12631 raft_consensus.cc:3060] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.986990 12671 raft_consensus.cc:515] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.990015 12652 leader_election.cc:290] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:31.991914 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aa4540d1c44661bf0a4c579cd11f23" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
I20260709 13:04:31.992108 12508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aa4540d1c44661bf0a4c579cd11f23" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
I20260709 13:04:31.992563 12434 raft_consensus.cc:2468] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 0.
I20260709 13:04:31.992997 12508 raft_consensus.cc:2393] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 490d760480074f44856a0eea650897e2 in current term 1: Already voted for candidate fd48f77857a446d7b9a780d156984eda in this term.
I20260709 13:04:31.993824 12326 leader_election.cc:304] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:31.995947 12648 tablet_bootstrap.cc:492] T 61e34d4f09424e2eac64767bc97145b7 P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:31.996472 12648 ts_tablet_manager.cc:1403] T 61e34d4f09424e2eac64767bc97145b7 P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.004s
I20260709 13:04:31.996959 12647 tablet_bootstrap.cc:654] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.996861 12652 raft_consensus.cc:2804] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.998974 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aa4540d1c44661bf0a4c579cd11f23" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:32.002604 12652 raft_consensus.cc:493] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.999310 12648 raft_consensus.cc:359] T 61e34d4f09424e2eac64767bc97145b7 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.003114 12652 raft_consensus.cc:3060] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.987879 12634 raft_consensus.cc:515] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.999984 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aa4540d1c44661bf0a4c579cd11f23" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:32.003957 12434 raft_consensus.cc:3060] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.003397 12648 raft_consensus.cc:385] T 61e34d4f09424e2eac64767bc97145b7 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.004408 12648 raft_consensus.cc:740] T 61e34d4f09424e2eac64767bc97145b7 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.005201 12648 consensus_queue.cc:260] T 61e34d4f09424e2eac64767bc97145b7 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:31.994410 12671 leader_election.cc:290] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729)
I20260709 13:04:31.999931 12650 raft_consensus.cc:515] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.019615 12358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01194ca40c845d0b41ecf6fb3353508" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:32.019338 12652 raft_consensus.cc:515] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.020351 12358 raft_consensus.cc:3060] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.020933 12360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e34d4f09424e2eac64767bc97145b7" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:32.021853 12360 raft_consensus.cc:3060] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.022166 12359 raft_consensus.cc:2393] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fd48f77857a446d7b9a780d156984eda in current term 1: Already voted for candidate 490d760480074f44856a0eea650897e2 in this term.
I20260709 13:04:32.027146 12678 raft_consensus.cc:493] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.027787 12678 raft_consensus.cc:515] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.031421 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03aadeada614ceab91c7881ef056cfe" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
I20260709 13:04:32.032071 12509 raft_consensus.cc:2468] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 0.
I20260709 13:04:32.033332 12650 leader_election.cc:290] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:32.035254 12635 raft_consensus.cc:493] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.037076 12652 leader_election.cc:290] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 election: Requested vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:32.036854 12635 raft_consensus.cc:515] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.038196 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01194ca40c845d0b41ecf6fb3353508" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:32.039937 12509 raft_consensus.cc:3060] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.041085 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aa4540d1c44661bf0a4c579cd11f23" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:32.041375 12635 leader_election.cc:290] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:32.035586 12647 tablet_bootstrap.cc:492] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192: No bootstrap required, opened a new log
I20260709 13:04:32.042416 12647 ts_tablet_manager.cc:1403] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.004s
I20260709 13:04:32.037412 12401 leader_election.cc:304] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:32.046739 12647 raft_consensus.cc:359] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.047688 12678 leader_election.cc:290] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:32.047941 12508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aa4540d1c44661bf0a4c579cd11f23" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:32.048707 12647 raft_consensus.cc:385] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.049057 12647 raft_consensus.cc:740] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.048297 12678 raft_consensus.cc:2804] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.049612 12678 raft_consensus.cc:493] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.050088 12678 raft_consensus.cc:3060] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.049127 12508 raft_consensus.cc:2393] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 490d760480074f44856a0eea650897e2 in current term 1: Already voted for candidate fd48f77857a446d7b9a780d156984eda in this term.
I20260709 13:04:32.038194 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03aadeada614ceab91c7881ef056cfe" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2" is_pre_election: true
I20260709 13:04:32.053167 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f16efa64af4b928338edba11a61db4" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
I20260709 13:04:32.054080 12435 raft_consensus.cc:2468] T b1f16efa64af4b928338edba11a61db4 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 0.
I20260709 13:04:32.056196 12358 raft_consensus.cc:2468] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 1.
I20260709 13:04:32.050052 12647 consensus_queue.cc:260] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.057912 12508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f16efa64af4b928338edba11a61db4" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
I20260709 13:04:32.058818 12508 raft_consensus.cc:2468] T b1f16efa64af4b928338edba11a61db4 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 0.
I20260709 13:04:32.059710 12509 raft_consensus.cc:2468] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 1.
I20260709 13:04:32.036875 12650 raft_consensus.cc:493] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.060830 12401 leader_election.cc:304] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:32.060765 12650 raft_consensus.cc:515] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.063266 12678 raft_consensus.cc:515] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.060930 12647 ts_tablet_manager.cc:1434] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:04:32.067273 12326 leader_election.cc:304] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 490d760480074f44856a0eea650897e2; no voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda
I20260709 13:04:32.067747 12678 leader_election.cc:290] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:32.068497 12652 raft_consensus.cc:2749] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.069144 12678 raft_consensus.cc:2804] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.069859 12678 raft_consensus.cc:697] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Becoming Leader. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Running, Role: LEADER
I20260709 13:04:32.070290 12326 leader_election.cc:304] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:32.070721 12678 consensus_queue.cc:237] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.071873 12634 leader_election.cc:290] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:32.071352 12648 ts_tablet_manager.cc:1434] T 61e34d4f09424e2eac64767bc97145b7 P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.007s
I20260709 13:04:32.076409 12652 raft_consensus.cc:2804] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.077006 12652 raft_consensus.cc:493] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.077486 12652 raft_consensus.cc:3060] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.080956 12635 raft_consensus.cc:493] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.081725 12635 raft_consensus.cc:515] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.086561 12648 tablet_bootstrap.cc:492] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda: Bootstrap starting.
I20260709 13:04:32.088616 12635 leader_election.cc:290] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:32.097875 12508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e34d4f09424e2eac64767bc97145b7" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:32.098829 12508 raft_consensus.cc:3060] T 61e34d4f09424e2eac64767bc97145b7 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.099169 12434 raft_consensus.cc:2468] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 1.
I20260709 13:04:32.102564 12650 leader_election.cc:290] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:32.066782 12360 raft_consensus.cc:2468] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 1.
I20260709 13:04:32.104985 12507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33b6b17e8d42218e76a3d80c4cc5fc" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
W20260709 13:04:32.107930 12400 leader_election.cc:343] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 490d760480074f44856a0eea650897e2 (127.0.107.193:42707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.109973 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03aadeada614ceab91c7881ef056cfe" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda"
W20260709 13:04:32.111711 12401 leader_election.cc:343] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.111922 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3f0eb1d7da4f359a5e57615d3dd37f" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
I20260709 13:04:32.110941 12509 raft_consensus.cc:3060] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.112885 12435 raft_consensus.cc:2468] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 0.
I20260709 13:04:32.117291 12507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3f0eb1d7da4f359a5e57615d3dd37f" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
I20260709 13:04:32.118201 12507 raft_consensus.cc:2468] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 0.
I20260709 13:04:32.120151 12400 leader_election.cc:304] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:32.122730 12684 raft_consensus.cc:2804] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.123514 12684 raft_consensus.cc:697] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Becoming Leader. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Running, Role: LEADER
I20260709 13:04:32.124928 12684 consensus_queue.cc:237] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.127875 12358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03aadeada614ceab91c7881ef056cfe" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:32.129225 12508 raft_consensus.cc:2468] T 61e34d4f09424e2eac64767bc97145b7 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 1.
I20260709 13:04:32.129633 12326 leader_election.cc:304] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:32.130487 12360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33b6b17e8d42218e76a3d80c4cc5fc" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2" is_pre_election: true
I20260709 13:04:32.092964 12652 raft_consensus.cc:515] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.137058 12635 raft_consensus.cc:2804] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.132067 12648 tablet_bootstrap.cc:654] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.137441 12635 raft_consensus.cc:493] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.137984 12635 raft_consensus.cc:3060] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.132385 12631 raft_consensus.cc:515] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.141477 12652 leader_election.cc:290] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 election: Requested vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:32.134649 12475 leader_election.cc:304] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda; no voters: 490d760480074f44856a0eea650897e2
I20260709 13:04:32.142633 12682 raft_consensus.cc:2804] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.143093 12682 raft_consensus.cc:697] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Becoming Leader. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Running, Role: LEADER
I20260709 13:04:32.134799 12509 raft_consensus.cc:2468] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 1.
I20260709 13:04:32.143908 12682 consensus_queue.cc:237] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.144876 12646 tablet_bootstrap.cc:492] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:32.144713 12401 leader_election.cc:304] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:32.145437 12646 ts_tablet_manager.cc:1403] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.164s	user 0.059s	sys 0.086s
I20260709 13:04:32.145654 12678 raft_consensus.cc:2804] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.146281 12678 raft_consensus.cc:697] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Becoming Leader. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Running, Role: LEADER
I20260709 13:04:32.147506 12631 leader_election.cc:290] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729)
I20260709 13:04:32.147140 12678 consensus_queue.cc:237] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.149863 12648 tablet_bootstrap.cc:492] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda: No bootstrap required, opened a new log
I20260709 13:04:32.150516 12648 ts_tablet_manager.cc:1403] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.000s
I20260709 13:04:32.151257 12360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6410f7906fb748fa9b06db7eecc3a0b0" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:32.151964 12360 raft_consensus.cc:3060] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.149566 12646 raft_consensus.cc:359] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.153571 12646 raft_consensus.cc:385] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.154186 12646 raft_consensus.cc:740] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.155931 12646 consensus_queue.cc:260] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.156654 12635 raft_consensus.cc:515] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.158665 12646 ts_tablet_manager.cc:1434] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:04:32.160648 12646 tablet_bootstrap.cc:492] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2: Bootstrap starting.
I20260709 13:04:32.154323 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6410f7906fb748fa9b06db7eecc3a0b0" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:32.154878 12648 raft_consensus.cc:359] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.163668 12648 raft_consensus.cc:385] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.164029 12648 raft_consensus.cc:740] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.164839 12648 consensus_queue.cc:260] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.167294 12648 ts_tablet_manager.cc:1434] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 13:04:32.167562 12646 tablet_bootstrap.cc:654] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.168071 12434 raft_consensus.cc:3060] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.172869 12652 raft_consensus.cc:493] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.173446 12652 raft_consensus.cc:515] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.174212 12256 catalog_manager.cc:5697] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94843016eb774f7a86692342c1b4c192 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "94843016eb774f7a86692342c1b4c192" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:32.175477 12326 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:39735, user_credentials={real_user=slave}} blocked reactor thread for 45932us
I20260709 13:04:32.175890 12652 leader_election.cc:290] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:32.176513 12256 catalog_manager.cc:5697] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94843016eb774f7a86692342c1b4c192 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "94843016eb774f7a86692342c1b4c192" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:32.178159 12400 leader_election.cc:343] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 490d760480074f44856a0eea650897e2 (127.0.107.193:42707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.179034 12360 raft_consensus.cc:2468] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 1.
W20260709 13:04:32.180322 12400 leader_election.cc:343] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 490d760480074f44856a0eea650897e2 (127.0.107.193:42707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.180516 12474 leader_election.cc:304] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:32.181030 12400 leader_election.cc:304] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94843016eb774f7a86692342c1b4c192; no voters: 490d760480074f44856a0eea650897e2, fd48f77857a446d7b9a780d156984eda
I20260709 13:04:32.181531 12631 raft_consensus.cc:2804] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.182090 12631 raft_consensus.cc:697] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Becoming Leader. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Running, Role: LEADER
I20260709 13:04:32.182245 12678 raft_consensus.cc:2749] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.182891 12631 consensus_queue.cc:237] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.186344 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f16efa64af4b928338edba11a61db4" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:32.187260 12435 raft_consensus.cc:3060] T b1f16efa64af4b928338edba11a61db4 P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.199940 12671 raft_consensus.cc:493] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.200677 12671 raft_consensus.cc:515] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.205543 12435 raft_consensus.cc:2468] T b1f16efa64af4b928338edba11a61db4 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 1.
I20260709 13:04:32.205726 12433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33b6b17e8d42218e76a3d80c4cc5fc" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
I20260709 13:04:32.206732 12433 raft_consensus.cc:2468] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 0.
I20260709 13:04:32.208439 12475 leader_election.cc:304] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:32.208799 12635 leader_election.cc:290] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 election: Requested vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:32.203166 12671 leader_election.cc:290] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729)
I20260709 13:04:32.210016 12671 raft_consensus.cc:2804] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.210476 12671 raft_consensus.cc:493] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.213415 12671 raft_consensus.cc:3060] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.213958 12508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03aadeada614ceab91c7881ef056cfe" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
I20260709 13:04:32.215063 12508 raft_consensus.cc:2393] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 490d760480074f44856a0eea650897e2 in current term 1: Already voted for candidate 94843016eb774f7a86692342c1b4c192 in this term.
I20260709 13:04:32.219545 12360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33b6b17e8d42218e76a3d80c4cc5fc" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2" is_pre_election: true
W20260709 13:04:32.221935 12474 leader_election.cc:343] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 490d760480074f44856a0eea650897e2 (127.0.107.193:42707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.222582 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f16efa64af4b928338edba11a61db4" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:32.223457 12509 raft_consensus.cc:3060] T b1f16efa64af4b928338edba11a61db4 P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.223989 12434 raft_consensus.cc:2468] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 1.
I20260709 13:04:32.231561 12671 raft_consensus.cc:515] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.235689 12360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33b6b17e8d42218e76a3d80c4cc5fc" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:32.236820 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03aadeada614ceab91c7881ef056cfe" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
W20260709 13:04:32.237473 12474 leader_election.cc:343] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 490d760480074f44856a0eea650897e2 (127.0.107.193:42707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.235759 12509 raft_consensus.cc:2468] T b1f16efa64af4b928338edba11a61db4 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 1.
I20260709 13:04:32.238569 12671 leader_election.cc:290] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729)
I20260709 13:04:32.212603 12326 leader_election.cc:304] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:32.240528 12635 raft_consensus.cc:2804] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.241226 12635 raft_consensus.cc:697] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Becoming Leader. State: Replica: 490d760480074f44856a0eea650897e2, State: Running, Role: LEADER
I20260709 13:04:32.242465 12635 consensus_queue.cc:237] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.246080 12646 tablet_bootstrap.cc:492] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2: No bootstrap required, opened a new log
I20260709 13:04:32.246641 12646 ts_tablet_manager.cc:1403] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2: Time spent bootstrapping tablet: real 0.086s	user 0.025s	sys 0.054s
I20260709 13:04:32.246644 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33b6b17e8d42218e76a3d80c4cc5fc" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:32.247848 12434 raft_consensus.cc:3060] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.250072 12646 raft_consensus.cc:359] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.250854 12646 raft_consensus.cc:385] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.251187 12646 raft_consensus.cc:740] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.251886 12646 consensus_queue.cc:260] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.252264 12258 catalog_manager.cc:5697] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94843016eb774f7a86692342c1b4c192 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "94843016eb774f7a86692342c1b4c192" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.254215 12646 ts_tablet_manager.cc:1434] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:04:32.255398 12433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3f0eb1d7da4f359a5e57615d3dd37f" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:32.256381 12433 raft_consensus.cc:3060] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.263448 12256 catalog_manager.cc:5697] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda reported cstate change: term changed from 0 to 1, leader changed from <none> to fd48f77857a446d7b9a780d156984eda (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fd48f77857a446d7b9a780d156984eda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.265800 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3f0eb1d7da4f359a5e57615d3dd37f" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:32.266487 12509 raft_consensus.cc:3060] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.270960 12434 raft_consensus.cc:2468] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 1.
I20260709 13:04:32.273062 12433 raft_consensus.cc:2468] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 1.
I20260709 13:04:32.275518 12326 leader_election.cc:304] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 490d760480074f44856a0eea650897e2; no voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda
I20260709 13:04:32.276584 12652 raft_consensus.cc:3060] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.276674 12509 raft_consensus.cc:2468] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 1.
I20260709 13:04:32.278081 12256 catalog_manager.cc:5697] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda reported cstate change: term changed from 0 to 1, leader changed from <none> to fd48f77857a446d7b9a780d156984eda (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fd48f77857a446d7b9a780d156984eda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.275154 12475 leader_election.cc:304] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda; no voters: 490d760480074f44856a0eea650897e2
I20260709 13:04:32.282648 12693 raft_consensus.cc:2804] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.283157 12693 raft_consensus.cc:697] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Becoming Leader. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Running, Role: LEADER
I20260709 13:04:32.283474 12258 catalog_manager.cc:5697] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 490d760480074f44856a0eea650897e2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "490d760480074f44856a0eea650897e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.284034 12693 consensus_queue.cc:237] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.287007 12326 leader_election.cc:304] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:32.288821 12649 raft_consensus.cc:2804] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.289340 12649 raft_consensus.cc:697] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Becoming Leader. State: Replica: 490d760480074f44856a0eea650897e2, State: Running, Role: LEADER
I20260709 13:04:32.287285 12652 raft_consensus.cc:2749] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.290227 12649 consensus_queue.cc:237] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.310531 12258 catalog_manager.cc:5697] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda reported cstate change: term changed from 0 to 1, leader changed from <none> to fd48f77857a446d7b9a780d156984eda (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fd48f77857a446d7b9a780d156984eda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.314605 12649 raft_consensus.cc:493] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.315155 12649 raft_consensus.cc:515] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.317477 12649 leader_election.cc:290] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:32.318056 12433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33b6b17e8d42218e76a3d80c4cc5fc" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94843016eb774f7a86692342c1b4c192" is_pre_election: true
I20260709 13:04:32.318427 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33b6b17e8d42218e76a3d80c4cc5fc" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd48f77857a446d7b9a780d156984eda" is_pre_election: true
I20260709 13:04:32.318984 12433 raft_consensus.cc:2393] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 490d760480074f44856a0eea650897e2 in current term 1: Already voted for candidate fd48f77857a446d7b9a780d156984eda in this term.
I20260709 13:04:32.320192 12326 leader_election.cc:304] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 490d760480074f44856a0eea650897e2; no voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda
I20260709 13:04:32.319458 12255 catalog_manager.cc:5697] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 490d760480074f44856a0eea650897e2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "490d760480074f44856a0eea650897e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.320979 12649 raft_consensus.cc:3060] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.327661 12649 raft_consensus.cc:2749] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.449944 12649 consensus_queue.cc:1048] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.465692 12649 consensus_queue.cc:1048] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.538313 12433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e01194ca40c845d0b41ecf6fb3353508"
dest_uuid: "94843016eb774f7a86692342c1b4c192"
mode: GRACEFUL
new_leader_uuid: "490d760480074f44856a0eea650897e2"
 from {username='slave'} at 127.0.0.1:49122
I20260709 13:04:32.538892 12433 raft_consensus.cc:606] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Received request to transfer leadership to TS 490d760480074f44856a0eea650897e2
I20260709 13:04:32.543871 12509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea33b6b17e8d42218e76a3d80c4cc5fc"
dest_uuid: "fd48f77857a446d7b9a780d156984eda"
mode: GRACEFUL
new_leader_uuid: "490d760480074f44856a0eea650897e2"
 from {username='slave'} at 127.0.0.1:35374
I20260709 13:04:32.544322 12509 raft_consensus.cc:606] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Received request to transfer leadership to TS 490d760480074f44856a0eea650897e2
I20260709 13:04:32.549382 12509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4aa4540d1c44661bf0a4c579cd11f23"
dest_uuid: "fd48f77857a446d7b9a780d156984eda"
mode: GRACEFUL
new_leader_uuid: "94843016eb774f7a86692342c1b4c192"
 from {username='slave'} at 127.0.0.1:35374
I20260709 13:04:32.549942 12509 raft_consensus.cc:606] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Received request to transfer leadership to TS 94843016eb774f7a86692342c1b4c192
I20260709 13:04:32.553882 12693 consensus_queue.cc:1048] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.555579 12360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b3f0eb1d7da4f359a5e57615d3dd37f"
dest_uuid: "490d760480074f44856a0eea650897e2"
mode: GRACEFUL
new_leader_uuid: "94843016eb774f7a86692342c1b4c192"
 from {username='slave'} at 127.0.0.1:55896
I20260709 13:04:32.556257 12360 raft_consensus.cc:606] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Received request to transfer leadership to TS 94843016eb774f7a86692342c1b4c192
I20260709 13:04:32.562141 12671 raft_consensus.cc:993] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda: : Instructing follower 94843016eb774f7a86692342c1b4c192 to start an election
I20260709 13:04:32.562536 12509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6410f7906fb748fa9b06db7eecc3a0b0"
dest_uuid: "fd48f77857a446d7b9a780d156984eda"
mode: GRACEFUL
new_leader_uuid: "94843016eb774f7a86692342c1b4c192"
 from {username='slave'} at 127.0.0.1:35374
I20260709 13:04:32.562692 12631 raft_consensus.cc:1081] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Signalling peer 94843016eb774f7a86692342c1b4c192 to start an election
I20260709 13:04:32.563745 12509 raft_consensus.cc:606] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Received request to transfer leadership to TS 94843016eb774f7a86692342c1b4c192
I20260709 13:04:32.565881 12434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4aa4540d1c44661bf0a4c579cd11f23"
dest_uuid: "94843016eb774f7a86692342c1b4c192"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:04:32.566545 12434 raft_consensus.cc:493] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.566960 12434 raft_consensus.cc:3060] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.575702 12671 consensus_queue.cc:1048] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.577005 12678 consensus_queue.cc:1048] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.578680 12433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d03aadeada614ceab91c7881ef056cfe"
dest_uuid: "94843016eb774f7a86692342c1b4c192"
mode: GRACEFUL
new_leader_uuid: "fd48f77857a446d7b9a780d156984eda"
 from {username='slave'} at 127.0.0.1:49122
I20260709 13:04:32.579459 12433 raft_consensus.cc:606] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Received request to transfer leadership to TS fd48f77857a446d7b9a780d156984eda
I20260709 13:04:32.591190 12434 raft_consensus.cc:515] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.594492 12650 consensus_queue.cc:1048] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.596306 12434 leader_election.cc:290] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 2 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:32.597731 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aa4540d1c44661bf0a4c579cd11f23" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:32.598073 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aa4540d1c44661bf0a4c579cd11f23" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:32.598465 12359 raft_consensus.cc:3060] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.598660 12509 raft_consensus.cc:3055] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:32.599061 12509 raft_consensus.cc:740] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Running, Role: LEADER
I20260709 13:04:32.600113 12509 consensus_queue.cc:260] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.602428 12509 raft_consensus.cc:3060] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.609383 12359 raft_consensus.cc:2468] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 2.
I20260709 13:04:32.614485 12509 raft_consensus.cc:2468] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 2.
I20260709 13:04:32.617118 12400 leader_election.cc:304] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:32.617955 12650 raft_consensus.cc:2804] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:32.618477 12650 raft_consensus.cc:697] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [term 2 LEADER]: Becoming Leader. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Running, Role: LEADER
I20260709 13:04:32.619367 12650 consensus_queue.cc:237] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.628568 12684 raft_consensus.cc:993] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192: : Instructing follower 490d760480074f44856a0eea650897e2 to start an election
I20260709 13:04:32.629055 12685 raft_consensus.cc:1081] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Signalling peer 490d760480074f44856a0eea650897e2 to start an election
I20260709 13:04:32.629076 12650 consensus_queue.cc:1048] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.630309 12258 catalog_manager.cc:5697] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 reported cstate change: term changed from 1 to 2, leader changed from fd48f77857a446d7b9a780d156984eda (127.0.107.195) to 94843016eb774f7a86692342c1b4c192 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "94843016eb774f7a86692342c1b4c192" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.631910 12358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e01194ca40c845d0b41ecf6fb3353508"
dest_uuid: "490d760480074f44856a0eea650897e2"
 from {username='slave'} at 127.0.0.1:55870
I20260709 13:04:32.637336 12358 raft_consensus.cc:493] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.637848 12358 raft_consensus.cc:3060] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.649271 12684 consensus_queue.cc:1048] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.649230 12358 raft_consensus.cc:515] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.652427 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01194ca40c845d0b41ecf6fb3353508" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:32.653074 12434 raft_consensus.cc:3055] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:32.653362 12434 raft_consensus.cc:740] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Running, Role: LEADER
I20260709 13:04:32.654147 12434 consensus_queue.cc:260] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.656571 12434 raft_consensus.cc:3060] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.664072 12434 raft_consensus.cc:2468] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 2.
I20260709 13:04:32.665045 12326 leader_election.cc:304] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:32.665175 12358 leader_election.cc:290] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 2 election: Requested vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:32.666456 12649 raft_consensus.cc:2804] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:32.666738 12509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01194ca40c845d0b41ecf6fb3353508" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:32.666946 12649 raft_consensus.cc:697] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [term 2 LEADER]: Becoming Leader. State: Replica: 490d760480074f44856a0eea650897e2, State: Running, Role: LEADER
I20260709 13:04:32.667375 12509 raft_consensus.cc:3060] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.668107 12649 consensus_queue.cc:237] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.674710 12509 raft_consensus.cc:2468] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 2.
I20260709 13:04:32.676426 12258 catalog_manager.cc:5697] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 reported cstate change: term changed from 1 to 2, leader changed from 94843016eb774f7a86692342c1b4c192 (127.0.107.194) to 490d760480074f44856a0eea650897e2 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "490d760480074f44856a0eea650897e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.728824 12631 consensus_queue.cc:1048] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.735954 12671 raft_consensus.cc:993] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda: : Instructing follower 94843016eb774f7a86692342c1b4c192 to start an election
I20260709 13:04:32.736423 12671 raft_consensus.cc:1081] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Signalling peer 94843016eb774f7a86692342c1b4c192 to start an election
I20260709 13:04:32.740666 12433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6410f7906fb748fa9b06db7eecc3a0b0"
dest_uuid: "94843016eb774f7a86692342c1b4c192"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:04:32.741294 12433 raft_consensus.cc:493] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.741667 12433 raft_consensus.cc:3060] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.741796 12678 consensus_queue.cc:1048] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.746659 12671 consensus_queue.cc:1048] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.751528 12433 raft_consensus.cc:515] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.753722 12649 consensus_queue.cc:1048] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.747408 12678 consensus_queue.cc:1048] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.758447 12433 leader_election.cc:290] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 2 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:32.758628 12360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6410f7906fb748fa9b06db7eecc3a0b0" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:32.763314 12508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6410f7906fb748fa9b06db7eecc3a0b0" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:32.764066 12508 raft_consensus.cc:3055] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:32.764415 12508 raft_consensus.cc:740] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Running, Role: LEADER
I20260709 13:04:32.766039 12508 consensus_queue.cc:260] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.770139 12508 raft_consensus.cc:3060] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.780607 12508 raft_consensus.cc:2468] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 2.
I20260709 13:04:32.782897 12401 leader_election.cc:304] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda; no voters: 490d760480074f44856a0eea650897e2
I20260709 13:04:32.785153 12714 raft_consensus.cc:2804] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:32.785806 12714 raft_consensus.cc:697] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [term 2 LEADER]: Becoming Leader. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Running, Role: LEADER
I20260709 13:04:32.786710 12714 consensus_queue.cc:237] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.791522 12652 consensus_queue.cc:1048] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.792935 12650 raft_consensus.cc:993] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192: : Instructing follower fd48f77857a446d7b9a780d156984eda to start an election
I20260709 13:04:32.793490 12650 raft_consensus.cc:1081] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Signalling peer fd48f77857a446d7b9a780d156984eda to start an election
I20260709 13:04:32.795522 12507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d03aadeada614ceab91c7881ef056cfe"
dest_uuid: "fd48f77857a446d7b9a780d156984eda"
 from {username='slave'} at 127.0.0.1:35364
I20260709 13:04:32.796062 12507 raft_consensus.cc:493] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.796433 12507 raft_consensus.cc:3060] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.799760 12635 consensus_queue.cc:1048] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.808934 12258 catalog_manager.cc:5697] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 reported cstate change: term changed from 1 to 2, leader changed from fd48f77857a446d7b9a780d156984eda (127.0.107.195) to 94843016eb774f7a86692342c1b4c192 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "94843016eb774f7a86692342c1b4c192" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.811724 12671 consensus_queue.cc:1048] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.831131 12507 raft_consensus.cc:515] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.832038 12649 raft_consensus.cc:993] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2: : Instructing follower 94843016eb774f7a86692342c1b4c192 to start an election
I20260709 13:04:32.834575 12649 raft_consensus.cc:1081] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Signalling peer 94843016eb774f7a86692342c1b4c192 to start an election
I20260709 13:04:32.834772 12509 raft_consensus.cc:1240] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Rejecting Update request from peer 94843016eb774f7a86692342c1b4c192 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:32.839738 12434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b3f0eb1d7da4f359a5e57615d3dd37f"
dest_uuid: "94843016eb774f7a86692342c1b4c192"
 from {username='slave'} at 127.0.0.1:49104
I20260709 13:04:32.839946 12714 consensus_queue.cc:1059] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.840463 12434 raft_consensus.cc:493] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.840955 12434 raft_consensus.cc:3060] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.841369 12714 raft_consensus.cc:3055] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:32.841892 12714 raft_consensus.cc:740] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Running, Role: LEADER
I20260709 13:04:32.843184 12714 consensus_queue.cc:260] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.844841 12714 raft_consensus.cc:3060] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.850033 12358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03aadeada614ceab91c7881ef056cfe" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:32.850780 12358 raft_consensus.cc:3060] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.851007 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03aadeada614ceab91c7881ef056cfe" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:32.854223 12507 leader_election.cc:290] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 2 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729)
I20260709 13:04:32.861263 12358 raft_consensus.cc:2468] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 2.
I20260709 13:04:32.862648 12474 leader_election.cc:304] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:32.864881 12631 raft_consensus.cc:2804] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:32.865435 12631 raft_consensus.cc:697] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 2 LEADER]: Becoming Leader. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Running, Role: LEADER
I20260709 13:04:32.866341 12631 consensus_queue.cc:237] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.876969 12693 consensus_queue.cc:1048] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.885229 12432 raft_consensus.cc:2468] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 2.
I20260709 13:04:32.896898 12434 raft_consensus.cc:515] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.898490 12433 raft_consensus.cc:1240] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Rejecting Update request from peer 490d760480074f44856a0eea650897e2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:32.901646 12434 leader_election.cc:290] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 2 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:32.902896 12508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3f0eb1d7da4f359a5e57615d3dd37f" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:32.903635 12508 raft_consensus.cc:3060] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.909724 12671 raft_consensus.cc:993] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda: : Instructing follower 490d760480074f44856a0eea650897e2 to start an election
I20260709 13:04:32.910305 12671 raft_consensus.cc:1081] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Signalling peer 490d760480074f44856a0eea650897e2 to start an election
I20260709 13:04:32.910741 12255 catalog_manager.cc:5697] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda reported cstate change: term changed from 1 to 2, leader changed from 94843016eb774f7a86692342c1b4c192 (127.0.107.194) to fd48f77857a446d7b9a780d156984eda (127.0.107.195). New cstate: current_term: 2 leader_uuid: "fd48f77857a446d7b9a780d156984eda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.912282 12508 raft_consensus.cc:2468] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 2.
I20260709 13:04:32.912421 12359 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea33b6b17e8d42218e76a3d80c4cc5fc"
dest_uuid: "490d760480074f44856a0eea650897e2"
 from {username='slave'} at 127.0.0.1:55880
I20260709 13:04:32.912968 12359 raft_consensus.cc:493] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.913329 12359 raft_consensus.cc:3060] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.913552 12401 leader_election.cc:304] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:32.914664 12685 raft_consensus.cc:2804] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:32.915154 12685 raft_consensus.cc:697] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [term 2 LEADER]: Becoming Leader. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Running, Role: LEADER
I20260709 13:04:32.916235 12685 consensus_queue.cc:237] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.924292 12360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3f0eb1d7da4f359a5e57615d3dd37f" candidate_uuid: "94843016eb774f7a86692342c1b4c192" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:32.924737 12635 consensus_queue.cc:1059] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.925575 12360 raft_consensus.cc:3055] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:32.925998 12360 raft_consensus.cc:740] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Running, Role: LEADER
I20260709 13:04:32.926832 12360 consensus_queue.cc:260] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
W20260709 13:04:32.928272 12635 consensus_queue.cc:1175] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fd48f77857a446d7b9a780d156984eda" responder_term: 1 status { last_received { term: 0 index: 0 } last_committed_idx: 0 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:04:32.930183 12359 raft_consensus.cc:515] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.928007 12360 raft_consensus.cc:3060] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.931332 12358 raft_consensus.cc:1240] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Rejecting Update request from peer fd48f77857a446d7b9a780d156984eda for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:32.934641 12671 consensus_queue.cc:1059] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.935657 12671 raft_consensus.cc:3055] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:32.936012 12671 raft_consensus.cc:740] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Running, Role: LEADER
I20260709 13:04:32.936976 12671 consensus_queue.cc:260] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.937601 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33b6b17e8d42218e76a3d80c4cc5fc" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:32.938302 12671 raft_consensus.cc:3060] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.938400 12360 raft_consensus.cc:2468] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94843016eb774f7a86692342c1b4c192 in term 2.
W20260709 13:04:32.939028 12652 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:04:32.938325 12435 raft_consensus.cc:3060] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.935657 12359 leader_election.cc:290] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 2 election: Requested vote from peers 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729), fd48f77857a446d7b9a780d156984eda (127.0.107.195:39735)
I20260709 13:04:32.941146 12508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33b6b17e8d42218e76a3d80c4cc5fc" candidate_uuid: "490d760480074f44856a0eea650897e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd48f77857a446d7b9a780d156984eda"
I20260709 13:04:32.942528 12255 catalog_manager.cc:5697] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 reported cstate change: term changed from 1 to 2, leader changed from 490d760480074f44856a0eea650897e2 (127.0.107.193) to 94843016eb774f7a86692342c1b4c192 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "94843016eb774f7a86692342c1b4c192" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.946485 12435 raft_consensus.cc:2468] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 2.
I20260709 13:04:32.947964 12326 leader_election.cc:304] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, 94843016eb774f7a86692342c1b4c192; no voters: 
I20260709 13:04:32.948812 12652 raft_consensus.cc:2804] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:32.949282 12652 raft_consensus.cc:697] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [term 2 LEADER]: Becoming Leader. State: Replica: 490d760480074f44856a0eea650897e2, State: Running, Role: LEADER
I20260709 13:04:32.950071 12652 consensus_queue.cc:237] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:32.954206 12508 raft_consensus.cc:2468] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d760480074f44856a0eea650897e2 in term 2.
I20260709 13:04:32.959424 12258 catalog_manager.cc:5697] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 reported cstate change: term changed from 1 to 2, leader changed from fd48f77857a446d7b9a780d156984eda (127.0.107.195) to 490d760480074f44856a0eea650897e2 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "490d760480074f44856a0eea650897e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.057673 12508 raft_consensus.cc:1275] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Refusing update from remote peer 490d760480074f44856a0eea650897e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:33.059304 12652 consensus_queue.cc:1048] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:33.066682 12435 raft_consensus.cc:1275] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Refusing update from remote peer 490d760480074f44856a0eea650897e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:33.068513 12635 consensus_queue.cc:1048] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:33.191390 12359 raft_consensus.cc:1275] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Refusing update from remote peer 94843016eb774f7a86692342c1b4c192: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:33.192803 12685 consensus_queue.cc:1048] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:33.197495 12507 raft_consensus.cc:1275] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Refusing update from remote peer 94843016eb774f7a86692342c1b4c192: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:33.199313 12714 consensus_queue.cc:1048] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:33.208683 12507 raft_consensus.cc:1275] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Refusing update from remote peer 94843016eb774f7a86692342c1b4c192: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:33.211988 12685 consensus_queue.cc:1048] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:33.212235 12359 raft_consensus.cc:3060] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:33.221217 12359 raft_consensus.cc:1275] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Refusing update from remote peer 94843016eb774f7a86692342c1b4c192: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:33.222640 12685 consensus_queue.cc:1048] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:33.281787 12435 raft_consensus.cc:1275] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Refusing update from remote peer fd48f77857a446d7b9a780d156984eda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:33.283380 12671 consensus_queue.cc:1048] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:33.291329 12359 raft_consensus.cc:1275] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Refusing update from remote peer fd48f77857a446d7b9a780d156984eda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:33.293064 12631 consensus_queue.cc:1048] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:33.330579 12507 raft_consensus.cc:1275] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Refusing update from remote peer 94843016eb774f7a86692342c1b4c192: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:33.332077 12685 consensus_queue.cc:1048] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.342818 12359 raft_consensus.cc:1275] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Refusing update from remote peer 94843016eb774f7a86692342c1b4c192: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:33.344337 12685 consensus_queue.cc:1048] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:33.434623 12507 raft_consensus.cc:1275] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Refusing update from remote peer 490d760480074f44856a0eea650897e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:33.435923 12635 consensus_queue.cc:1048] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:33.444856 12435 raft_consensus.cc:1275] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Refusing update from remote peer 490d760480074f44856a0eea650897e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:33.446383 12652 consensus_queue.cc:1048] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:35.583302 12258 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60536:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:04:35.610327 12258 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60536:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:04:35.656157   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:35.872463 12754 tablet.cc:1724] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:35.873986 12356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "327fa75753f149959a81b96b9b3635ff"
dest_uuid: "490d760480074f44856a0eea650897e2"
mode: GRACEFUL
new_leader_uuid: "fd48f77857a446d7b9a780d156984eda"
 from {username='slave'} at 127.0.0.1:53964
I20260709 13:04:35.875185 12356 raft_consensus.cc:606] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Received request to transfer leadership to TS fd48f77857a446d7b9a780d156984eda
I20260709 13:04:35.920019 12772 tablet.cc:1724] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:35.967919 12765 tablet.cc:1724] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:35.994788 12752 log.cc:927] Time spent T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:04:36.051090 12782 tablet.cc:1724] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.044947 12785 tablet.cc:1724] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:36.082393 12774 log.cc:927] Time spent T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:04:36.072809 12784 tablet.cc:1724] T 61e34d4f09424e2eac64767bc97145b7 P fd48f77857a446d7b9a780d156984eda: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.088398 12779 tablet.cc:1724] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:36.104413 12757 log.cc:927] Time spent T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192: Append to log took a long time: real 0.242s	user 0.005s	sys 0.000s
I20260709 13:04:36.100353 12781 tablet.cc:1724] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.112149 12788 tablet.cc:1724] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.077576 12780 tablet.cc:1724] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.144754 12765 tablet.cc:1724] T 15334a8c7e314a87a6ece58b7a573915 P fd48f77857a446d7b9a780d156984eda: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.146492 12754 tablet.cc:1724] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:36.148960 12786 log.cc:927] Time spent T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:04:36.162036 12772 tablet.cc:1724] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.184792 12780 tablet.cc:1724] T b1f16efa64af4b928338edba11a61db4 P 94843016eb774f7a86692342c1b4c192: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.193135 12432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e92397046da34f10a3938976d5d581b1"
dest_uuid: "94843016eb774f7a86692342c1b4c192"
mode: GRACEFUL
new_leader_uuid: "fd48f77857a446d7b9a780d156984eda"
 from {username='slave'} at 127.0.0.1:42462
I20260709 13:04:36.206897 12432 raft_consensus.cc:606] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Received request to transfer leadership to TS fd48f77857a446d7b9a780d156984eda
I20260709 13:04:36.208178 12766 raft_consensus.cc:993] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2: : Instructing follower fd48f77857a446d7b9a780d156984eda to start an election
I20260709 13:04:36.208958   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:36.209177 12766 raft_consensus.cc:1081] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Signalling peer fd48f77857a446d7b9a780d156984eda to start an election
I20260709 13:04:36.209941   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:36.213287 12509 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "327fa75753f149959a81b96b9b3635ff"
dest_uuid: "fd48f77857a446d7b9a780d156984eda"
 from {username='slave'} at 127.0.0.1:35352
I20260709 13:04:36.201987 12754 tablet.cc:1724] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.213989 12509 raft_consensus.cc:493] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:36.216281 12509 raft_consensus.cc:3060] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.223752 12765 tablet.cc:1724] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.225032 12779 tablet.cc:1724] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:36.228464 12790 log.cc:927] Time spent T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:04:36.230181 12788 tablet.cc:1724] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.238826 12791 tablet.cc:1724] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.244318 12780 tablet.cc:1724] T 15334a8c7e314a87a6ece58b7a573915 P 94843016eb774f7a86692342c1b4c192: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.236462 12782 tablet.cc:1724] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.256937 12678 raft_consensus.cc:993] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192: : Instructing follower fd48f77857a446d7b9a780d156984eda to start an election
I20260709 13:04:36.265041 12678 raft_consensus.cc:1081] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Signalling peer fd48f77857a446d7b9a780d156984eda to start an election
I20260709 13:04:36.258852 12781 tablet.cc:1724] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.249542 12785 tablet.cc:1724] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.267076 12504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e92397046da34f10a3938976d5d581b1"
dest_uuid: "fd48f77857a446d7b9a780d156984eda"
 from {username='slave'} at 127.0.0.1:35364
I20260709 13:04:36.267735 12504 raft_consensus.cc:493] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:36.268098 12504 raft_consensus.cc:3060] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.269806 12754 tablet.cc:1724] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.284277 12765 tablet.cc:1724] T b1f16efa64af4b928338edba11a61db4 P fd48f77857a446d7b9a780d156984eda: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.303452 12509 raft_consensus.cc:515] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:36.276870 12504 raft_consensus.cc:515] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:36.306581 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327fa75753f149959a81b96b9b3635ff" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:36.307030 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327fa75753f149959a81b96b9b3635ff" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:36.307345 12356 raft_consensus.cc:3055] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:36.307727 12356 raft_consensus.cc:740] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 490d760480074f44856a0eea650897e2, State: Running, Role: LEADER
I20260709 13:04:36.308771 12356 consensus_queue.cc:260] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:36.309365 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92397046da34f10a3938976d5d581b1" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94843016eb774f7a86692342c1b4c192"
I20260709 13:04:36.280923 12779 tablet.cc:1724] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.310068 12432 raft_consensus.cc:3055] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:36.310510 12432 raft_consensus.cc:740] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94843016eb774f7a86692342c1b4c192, State: Running, Role: LEADER
I20260709 13:04:36.311409 12432 consensus_queue.cc:260] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:36.312569 12432 raft_consensus.cc:3060] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.312804 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92397046da34f10a3938976d5d581b1" candidate_uuid: "fd48f77857a446d7b9a780d156984eda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "490d760480074f44856a0eea650897e2"
I20260709 13:04:36.313473 12357 raft_consensus.cc:3060] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.307735 12431 raft_consensus.cc:3060] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.308094 12504 leader_election.cc:290] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 2 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729)
I20260709 13:04:36.310063 12356 raft_consensus.cc:3060] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.309226 12772 tablet.cc:1724] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:36.320096 12509 leader_election.cc:290] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 2 election: Requested vote from peers 490d760480074f44856a0eea650897e2 (127.0.107.193:42707), 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729)
I20260709 13:04:36.333016 12357 raft_consensus.cc:2468] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 2.
I20260709 13:04:36.334739 12474 leader_election.cc:304] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d760480074f44856a0eea650897e2, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:36.335719 12777 raft_consensus.cc:2804] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:36.336179 12777 raft_consensus.cc:697] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [term 2 LEADER]: Becoming Leader. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Running, Role: LEADER
I20260709 13:04:36.338310 12777 consensus_queue.cc:237] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:36.347184 12432 raft_consensus.cc:2468] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 2.
I20260709 13:04:36.348950 12431 raft_consensus.cc:2468] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 2.
I20260709 13:04:36.350862 12475 leader_election.cc:304] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94843016eb774f7a86692342c1b4c192, fd48f77857a446d7b9a780d156984eda; no voters: 
I20260709 13:04:36.352043 12759 raft_consensus.cc:2804] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:36.352571 12759 raft_consensus.cc:697] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [term 2 LEADER]: Becoming Leader. State: Replica: fd48f77857a446d7b9a780d156984eda, State: Running, Role: LEADER
I20260709 13:04:36.352671 12356 raft_consensus.cc:2468] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48f77857a446d7b9a780d156984eda in term 2.
I20260709 13:04:36.353766 12759 consensus_queue.cc:237] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } }
I20260709 13:04:36.362627 12255 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949: soft_deleted_table [id=c2a75e4a855c4f81a62236da52982f0c] alter complete (version 1)
I20260709 13:04:36.377018 12255 catalog_manager.cc:5697] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda reported cstate change: term changed from 1 to 2, leader changed from 94843016eb774f7a86692342c1b4c192 (127.0.107.194) to fd48f77857a446d7b9a780d156984eda (127.0.107.195). New cstate: current_term: 2 leader_uuid: "fd48f77857a446d7b9a780d156984eda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:36.378952 12255 catalog_manager.cc:5697] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda reported cstate change: term changed from 1 to 2, leader changed from 490d760480074f44856a0eea650897e2 (127.0.107.193) to fd48f77857a446d7b9a780d156984eda (127.0.107.195). New cstate: current_term: 2 leader_uuid: "fd48f77857a446d7b9a780d156984eda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48f77857a446d7b9a780d156984eda" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39735 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:36.887751 12356 raft_consensus.cc:1275] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Refusing update from remote peer fd48f77857a446d7b9a780d156984eda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.889074 12759 consensus_queue.cc:1048] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:36.892958 12431 raft_consensus.cc:1275] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Refusing update from remote peer fd48f77857a446d7b9a780d156984eda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.894284 12759 consensus_queue.cc:1048] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:36.912856 12356 raft_consensus.cc:1275] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Refusing update from remote peer fd48f77857a446d7b9a780d156984eda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.913723 12432 raft_consensus.cc:1275] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Refusing update from remote peer fd48f77857a446d7b9a780d156984eda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.915216 12759 consensus_queue.cc:1048] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d760480074f44856a0eea650897e2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:36.918226 12759 consensus_queue.cc:1048] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [LEADER]: Connected to new peer: Peer: permanent_uuid: "94843016eb774f7a86692342c1b4c192" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:37.276005   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:04:37.312026   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:37.312959   431 tablet_replica.cc:333] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.313925   431 raft_consensus.cc:2243] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.314461   431 raft_consensus.cc:2272] T d03aadeada614ceab91c7881ef056cfe P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.317009   431 tablet_replica.cc:333] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.317691   431 raft_consensus.cc:2243] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.318184   431 raft_consensus.cc:2272] T b4aa4540d1c44661bf0a4c579cd11f23 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.321175   431 tablet_replica.cc:333] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.321880   431 raft_consensus.cc:2243] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.322387   431 raft_consensus.cc:2272] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.325493   431 tablet_replica.cc:333] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.326182   431 raft_consensus.cc:2243] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.326685   431 raft_consensus.cc:2272] T 61e34d4f09424e2eac64767bc97145b7 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.329016   431 tablet_replica.cc:333] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.329636   431 raft_consensus.cc:2243] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.330230   431 raft_consensus.cc:2272] T 6410f7906fb748fa9b06db7eecc3a0b0 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.333760   431 tablet_replica.cc:333] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.334458   431 raft_consensus.cc:2243] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.335376   431 raft_consensus.cc:2272] T 15334a8c7e314a87a6ece58b7a573915 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.337630   431 tablet_replica.cc:333] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.338259   431 raft_consensus.cc:2243] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.339110   431 raft_consensus.cc:2272] T e01194ca40c845d0b41ecf6fb3353508 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.341429   431 tablet_replica.cc:333] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.342137   431 raft_consensus.cc:2243] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.342823   431 raft_consensus.cc:2272] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.345230   431 tablet_replica.cc:333] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.345788   431 raft_consensus.cc:2243] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.346671   431 raft_consensus.cc:2272] T ea33b6b17e8d42218e76a3d80c4cc5fc P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.349180   431 tablet_replica.cc:333] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.349776   431 raft_consensus.cc:2243] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.350186   431 raft_consensus.cc:2272] T 327fa75753f149959a81b96b9b3635ff P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.352867   431 tablet_replica.cc:333] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.353395   431 raft_consensus.cc:2243] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.354224   431 raft_consensus.cc:2272] T b1f16efa64af4b928338edba11a61db4 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.356302   431 tablet_replica.cc:333] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.356861   431 raft_consensus.cc:2243] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.357379   431 raft_consensus.cc:2272] T e92397046da34f10a3938976d5d581b1 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.360536   431 tablet_replica.cc:333] T 4d6ea491b3804e65afcf8825807fd5b0 P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.361300   431 raft_consensus.cc:2243] T 4d6ea491b3804e65afcf8825807fd5b0 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.361868   431 raft_consensus.cc:2272] T 4d6ea491b3804e65afcf8825807fd5b0 P 490d760480074f44856a0eea650897e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:37.363447 12474 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
I20260709 13:04:37.364425   431 tablet_replica.cc:333] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.365053   431 raft_consensus.cc:2243] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.365896   431 raft_consensus.cc:2272] T d6867276dd8a48728dabeb52c4d3c2e9 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:37.366932 12474 consensus_peers.cc:597] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda -> Peer 490d760480074f44856a0eea650897e2 (127.0.107.193:42707): Couldn't send request to peer 490d760480074f44856a0eea650897e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:37.368475   431 tablet_replica.cc:333] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.369081   431 raft_consensus.cc:2243] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.369549   431 raft_consensus.cc:2272] T 3985047828c145d4bb0f8b39d1216080 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.371701   431 tablet_replica.cc:333] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.372233   431 raft_consensus.cc:2243] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.372684   431 raft_consensus.cc:2272] T 69e626ea4434444da48e89a36f490386 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.374687   431 tablet_replica.cc:333] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.375174   431 raft_consensus.cc:2243] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.376008   431 raft_consensus.cc:2272] T ef0bf6a51c1749f18728e522847937c4 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.378183   431 tablet_replica.cc:333] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2: stopping tablet replica
I20260709 13:04:37.378649   431 raft_consensus.cc:2243] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.379468   431 raft_consensus.cc:2272] T 6fc12318d797492499c5bab80be4aa39 P 490d760480074f44856a0eea650897e2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:37.384865 12400 consensus_peers.cc:597] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 -> Peer 490d760480074f44856a0eea650897e2 (127.0.107.193:42707): Couldn't send request to peer 490d760480074f44856a0eea650897e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:37.412350 12474 consensus_peers.cc:597] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda -> Peer 490d760480074f44856a0eea650897e2 (127.0.107.193:42707): Couldn't send request to peer 490d760480074f44856a0eea650897e2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:37.412802 12474 consensus_peers.cc:597] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda -> Peer 490d760480074f44856a0eea650897e2 (127.0.107.193:42707): Couldn't send request to peer 490d760480074f44856a0eea650897e2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:37.424448 12400 consensus_peers.cc:597] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 -> Peer 490d760480074f44856a0eea650897e2 (127.0.107.193:42707): Couldn't send request to peer 490d760480074f44856a0eea650897e2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:37.424441   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:04:37.456081 12400 consensus_peers.cc:597] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 -> Peer 490d760480074f44856a0eea650897e2 (127.0.107.193:42707): Couldn't send request to peer 490d760480074f44856a0eea650897e2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:37.463951   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:04:37.489375   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:37.490118   431 tablet_replica.cc:333] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.490908   431 raft_consensus.cc:2243] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.491803   431 raft_consensus.cc:2272] T 1b3f0eb1d7da4f359a5e57615d3dd37f P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.493844   431 tablet_replica.cc:333] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.494454   431 raft_consensus.cc:2243] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.495040   431 raft_consensus.cc:2272] T d03aadeada614ceab91c7881ef056cfe P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.497973   431 tablet_replica.cc:333] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.498814   431 raft_consensus.cc:2243] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.499760   431 raft_consensus.cc:2272] T 61e34d4f09424e2eac64767bc97145b7 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.501847   431 tablet_replica.cc:333] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.502421   431 raft_consensus.cc:2243] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.503181   431 raft_consensus.cc:2272] T 6410f7906fb748fa9b06db7eecc3a0b0 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.505620   431 tablet_replica.cc:333] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.506476   431 raft_consensus.cc:2243] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.507413   431 raft_consensus.cc:2272] T b4aa4540d1c44661bf0a4c579cd11f23 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:37.508884 12475 consensus_peers.cc:597] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda -> Peer 94843016eb774f7a86692342c1b4c192 (127.0.107.194:40729): Couldn't send request to peer 94843016eb774f7a86692342c1b4c192. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:37.509733   431 tablet_replica.cc:333] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.510362   431 raft_consensus.cc:2243] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.510820   431 raft_consensus.cc:2272] T e01194ca40c845d0b41ecf6fb3353508 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.512779   431 tablet_replica.cc:333] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.513337   431 raft_consensus.cc:2243] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.513803   431 raft_consensus.cc:2272] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.516204   431 tablet_replica.cc:333] T 15334a8c7e314a87a6ece58b7a573915 P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.516830   431 raft_consensus.cc:2243] T 15334a8c7e314a87a6ece58b7a573915 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.517251   431 raft_consensus.cc:2272] T 15334a8c7e314a87a6ece58b7a573915 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.519176   431 tablet_replica.cc:333] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.519747   431 raft_consensus.cc:2243] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.520531   431 raft_consensus.cc:2272] T 4d6ea491b3804e65afcf8825807fd5b0 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.522506   431 tablet_replica.cc:333] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.523048   431 raft_consensus.cc:2243] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.523479   431 raft_consensus.cc:2272] T e92397046da34f10a3938976d5d581b1 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.525996   431 tablet_replica.cc:333] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.526623   431 raft_consensus.cc:2243] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.526998   431 raft_consensus.cc:2272] T ea33b6b17e8d42218e76a3d80c4cc5fc P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.528810   431 tablet_replica.cc:333] T b1f16efa64af4b928338edba11a61db4 P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.529276   431 raft_consensus.cc:2243] T b1f16efa64af4b928338edba11a61db4 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.529654   431 raft_consensus.cc:2272] T b1f16efa64af4b928338edba11a61db4 P 94843016eb774f7a86692342c1b4c192 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.531466   431 tablet_replica.cc:333] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.531939   431 raft_consensus.cc:2243] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.532433   431 raft_consensus.cc:2272] T 327fa75753f149959a81b96b9b3635ff P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.534925   431 tablet_replica.cc:333] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.535558   431 raft_consensus.cc:2243] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.536038   431 raft_consensus.cc:2272] T 6fc12318d797492499c5bab80be4aa39 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.538015   431 tablet_replica.cc:333] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.538538   431 raft_consensus.cc:2243] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.538981   431 raft_consensus.cc:2272] T d6867276dd8a48728dabeb52c4d3c2e9 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.541019   431 tablet_replica.cc:333] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.541536   431 raft_consensus.cc:2243] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.542294   431 raft_consensus.cc:2272] T 3985047828c145d4bb0f8b39d1216080 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.544255   431 tablet_replica.cc:333] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.544771   431 raft_consensus.cc:2243] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.545624   431 raft_consensus.cc:2272] T 69e626ea4434444da48e89a36f490386 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.547652   431 tablet_replica.cc:333] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192: stopping tablet replica
I20260709 13:04:37.548117   431 raft_consensus.cc:2243] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.548568   431 raft_consensus.cc:2272] T ef0bf6a51c1749f18728e522847937c4 P 94843016eb774f7a86692342c1b4c192 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.592104   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:04:37.626945   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:04:37.650213 12474 consensus_peers.cc:597] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda -> Peer 490d760480074f44856a0eea650897e2 (127.0.107.193:42707): Couldn't send request to peer 490d760480074f44856a0eea650897e2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:37.657783   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:37.658629   431 tablet_replica.cc:333] T 61e34d4f09424e2eac64767bc97145b7 P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.659327   431 raft_consensus.cc:2243] T 61e34d4f09424e2eac64767bc97145b7 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.659858   431 raft_consensus.cc:2272] T 61e34d4f09424e2eac64767bc97145b7 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.661890   431 tablet_replica.cc:333] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.662506   431 raft_consensus.cc:2243] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.662969   431 raft_consensus.cc:2272] T b4aa4540d1c44661bf0a4c579cd11f23 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.664970   431 tablet_replica.cc:333] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.665505   431 raft_consensus.cc:2243] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.666435   431 raft_consensus.cc:2272] T d03aadeada614ceab91c7881ef056cfe P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.668629   431 tablet_replica.cc:333] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.669235   431 raft_consensus.cc:2243] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.669728   431 raft_consensus.cc:2272] T 6410f7906fb748fa9b06db7eecc3a0b0 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.671808   431 tablet_replica.cc:333] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.672374   431 raft_consensus.cc:2243] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.672828   431 raft_consensus.cc:2272] T 1b3f0eb1d7da4f359a5e57615d3dd37f P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.675001   431 tablet_replica.cc:333] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.675637   431 raft_consensus.cc:2243] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.676079   431 raft_consensus.cc:2272] T e01194ca40c845d0b41ecf6fb3353508 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.677994   431 tablet_replica.cc:333] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.678540   431 raft_consensus.cc:2243] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.679407   431 raft_consensus.cc:2272] T b6c8ea1f5f3e49c9a64a36b9d8dc4370 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.681631   431 tablet_replica.cc:333] T 15334a8c7e314a87a6ece58b7a573915 P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.682178   431 raft_consensus.cc:2243] T 15334a8c7e314a87a6ece58b7a573915 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.682660   431 raft_consensus.cc:2272] T 15334a8c7e314a87a6ece58b7a573915 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.684528   431 tablet_replica.cc:333] T 4d6ea491b3804e65afcf8825807fd5b0 P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.685065   431 raft_consensus.cc:2243] T 4d6ea491b3804e65afcf8825807fd5b0 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.685487   431 raft_consensus.cc:2272] T 4d6ea491b3804e65afcf8825807fd5b0 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.687518   431 tablet_replica.cc:333] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.688036   431 raft_consensus.cc:2243] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.688784   431 raft_consensus.cc:2272] T e92397046da34f10a3938976d5d581b1 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.691223   431 tablet_replica.cc:333] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.691812   431 raft_consensus.cc:2243] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.692268   431 raft_consensus.cc:2272] T d6867276dd8a48728dabeb52c4d3c2e9 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.694270   431 tablet_replica.cc:333] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.694811   431 raft_consensus.cc:2243] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.695298   431 raft_consensus.cc:2272] T 3985047828c145d4bb0f8b39d1216080 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.697213   431 tablet_replica.cc:333] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.697757   431 raft_consensus.cc:2243] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.698199   431 raft_consensus.cc:2272] T ea33b6b17e8d42218e76a3d80c4cc5fc P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.700037   431 tablet_replica.cc:333] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.700536   431 raft_consensus.cc:2243] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.701324   431 raft_consensus.cc:2272] T 327fa75753f149959a81b96b9b3635ff P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.703641   431 tablet_replica.cc:333] T b1f16efa64af4b928338edba11a61db4 P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.704173   431 raft_consensus.cc:2243] T b1f16efa64af4b928338edba11a61db4 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.704605   431 raft_consensus.cc:2272] T b1f16efa64af4b928338edba11a61db4 P fd48f77857a446d7b9a780d156984eda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.706408   431 tablet_replica.cc:333] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.706895   431 raft_consensus.cc:2243] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.707350   431 raft_consensus.cc:2272] T 6fc12318d797492499c5bab80be4aa39 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.709241   431 tablet_replica.cc:333] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.709726   431 raft_consensus.cc:2243] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.710158   431 raft_consensus.cc:2272] T 69e626ea4434444da48e89a36f490386 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.712131   431 tablet_replica.cc:333] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda: stopping tablet replica
I20260709 13:04:37.712590   431 raft_consensus.cc:2243] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.713018   431 raft_consensus.cc:2272] T ef0bf6a51c1749f18728e522847937c4 P fd48f77857a446d7b9a780d156984eda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.751957   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:37.785796   431 master.cc:562] Master@127.0.107.254:37827 shutting down...
I20260709 13:04:37.807818   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.808341   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.808660   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 19f5d46ebf48429398aff61742f42949: stopping tablet replica
I20260709 13:04:37.829058   431 master.cc:584] Master@127.0.107.254:37827 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11359 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (26109 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (332407 ms total)
[  PASSED  ] 8 tests.
I20260709 13:04:37.886607   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 398 messages since previous log ~530 seconds ago
I20260709 13:04:37.886821   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 398 messages since previous log ~530 seconds ago
I20260709 13:04:37.886969   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 398 messages since previous log ~530 seconds ago
I20260709 13:04:37.887120   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:04:37.887660   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:04:37.887849   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~74 seconds ago
I20260709 13:04:37.888034   431 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 4 messages since previous log ~171 seconds ago
I20260709 13:04:37.888238   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 4 messages since previous log ~171 seconds ago
I20260709 13:04:37.888398   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 10 messages since previous log ~170 seconds ago
I20260709 13:04:37.888612   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 7 messages since previous log ~0 seconds ago
I20260709 13:04:37.888836   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~10 seconds ago
